2024-02-15T22:29:19.094 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T22:29:19.095 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777 --verbose --name pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/orig.config.yaml 2024-02-15T22:29:19.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T22:29:19.252 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777 branch: wip-batrick-testing-20240215.160715 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7561777' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240215.160715 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f78a58c0ffd401d1493058a1022c35f011d65275 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f78a58c0ffd401d1493058a1022c35f011d65275 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240215.160715 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3196 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: wip-batrick-testing-20240215.160715 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f78a58c0ffd401d1493058a1022c35f011d65275 targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxxDCi4HZrYb15GRe3e63dDZ4to8z+UGJnZJy3byZXrzflI2i2rL8mYvgqZrl3sDK2a3uxya1kuszD2zcyaotU= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRh5/JwRbNo6zz1Cdo3ZkAWDgvFlhPlRzs7qwWhkwxtrh4A9dmdVdtIoyTODS0w2YZ+SHoakFgbYXdXwG2Nca4= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_21:23:20 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-15T22:29:19.252 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa; will attempt to use it 2024-02-15T22:29:19.253 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f78a58c0ffd401d1493058a1022c35f011d65275/qa/tasks 2024-02-15T22:29:19.253 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T22:29:19.254 INFO:teuthology.task.internal:Checking packages... 2024-02-15T22:29:19.278 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f78a58c0ffd401d1493058a1022c35f011d65275' 2024-02-15T22:29:19.278 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T22:29:19.278 INFO:teuthology.packaging:ref: None 2024-02-15T22:29:19.278 INFO:teuthology.packaging:tag: None 2024-02-15T22:29:19.278 INFO:teuthology.packaging:branch: wip-batrick-testing-20240215.160715 2024-02-15T22:29:19.278 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:29:19.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240215.160715 2024-02-15T22:29:19.419 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1450.gf78a58c0 2024-02-15T22:29:19.421 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T22:29:19.427 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T22:29:19.428 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T22:29:19.441 INFO:teuthology.task.internal:Saving configuration 2024-02-15T22:29:19.460 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T22:29:19.466 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T22:29:19.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:24:39.661599', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxxDCi4HZrYb15GRe3e63dDZ4to8z+UGJnZJy3byZXrzflI2i2rL8mYvgqZrl3sDK2a3uxya1kuszD2zcyaotU='} 2024-02-15T22:29:19.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:24:39.660504', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRh5/JwRbNo6zz1Cdo3ZkAWDgvFlhPlRzs7qwWhkwxtrh4A9dmdVdtIoyTODS0w2YZ+SHoakFgbYXdXwG2Nca4='} 2024-02-15T22:29:19.518 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T22:29:19.524 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-15T22:29:19.524 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-15T22:29:19.524 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T22:29:19.595 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a209150d0>, signals=[15]) 2024-02-15T22:29:19.595 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T22:29:19.602 INFO:teuthology.task.internal:Opening connections... 2024-02-15T22:29:19.602 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:29:19.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:29:19.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-02-15T22:29:19.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:29:19.787 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T22:29:19.794 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-02-15T22:29:19.811 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-02-15T22:29:19.811 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:29:19.868 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:29:19.869 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:29:19.869 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-02-15T22:29:19.895 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-02-15T22:29:19.913 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-02-15T22:29:19.913 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-02-15T22:29:19.970 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-02-15T22:29:19.970 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-15T22:29:19.971 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T22:29:19.972 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-02-15T22:29:19.994 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T22:29:20.004 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T22:29:20.009 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T22:29:20.010 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:29:20.012 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-02-15T22:29:20.029 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T22:29:20.035 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T22:29:20.035 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:29:20.069 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-02-15T22:29:20.109 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T22:29:20.167 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T22:29:20.183 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T22:29:20.183 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T22:29:20.183 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:29:20.184 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T22:29:20.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:29:20.200 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-15T22:29:20.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:29:20.201 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-02-15T22:29:20.257 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:29:20.257 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.14.0-361.el9.x86_64 2024-02-15T22:29:20.257 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-02-15T22:29:20.258 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-361.el9.x86_64 2024-02-15T22:29:20.259 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-361.el9.x86_64 2024-02-15T22:29:20.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-02-15T22:29:22.297 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-02-15T22:29:22.555 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-02-15T22:29:23.906 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-02-15T22:29:24.221 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-02-15T22:29:25.021 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-02-15T22:29:25.454 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-02-15T22:29:27.239 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-02-15T22:29:27.638 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-02-15T22:29:31.517 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.1 MB 00:00 2024-02-15T22:29:32.048 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.1 MB 00:00 2024-02-15T22:29:33.173 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2024-02-15T22:29:33.531 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2024-02-15T22:29:34.477 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2024-02-15T22:29:39.374 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-02-15T22:29:41.690 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:29:41.690 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:29:41.797 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:29:41.807 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-02-15T22:29:41.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:29:41.809 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 100 M 2024-02-15T22:29:41.809 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 123 M 2024-02-15T22:29:41.809 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:29:42.168 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 17 MB/s | 6.1 MB 00:00 2024-02-15T22:29:42.676 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-02-15T22:29:43.368 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 28 MB/s | 33 MB 00:01 2024-02-15T22:29:43.727 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 20 MB/s | 39 MB 00:01 2024-02-15T22:29:43.730 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:43.730 INFO:teuthology.orchestra.run.smithi138.stdout:Total 52 MB/s | 100 MB 00:01 2024-02-15T22:29:43.731 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:29:43.899 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 20 MB 00:10 2024-02-15T22:29:44.109 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:29:44.109 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:29:45.128 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:29:45.129 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:29:47.532 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:29:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:29:48.322 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:29:48.781 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-15T22:29:51.072 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:29:51.105 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-15T22:29:51.105 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-15T22:29:51.202 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-15T22:29:51.210 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 100 M 2024-02-15T22:29:51.211 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 123 M 2024-02-15T22:29:51.212 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:29:51.258 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:29:51.908 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 8.7 MB/s | 6.1 MB 00:00 2024-02-15T22:29:52.408 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 17 MB/s | 21 MB 00:01 2024-02-15T22:29:53.283 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 19 MB/s | 39 MB 00:02 2024-02-15T22:29:53.842 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-core-5.14.0-421.el9.x86_6 17 MB/s | 33 MB 00:01 2024-02-15T22:29:53.845 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:29:53.845 INFO:teuthology.orchestra.run.smithi170.stdout:Total 38 MB/s | 100 MB 00:02 2024-02-15T22:29:53.845 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:29:54.215 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:29:54.215 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:29:55.239 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:29:55.239 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:29:55.990 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:29:56.104 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:29:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:29:58.308 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:29:58.434 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:30:00.860 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:01.161 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:30:01.339 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:30:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:30:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:11.013 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:30.057 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:30.057 INFO:teuthology.orchestra.run.smithi138.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:30:30.057 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:30:30.129 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:30.540 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:30.540 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:30:30.540 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:30:30.540 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:30:31.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:31.025 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:30:31.026 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:30:31.547 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:30:31.676 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.677 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:30:31.677 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:30:31.677 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:30:31.677 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:30:31.677 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-15T22:30:31.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:30:31.678 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:30:31.788 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:31.788 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:30:31.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-02-15T22:30:31.826 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 68.el9 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8264254 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-02-15T22:30:31.827 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:30:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:30:31.829 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:30:31.829 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:30:31.829 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:30:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-02-15T22:30:33.907 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:30:33.947 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-02-15T22:30:33.949 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-02-15T22:30:33.964 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.JTlbEqDMVF 2024-02-15T22:30:33.964 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JTlbEqDMVF 2024-02-15T22:30:34.031 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.JTlbEqDMVF 2024-02-15T22:30:34.168 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.JTlbEqDMVF is 6KB 2024-02-15T22:30:34.216 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.JTlbEqDMVF 2024-02-15T22:30:34.230 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:30:34.294 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:30:34.295 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:30:34.295 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:30:34.295 INFO:teuthology.orchestra.run.smithi138.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:30:34.296 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:30:34.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-02-15T22:30:40.416 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:40.417 INFO:teuthology.orchestra.run.smithi170.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-15T22:30:40.417 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:30:40.489 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:40.895 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:40.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-15T22:30:40.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-15T22:30:40.895 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:30:41.314 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:30:41.807 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:30:41.931 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:41.932 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:30:41.932 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-15T22:30:41.932 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T22:30:41.932 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T22:30:41.932 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-15T22:30:41.932 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T22:30:41.932 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T22:30:42.040 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-15T22:30:42.040 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-15T22:30:42.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-02-15T22:30:42.074 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 68.el9 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8264254 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-15T22:30:42.075 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:30:42.076 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T22:30:42.077 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T22:30:42.077 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-421.el9.x86_64 2024-02-15T22:30:42.077 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T22:30:42.689 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-02-15T22:30:44.097 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-15T22:30:44.149 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-02-15T22:30:44.152 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-02-15T22:30:44.166 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.GVwIFodzX1 2024-02-15T22:30:44.167 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GVwIFodzX1 2024-02-15T22:30:44.235 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.GVwIFodzX1 2024-02-15T22:30:44.371 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.GVwIFodzX1 is 6KB 2024-02-15T22:30:44.420 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.GVwIFodzX1 2024-02-15T22:30:44.434 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T22:30:44.498 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-15T22:30:44.498 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-15T22:30:44.498 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-15T22:30:44.498 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-15T22:30:44.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-15T22:30:44.645 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-02-15T22:31:04.473 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-15T22:31:04.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:31:04.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:31:14.656 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-15T22:31:14.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:31:14.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:31:22.940 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-02-15T22:31:31.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:31:31.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:31:33.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-02-15T22:31:42.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:31:42.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:32:32.000 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T22:32:42.201 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T22:32:44.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:32:44.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:32:44.426 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-15T22:32:44.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:32:44.811 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:32:44.811 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-02-15T22:32:44.826 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:32:44.826 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:32:44.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:32:44.826 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:32:45.827 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-15T22:32:45.828 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:32:45.884 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-02-15T22:32:45.912 DEBUG:teuthology.parallel:result is None 2024-02-15T22:32:54.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:32:54.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:32:54.562 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-02-15T22:32:54.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:32:54.951 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-15T22:32:54.951 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-02-15T22:32:54.966 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-421.el9.x86_64 2024-02-15T22:32:54.966 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-15T22:32:54.966 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T22:32:54.966 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T22:32:55.967 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-15T22:32:55.967 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T22:32:56.053 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-02-15T22:32:56.092 DEBUG:teuthology.parallel:result is None 2024-02-15T22:32:56.093 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T22:32:56.109 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T22:32:56.110 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:32:56.112 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T22:32:56.129 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T22:32:56.137 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T22:32:56.148 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T22:32:56.148 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:32:56.169 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T22:32:56.242 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T22:32:56.250 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T22:32:56.251 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:32:56.253 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T22:32:56.287 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:32:56.291 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:32:56.301 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:32:56.304 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T22:32:56.306 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T22:32:56.314 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T22:32:56.314 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:32:56.344 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T22:32:56.375 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T22:32:56.491 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T22:32:56.491 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:32:56.493 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T22:32:56.508 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:32:56.592 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:32:56.637 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:32:56.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:32:56.761 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:32:56.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:32:56.828 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:32:56.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T22:32:56.923 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:32:57.003 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T22:32:57.050 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:32:57.050 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T22:32:57.118 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-02-15T22:32:57.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-02-15T22:32:57.157 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:32:57.199 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T22:32:57.540 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T22:32:57.548 INFO:teuthology.task.internal:Starting timer... 2024-02-15T22:32:57.548 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T22:32:57.562 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T22:32:57.572 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-15T22:32:57.572 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-02-15T22:32:57.634 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-02-15T22:32:57.636 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-02-15T22:32:57.688 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-02-15T22:32:57.689 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T22:32:57.689 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-02-15T22:32:57.705 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-02-15T22:32:57.705 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-02-15T22:32:57.721 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-02-15T22:32:57.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi138.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-02-15T22:32:57.722 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:32:57.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:32:57.773 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T22:32:57.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:32:57.800 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T22:32:57.800 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:32:57.848 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-02-15T22:32:57.882 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T22:32:57.891 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-15T22:32:57.897 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-15T22:32:58.034 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T22:32:58.050 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T22:32:58.052 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T22:37:10.159 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-02-15T22:37:10.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:37:10.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:37:10.250 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-02-15T22:37:10.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-02-15T22:37:10.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:37:10.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T22:37:10.424 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-02-15T22:37:10.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-15T22:37:10.499 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T22:37:10.510 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T22:37:10.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:37:10.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:37:10.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T22:37:10.513 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T22:37:10.541 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:37:10.557 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:37:10.569 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T22:37:10.586 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T22:37:10.586 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-02-15T22:37:10.600 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-02-15T22:37:10.615 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-02-15T22:37:10.616 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:37:10.628 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-02-15T22:37:10.632 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:37:10.645 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T22:37:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T22:37:10.689 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.693 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.721 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.725 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T22:37:10.725 INFO:teuthology.run_tasks:Running task install... 2024-02-15T22:37:10.734 DEBUG:teuthology.task.install:project ceph 2024-02-15T22:37:10.735 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'}} 2024-02-15T22:37:10.735 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-15T22:37:10.735 INFO:teuthology.task.install:Using flavor: default 2024-02-15T22:37:10.741 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T22:37:10.741 INFO:teuthology.task.install:extra packages: [] 2024-02-15T22:37:10.741 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-15T22:37:10.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:37:10.742 INFO:teuthology.packaging:ref: None 2024-02-15T22:37:10.742 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:37:10.742 INFO:teuthology.packaging:branch: None 2024-02-15T22:37:10.742 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:37:11.032 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> None 2024-02-15T22:37:11.033 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-15T22:37:12.524 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-15T22:37:12.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-15T22:37:12.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-02-15T22:37:12.528 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:37:12.528 INFO:teuthology.packaging:ref: None 2024-02-15T22:37:12.528 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:37:12.529 INFO:teuthology.packaging:branch: None 2024-02-15T22:37:12.529 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:37:12.529 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-15T22:37:12.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-15T22:37:12.683 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-15T22:37:12.683 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-15T22:37:12.714 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:37:12.714 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:37:12.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:37:12.747 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:37:12.747 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:37:12.747 INFO:teuthology.packaging:ref: None 2024-02-15T22:37:12.747 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:37:12.747 INFO:teuthology.packaging:branch: None 2024-02-15T22:37:12.747 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:37:12.747 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:37:12.767 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-02-15T22:37:12.767 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-02-15T22:37:12.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T22:37:12.792 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:37:12.792 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T22:37:12.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:37:12.825 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T22:37:12.826 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:37:12.826 INFO:teuthology.packaging:ref: None 2024-02-15T22:37:12.826 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:37:12.826 INFO:teuthology.packaging:branch: None 2024-02-15T22:37:12.826 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:37:12.826 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T22:37:12.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T22:37:12.900 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:37:12.967 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-02-15T22:37:12.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-02-15T22:37:12.978 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T22:37:13.045 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-02-15T22:37:13.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-02-15T22:37:13.220 INFO:teuthology.orchestra.run.smithi170.stdout:74 files removed 2024-02-15T22:37:13.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-02-15T22:37:13.291 INFO:teuthology.orchestra.run.smithi138.stdout:74 files removed 2024-02-15T22:37:13.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-02-15T22:37:13.715 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 528 kB/s | 76 kB 00:00 2024-02-15T22:37:13.779 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 547 kB/s | 76 kB 00:00 2024-02-15T22:37:13.882 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 79 kB/s | 9.3 kB 00:00 2024-02-15T22:37:13.963 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 69 kB/s | 9.3 kB 00:00 2024-02-15T22:37:14.033 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 19 kB/s | 2.2 kB 00:00 2024-02-15T22:37:14.138 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 16 kB/s | 2.2 kB 00:00 2024-02-15T22:37:14.685 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-15T22:37:15.074 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.7 MB 00:00 2024-02-15T22:37:16.460 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2024-02-15T22:37:17.032 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2024-02-15T22:37:17.740 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.0 MB 00:00 2024-02-15T22:37:19.323 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-02-15T22:37:24.045 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-02-15T22:37:29.471 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-02-15T22:37:30.598 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 19 MB 00:11 2024-02-15T22:37:31.055 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2024-02-15T22:37:32.676 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-15T22:37:36.973 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.1 MB 00:02 2024-02-15T22:37:37.565 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-02-15T22:37:39.067 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2024-02-15T22:37:40.214 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-15T22:37:40.227 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:37:40.228 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-15T22:37:40.229 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout:Install 28 Packages 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-02-15T22:37:40.230 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:37:40.231 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 53 M 2024-02-15T22:37:40.231 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:37:40.449 INFO:teuthology.orchestra.run.smithi170.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 30 MB/s | 5.2 MB 00:00 2024-02-15T22:37:40.466 INFO:teuthology.orchestra.run.smithi170.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-02-15T22:37:40.500 INFO:teuthology.orchestra.run.smithi170.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 19 MB/s | 653 kB 00:00 2024-02-15T22:37:40.533 INFO:teuthology.orchestra.run.smithi170.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-02-15T22:37:40.625 INFO:teuthology.orchestra.run.smithi170.stdout:(5/30): librgw2-18.2.0-0.el9.x86_64.rpm 48 MB/s | 4.4 MB 00:00 2024-02-15T22:37:40.642 INFO:teuthology.orchestra.run.smithi170.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 2.7 MB/s | 45 kB 00:00 2024-02-15T22:37:40.659 INFO:teuthology.orchestra.run.smithi170.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 7.0 MB/s | 119 kB 00:00 2024-02-15T22:37:40.693 INFO:teuthology.orchestra.run.smithi170.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 4.6 MB/s | 155 kB 00:00 2024-02-15T22:37:40.718 INFO:teuthology.orchestra.run.smithi170.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-02-15T22:37:40.743 INFO:teuthology.orchestra.run.smithi170.stdout:(10/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 12 MB/s | 297 kB 00:00 2024-02-15T22:37:40.835 INFO:teuthology.orchestra.run.smithi170.stdout:(11/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 14 MB/s | 7.6 MB 00:00 2024-02-15T22:37:40.860 INFO:teuthology.orchestra.run.smithi170.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 850 kB/s | 99 kB 00:00 2024-02-15T22:37:41.061 INFO:teuthology.orchestra.run.smithi170.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-02-15T22:37:41.578 INFO:teuthology.orchestra.run.smithi170.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 143 kB/s | 106 kB 00:00 2024-02-15T22:37:41.736 INFO:teuthology.orchestra.run.smithi170.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 182 kB/s | 159 kB 00:00 2024-02-15T22:37:42.545 INFO:teuthology.orchestra.run.smithi170.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 31 kB/s | 44 kB 00:01 2024-02-15T22:37:42.753 INFO:teuthology.orchestra.run.smithi170.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 563 kB/s | 661 kB 00:01 2024-02-15T22:37:43.104 INFO:teuthology.orchestra.run.smithi170.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 207 kB/s | 282 kB 00:01 2024-02-15T22:37:43.179 INFO:teuthology.orchestra.run.smithi170.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 65 kB/s | 41 kB 00:00 2024-02-15T22:37:48.087 INFO:teuthology.orchestra.run.smithi170.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 21 kB/s | 111 kB 00:05 2024-02-15T22:37:48.629 INFO:teuthology.orchestra.run.smithi170.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 48 kB/s | 26 kB 00:00 2024-02-15T22:37:49.212 INFO:teuthology.orchestra.run.smithi170.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 83 kB/s | 49 kB 00:00 2024-02-15T22:37:49.787 INFO:teuthology.orchestra.run.smithi170.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 117 kB/s | 67 kB 00:00 2024-02-15T22:37:50.171 INFO:teuthology.orchestra.run.smithi170.stdout:(24/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 44 kB/s | 309 kB 00:07 2024-02-15T22:37:52.596 INFO:teuthology.orchestra.run.smithi170.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 79 kB/s | 192 kB 00:02 2024-02-15T22:37:55.379 INFO:teuthology.orchestra.run.smithi170.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 150 kB/s | 838 kB 00:05 2024-02-15T22:37:55.454 INFO:teuthology.orchestra.run.smithi170.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-02-15T22:37:55.521 INFO:teuthology.orchestra.run.smithi170.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-02-15T22:38:03.963 INFO:teuthology.orchestra.run.smithi170.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 142 kB/s | 1.6 MB 00:11 2024-02-15T22:38:05.480 INFO:teuthology.orchestra.run.smithi170.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 203 kB/s | 4.4 MB 00:22 2024-02-15T22:38:05.484 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:05.484 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.1 MB/s | 53 MB 00:25 2024-02-15T22:38:05.484 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:05.520 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:05.520 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:05.965 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:05.965 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-15T22:38:07.484 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-15T22:38:07.534 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-15T22:38:07.844 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-15T22:38:07.916 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:38:08.008 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:38:08.088 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-15T22:38:08.118 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:38:08.180 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:38:08.209 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-15T22:38:08.262 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-15T22:38:08.327 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-15T22:38:08.362 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:38:08.427 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:38:08.533 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-15T22:38:08.573 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-15T22:38:08.609 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-15T22:38:08.634 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-15T22:38:08.661 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-15T22:38:08.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-15T22:38:08.729 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-15T22:38:09.030 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-15T22:38:09.059 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-15T22:38:09.151 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-15T22:38:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-15T22:38:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-15T22:38:09.622 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-15T22:38:09.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-15T22:38:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-15T22:38:09.791 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-15T22:38:09.831 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-15T22:38:11.845 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:38:11.877 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:38:12.428 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:38:12.472 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-15T22:38:12.565 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-15T22:38:12.565 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:38:12.565 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:38:12.565 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:12.598 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-02-15T22:38:21.909 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:22.668 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:38:22.692 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:22.694 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-15T22:38:22.771 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-15T22:38:22.771 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:38:23.902 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:38:23.902 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-15T22:38:23.902 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-15T22:38:23.902 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-15T22:38:23.902 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-15T22:38:23.903 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-15T22:38:23.904 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:38:23.905 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-15T22:38:23.905 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-15T22:38:25.070 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.071 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:25.072 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-02-15T22:38:25.072 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:38:25.072 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:25.072 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:25.392 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-02-15T22:38:25.973 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:48 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:26.139 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:26.139 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:38:26.140 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:26.141 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 40 M 2024-02-15T22:38:26.142 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 167 M 2024-02-15T22:38:26.142 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:38:26.259 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-02-15T22:38:26.376 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 542 kB/s | 63 kB 00:00 2024-02-15T22:38:26.785 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): ceph-test-18.2.0-0.el9.x86_64.rpm 62 MB/s | 40 MB 00:00 2024-02-15T22:38:26.810 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 449 kB/s | 300 kB 00:00 2024-02-15T22:38:26.835 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 406 kB/s | 186 kB 00:00 2024-02-15T22:38:26.860 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-02-15T22:38:26.863 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:26.864 INFO:teuthology.orchestra.run.smithi170.stdout:Total 56 MB/s | 40 MB 00:00 2024-02-15T22:38:26.864 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:26.883 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:26.883 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:27.238 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:27.238 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:27.767 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:38:27.941 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:38:27.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:38:28.022 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-15T22:38:28.328 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 424 kB/s | 20 MB 00:49 2024-02-15T22:38:31.750 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-15T22:38:31.821 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-15T22:38:33.170 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:38:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:38:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:34.499 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:34.796 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-02-15T22:38:35.379 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:58 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:35.547 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-15T22:38:35.549 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:38:35.550 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:38:35.551 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout:Install 33 Packages 2024-02-15T22:38:35.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:35.553 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 30 M 2024-02-15T22:38:35.553 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 109 M 2024-02-15T22:38:35.553 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:38:35.814 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-15T22:38:35.824 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-15T22:38:35.825 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-15T22:38:35.826 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout:Install 28 Packages 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-02-15T22:38:35.827 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:38:35.828 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 53 M 2024-02-15T22:38:35.828 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:38:36.063 INFO:teuthology.orchestra.run.smithi138.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 27 MB/s | 5.2 MB 00:00 2024-02-15T22:38:36.088 INFO:teuthology.orchestra.run.smithi138.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 966 kB/s | 24 kB 00:00 2024-02-15T22:38:36.129 INFO:teuthology.orchestra.run.smithi138.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-02-15T22:38:36.163 INFO:teuthology.orchestra.run.smithi138.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-02-15T22:38:36.221 INFO:teuthology.orchestra.run.smithi170.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 49 kB/s | 6.4 kB 00:00 2024-02-15T22:38:36.263 INFO:teuthology.orchestra.run.smithi170.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 8.4 MB/s | 1.4 MB 00:00 2024-02-15T22:38:36.272 INFO:teuthology.orchestra.run.smithi138.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 19 MB/s | 7.6 MB 00:00 2024-02-15T22:38:36.305 INFO:teuthology.orchestra.run.smithi170.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 9.8 MB/s | 2.1 MB 00:00 2024-02-15T22:38:36.305 INFO:teuthology.orchestra.run.smithi138.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.3 MB/s | 45 kB 00:00 2024-02-15T22:38:36.339 INFO:teuthology.orchestra.run.smithi170.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.0 MB/s | 240 kB 00:00 2024-02-15T22:38:36.381 INFO:teuthology.orchestra.run.smithi138.stdout:(7/30): librgw2-18.2.0-0.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-02-15T22:38:36.406 INFO:teuthology.orchestra.run.smithi138.stdout:(8/30): python3-ceph-common-18.2.0-0.el9.x86_64 1.2 MB/s | 119 kB 00:00 2024-02-15T22:38:36.422 INFO:teuthology.orchestra.run.smithi170.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-02-15T22:38:36.432 INFO:teuthology.orchestra.run.smithi138.stdout:(9/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-02-15T22:38:36.457 INFO:teuthology.orchestra.run.smithi138.stdout:(10/30): python3-rados-18.2.0-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-02-15T22:38:36.482 INFO:teuthology.orchestra.run.smithi138.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-02-15T22:38:36.515 INFO:teuthology.orchestra.run.smithi138.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-02-15T22:38:36.665 INFO:teuthology.orchestra.run.smithi170.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 44 MB/s | 18 MB 00:00 2024-02-15T22:38:36.724 INFO:teuthology.orchestra.run.smithi138.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 21 MB/s | 18 MB 00:00 2024-02-15T22:38:36.890 INFO:teuthology.orchestra.run.smithi170.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 71 kB/s | 32 kB 00:00 2024-02-15T22:38:36.948 INFO:teuthology.orchestra.run.smithi170.stdout:(8/33): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 144 kB 00:00 2024-02-15T22:38:36.973 INFO:teuthology.orchestra.run.smithi170.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 167 kB/s | 47 kB 00:00 2024-02-15T22:38:37.019 INFO:teuthology.orchestra.run.smithi170.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 300 kB/s | 39 kB 00:00 2024-02-15T22:38:37.033 INFO:teuthology.orchestra.run.smithi138.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 170 kB/s | 44 kB 00:00 2024-02-15T22:38:37.066 INFO:teuthology.orchestra.run.smithi138.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 181 kB/s | 106 kB 00:00 2024-02-15T22:38:37.092 INFO:teuthology.orchestra.run.smithi138.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 276 kB/s | 159 kB 00:00 2024-02-15T22:38:37.174 INFO:teuthology.orchestra.run.smithi170.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 241 kB 00:00 2024-02-15T22:38:37.333 INFO:teuthology.orchestra.run.smithi170.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 3.2 MB/s | 1.1 MB 00:00 2024-02-15T22:38:37.358 INFO:teuthology.orchestra.run.smithi170.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 303 kB/s | 103 kB 00:00 2024-02-15T22:38:37.359 INFO:teuthology.orchestra.run.smithi138.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 661 kB 00:00 2024-02-15T22:38:37.383 INFO:teuthology.orchestra.run.smithi170.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 594 kB/s | 124 kB 00:00 2024-02-15T22:38:37.408 INFO:teuthology.orchestra.run.smithi170.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 113 kB 00:00 2024-02-15T22:38:37.442 INFO:teuthology.orchestra.run.smithi138.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 752 kB/s | 282 kB 00:00 2024-02-15T22:38:37.459 INFO:teuthology.orchestra.run.smithi138.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 112 kB/s | 41 kB 00:00 2024-02-15T22:38:37.567 INFO:teuthology.orchestra.run.smithi170.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.0 MB/s | 187 kB 00:00 2024-02-15T22:38:37.784 INFO:teuthology.orchestra.run.smithi170.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 108 kB/s | 43 kB 00:00 2024-02-15T22:38:37.893 INFO:teuthology.orchestra.run.smithi170.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 99 kB/s | 11 kB 00:00 2024-02-15T22:38:37.943 INFO:teuthology.orchestra.run.smithi170.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 321 kB/s | 172 kB 00:00 2024-02-15T22:38:38.001 INFO:teuthology.orchestra.run.smithi170.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 163 kB/s | 18 kB 00:00 2024-02-15T22:38:38.035 INFO:teuthology.orchestra.run.smithi170.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-02-15T22:38:38.135 INFO:teuthology.orchestra.run.smithi170.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 197 kB/s | 20 kB 00:00 2024-02-15T22:38:38.152 INFO:teuthology.orchestra.run.smithi170.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 129 kB/s | 19 kB 00:00 2024-02-15T22:38:38.201 INFO:teuthology.orchestra.run.smithi138.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 430 kB/s | 309 kB 00:00 2024-02-15T22:38:38.244 INFO:teuthology.orchestra.run.smithi170.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 426 kB/s | 46 kB 00:00 2024-02-15T22:38:38.269 INFO:teuthology.orchestra.run.smithi170.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 511 kB/s | 358 kB 00:00 2024-02-15T22:38:38.370 INFO:teuthology.orchestra.run.smithi170.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 363 kB/s | 79 kB 00:00 2024-02-15T22:38:38.386 INFO:teuthology.orchestra.run.smithi170.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-02-15T22:38:38.428 INFO:teuthology.orchestra.run.smithi170.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-02-15T22:38:38.479 INFO:teuthology.orchestra.run.smithi170.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 389 kB/s | 36 kB 00:00 2024-02-15T22:38:38.512 INFO:teuthology.orchestra.run.smithi170.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 633 kB/s | 90 kB 00:00 2024-02-15T22:38:38.563 INFO:teuthology.orchestra.run.smithi170.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-02-15T22:38:38.612 INFO:teuthology.orchestra.run.smithi170.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2024-02-15T22:38:38.618 INFO:teuthology.orchestra.run.smithi138.stdout:(21/30): fmt-8.1.1-5.el9.x86_64.rpm 88 kB/s | 111 kB 00:01 2024-02-15T22:38:38.680 INFO:teuthology.orchestra.run.smithi170.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.1 MB/s | 427 kB 00:00 2024-02-15T22:38:38.687 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:38.687 INFO:teuthology.orchestra.run.smithi170.stdout:Total 9.5 MB/s | 30 MB 00:03 2024-02-15T22:38:38.687 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:38.726 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:38.726 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:38.735 INFO:teuthology.orchestra.run.smithi138.stdout:(22/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 49 kB/s | 26 kB 00:00 2024-02-15T22:38:39.074 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:39.074 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:39.177 INFO:teuthology.orchestra.run.smithi138.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 87 kB/s | 49 kB 00:00 2024-02-15T22:38:39.635 INFO:teuthology.orchestra.run.smithi138.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 75 kB/s | 67 kB 00:00 2024-02-15T22:38:40.287 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:40.365 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-15T22:38:40.400 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-15T22:38:40.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-15T22:38:40.524 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-15T22:38:40.602 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-15T22:38:40.643 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-15T22:38:40.723 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-15T22:38:40.776 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-15T22:38:40.815 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-15T22:38:40.864 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-15T22:38:40.926 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-15T22:38:41.112 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-15T22:38:41.162 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-15T22:38:41.192 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-15T22:38:41.235 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-15T22:38:41.265 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-15T22:38:41.340 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-15T22:38:41.376 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:38:41.409 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-15T22:38:41.449 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-15T22:38:41.484 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-15T22:38:41.519 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-15T22:38:41.598 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-15T22:38:41.641 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-15T22:38:41.721 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-15T22:38:41.858 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-15T22:38:41.984 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:38:42.154 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-15T22:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-15T22:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-15T22:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:38:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:44.432 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-15T22:38:44.455 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-15T22:38:44.455 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:44.455 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:38:44.456 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:38:44.456 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:38:44.456 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:44.530 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-15T22:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-15T22:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-15T22:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-15T22:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-15T22:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-15T22:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-15T22:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-15T22:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-15T22:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-15T22:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-15T22:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-15T22:38:47.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-15T22:38:47.183 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:38:47.184 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:38:47.185 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:47.186 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:47.520 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-02-15T22:38:48.111 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:11 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:48.218 INFO:teuthology.orchestra.run.smithi138.stdout:(25/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 93 kB/s | 838 kB 00:09 2024-02-15T22:38:48.227 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:38:48.279 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:48.280 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:38:48.280 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:48.339 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-02-15T22:38:48.919 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:11 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:49.082 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-15T22:38:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 209 k 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 200 k 2024-02-15T22:38:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:38:49.148 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.2 MB/s | 209 kB 00:00 2024-02-15T22:38:49.149 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:49.149 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.1 MB/s | 209 kB 00:00 2024-02-15T22:38:49.149 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:49.154 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:49.154 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:49.157 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:49.157 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:49.224 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:49.691 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:38:49.777 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:38:50.174 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:38:50.395 INFO:teuthology.orchestra.run.smithi138.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 18 kB/s | 192 kB 00:10 2024-02-15T22:38:50.468 INFO:teuthology.orchestra.run.smithi138.stdout:(27/30): librados2-18.2.0-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-02-15T22:38:50.517 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:38:50.517 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:50.518 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:38:50.518 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-15T22:38:50.518 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:50.518 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:50.535 INFO:teuthology.orchestra.run.smithi138.stdout:(28/30): librbd1-18.2.0-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-02-15T22:38:50.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:38:51.318 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:14 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:51.486 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:51.487 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:51.487 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-02-15T22:38:51.487 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:51.487 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 142 k 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 399 k 2024-02-15T22:38:51.488 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:38:51.548 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.3 MB/s | 142 kB 00:00 2024-02-15T22:38:51.549 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:51.550 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.2 MB/s | 142 kB 00:00 2024-02-15T22:38:51.550 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:51.557 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:51.608 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:51.609 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:51.751 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:38:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:38:51.849 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:38:51.849 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:38:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:52.818 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:53.044 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-02-15T22:38:53.645 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:16 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:53.760 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:38:53.811 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:53.812 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:38:53.812 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:38:53.871 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:38:54.447 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:17 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:38:54.616 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:38:54.617 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout:Install 7 Packages 2024-02-15T22:38:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:38:54.619 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.0 M 2024-02-15T22:38:54.619 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 8.1 M 2024-02-15T22:38:54.619 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:38:56.695 INFO:teuthology.orchestra.run.smithi170.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 196 kB/s | 23 kB 00:00 2024-02-15T22:38:56.720 INFO:teuthology.orchestra.run.smithi170.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 102 kB/s | 15 kB 00:00 2024-02-15T22:38:56.770 INFO:teuthology.orchestra.run.smithi170.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.8 MB/s | 1.7 MB 00:00 2024-02-15T22:38:57.145 INFO:teuthology.orchestra.run.smithi170.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 20 kB/s | 9.0 kB 00:00 2024-02-15T22:38:57.170 INFO:teuthology.orchestra.run.smithi170.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 91 kB/s | 41 kB 00:00 2024-02-15T22:38:57.196 INFO:teuthology.orchestra.run.smithi170.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 72 kB/s | 31 kB 00:00 2024-02-15T22:38:58.704 INFO:teuthology.orchestra.run.smithi170.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 121 kB/s | 188 kB 00:01 2024-02-15T22:38:58.709 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:38:58.709 INFO:teuthology.orchestra.run.smithi170.stdout:Total 499 kB/s | 2.0 MB 00:04 2024-02-15T22:38:58.709 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:38:58.718 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:38:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:38:58.791 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:38:58.791 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:38:59.114 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:38:59.181 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-15T22:38:59.214 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-15T22:38:59.261 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-15T22:38:59.301 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-15T22:38:59.330 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-15T22:38:59.564 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-15T22:38:59.600 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-15T22:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-15T22:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-15T22:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-15T22:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-15T22:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-15T22:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-15T22:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-15T22:39:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-15T22:39:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-15T22:39:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:39:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:39:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:00.509 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:00.715 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:39:01.289 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:24 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:01.456 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:39:01.458 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-02-15T22:39:01.459 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:01.460 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 37 M 2024-02-15T22:39:01.460 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 209 M 2024-02-15T22:39:01.460 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:01.953 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 33 MB/s | 7.4 MB 00:00 2024-02-15T22:39:02.061 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 95 kB/s | 32 kB 00:00 2024-02-15T22:39:02.108 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 111 kB/s | 17 kB 00:00 2024-02-15T22:39:02.137 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 455 kB/s | 34 kB 00:00 2024-02-15T22:39:02.342 INFO:teuthology.orchestra.run.smithi138.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 115 kB/s | 1.6 MB 00:14 2024-02-15T22:39:02.521 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-02-15T22:39:02.533 INFO:teuthology.orchestra.run.smithi138.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 181 kB/s | 4.4 MB 00:25 2024-02-15T22:39:02.541 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:02.541 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.0 MB/s | 53 MB 00:26 2024-02-15T22:39:02.542 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:02.577 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:02.577 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:02.587 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 4.8 MB 00:00 2024-02-15T22:39:02.612 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-02-15T22:39:03.021 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 802 kB 00:00 2024-02-15T22:39:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:03.172 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-02-15T22:39:03.230 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 2.0 MB/s | 3.0 MB 00:01 2024-02-15T22:39:03.255 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 833 kB/s | 194 kB 00:00 2024-02-15T22:39:03.472 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 820 kB/s | 245 kB 00:00 2024-02-15T22:39:03.475 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:03.475 INFO:teuthology.orchestra.run.smithi170.stdout:Total 18 MB/s | 37 MB 00:02 2024-02-15T22:39:03.493 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:03.520 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:03.520 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:03.957 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:03.958 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:04.431 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:04.524 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-15T22:39:04.555 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-15T22:39:04.605 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-15T22:39:04.661 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:04.729 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:39:04.759 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:39:04.856 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:39:04.888 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:39:04.981 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-15T22:39:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:39:05.112 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:39:05.163 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:39:05.192 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-02-15T22:39:05.223 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:39:05.285 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:39:05.314 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-15T22:39:05.361 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-02-15T22:39:05.430 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-15T22:39:05.458 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:39:05.523 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:39:05.638 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-15T22:39:05.680 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-15T22:39:05.722 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-15T22:39:05.755 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-15T22:39:05.782 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-15T22:39:05.818 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-15T22:39:05.835 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:39:05.850 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-15T22:39:05.957 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:39:06.148 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-15T22:39:06.214 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-15T22:39:06.304 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-02-15T22:39:06.343 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-02-15T22:39:06.381 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-15T22:39:06.772 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-15T22:39:06.799 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-15T22:39:06.853 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-02-15T22:39:06.919 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-02-15T22:39:06.943 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-02-15T22:39:07.196 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:39:08.215 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:39:08.246 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-15T22:39:09.029 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:39:09.057 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:39:09.601 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-02-15T22:39:09.643 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-15T22:39:09.722 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-02-15T22:39:09.722 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-15T22:39:09.722 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-15T22:39:09.722 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:09.753 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:39:10.933 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:39:10.934 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:39:11.411 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:11.412 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:11.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:39:12.445 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:35 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:12.612 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:39:12.613 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:12.614 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:12.615 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-02-15T22:39:12.615 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:12.615 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.0 M 2024-02-15T22:39:12.615 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-02-15T22:39:12.615 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:12.714 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 863 kB/s | 47 kB 00:00 2024-02-15T22:39:12.881 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 110 kB/s | 24 kB 00:00 2024-02-15T22:39:12.923 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 68 kB/s | 18 kB 00:00 2024-02-15T22:39:13.056 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 755 kB/s | 132 kB 00:00 2024-02-15T22:39:13.107 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 505 kB/s | 174 kB 00:00 2024-02-15T22:39:13.132 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.0 MB/s | 211 kB 00:00 2024-02-15T22:39:13.149 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 464 kB/s | 43 kB 00:00 2024-02-15T22:39:13.491 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 42 kB/s | 15 kB 00:00 2024-02-15T22:39:13.525 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 77 kB/s | 32 kB 00:00 2024-02-15T22:39:13.692 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 355 kB/s | 59 kB 00:00 2024-02-15T22:39:13.759 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 333 kB/s | 203 kB 00:00 2024-02-15T22:39:13.867 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 512 kB/s | 90 kB 00:00 2024-02-15T22:39:14.018 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-02-15T22:39:14.024 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:14.024 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-02-15T22:39:14.024 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:14.038 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:14.038 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:14.145 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:14.146 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:14.850 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:39:14.910 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:39:14.983 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:39:15.020 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:39:15.061 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:39:15.255 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:39:15.304 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:39:16.026 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:39:16.077 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:39:16.110 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-15T22:39:17.040 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-15T22:39:17.040 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-15T22:39:17.040 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:39:17.041 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:39:17.423 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:17.424 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:17.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:39:18.278 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:41 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:18.444 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:39:18.445 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-02-15T22:39:18.446 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:18.447 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 6.8 M 2024-02-15T22:39:18.447 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-02-15T22:39:18.447 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-02-15T22:39:19.099 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:19.387 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.8 MB/s | 127 kB 00:00 2024-02-15T22:39:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-15T22:39:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-02-15T22:39:19.862 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:19.862 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-15T22:39:19.862 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:39:19.862 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-15T22:39:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-15T22:39:19.950 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-15T22:39:19.950 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 636 kB/s | 548 kB 00:00 2024-02-15T22:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 214 kB/s | 227 kB 00:01 2024-02-15T22:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 278 kB/s | 58 kB 00:00 2024-02-15T22:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 5.8 MB 00:01 2024-02-15T22:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 161 kB/s | 51 kB 00:00 2024-02-15T22:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.0 MB/s | 6.8 MB 00:02 2024-02-15T22:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:21.084 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:39:21.084 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-02-15T22:39:21.084 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-15T22:39:21.085 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-15T22:39:21.086 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-02-15T22:39:21.087 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-15T22:39:21.087 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-02-15T22:39:21.135 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:21.305 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:39:21.356 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:39:21.881 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:39:21.968 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:39:22.027 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:39:22.052 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-15T22:39:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-15T22:39:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-3.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:22.203 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:22.455 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:39:22.859 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:39:23.029 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:50 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:23.173 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:39:23.173 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:23.173 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:23.173 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:23.174 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:23.194 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:23.195 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:23.195 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:39:23.195 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:23.195 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-15T22:39:23.196 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:23.197 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 40 M 2024-02-15T22:39:23.197 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 167 M 2024-02-15T22:39:23.197 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:23.317 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): libcephsqlite-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-02-15T22:39:23.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-02-15T22:39:23.459 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 445 kB/s | 63 kB 00:00 2024-02-15T22:39:23.851 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): ceph-test-18.2.0-0.el9.x86_64.rpm 61 MB/s | 40 MB 00:00 2024-02-15T22:39:23.876 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 442 kB/s | 300 kB 00:00 2024-02-15T22:39:23.902 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 421 kB/s | 186 kB 00:00 2024-02-15T22:39:23.927 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-02-15T22:39:23.930 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:23.930 INFO:teuthology.orchestra.run.smithi138.stdout:Total 55 MB/s | 40 MB 00:00 2024-02-15T22:39:23.931 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:23.950 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:23.950 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:24.013 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:47 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 913 k 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 2.7 M 2024-02-15T22:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:24.257 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 10 MB/s | 835 kB 00:00 2024-02-15T22:39:24.287 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:24.287 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:24.457 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 283 kB/s | 79 kB 00:00 2024-02-15T22:39:24.458 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:24.459 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.2 MB/s | 913 kB 00:00 2024-02-15T22:39:24.459 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:24.478 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:24.478 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:24.558 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:24.559 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:24.743 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:24.825 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:39:24.904 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-15T22:39:24.935 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-15T22:39:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-15T22:39:24.985 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-15T22:39:25.037 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-15T22:39:25.073 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-15T22:39:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-15T22:39:25.650 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:25.962 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:26.245 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-02-15T22:39:26.843 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:49 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:27.010 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:27.011 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:27.011 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:27.011 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:27.011 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 126 k 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 456 k 2024-02-15T22:39:27.012 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:27.078 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-02-15T22:39:27.079 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:27.079 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.8 MB/s | 126 kB 00:00 2024-02-15T22:39:27.079 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:27.084 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:27.085 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:27.140 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:27.140 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:27.317 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:27.427 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:28.174 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:28.408 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-02-15T22:39:28.774 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 5/6 2024-02-15T22:39:28.856 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-15T22:39:28.999 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:51 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:29.116 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:29.169 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:29.170 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:29.170 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:29.244 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-02-15T22:39:29.825 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:52 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:29.990 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:29.991 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:29.991 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:29.991 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 30 k 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 137 k 2024-02-15T22:39:29.992 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:30.058 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 467 kB/s | 30 kB 00:00 2024-02-15T22:39:30.059 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:30.059 INFO:teuthology.orchestra.run.smithi170.stdout:Total 456 kB/s | 30 kB 00:00 2024-02-15T22:39:30.059 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:30.062 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:30.062 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:30.175 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:30.289 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:30.714 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:30.996 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:31.077 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 6/6 2024-02-15T22:39:31.077 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/6 2024-02-15T22:39:31.077 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/6 2024-02-15T22:39:31.077 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-15T22:39:31.078 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-15T22:39:31.078 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-15T22:39:31.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-02-15T22:39:31.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:18.2.0-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:18.2.0-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:31.490 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:31.757 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:54 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:31.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-02-15T22:39:31.872 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:31.923 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:31.924 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:31.925 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:31.993 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-02-15T22:39:32.408 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:59 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:32.574 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:55 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:32.578 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-02-15T22:39:32.581 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-15T22:39:32.582 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-15T22:39:32.583 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout:Install 33 Packages 2024-02-15T22:39:32.584 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:32.585 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 30 M 2024-02-15T22:39:32.585 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 109 M 2024-02-15T22:39:32.585 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:32.686 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:32.738 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:32.739 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:32.739 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:32.811 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-02-15T22:39:33.110 INFO:teuthology.orchestra.run.smithi138.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 61 kB/s | 6.4 kB 00:00 2024-02-15T22:39:33.169 INFO:teuthology.orchestra.run.smithi138.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 8.8 MB/s | 1.4 MB 00:00 2024-02-15T22:39:33.236 INFO:teuthology.orchestra.run.smithi138.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 9.1 MB/s | 2.1 MB 00:00 2024-02-15T22:39:33.261 INFO:teuthology.orchestra.run.smithi138.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 9.4 MB/s | 240 kB 00:00 2024-02-15T22:39:33.336 INFO:teuthology.orchestra.run.smithi138.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-02-15T22:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:56 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:33.612 INFO:teuthology.orchestra.run.smithi138.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 40 MB/s | 18 MB 00:00 2024-02-15T22:39:33.631 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-02-15T22:39:33.662 INFO:teuthology.orchestra.run.smithi138.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 104 kB/s | 32 kB 00:00 2024-02-15T22:39:33.696 INFO:teuthology.orchestra.run.smithi138.stdout:(8/33): python3-mako-1.1.4-6.el9.noarch.rpm 332 kB/s | 144 kB 00:00 2024-02-15T22:39:33.721 INFO:teuthology.orchestra.run.smithi138.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 440 kB/s | 47 kB 00:00 2024-02-15T22:39:33.738 INFO:teuthology.orchestra.run.smithi138.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 511 kB/s | 39 kB 00:00 2024-02-15T22:39:33.847 INFO:teuthology.orchestra.run.smithi138.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 241 kB 00:00 2024-02-15T22:39:34.139 INFO:teuthology.orchestra.run.smithi138.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 257 kB/s | 103 kB 00:00 2024-02-15T22:39:34.181 INFO:teuthology.orchestra.run.smithi138.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 372 kB/s | 124 kB 00:00 2024-02-15T22:39:34.202 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:57 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:34.315 INFO:teuthology.orchestra.run.smithi138.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 1.9 MB/s | 1.1 MB 00:00 2024-02-15T22:39:34.316 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:34.365 INFO:teuthology.orchestra.run.smithi138.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 501 kB/s | 113 kB 00:00 2024-02-15T22:39:34.368 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:34.369 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:34.369 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:34.440 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-02-15T22:39:34.449 INFO:teuthology.orchestra.run.smithi138.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 699 kB/s | 187 kB 00:00 2024-02-15T22:39:34.507 INFO:teuthology.orchestra.run.smithi138.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 226 kB/s | 43 kB 00:00 2024-02-15T22:39:34.566 INFO:teuthology.orchestra.run.smithi138.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-02-15T22:39:34.633 INFO:teuthology.orchestra.run.smithi138.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 641 kB/s | 172 kB 00:00 2024-02-15T22:39:34.658 INFO:teuthology.orchestra.run.smithi138.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-02-15T22:39:34.741 INFO:teuthology.orchestra.run.smithi138.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 215 kB/s | 23 kB 00:00 2024-02-15T22:39:34.767 INFO:teuthology.orchestra.run.smithi138.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 179 kB/s | 19 kB 00:00 2024-02-15T22:39:34.793 INFO:teuthology.orchestra.run.smithi138.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2024-02-15T22:39:34.818 INFO:teuthology.orchestra.run.smithi138.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 257 kB/s | 20 kB 00:00 2024-02-15T22:39:34.852 INFO:teuthology.orchestra.run.smithi138.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 550 kB/s | 46 kB 00:00 2024-02-15T22:39:34.877 INFO:teuthology.orchestra.run.smithi138.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 938 kB/s | 79 kB 00:00 2024-02-15T22:39:34.936 INFO:teuthology.orchestra.run.smithi138.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-02-15T22:39:34.961 INFO:teuthology.orchestra.run.smithi138.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-02-15T22:39:35.012 INFO:teuthology.orchestra.run.smithi138.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-02-15T22:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:58 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:35.037 INFO:teuthology.orchestra.run.smithi138.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-02-15T22:39:35.079 INFO:teuthology.orchestra.run.smithi138.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-02-15T22:39:35.112 INFO:teuthology.orchestra.run.smithi138.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 266 kB/s | 20 kB 00:00 2024-02-15T22:39:35.136 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:35.180 INFO:teuthology.orchestra.run.smithi138.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.5 MB/s | 427 kB 00:00 2024-02-15T22:39:35.184 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:35.184 INFO:teuthology.orchestra.run.smithi138.stdout:Total 11 MB/s | 30 MB 00:02 2024-02-15T22:39:35.185 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:35.187 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:35.189 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:35.189 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:35.224 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:35.224 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:35.257 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-02-15T22:39:35.590 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:35.590 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:35.826 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:58 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:35.939 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:35.991 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:35.992 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-02-15T22:39:35.992 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:36.064 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-02-15T22:39:36.644 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:59 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:36.807 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:36.809 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:36.810 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:36.810 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:36.810 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:36.810 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:39:36.811 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:36.812 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 86 k 2024-02-15T22:39:36.812 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 230 k 2024-02-15T22:39:36.812 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:36.882 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-15T22:39:36.885 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-02-15T22:39:36.886 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:36.886 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-02-15T22:39:36.886 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:36.893 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:36.893 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:36.914 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-15T22:39:36.947 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:36.948 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-15T22:39:36.948 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:37.040 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-15T22:39:37.085 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:37.126 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-15T22:39:37.168 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-15T22:39:37.191 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:37.240 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-15T22:39:37.293 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-15T22:39:37.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-15T22:39:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-15T22:39:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-15T22:39:37.604 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:37.628 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-15T22:39:37.679 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-15T22:39:37.718 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-15T22:39:37.753 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-15T22:39:37.783 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-15T22:39:37.859 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-15T22:39:37.877 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:37.877 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:37.877 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:37.878 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:37.878 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:37.878 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:37.894 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:39:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-15T22:39:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-15T22:39:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-15T22:39:38.039 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-15T22:39:38.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-02-15T22:39:38.127 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-15T22:39:38.170 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-15T22:39:38.241 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-15T22:39:38.378 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-15T22:39:38.505 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:39:38.660 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-02-15T22:39:38.685 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-15T22:39:38.690 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:01 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:38.709 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-02-15T22:39:38.709 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:38.710 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-15T22:39:38.710 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:39:38.710 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-15T22:39:38.710 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:38.874 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:38.874 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.0 M 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 12 M 2024-02-15T22:39:38.875 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:38.973 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-02-15T22:39:38.974 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:38.974 INFO:teuthology.orchestra.run.smithi170.stdout:Total 30 MB/s | 3.0 MB 00:00 2024-02-15T22:39:38.974 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:38.983 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:38.984 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:39.058 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:39.059 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:39.484 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:39.549 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:39.574 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:39.574 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:39.574 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:39:39.575 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:39:39.575 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:39:39.575 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:40.295 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-15T22:39:40.323 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-02-15T22:39:40.323 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:40.324 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-15T22:39:40.324 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:39:40.324 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-15T22:39:40.324 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:40.677 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:40.678 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:40.678 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:40.678 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:40.678 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:40.678 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:40.771 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-15T22:39:40.794 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-02-15T22:39:40.794 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:40.794 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-15T22:39:40.794 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:39:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-15T22:39:40.795 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:40.894 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-02-15T22:39:40.997 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-15T22:39:41.020 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:41.086 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-15T22:39:41.481 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:04 ago on Thu 15 Feb 2024 10:37:37 PM UTC. 2024-02-15T22:39:41.646 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-15T22:39:41.646 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 169 k 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 490 k 2024-02-15T22:39:41.647 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-15T22:39:41.712 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.6 MB/s | 169 kB 00:00 2024-02-15T22:39:41.713 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:41.713 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.5 MB/s | 169 kB 00:00 2024-02-15T22:39:41.713 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-15T22:39:41.720 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-15T22:39:41.720 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-15T22:39:41.775 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-15T22:39:41.776 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-15T22:39:41.935 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-15T22:39:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:42.796 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-15T22:39:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:39:42.796 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-15T22:39:43.024 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-15T22:39:43.025 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-15T22:39:43.026 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-15T22:39:43.027 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-15T22:39:43.028 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-15T22:39:43.028 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-15T22:39:43.028 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-15T22:39:43.028 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-15T22:39:43.076 DEBUG:teuthology.parallel:result is None 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:44.013 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-15T22:39:44.014 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-15T22:39:44.015 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-15T22:39:44.016 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:44.016 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:44.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-02-15T22:39:44.976 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:11 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:45.093 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:45.144 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:45.145 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:39:45.145 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:45.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-02-15T22:39:45.788 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:12 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:45.951 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-02-15T22:39:45.952 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 209 k 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 200 k 2024-02-15T22:39:45.953 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:46.025 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-18.2.0-0.el9.noarch.rpm 2.8 MB/s | 209 kB 00:00 2024-02-15T22:39:46.026 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:46.026 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.8 MB/s | 209 kB 00:00 2024-02-15T22:39:46.026 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:46.031 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:46.031 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:46.033 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:46.034 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:46.102 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:46.552 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:39:46.639 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:39:47.028 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:47.318 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:47.540 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T22:39:48.124 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:15 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:48.295 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:48.296 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:48.296 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-02-15T22:39:48.296 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:48.296 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:48.296 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 142 k 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 399 k 2024-02-15T22:39:48.297 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:48.359 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.2 MB/s | 142 kB 00:00 2024-02-15T22:39:48.359 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:48.360 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.2 MB/s | 142 kB 00:00 2024-02-15T22:39:48.360 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:48.367 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:48.367 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:48.418 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:48.419 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:48.560 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:48.659 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:39:48.659 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-15T22:39:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:49.698 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:39:49.698 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:49.699 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:49.699 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-02-15T22:39:49.699 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:49.699 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:49.966 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-02-15T22:39:50.567 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:17 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:50.682 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:39:50.732 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:50.733 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:39:50.734 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:50.800 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T22:39:51.375 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:18 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:51.540 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-15T22:39:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout:Install 7 Packages 2024-02-15T22:39:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:51.543 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.0 M 2024-02-15T22:39:51.543 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 8.1 M 2024-02-15T22:39:51.543 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:52.042 INFO:teuthology.orchestra.run.smithi138.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 220 kB/s | 23 kB 00:00 2024-02-15T22:39:52.067 INFO:teuthology.orchestra.run.smithi138.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 112 kB/s | 15 kB 00:00 2024-02-15T22:39:52.126 INFO:teuthology.orchestra.run.smithi138.stdout:(3/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 9.0 MB/s | 1.7 MB 00:00 2024-02-15T22:39:52.435 INFO:teuthology.orchestra.run.smithi138.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 100 kB/s | 31 kB 00:00 2024-02-15T22:39:52.894 INFO:teuthology.orchestra.run.smithi138.stdout:(5/7): python3-routes-2.5.1-5.el9.noarch.rpm 411 kB/s | 188 kB 00:00 2024-02-15T22:39:53.569 INFO:teuthology.orchestra.run.smithi138.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 27 kB/s | 41 kB 00:01 2024-02-15T22:39:53.752 INFO:teuthology.orchestra.run.smithi138.stdout:(7/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 5.3 kB/s | 9.0 kB 00:01 2024-02-15T22:39:53.754 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:39:53.755 INFO:teuthology.orchestra.run.smithi138.stdout:Total 923 kB/s | 2.0 MB 00:02 2024-02-15T22:39:53.755 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:39:53.764 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:39:53.764 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:39:53.830 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:39:53.830 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:39:54.128 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:39:54.195 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-15T22:39:54.229 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-15T22:39:54.275 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-15T22:39:54.308 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-15T22:39:54.337 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-02-15T22:39:54.563 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-02-15T22:39:54.607 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-15T22:39:55.178 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-15T22:39:55.179 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-15T22:39:55.489 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-15T22:39:55.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:55.521 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:39:55.521 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-02-15T22:39:55.521 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:55.522 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:39:55.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T22:39:56.281 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:23 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:39:56.448 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-15T22:39:56.454 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:39:56.455 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:39:56.456 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-02-15T22:39:56.456 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:39:56.456 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 37 M 2024-02-15T22:39:56.456 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 209 M 2024-02-15T22:39:56.456 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:39:57.095 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 46 MB/s | 7.4 MB 00:00 2024-02-15T22:39:57.436 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 54 kB/s | 17 kB 00:00 2024-02-15T22:39:57.929 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 69 kB/s | 34 kB 00:00 2024-02-15T22:39:58.079 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-02-15T22:39:58.446 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): flexiblas-3.0.4-8.el9.x86_64.rpm 21 kB/s | 32 kB 00:01 2024-02-15T22:39:58.588 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 7.2 MB/s | 4.7 MB 00:00 2024-02-15T22:39:58.772 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.9 MB/s | 4.8 MB 00:00 2024-02-15T22:39:58.797 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 620 kB/s | 217 kB 00:00 2024-02-15T22:39:58.931 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 802 kB 00:00 2024-02-15T22:39:59.039 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 805 kB/s | 194 kB 00:00 2024-02-15T22:39:59.998 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-02-15T22:40:00.456 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 161 kB/s | 245 kB 00:01 2024-02-15T22:40:00.460 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:00.460 INFO:teuthology.orchestra.run.smithi138.stdout:Total 9.2 MB/s | 37 MB 00:04 2024-02-15T22:40:00.481 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:00.507 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:00.508 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:00.929 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:00.929 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-15T22:40:01.736 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-15T22:40:01.831 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:40:01.873 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-15T22:40:02.058 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:40:02.089 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:40:02.165 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-15T22:40:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-15T22:40:02.944 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-15T22:40:04.173 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-15T22:40:05.198 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-15T22:40:05.227 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-15T22:40:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-02-15T22:40:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-02-15T22:40:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-15T22:40:08.064 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-15T22:40:08.065 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-15T22:40:08.557 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:08.558 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:08.958 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-02-15T22:40:09.562 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:36 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:09.737 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:09.738 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:09.738 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-15T22:40:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-02-15T22:40:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:09.741 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.0 M 2024-02-15T22:40:09.741 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 26 M 2024-02-15T22:40:09.741 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:10.073 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 692 kB/s | 47 kB 00:00 2024-02-15T22:40:10.207 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 121 kB/s | 24 kB 00:00 2024-02-15T22:40:10.257 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 72 kB/s | 18 kB 00:00 2024-02-15T22:40:10.382 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 754 kB/s | 132 kB 00:00 2024-02-15T22:40:10.450 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 528 kB/s | 174 kB 00:00 2024-02-15T22:40:10.475 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 968 kB/s | 211 kB 00:00 2024-02-15T22:40:10.509 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 340 kB/s | 43 kB 00:00 2024-02-15T22:40:10.834 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-02-15T22:40:10.876 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 76 kB/s | 32 kB 00:00 2024-02-15T22:40:11.168 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 203 kB/s | 59 kB 00:00 2024-02-15T22:40:11.202 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 293 kB/s | 203 kB 00:00 2024-02-15T22:40:11.402 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 384 kB/s | 90 kB 00:00 2024-02-15T22:40:11.636 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.3 MB/s | 1.0 MB 00:00 2024-02-15T22:40:11.639 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:11.639 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.1 MB/s | 2.0 MB 00:01 2024-02-15T22:40:11.640 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:11.655 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:11.655 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:11.760 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:11.761 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:12.298 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:12.473 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-15T22:40:12.528 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-15T22:40:12.591 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-15T22:40:12.630 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-15T22:40:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-15T22:40:12.764 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-15T22:40:12.867 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-15T22:40:12.917 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-15T22:40:13.627 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-15T22:40:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-15T22:40:13.707 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-15T22:40:13.754 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-15T22:40:13.778 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-15T22:40:14.588 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-15T22:40:14.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-15T22:40:14.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-15T22:40:14.589 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-15T22:40:14.962 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-15T22:40:14.962 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:14.962 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:14.962 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-15T22:40:14.963 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:14.964 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:15.230 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T22:40:15.812 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:42 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:15.979 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:40:15.980 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-02-15T22:40:15.981 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:15.982 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 6.8 M 2024-02-15T22:40:15.982 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 33 M 2024-02-15T22:40:15.982 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:16.536 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.1 MB/s | 127 kB 00:00 2024-02-15T22:40:16.695 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 831 kB/s | 227 kB 00:00 2024-02-15T22:40:16.995 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 5.8 MB 00:00 2024-02-15T22:40:17.446 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 77 kB/s | 58 kB 00:00 2024-02-15T22:40:17.646 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 79 kB/s | 51 kB 00:00 2024-02-15T22:40:18.004 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 374 kB/s | 548 kB 00:01 2024-02-15T22:40:18.008 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:18.008 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.3 MB/s | 6.8 MB 00:02 2024-02-15T22:40:18.009 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:18.018 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:18.018 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:18.109 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:18.109 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:18.413 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:18.578 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-15T22:40:18.623 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-15T22:40:19.128 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-15T22:40:19.225 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-15T22:40:19.285 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-15T22:40:19.312 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-15T22:40:20.112 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-15T22:40:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-15T22:40:20.430 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:20.430 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:20.431 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:20.712 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-02-15T22:40:21.289 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:48 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:21.455 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:21.456 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:21.456 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:21.456 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:21.456 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 913 k 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 2.7 M 2024-02-15T22:40:21.457 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:21.542 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 9.6 MB/s | 835 kB 00:00 2024-02-15T22:40:21.801 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 229 kB/s | 79 kB 00:00 2024-02-15T22:40:21.802 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:21.802 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.6 MB/s | 913 kB 00:00 2024-02-15T22:40:21.803 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:21.823 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:21.823 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:21.903 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:21.904 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:22.093 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-15T22:40:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-15T22:40:23.041 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-02-15T22:40:23.041 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-02-15T22:40:23.377 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-15T22:40:23.378 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:23.378 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:23.378 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-15T22:40:23.378 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:23.378 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:23.637 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-02-15T22:40:24.231 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:51 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:24.396 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 126 k 2024-02-15T22:40:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 456 k 2024-02-15T22:40:24.398 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:24.459 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.0 MB/s | 126 kB 00:00 2024-02-15T22:40:24.460 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:24.460 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.0 MB/s | 126 kB 00:00 2024-02-15T22:40:24.460 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:24.466 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:24.466 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:24.521 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:24.521 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:24.663 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:24.766 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:25.302 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:25.657 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:25.658 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-02-15T22:40:25.658 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:25.658 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:25.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-02-15T22:40:26.532 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:53 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:26.650 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:26.703 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:26.704 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:26.704 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:26.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-02-15T22:40:27.365 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:54 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:27.531 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:27.531 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 30 k 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 137 k 2024-02-15T22:40:27.532 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:27.601 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 449 kB/s | 30 kB 00:00 2024-02-15T22:40:27.601 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:27.601 INFO:teuthology.orchestra.run.smithi138.stdout:Total 439 kB/s | 30 kB 00:00 2024-02-15T22:40:27.601 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:27.605 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:27.605 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:27.641 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:27.641 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:27.723 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:27.849 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:28.250 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:28.526 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:28.527 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:28.527 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:28.527 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-02-15T22:40:28.527 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:28.527 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:28.712 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-02-15T22:40:29.295 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:56 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:29.410 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:29.463 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:29.464 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:29.464 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:29.535 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-02-15T22:40:30.116 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:57 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:30.228 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:30.280 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:30.281 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:30.281 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:30.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-02-15T22:40:30.928 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:57 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:31.042 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:31.095 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:31.096 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:31.096 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:31.168 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-02-15T22:40:31.744 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:58 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:31.858 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:31.910 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:31.911 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:31.911 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:31.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-02-15T22:40:32.568 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:59 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:32.682 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:32.735 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:32.736 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:32.736 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:32.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-02-15T22:40:33.388 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:00 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:33.502 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-02-15T22:40:33.555 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:33.556 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-02-15T22:40:33.556 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:33.625 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-02-15T22:40:34.205 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:01 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:34.372 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:34.373 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 86 k 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 230 k 2024-02-15T22:40:34.374 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:34.439 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-02-15T22:40:34.439 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:34.439 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.3 MB/s | 86 kB 00:00 2024-02-15T22:40:34.440 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:34.446 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:34.446 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:34.501 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:34.501 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:34.641 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:34.737 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:35.143 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:35.419 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:35.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-02-15T22:40:36.258 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:03 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:36.432 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:36.432 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:36.432 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.0 M 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 12 M 2024-02-15T22:40:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:36.529 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 31 MB/s | 3.0 MB 00:00 2024-02-15T22:40:36.529 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:36.530 INFO:teuthology.orchestra.run.smithi138.stdout:Total 31 MB/s | 3.0 MB 00:00 2024-02-15T22:40:36.530 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:36.539 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:36.539 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:36.611 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:36.612 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:37.023 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:37.097 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-15T22:40:37.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:38.240 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:38.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-02-15T22:40:39.091 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:06 ago on Thu 15 Feb 2024 10:38:33 PM UTC. 2024-02-15T22:40:39.259 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 169 k 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 490 k 2024-02-15T22:40:39.260 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-02-15T22:40:39.319 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.8 MB/s | 169 kB 00:00 2024-02-15T22:40:39.320 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:40:39.320 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.7 MB/s | 169 kB 00:00 2024-02-15T22:40:39.320 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-02-15T22:40:39.328 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-02-15T22:40:39.328 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-02-15T22:40:39.383 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-02-15T22:40:39.383 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-02-15T22:40:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-02-15T22:40:39.634 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:40:40.420 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-02-15T22:40:40.651 DEBUG:teuthology.parallel:result is None 2024-02-15T22:40:40.652 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:40:40.652 INFO:teuthology.packaging:ref: None 2024-02-15T22:40:40.652 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:40:40.652 INFO:teuthology.packaging:branch: None 2024-02-15T22:40:40.652 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:40:40.652 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-15T22:40:40.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-15T22:40:40.799 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:40:40.819 INFO:teuthology.orchestra.run.smithi138.stdout:18.2.0-0.el9 2024-02-15T22:40:40.820 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-15T22:40:40.820 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-15T22:40:40.822 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T22:40:40.822 INFO:teuthology.packaging:ref: None 2024-02-15T22:40:40.822 INFO:teuthology.packaging:tag: v18.2.0 2024-02-15T22:40:40.822 INFO:teuthology.packaging:branch: None 2024-02-15T22:40:40.822 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:40:40.822 INFO:teuthology.packaging:Tag 'v18.2.0' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-15T22:40:40.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-02-15T22:40:40.962 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T22:40:40.987 INFO:teuthology.orchestra.run.smithi170.stdout:18.2.0-0.el9 2024-02-15T22:40:40.987 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-02-15T22:40:40.987 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-02-15T22:40:40.989 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T22:40:40.989 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:40:40.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:40:41.018 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:40:41.018 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T22:40:41.059 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T22:40:41.059 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:40:41.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:40:41.086 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:40:41.152 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:40:41.152 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T22:40:41.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T22:40:41.250 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T22:40:41.250 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:40:41.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:40:41.276 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:40:41.342 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:40:41.342 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T22:40:41.372 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T22:40:41.439 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T22:40:41.439 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:40:41.439 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:40:41.466 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:40:41.532 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:40:41.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T22:40:41.559 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T22:40:41.627 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:40:41.636 INFO:teuthology.task.print:**** done install task... 2024-02-15T22:40:41.636 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-15T22:40:41.741 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-15T22:40:41.741 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-02-15T22:40:41.742 INFO:tasks.cephadm:Cluster fsid is 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:40:41.742 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-15T22:40:41.742 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-15T22:40:41.742 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi138': '172.21.15.138', 'mon.smithi170': '172.21.15.170'} 2024-02-15T22:40:41.742 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-15T22:40:41.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s) 2024-02-15T22:40:41.769 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-02-15T22:40:41.801 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-02-15T22:40:41.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:40:42.086 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76790/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:25:41.455235', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76792/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:17:06.436952', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-02-15T22:40:42.308 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 73690242cfa21422dac9d72743765341a1f42553 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-02-15T22:40:42.309 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/73690242cfa21422dac9d72743765341a1f42553/centos/9/x86_64/flavors/default/cephadm 2024-02-15T22:40:42.310 DEBUG:teuthology.orchestra.run.smithi138:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/73690242cfa21422dac9d72743765341a1f42553/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:42.883 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r--. 1 ubuntu ubuntu 214739 Feb 15 22:40 /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:42.883 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/73690242cfa21422dac9d72743765341a1f42553/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:43.483 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 214739 Feb 15 22:40 /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:43.484 DEBUG:teuthology.orchestra.run.smithi138:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:43.502 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T22:40:43.533 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-02-15T22:40:43.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-15T22:40:43.545 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-02-15T22:40:44.398 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-15T22:40:44.427 INFO:teuthology.orchestra.run.smithi138.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "repo_digests": [ 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-15T22:41:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-15T22:41:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-02-15T22:41:03.365 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:41:08.652 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-02-15T22:41:08.652 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-02-15T22:41:08.652 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-02-15T22:41:08.653 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-02-15T22:41:08.653 INFO:teuthology.orchestra.run.smithi170.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-02-15T22:41:08.653 INFO:teuthology.orchestra.run.smithi170.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-02-15T22:41:08.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-02-15T22:41:08.653 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-02-15T22:41:08.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph 2024-02-15T22:41:08.709 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-02-15T22:41:08.740 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /etc/ceph 2024-02-15T22:41:08.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-02-15T22:41:08.809 INFO:tasks.cephadm:Writing seed config... 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-15T22:41:08.810 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-15T22:41:08.811 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-15T22:41:08.812 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-15T22:41:08.813 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:41:08.813 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-15T22:41:08.836 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3fa87466-cc53-11ee-95ba-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-15T22:41:08.836 DEBUG:teuthology.orchestra.run.smithi138:mon.smithi138> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service 2024-02-15T22:41:08.878 INFO:tasks.cephadm:Bootstrapping... 2024-02-15T22:41:08.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.138 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:09.036 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-02-15T22:41:09.036 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', '3fa87466-cc53-11ee-95ba-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.138', '--skip-admin-label'] 2024-02-15T22:41:09.061 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:41:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-15T22:41:09.061 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying podman|docker is present... 2024-02-15T22:41:09.085 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:41:09.085 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying lvm2 is present... 2024-02-15T22:41:09.085 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying time synchronization is in place... 2024-02-15T22:41:09.092 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-15T22:41:09.092 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T22:41:09.098 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-15T22:41:09.098 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:41:09.104 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout enabled 2024-02-15T22:41:09.110 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout active 2024-02-15T22:41:09.110 INFO:teuthology.orchestra.run.smithi138.stdout:Unit chronyd.service is enabled and running 2024-02-15T22:41:09.110 INFO:teuthology.orchestra.run.smithi138.stdout:Repeating the final host check... 2024-02-15T22:41:09.132 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-15T22:41:09.132 INFO:teuthology.orchestra.run.smithi138.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-15T22:41:09.133 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl is present 2024-02-15T22:41:09.133 INFO:teuthology.orchestra.run.smithi138.stdout:lvcreate is present 2024-02-15T22:41:09.139 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-15T22:41:09.139 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T22:41:09.144 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-15T22:41:09.145 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:41:09.151 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout enabled 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout active 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Unit chronyd.service is enabled and running 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Host looks OK 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Cluster fsid: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Acquiring lock 140545938293520 on /run/cephadm/3fa87466-cc53-11ee-95ba-87774f69a715.lock 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Lock 140545938293520 acquired on /run/cephadm/3fa87466-cc53-11ee-95ba-87774f69a715.lock 2024-02-15T22:41:09.157 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying IP 172.21.15.138 port 3300 ... 2024-02-15T22:41:09.158 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying IP 172.21.15.138 port 6789 ... 2024-02-15T22:41:09.158 INFO:teuthology.orchestra.run.smithi138.stdout:Base mon IP(s) is [172.21.15.138:3300, 172.21.15.138:6789], mon addrv is [v2:172.21.15.138:3300,v1:172.21.15.138:6789] 2024-02-15T22:41:09.161 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.138 metric 100 2024-02-15T22:41:09.161 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.138 metric 100 2024-02-15T22:41:09.163 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-15T22:41:09.163 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-15T22:41:09.163 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1771sec hoplimit 64 pref medium 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-02-15T22:41:09.166 INFO:teuthology.orchestra.run.smithi138.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-15T22:41:09.167 INFO:teuthology.orchestra.run.smithi138.stdout:Mon IP `172.21.15.138` is in CIDR network `172.21.0.0/20` 2024-02-15T22:41:09.167 INFO:teuthology.orchestra.run.smithi138.stdout:Mon IP `172.21.15.138` is in CIDR network `172.21.0.0/20` 2024-02-15T22:41:09.167 INFO:teuthology.orchestra.run.smithi138.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-15T22:41:09.167 INFO:teuthology.orchestra.run.smithi138.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-15T22:41:09.168 INFO:teuthology.orchestra.run.smithi138.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Getting image source signatures 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-02-15T22:41:09.950 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-02-15T22:41:09.951 INFO:teuthology.orchestra.run.smithi138.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-15T22:41:10.838 INFO:teuthology.orchestra.run.smithi138.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-15T22:41:10.838 INFO:teuthology.orchestra.run.smithi138.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-02-15T22:41:10.838 INFO:teuthology.orchestra.run.smithi138.stdout:Extracting ceph user uid/gid from container image... 2024-02-15T22:41:11.751 INFO:teuthology.orchestra.run.smithi138.stdout:stat: stdout 167 167 2024-02-15T22:41:11.751 INFO:teuthology.orchestra.run.smithi138.stdout:Creating initial keys... 2024-02-15T22:41:12.557 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph-authtool: stdout AQAIk85lOVKIARAA8ML7+A8xJxy+L4kG920rxQ== 2024-02-15T22:41:13.496 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph-authtool: stdout AQAIk85lAymEMxAAs3MYI+ekpzxewKaUSnv43Q== 2024-02-15T22:41:14.510 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph-authtool: stdout AQAJk85lMJjnMRAA2Ro6skSi1ZogjXX6Kf3BBQ== 2024-02-15T22:41:14.511 INFO:teuthology.orchestra.run.smithi138.stdout:Creating initial monmap... 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool for smithi138 [v2:172.21.15.138:3300,v1:172.21.15.138:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = pacific 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: set fsid to 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:41:15.475 INFO:teuthology.orchestra.run.smithi138.stdout:Creating mon... 2024-02-15T22:41:16.473 INFO:teuthology.orchestra.run.smithi138.stdout:create mon.smithi138 on 2024-02-15T22:41:16.687 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-15T22:41:16.824 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-15T22:41:17.016 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target. 2024-02-15T22:41:17.016 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target. 2024-02-15T22:41:17.224 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138 2024-02-15T22:41:17.224 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service: Unit ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service not loaded. 2024-02-15T22:41:17.381 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target.wants/ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service → /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715@.service. 2024-02-15T22:41:17.867 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:17 smithi138 podman[28843]: 2024-02-15 22:41:17.802269418 +0000 UTC m=+0.293714837 container start 8549a9d6291207e919b852f006b5314521a5c7adbae9adeedc1eb6a59d20429d (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0) 2024-02-15T22:41:17.867 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:17 smithi138 ceph-mon[28862]: mkfs 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:17.895 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:41:17.895 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout disabled 2024-02-15T22:41:17.902 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:41:17.902 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:41:17.903 INFO:teuthology.orchestra.run.smithi138.stdout:firewalld.service is not enabled 2024-02-15T22:41:17.903 INFO:teuthology.orchestra.run.smithi138.stdout:Not possible to enable service . firewalld.service is not available 2024-02-15T22:41:17.903 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mon to start... 2024-02-15T22:41:17.903 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mon... 2024-02-15T22:41:18.126 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:17 smithi138 ceph-mon[28862]: mon.smithi138 is new leader, mons smithi138 in quorum (ranks 0) 2024-02-15T22:41:18.126 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:17 smithi138 bash[28843]: 8549a9d6291207e919b852f006b5314521a5c7adbae9adeedc1eb6a59d20429d 2024-02-15T22:41:18.126 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:17 smithi138 systemd[1]: Started Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout cluster: 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout id: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout services: 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi138 (age 0.547482s) 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout data: 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout pgs: 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.332+0000 7f702b869700 1 Processor -- start 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f702b869700 1 -- start start 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f702b869700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f702b869700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7024105210 con 0x7f70241048c0 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f7029605700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f7029605700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48442/0 (socket says 172.21.15.138:48442) 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f7029605700 1 -- 172.21.15.138:0/4232192087 learned_addr learned my addr 172.21.15.138:0/4232192087 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.333+0000 7f7029605700 1 -- 172.21.15.138:0/4232192087 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024105350 con 0x7f70241048c0 2024-02-15T22:41:18.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f7029605700 1 --2- 172.21.15.138:0/4232192087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f70140098a0 tx=0x7f7014009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f97564c72e96fda server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f701bfff700 1 -- 172.21.15.138:0/4232192087 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7014004180 con 0x7f70241048c0 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f701bfff700 1 -- 172.21.15.138:0/4232192087 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70140042e0 con 0x7f70241048c0 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f701bfff700 1 -- 172.21.15.138:0/4232192087 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70140036a0 con 0x7f70241048c0 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 -- 172.21.15.138:0/4232192087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 msgr2=0x7f7024104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 --2- 172.21.15.138:0/4232192087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f70140098a0 tx=0x7f7014009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 -- 172.21.15.138:0/4232192087 shutdown_connections 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 --2- 172.21.15.138:0/4232192087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f7024104cd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 -- 172.21.15.138:0/4232192087 >> 172.21.15.138:0/4232192087 conn(0x7f70240ffed0 msgr2=0x7f7024102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.334+0000 7f702b869700 1 -- 172.21.15.138:0/4232192087 shutdown_connections 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f702b869700 1 -- 172.21.15.138:0/4232192087 wait complete. 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f702b869700 1 Processor -- start 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f702b869700 1 -- start start 2024-02-15T22:41:18.899 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f702b869700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f702b869700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702418db40 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f7029605700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f7029605700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48444/0 (socket says 172.21.15.138:48444) 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.335+0000 7f7029605700 1 -- 172.21.15.138:0/2624416424 learned_addr learned my addr 172.21.15.138:0/2624416424 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f7029605700 1 -- 172.21.15.138:0/2624416424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014009550 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f7029605700 1 --2- 172.21.15.138:0/2624416424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f70241055f0 tx=0x7f7014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7014003ce0 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014020070 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7014011630 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702418bc50 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702418c0f0 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7014022030 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.336+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7014025d40 con 0x7f70241048c0 2024-02-15T22:41:18.900 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.337+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7024062380 con 0x7f70241048c0 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.339+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7014025480 con 0x7f70241048c0 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.409+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7024192360 con 0x7f70241048c0 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.409+0000 7f701a7fc700 1 -- 172.21.15.138:0/2624416424 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f7014011bd0 con 0x7f70241048c0 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 msgr2=0x7f702418d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 --2- 172.21.15.138:0/2624416424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f70241055f0 tx=0x7f7014004750 comp rx=0 tx=0).stop 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 shutdown_connections 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 --2- 172.21.15.138:0/2624416424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70241048c0 0x7f702418d600 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 >> 172.21.15.138:0/2624416424 conn(0x7f70240ffed0 msgr2=0x7f7024079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 shutdown_connections 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:18.410+0000 7f702b869700 1 -- 172.21.15.138:0/2624416424 wait complete. 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:mon is available 2024-02-15T22:41:18.901 INFO:teuthology.orchestra.run.smithi138.stdout:Assimilating anything we can from ceph.conf... 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: mon.smithi138 is new leader, mons smithi138 in quorum (ranks 0) 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: monmap e1: 1 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: fsmap 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: osdmap e1: 0 total, 0 up, 0 in 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: mgrmap e1: no daemons active 2024-02-15T22:41:19.130 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:18 smithi138 ceph-mon[28862]: from='client.? 172.21.15.138:0/2624416424' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-15T22:41:19.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:19 smithi138 ceph-mon[28862]: from='client.? 172.21.15.138:0/3290172009' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T22:41:19.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:19 smithi138 ceph-mon[28862]: from='client.? 172.21.15.138:0/3290172009' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [global] 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout fsid = 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.138:3300,v1:172.21.15.138:6789] 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:20.012 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [osd] 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.356+0000 7f5ff6ef1700 1 Processor -- start 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.356+0000 7f5ff6ef1700 1 -- start start 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff6ef1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff6ef1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0108b00 con 0x7f5ff0074450 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff4c8d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:20.013 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff4c8d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48450/0 (socket says 172.21.15.138:48450) 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff4c8d700 1 -- 172.21.15.138:0/2471337353 learned_addr learned my addr 172.21.15.138:0/2471337353 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff4c8d700 1 -- 172.21.15.138:0/2471337353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0108c40 con 0x7f5ff0074450 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5ff4c8d700 1 --2- 172.21.15.138:0/2471337353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098a0 tx=0x7f5fe4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd94512c32808ff server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5fef7fe700 1 -- 172.21.15.138:0/2471337353 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fe4004180 con 0x7f5ff0074450 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5fef7fe700 1 -- 172.21.15.138:0/2471337353 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40042e0 con 0x7f5ff0074450 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.357+0000 7f5fef7fe700 1 -- 172.21.15.138:0/2471337353 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fe40036a0 con 0x7f5ff0074450 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/2471337353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 msgr2=0x7f5ff01085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 --2- 172.21.15.138:0/2471337353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40098a0 tx=0x7f5fe4009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/2471337353 shutdown_connections 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 --2- 172.21.15.138:0/2471337353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff01085c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/2471337353 >> 172.21.15.138:0/2471337353 conn(0x7f5ff00fff10 msgr2=0x7f5ff0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/2471337353 shutdown_connections 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/2471337353 wait complete. 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.358+0000 7f5ff6ef1700 1 Processor -- start 2024-02-15T22:41:20.014 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff6ef1700 1 -- start start 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff6ef1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff6ef1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0106450 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff4c8d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff4c8d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48456/0 (socket says 172.21.15.138:48456) 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff4c8d700 1 -- 172.21.15.138:0/3290172009 learned_addr learned my addr 172.21.15.138:0/3290172009 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff4c8d700 1 -- 172.21.15.138:0/3290172009 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4009550 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff4c8d700 1 --2- 172.21.15.138:0/3290172009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4004000 tx=0x7f5fe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fe4003ce0 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4020070 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff0104560 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.359+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fe4011630 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.360+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0104a00 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.360+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5fe4022030 con 0x7f5ff0074450 2024-02-15T22:41:20.015 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.360+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5fe4025d40 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.361+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff0062380 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.363+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5fe4025480 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.430+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5ff0192b60 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.434+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5fe4011bd0 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.434+0000 7f5fedffb700 1 -- 172.21.15.138:0/3290172009 <== mon.0 v2:172.21.15.138:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f5fe4037590 con 0x7f5ff0074450 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 msgr2=0x7f5ff0105f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 --2- 172.21.15.138:0/3290172009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4004000 tx=0x7f5fe4004750 comp rx=0 tx=0).stop 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 shutdown_connections 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 --2- 172.21.15.138:0/3290172009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ff0074450 0x7f5ff0105f10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 >> 172.21.15.138:0/3290172009 conn(0x7f5ff00fff10 msgr2=0x7f5ff0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 shutdown_connections 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:19.435+0000 7f5ff6ef1700 1 -- 172.21.15.138:0/3290172009 wait complete. 2024-02-15T22:41:20.016 INFO:teuthology.orchestra.run.smithi138.stdout:Generating new minimal ceph.conf... 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.460+0000 7fcf9d042700 1 Processor -- start 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.460+0000 7fcf9d042700 1 -- start start 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.460+0000 7fcf9d042700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.460+0000 7fcf9d042700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf98105200 con 0x7fcf981048b0 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:21.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48466/0 (socket says 172.21.15.138:48466) 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf96d9d700 1 -- 172.21.15.138:0/1822075346 learned_addr learned my addr 172.21.15.138:0/1822075346 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf96d9d700 1 -- 172.21.15.138:0/1822075346 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98105340 con 0x7fcf981048b0 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf96d9d700 1 --2- 172.21.15.138:0/1822075346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098a0 tx=0x7fcf8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678ee3e18debf627 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf95d9b700 1 -- 172.21.15.138:0/1822075346 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf8c004180 con 0x7fcf981048b0 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf95d9b700 1 -- 172.21.15.138:0/1822075346 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcf8c0042e0 con 0x7fcf981048b0 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.461+0000 7fcf95d9b700 1 -- 172.21.15.138:0/1822075346 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf8c011a50 con 0x7fcf981048b0 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 -- 172.21.15.138:0/1822075346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 msgr2=0x7fcf98104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 --2- 172.21.15.138:0/1822075346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098a0 tx=0x7fcf8c009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 -- 172.21.15.138:0/1822075346 shutdown_connections 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 --2- 172.21.15.138:0/1822075346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf98104cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 -- 172.21.15.138:0/1822075346 >> 172.21.15.138:0/1822075346 conn(0x7fcf980ffee0 msgr2=0x7fcf98102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:21.043 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 -- 172.21.15.138:0/1822075346 shutdown_connections 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 -- 172.21.15.138:0/1822075346 wait complete. 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.462+0000 7fcf9d042700 1 Processor -- start 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf9d042700 1 -- start start 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf9d042700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf9d042700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf98199c10 con 0x7fcf981048b0 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf96d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48472/0 (socket says 172.21.15.138:48472) 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf96d9d700 1 -- 172.21.15.138:0/2790616648 learned_addr learned my addr 172.21.15.138:0/2790616648 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf96d9d700 1 -- 172.21.15.138:0/2790616648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009550 con 0x7fcf981048b0 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf96d9d700 1 --2- 172.21.15.138:0/2790616648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c003de0 tx=0x7fcf8c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:21.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.463+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf8c003930 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf98199e10 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcf8c003a90 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf8c019730 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9819a2b0 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf8c019cd0 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.464+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf8c02c3a0 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.465+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf98062380 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.467+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fcf8c01abc0 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.533+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fcf98106720 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.534+0000 7fcf7ffff700 1 -- 172.21.15.138:0/2790616648 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fcf8c01a430 con 0x7fcf981048b0 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 msgr2=0x7fcf981996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 --2- 172.21.15.138:0/2790616648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c003de0 tx=0x7fcf8c011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:21.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 shutdown_connections 2024-02-15T22:41:21.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 --2- 172.21.15.138:0/2790616648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf981048b0 0x7fcf981996d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:21.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 >> 172.21.15.138:0/2790616648 conn(0x7fcf980ffee0 msgr2=0x7fcf98079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:21.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 shutdown_connections 2024-02-15T22:41:21.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:20.535+0000 7fcf9d042700 1 -- 172.21.15.138:0/2790616648 wait complete. 2024-02-15T22:41:21.046 INFO:teuthology.orchestra.run.smithi138.stdout:Restarting the monitor... 2024-02-15T22:41:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:20 smithi138 ceph-mon[28862]: from='client.? 172.21.15.138:0/2790616648' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:41:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:41:21.630 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[28858]: 2024-02-15T22:41:21.320+0000 7f5f49793700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:41:21.630 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[28858]: 2024-02-15T22:41:21.320+0000 7f5f49793700 -1 mon.smithi138@0(leader) e1 *** Got Signal Terminated *** 2024-02-15T22:41:21.630 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 podman[29107]: 2024-02-15 22:41:21.341290199 +0000 UTC m=+0.143534475 container died 8549a9d6291207e919b852f006b5314521a5c7adbae9adeedc1eb6a59d20429d (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-15T22:41:21.964 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 podman[29107]: 2024-02-15 22:41:21.736894691 +0000 UTC m=+0.539138987 container cleanup 8549a9d6291207e919b852f006b5314521a5c7adbae9adeedc1eb6a59d20429d (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-15T22:41:21.964 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 bash[29107]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138 2024-02-15T22:41:22.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:21 smithi138 podman[29121]: 2024-02-15 22:41:21.962708191 +0000 UTC m=+0.615558983 container remove 8549a9d6291207e919b852f006b5314521a5c7adbae9adeedc1eb6a59d20429d (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1) 2024-02-15T22:41:22.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service: Deactivated successfully. 2024-02-15T22:41:22.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 systemd[1]: Stopped Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:41:22.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 systemd[1]: Starting Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 podman[29210]: 2024-02-15 22:41:22.209191912 +0000 UTC m=+0.019005249 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 podman[29210]: 2024-02-15 22:41:22.330083545 +0000 UTC m=+0.139896871 container create 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD) 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 podman[29210]: 2024-02-15 22:41:22.515999457 +0000 UTC m=+0.325812784 container init 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1) 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 podman[29210]: 2024-02-15 22:41:22.518996554 +0000 UTC m=+0.328809890 container start 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0) 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: pidfile_write: ignore empty --pid-file 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: load: jerasure load: lrc 2024-02-15T22:41:22.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: RocksDB version: 7.9.2 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Git sha 0 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Compile date 2023-08-03 19:21:13 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: DB SUMMARY 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: DB Session ID: OESSYX9KWX1NTASVREAV 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi138/store.db dir, Total Num: 1, files: 000008.sst 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi138/store.db: 000009.log size: 97424 ; 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:41:22.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.env: 0x55556697f720 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.fs: PosixFileSystem 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.info_log: 0x5555697932c0 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.statistics: (nil) 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.use_fsync: 0 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:41:22.595 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.db_log_dir: 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.wal_dir: 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:41:22.596 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.write_buffer_manager: 0x555568a043c0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.unordered_write: 0 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:41:22.597 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.row_cache: None 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.wal_filter: None 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.wal_compression: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:41:22.598 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:41:22.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_open_files: -1 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Compression algorithms supported: 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kZSTD supported: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:41:22.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000010 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.merge_operator: 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_filter: None 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:41:22.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5555697933c0) 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_type: 0 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_index_type: 0 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_shortening: 1 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: checksum: 4 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: no_block_cache: 0 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache: 0x555568aa5350 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_options: 2024-02-15T22:41:22.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: capacity : 536870912 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_shard_bits : 4 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: strict_capacity_limit : 0 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_compressed: (nil) 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: persistent_cache: (nil) 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size: 4096 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size_deviation: 10 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_restart_interval: 16 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_block_restart_interval: 1 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: metadata_block_size: 4096 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: partition_filters: 0 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: use_delta_encoding: 1 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: filter_policy: bloomfilter 2024-02-15T22:41:22.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: whole_key_filtering: 1 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: verify_compression: 0 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: format_version: 5 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_index_compression: 1 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_align: 0 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_auto_readahead_size: 262144 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: prepopulate_block_cache: 0 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: initial_auto_readahead_size: 8192 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_file_reads_for_auto_readahead: 2 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression: NoCompression 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:41:22.604 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.num_levels: 7 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:41:22.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:41:22.606 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.arena_block_size: 1048576 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:41:22.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:41:22.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.ttl: 2592000 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:41:22.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.blob_file_starting_level: 0 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a8152ccf-1195-4574-a017-cbda5479be72 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036882547949, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036882549352, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92774, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 90791, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83506, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 269, "num_filter_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708036882, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a8152ccf-1195-4574-a017-cbda5479be72", "db_session_id": "OESSYX9KWX1NTASVREAV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-15T22:41:22.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708036882549474, "job": 1, "event": "recovery_finished"} 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi138/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555568b42000 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: DB pointer 0x555568b2e000 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** DB Stats ** 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.611 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: L0 2/0 92.47 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Sum 2/0 92.47 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-15T22:41:22.612 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative compaction: 0.00 GB write, 21.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval compaction: 0.00 GB write, 21.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache BinnedLRUCache@0x555568aa5350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:41:22.613 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: starting mon.smithi138 rank 0 at public addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] at bind addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi138 fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???) e1 preinit fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).mds e1 new map 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).mds e1 print_map 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: e1 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: legacy client fscid: -1 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: No filesystems configured 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 bash[29210]: 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 2024-02-15T22:41:22.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 systemd[1]: Started Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:41:22.615 INFO:teuthology.orchestra.run.smithi138.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-15T22:41:22.876 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mon.smithi138 is new leader, mons smithi138 in quorum (ranks 0) 2024-02-15T22:41:22.876 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: monmap e1: 1 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0]} removed_ranks: {} 2024-02-15T22:41:22.876 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: fsmap 2024-02-15T22:41:22.876 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: osdmap e1: 0 total, 0 up, 0 in 2024-02-15T22:41:22.876 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:22 smithi138 ceph-mon[29229]: mgrmap e1: no daemons active 2024-02-15T22:41:23.905 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca3d58c700 1 Processor -- start 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca3d58c700 1 -- start start 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca3d58c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca3d58c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38105200 con 0x7fca381048b0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca36ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca36ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48486/0 (socket says 172.21.15.138:48486) 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca36ffd700 1 -- 172.21.15.138:0/2906718537 learned_addr learned my addr 172.21.15.138:0/2906718537 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.096+0000 7fca36ffd700 1 -- 172.21.15.138:0/2906718537 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38105340 con 0x7fca381048b0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca36ffd700 1 --2- 172.21.15.138:0/2906718537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca280098a0 tx=0x7fca28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fea99d846b0153 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca35ffb700 1 -- 172.21.15.138:0/2906718537 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca28004180 con 0x7fca381048b0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca35ffb700 1 -- 172.21.15.138:0/2906718537 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca280042e0 con 0x7fca381048b0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca35ffb700 1 -- 172.21.15.138:0/2906718537 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca28011a50 con 0x7fca381048b0 2024-02-15T22:41:23.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca3d58c700 1 -- 172.21.15.138:0/2906718537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 msgr2=0x7fca38104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca3d58c700 1 --2- 172.21.15.138:0/2906718537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fca280098a0 tx=0x7fca28009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca3d58c700 1 -- 172.21.15.138:0/2906718537 shutdown_connections 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca3d58c700 1 --2- 172.21.15.138:0/2906718537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38104cc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.097+0000 7fca3d58c700 1 -- 172.21.15.138:0/2906718537 >> 172.21.15.138:0/2906718537 conn(0x7fca380ffee0 msgr2=0x7fca38102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 -- 172.21.15.138:0/2906718537 shutdown_connections 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 -- 172.21.15.138:0/2906718537 wait complete. 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 Processor -- start 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 -- start start 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.098+0000 7fca3d58c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38199c40 con 0x7fca381048b0 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca36ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca36ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:48500/0 (socket says 172.21.15.138:48500) 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca36ffd700 1 -- 172.21.15.138:0/791352175 learned_addr learned my addr 172.21.15.138:0/791352175 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca36ffd700 1 -- 172.21.15.138:0/791352175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28009550 con 0x7fca381048b0 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca36ffd700 1 --2- 172.21.15.138:0/791352175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca28003f80 tx=0x7fca28011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:23.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca28003a80 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca28003be0 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca28019820 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca38199e40 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3819a2e0 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.099+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca2802d440 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.100+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fca28024810 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.100+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca38062380 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.102+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fca2801acc0 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.169+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fca381067a0 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.171+0000 7fca1ffff700 1 -- 172.21.15.138:0/791352175 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fca28005a20 con 0x7fca381048b0 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 msgr2=0x7fca38199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 --2- 172.21.15.138:0/791352175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fca28003f80 tx=0x7fca28011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 shutdown_connections 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 --2- 172.21.15.138:0/791352175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca381048b0 0x7fca38199700 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 >> 172.21.15.138:0/791352175 conn(0x7fca380ffee0 msgr2=0x7fca38101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:23.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.172+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 shutdown_connections 2024-02-15T22:41:23.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:23.173+0000 7fca3d58c700 1 -- 172.21.15.138:0/791352175 wait complete. 2024-02-15T22:41:23.909 INFO:teuthology.orchestra.run.smithi138.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-15T22:41:23.931 INFO:teuthology.orchestra.run.smithi138.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:41:23.931 INFO:teuthology.orchestra.run.smithi138.stdout:Creating mgr... 2024-02-15T22:41:23.932 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-15T22:41:23.932 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-15T22:41:23.932 INFO:teuthology.orchestra.run.smithi138.stdout:Verifying port 0.0.0.0:8443 ... 2024-02-15T22:41:24.166 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mgr.smithi138.jqscxs 2024-02-15T22:41:24.166 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mgr.smithi138.jqscxs.service: Unit ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mgr.smithi138.jqscxs.service not loaded. 2024-02-15T22:41:24.309 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715.target.wants/ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mgr.smithi138.jqscxs.service → /etc/systemd/system/ceph-3fa87466-cc53-11ee-95ba-87774f69a715@.service. 2024-02-15T22:41:24.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:24 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/791352175' entity='client.admin' 2024-02-15T22:41:24.824 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:41:24.825 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout disabled 2024-02-15T22:41:24.832 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:41:24.832 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:41:24.832 INFO:teuthology.orchestra.run.smithi138.stdout:firewalld.service is not enabled 2024-02-15T22:41:24.832 INFO:teuthology.orchestra.run.smithi138.stdout:Not possible to enable service . firewalld.service is not available 2024-02-15T22:41:24.840 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:41:24.840 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout disabled 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:firewalld.service is not enabled 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mgr to start... 2024-02-15T22:41:24.847 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mgr... 2024-02-15T22:41:25.633 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:25 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3001510502' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:41:25.896 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:25.896 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsid": "3fa87466-cc53-11ee-95ba-87774f69a715", 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "smithi138" 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:41:25.897 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:41:25.898 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:41:25.905 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:41:25.905 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:41:25.905 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.905 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:41:25.906 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:41:17.864460+0000", 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:25.907 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.246+0000 7fa8cf51b700 1 Processor -- start 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.246+0000 7fa8cf51b700 1 -- start start 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.246+0000 7fa8cf51b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.246+0000 7fa8cf51b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8104600 con 0x7fa8c8103cb0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8cd2b7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8cd2b7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51884/0 (socket says 172.21.15.138:51884) 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8cd2b7700 1 -- 172.21.15.138:0/1321722053 learned_addr learned my addr 172.21.15.138:0/1321722053 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8cd2b7700 1 -- 172.21.15.138:0/1321722053 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8104740 con 0x7fa8c8103cb0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8cd2b7700 1 --2- 172.21.15.138:0/1321722053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098a0 tx=0x7fa8b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc01eb875440832 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8bffff700 1 -- 172.21.15.138:0/1321722053 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8b8004180 con 0x7fa8c8103cb0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8bffff700 1 -- 172.21.15.138:0/1321722053 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8b80042e0 con 0x7fa8c8103cb0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.247+0000 7fa8bffff700 1 -- 172.21.15.138:0/1321722053 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8b8011a50 con 0x7fa8c8103cb0 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 -- 172.21.15.138:0/1321722053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 msgr2=0x7fa8c81040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:25.908 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 --2- 172.21.15.138:0/1321722053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098a0 tx=0x7fa8b8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 -- 172.21.15.138:0/1321722053 shutdown_connections 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 --2- 172.21.15.138:0/1321722053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c81040c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 -- 172.21.15.138:0/1321722053 >> 172.21.15.138:0/1321722053 conn(0x7fa8c80ff670 msgr2=0x7fa8c8101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 -- 172.21.15.138:0/1321722053 shutdown_connections 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.248+0000 7fa8cf51b700 1 -- 172.21.15.138:0/1321722053 wait complete. 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cf51b700 1 Processor -- start 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cf51b700 1 -- start start 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cf51b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cf51b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8199c90 con 0x7fa8c8103cb0 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cd2b7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cd2b7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51894/0 (socket says 172.21.15.138:51894) 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cd2b7700 1 -- 172.21.15.138:0/3001510502 learned_addr learned my addr 172.21.15.138:0/3001510502 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cd2b7700 1 -- 172.21.15.138:0/3001510502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009550 con 0x7fa8c8103cb0 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.249+0000 7fa8cd2b7700 1 --2- 172.21.15.138:0/3001510502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8003de0 tx=0x7fa8b8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8b8003930 con 0x7fa8c8103cb0 2024-02-15T22:41:25.909 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8b8003a90 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8b80196c0 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c8199e90 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c819a330 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa8b8019c80 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.250+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa8b802c3a0 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.251+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c8062380 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.253+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa8b801abc0 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.325+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa8c819cd50 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.325+0000 7fa8be7fc700 1 -- 172.21.15.138:0/3001510502 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fa8b8005a20 con 0x7fa8c8103cb0 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 msgr2=0x7fa8c8199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 --2- 172.21.15.138:0/3001510502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8003de0 tx=0x7fa8b8011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 shutdown_connections 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 --2- 172.21.15.138:0/3001510502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8c8103cb0 0x7fa8c8199750 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 >> 172.21.15.138:0/3001510502 conn(0x7fa8c80ff670 msgr2=0x7fa8c8100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 shutdown_connections 2024-02-15T22:41:25.910 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:25.327+0000 7fa8cf51b700 1 -- 172.21.15.138:0/3001510502 wait complete. 2024-02-15T22:41:25.911 INFO:teuthology.orchestra.run.smithi138.stdout:mgr not available, waiting (1/15)... 2024-02-15T22:41:28.904 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1560475759' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: mgrmap e2: smithi138.jqscxs(active, starting, since 0.00325665s) 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:31.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:41:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:31 smithi138 ceph-mon[29229]: from='mgr.14100 172.21.15.138:0/3831074450' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:33.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:33 smithi138 ceph-mon[29229]: mgrmap e3: smithi138.jqscxs(active, since 1.00732s) 2024-02-15T22:41:34.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsid": "3fa87466-cc53-11ee-95ba-87774f69a715", 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "smithi138" 2024-02-15T22:41:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:41:34.192 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:41:34.193 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.194 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:41:17.864460+0000", 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.292+0000 7f88dfb55700 1 Processor -- start 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dfb55700 1 -- start start 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dfb55700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dfb55700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8105710 con 0x7f88d8104dc0 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dd8f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dd8f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51910/0 (socket says 172.21.15.138:51910) 2024-02-15T22:41:34.195 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.293+0000 7f88dd8f1700 1 -- 172.21.15.138:0/3876082815 learned_addr learned my addr 172.21.15.138:0/3876082815 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.294+0000 7f88dd8f1700 1 -- 172.21.15.138:0/3876082815 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8105850 con 0x7f88d8104dc0 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.294+0000 7f88dd8f1700 1 --2- 172.21.15.138:0/3876082815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098a0 tx=0x7f88d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60334dd90fac36a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.294+0000 7f88dc8ef700 1 -- 172.21.15.138:0/3876082815 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d4004180 con 0x7f88d8104dc0 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.294+0000 7f88dc8ef700 1 -- 172.21.15.138:0/3876082815 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88d40042e0 con 0x7f88d8104dc0 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.294+0000 7f88dc8ef700 1 -- 172.21.15.138:0/3876082815 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d4011a50 con 0x7f88d8104dc0 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- 172.21.15.138:0/3876082815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 msgr2=0x7f88d81051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 --2- 172.21.15.138:0/3876082815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88d40098a0 tx=0x7f88d4009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- 172.21.15.138:0/3876082815 shutdown_connections 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 --2- 172.21.15.138:0/3876082815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d81051d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- 172.21.15.138:0/3876082815 >> 172.21.15.138:0/3876082815 conn(0x7f88d80ff670 msgr2=0x7f88d8101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:34.196 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- 172.21.15.138:0/3876082815 shutdown_connections 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- 172.21.15.138:0/3876082815 wait complete. 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 Processor -- start 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.295+0000 7f88dfb55700 1 -- start start 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dfb55700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dfb55700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d818ffc0 con 0x7f88d8104dc0 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dd8f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dd8f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51916/0 (socket says 172.21.15.138:51916) 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dd8f1700 1 -- 172.21.15.138:0/1560475759 learned_addr learned my addr 172.21.15.138:0/1560475759 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dd8f1700 1 -- 172.21.15.138:0/1560475759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009550 con 0x7f88d8104dc0 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dd8f1700 1 --2- 172.21.15.138:0/1560475759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88d4003de0 tx=0x7f88d4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:34.197 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d4003930 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88d4003a90 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d818e0d0 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d40196c0 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.296+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d818e570 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.297+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88d4019c50 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.297+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f88d402c3a0 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.297+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8062380 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.299+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f88d401abc0 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.374+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f88d818ef70 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.374+0000 7f88ceffd700 1 -- 172.21.15.138:0/1560475759 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f88d401a430 con 0x7f88d8104dc0 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 msgr2=0x7f88d818fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:34.198 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 --2- 172.21.15.138:0/1560475759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88d4003de0 tx=0x7f88d4011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 shutdown_connections 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 --2- 172.21.15.138:0/1560475759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88d8104dc0 0x7f88d818fa80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 >> 172.21.15.138:0/1560475759 conn(0x7f88d80ff670 msgr2=0x7f88d81042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 shutdown_connections 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:28.375+0000 7f88dfb55700 1 -- 172.21.15.138:0/1560475759 wait complete. 2024-02-15T22:41:34.199 INFO:teuthology.orchestra.run.smithi138.stdout:mgr not available, waiting (2/15)... 2024-02-15T22:41:35.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:35 smithi138 ceph-mon[29229]: mgrmap e4: smithi138.jqscxs(active, since 3s) 2024-02-15T22:41:40.144 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:40 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1362555828' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsid": "3fa87466-cc53-11ee-95ba-87774f69a715", 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "health": { 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 0 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:40.983 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "smithi138" 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-15T22:41:40.984 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.985 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "restful" 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ], 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:40.986 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "modified": "2024-02-15T22:41:17.864460+0000", 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout }, 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd932fa700 1 Processor -- start 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd932fa700 1 -- start start 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd932fa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd932fa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c07a830 con 0x7efd8c07bdf0 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd91096700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd91096700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51330/0 (socket says 172.21.15.138:51330) 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.699+0000 7efd91096700 1 -- 172.21.15.138:0/3408842489 learned_addr learned my addr 172.21.15.138:0/3408842489 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:40.987 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.700+0000 7efd91096700 1 -- 172.21.15.138:0/3408842489 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c07a970 con 0x7efd8c07bdf0 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.700+0000 7efd91096700 1 --2- 172.21.15.138:0/3408842489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd88009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521c16101b69eb72 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.700+0000 7efd83fff700 1 -- 172.21.15.138:0/3408842489 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd88005c30 con 0x7efd8c07bdf0 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.700+0000 7efd83fff700 1 -- 172.21.15.138:0/3408842489 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd88005d90 con 0x7efd8c07bdf0 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.700+0000 7efd83fff700 1 -- 172.21.15.138:0/3408842489 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd88006030 con 0x7efd8c07bdf0 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 -- 172.21.15.138:0/3408842489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 msgr2=0x7efd8c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 --2- 172.21.15.138:0/3408842489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd88009b80 comp rx=0 tx=0).stop 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 -- 172.21.15.138:0/3408842489 shutdown_connections 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 --2- 172.21.15.138:0/3408842489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c07a2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 -- 172.21.15.138:0/3408842489 >> 172.21.15.138:0/3408842489 conn(0x7efd8c101020 msgr2=0x7efd8c103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 -- 172.21.15.138:0/3408842489 shutdown_connections 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 -- 172.21.15.138:0/3408842489 wait complete. 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.701+0000 7efd932fa700 1 Processor -- start 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd932fa700 1 -- start start 2024-02-15T22:41:40.988 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd932fa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd932fa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c19bdf0 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd91096700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd91096700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51332/0 (socket says 172.21.15.138:51332) 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd91096700 1 -- 172.21.15.138:0/1362555828 learned_addr learned my addr 172.21.15.138:0/1362555828 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd91096700 1 -- 172.21.15.138:0/1362555828 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88009500 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd91096700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efd88004230 tx=0x7efd88004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd880044f0 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd88006580 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c19bff0 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd88011be0 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.702+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c19c490 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.703+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7efd88018070 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.703+0000 7efd827fc700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 0x7efd7803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.703+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efd8804b9b0 con 0x7efd8c07bdf0 2024-02-15T22:41:40.989 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.703+0000 7efd90895700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 0x7efd7803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.703+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c062380 con 0x7efd8c07bdf0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.704+0000 7efd90895700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 0x7efd7803a810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd7c006fd0 tx=0x7efd7c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.709+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd88022350 con 0x7efd8c07bdf0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.982+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efd8c19ee50 con 0x7efd8c07bdf0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.983+0000 7efd827fc700 1 -- 172.21.15.138:0/1362555828 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7efd8801a370 con 0x7efd8c07bdf0 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 msgr2=0x7efd7803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 0x7efd7803a810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd7c006fd0 tx=0x7efd7c006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 msgr2=0x7efd8c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efd88004230 tx=0x7efd88004260 comp rx=0 tx=0).stop 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 shutdown_connections 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7efd78038360 0x7efd7803a810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 --2- 172.21.15.138:0/1362555828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8c07bdf0 0x7efd8c19b8b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:40.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 >> 172.21.15.138:0/1362555828 conn(0x7efd8c101020 msgr2=0x7efd8c101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:40.991 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 shutdown_connections 2024-02-15T22:41:40.991 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:39.985+0000 7efd932fa700 1 -- 172.21.15.138:0/1362555828 wait complete. 2024-02-15T22:41:40.991 INFO:teuthology.orchestra.run.smithi138.stdout:mgr is available 2024-02-15T22:41:41.916 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:41 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/563750630' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T22:41:42.185 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:42.185 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [global] 2024-02-15T22:41:42.185 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout fsid = 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:42.185 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout [osd] 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-15T22:41:42.186 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.427+0000 7f5854d75700 1 Processor -- start 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.427+0000 7f5854d75700 1 -- start start 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f5854d75700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f5854d75700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850106320 con 0x7f58501059d0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51348/0 (socket says 172.21.15.138:51348) 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584e59c700 1 -- 172.21.15.138:0/2345267562 learned_addr learned my addr 172.21.15.138:0/2345267562 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584e59c700 1 -- 172.21.15.138:0/2345267562 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850106460 con 0x7f58501059d0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584e59c700 1 --2- 172.21.15.138:0/2345267562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5848009870 tx=0x7f5848009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35878f9d57add63c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584d59a700 1 -- 172.21.15.138:0/2345267562 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5848005c30 con 0x7f58501059d0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584d59a700 1 -- 172.21.15.138:0/2345267562 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5848005d90 con 0x7f58501059d0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.428+0000 7f584d59a700 1 -- 172.21.15.138:0/2345267562 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5848006030 con 0x7f58501059d0 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 -- 172.21.15.138:0/2345267562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 msgr2=0x7f5850105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 --2- 172.21.15.138:0/2345267562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5848009870 tx=0x7f5848009b80 comp rx=0 tx=0).stop 2024-02-15T22:41:42.187 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 -- 172.21.15.138:0/2345267562 shutdown_connections 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 --2- 172.21.15.138:0/2345267562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850105de0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 -- 172.21.15.138:0/2345267562 >> 172.21.15.138:0/2345267562 conn(0x7f5850101020 msgr2=0x7f5850103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 -- 172.21.15.138:0/2345267562 shutdown_connections 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.429+0000 7f5854d75700 1 -- 172.21.15.138:0/2345267562 wait complete. 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f5854d75700 1 Processor -- start 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f5854d75700 1 -- start start 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f5854d75700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f5854d75700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850199ba0 con 0x7f58501059d0 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f584e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f584e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51352/0 (socket says 172.21.15.138:51352) 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f584e59c700 1 -- 172.21.15.138:0/563750630 learned_addr learned my addr 172.21.15.138:0/563750630 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.430+0000 7f584e59c700 1 -- 172.21.15.138:0/563750630 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009500 con 0x7f58501059d0 2024-02-15T22:41:42.188 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f584e59c700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5848006160 tx=0x7f5848006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5848004430 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5848006760 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5850199da0 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5848011d00 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.431+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585019a240 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f5848018070 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f583f7fe700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 0x7f583803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f584804bbd0 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5850062380 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f584dd9b700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 0x7f583803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.432+0000 7f584dd9b700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 0x7f583803a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.437+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f584800b810 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.622+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5850107840 con 0x7f58501059d0 2024-02-15T22:41:42.189 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.623+0000 7f583f7fe700 1 -- 172.21.15.138:0/563750630 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f58480062f0 con 0x7f58501059d0 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 msgr2=0x7f583803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 0x7f583803a860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 msgr2=0x7f5850199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5848006160 tx=0x7f5848006190 comp rx=0 tx=0).stop 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 shutdown_connections 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f58380383b0 0x7f583803a860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 --2- 172.21.15.138:0/563750630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f58501059d0 0x7f5850199660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 >> 172.21.15.138:0/563750630 conn(0x7f5850101020 msgr2=0x7f5850101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 shutdown_connections 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:41.625+0000 7f5854d75700 1 -- 172.21.15.138:0/563750630 wait complete. 2024-02-15T22:41:42.190 INFO:teuthology.orchestra.run.smithi138.stdout:Enabling cephadm module... 2024-02-15T22:41:43.881 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:43 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3567464996' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-15T22:41:44.166 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.602+0000 7fe03852f700 1 Processor -- start 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.602+0000 7fe03852f700 1 -- start start 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.602+0000 7fe03852f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.602+0000 7fe03852f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03007a810 con 0x7fe03007bdd0 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0362cb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0362cb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51368/0 (socket says 172.21.15.138:51368) 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0362cb700 1 -- 172.21.15.138:0/2982718326 learned_addr learned my addr 172.21.15.138:0/2982718326 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0362cb700 1 -- 172.21.15.138:0/2982718326 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03007a950 con 0x7fe03007bdd0 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0362cb700 1 --2- 172.21.15.138:0/2982718326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0200098a0 tx=0x7fe020009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32ead532e335e92 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:44.167 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0352c9700 1 -- 172.21.15.138:0/2982718326 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe020004180 con 0x7fe03007bdd0 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0352c9700 1 -- 172.21.15.138:0/2982718326 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe0200042e0 con 0x7fe03007bdd0 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.603+0000 7fe0352c9700 1 -- 172.21.15.138:0/2982718326 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe020011a50 con 0x7fe03007bdd0 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- 172.21.15.138:0/2982718326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 msgr2=0x7fe03007a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 --2- 172.21.15.138:0/2982718326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0200098a0 tx=0x7fe020009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- 172.21.15.138:0/2982718326 shutdown_connections 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 --2- 172.21.15.138:0/2982718326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03007a2d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- 172.21.15.138:0/2982718326 >> 172.21.15.138:0/2982718326 conn(0x7fe030101020 msgr2=0x7fe030103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- 172.21.15.138:0/2982718326 shutdown_connections 2024-02-15T22:41:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- 172.21.15.138:0/2982718326 wait complete. 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 Processor -- start 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.604+0000 7fe03852f700 1 -- start start 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe03852f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe03852f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03019be50 con 0x7fe03007bdd0 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe0362cb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe0362cb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51370/0 (socket says 172.21.15.138:51370) 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe0362cb700 1 -- 172.21.15.138:0/3567464996 learned_addr learned my addr 172.21.15.138:0/3567464996 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe0362cb700 1 -- 172.21.15.138:0/3567464996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020009550 con 0x7fe03007bdd0 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe0362cb700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe020006af0 tx=0x7fe020011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe020003b90 con 0x7fe03007bdd0 2024-02-15T22:41:44.169 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03019c050 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe02001a8a0 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe020019880 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.605+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03019c4f0 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.606+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fe020019b40 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.606+0000 7fe02f7fe700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 0x7fe01803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.606+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe02004c6c0 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.606+0000 7fe035aca700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 0x7fe01803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.606+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe030062380 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.607+0000 7fe035aca700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 0x7fe01803a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe024006fd0 tx=0x7fe024006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.611+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe02002c3a0 con 0x7fe03007bdd0 2024-02-15T22:41:44.170 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:42.852+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fe03019eeb0 con 0x7fe03007bdd0 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.563+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fe02000fda0 con 0x7fe03007bdd0 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.565+0000 7fe02f7fe700 1 -- 172.21.15.138:0/3567464996 <== mon.0 v2:172.21.15.138:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fe02001aa10 con 0x7fe03007bdd0 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 msgr2=0x7fe01803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 0x7fe01803a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe024006fd0 tx=0x7fe024006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 msgr2=0x7fe03019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe020006af0 tx=0x7fe020011a90 comp rx=0 tx=0).stop 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 shutdown_connections 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7fe018038360 0x7fe01803a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 --2- 172.21.15.138:0/3567464996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe03007bdd0 0x7fe03019b910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 >> 172.21.15.138:0/3567464996 conn(0x7fe030101020 msgr2=0x7fe0301026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:44.171 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 shutdown_connections 2024-02-15T22:41:44.172 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:43.568+0000 7fe03852f700 1 -- 172.21.15.138:0/3567464996 wait complete. 2024-02-15T22:41:44.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:44 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3567464996' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-15T22:41:44.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:44 smithi138 ceph-mon[29229]: mgrmap e5: smithi138.jqscxs(active, since 12s) 2024-02-15T22:41:45.466 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:41:45.466 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-15T22:41:45.466 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "active_name": "smithi138.jqscxs", 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c6c0f700 1 Processor -- start 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c6c0f700 1 -- start start 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c6c0f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c6c0f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0106310 con 0x7f32c01059c0 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c49ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c49ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37322/0 (socket says 172.21.15.138:37322) 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.573+0000 7f32c49ab700 1 -- 172.21.15.138:0/2551440945 learned_addr learned my addr 172.21.15.138:0/2551440945 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.574+0000 7f32c49ab700 1 -- 172.21.15.138:0/2551440945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0106450 con 0x7f32c01059c0 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.574+0000 7f32c49ab700 1 --2- 172.21.15.138:0/2551440945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32b40098a0 tx=0x7f32b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8240df74d94cc2e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:45.467 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.574+0000 7f32bf7fe700 1 -- 172.21.15.138:0/2551440945 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b4004180 con 0x7f32c01059c0 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.574+0000 7f32bf7fe700 1 -- 172.21.15.138:0/2551440945 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f32b40042e0 con 0x7f32c01059c0 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.574+0000 7f32bf7fe700 1 -- 172.21.15.138:0/2551440945 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b4011a50 con 0x7f32c01059c0 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2551440945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 msgr2=0x7f32c0105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2551440945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32b40098a0 tx=0x7f32b4009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2551440945 shutdown_connections 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2551440945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c0105dd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2551440945 >> 172.21.15.138:0/2551440945 conn(0x7f32c0100ff0 msgr2=0x7f32c0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2551440945 shutdown_connections 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2551440945 wait complete. 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 Processor -- start 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.575+0000 7f32c6c0f700 1 -- start start 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c6c0f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c6c0f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c007c160 con 0x7f32c01059c0 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c49ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c49ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37324/0 (socket says 172.21.15.138:37324) 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c49ab700 1 -- 172.21.15.138:0/2236623730 learned_addr learned my addr 172.21.15.138:0/2236623730 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c49ab700 1 -- 172.21.15.138:0/2236623730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009550 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c49ab700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32b4003f80 tx=0x7f32b4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b4003a80 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f32b4003be0 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c007a270 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.576+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32b4019820 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.577+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c007a710 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.577+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f32b4019a50 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.578+0000 7f32bdffb700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 0x7f32b003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.578+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f32b404d530 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.578+0000 7f32bffff700 1 -- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 msgr2=0x7f32b003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.578+0000 7f32bffff700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 0x7f32b003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.578+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0062380 con 0x7f32c01059c0 2024-02-15T22:41:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.582+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f32b402c3a0 con 0x7f32c01059c0 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.779+0000 7f32bffff700 1 -- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 msgr2=0x7f32b003a8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.779+0000 7f32bffff700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 0x7f32b003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.833+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f32c007b150 con 0x7f32c01059c0 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.833+0000 7f32bdffb700 1 -- 172.21.15.138:0/2236623730 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f32b404a070 con 0x7f32c01059c0 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.835+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 msgr2=0x7f32b003a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.835+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 0x7f32b003a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.835+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 msgr2=0x7f32c007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.835+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32b4003f80 tx=0x7f32b4011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 shutdown_connections 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f32b00383f0 0x7f32b003a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 --2- 172.21.15.138:0/2236623730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c01059c0 0x7f32c007bc20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 >> 172.21.15.138:0/2236623730 conn(0x7f32c0100ff0 msgr2=0x7f32c0102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 shutdown_connections 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:44.836+0000 7f32c6c0f700 1 -- 172.21.15.138:0/2236623730 wait complete. 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for the mgr to restart... 2024-02-15T22:41:45.470 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mgr epoch 5... 2024-02-15T22:41:45.724 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:45 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2236623730' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: Active manager daemon smithi138.jqscxs restarted 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: osdmap e2: 0 total, 0 up, 0 in 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: mgrmap e6: smithi138.jqscxs(active, starting, since 0.00342439s) 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:41:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:41:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:41:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:41:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:50 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:41:51.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: Found migration_current of "None". Setting to last migration. 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:41:51.444 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:51 smithi138 ceph-mon[29229]: mgrmap e7: smithi138.jqscxs(active, since 1.00558s) 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a68674700 1 Processor -- start 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a68674700 1 -- start start 2024-02-15T22:41:51.746 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a68674700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a68674700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60079d10 con 0x7f1a60106520 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a66410700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a66410700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37336/0 (socket says 172.21.15.138:37336) 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.683+0000 7f1a66410700 1 -- 172.21.15.138:0/371370456 learned_addr learned my addr 172.21.15.138:0/371370456 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.684+0000 7f1a66410700 1 -- 172.21.15.138:0/371370456 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60079e50 con 0x7f1a60106520 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.684+0000 7f1a66410700 1 --2- 172.21.15.138:0/371370456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0098a0 tx=0x7f1a5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ea31abb51e707d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.684+0000 7f1a6540e700 1 -- 172.21.15.138:0/371370456 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a5c004180 con 0x7f1a60106520 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.684+0000 7f1a6540e700 1 -- 172.21.15.138:0/371370456 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a5c0042e0 con 0x7f1a60106520 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.684+0000 7f1a6540e700 1 -- 172.21.15.138:0/371370456 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a5c011a50 con 0x7f1a60106520 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- 172.21.15.138:0/371370456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 msgr2=0x7f1a60108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 --2- 172.21.15.138:0/371370456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0098a0 tx=0x7f1a5c009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- 172.21.15.138:0/371370456 shutdown_connections 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 --2- 172.21.15.138:0/371370456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60108900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- 172.21.15.138:0/371370456 >> 172.21.15.138:0/371370456 conn(0x7f1a600fff00 msgr2=0x7f1a60102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:51.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- 172.21.15.138:0/371370456 shutdown_connections 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- 172.21.15.138:0/371370456 wait complete. 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 Processor -- start 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- start start 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.685+0000 7f1a68674700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a601063c0 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a66410700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a66410700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37346/0 (socket says 172.21.15.138:37346) 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a66410700 1 -- 172.21.15.138:0/3228834420 learned_addr learned my addr 172.21.15.138:0/3228834420 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a66410700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009550 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a66410700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009520 tx=0x7f1a5c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a5c003a80 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a60104530 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a5c003be0 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a5c019750 con 0x7f1a60106520 2024-02-15T22:41:51.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.686+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a60104a30 con 0x7f1a60106520 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f1a5c019a10 con 0x7f1a60106520 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a577fe700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4c03af60 con 0x7f1a4c0383a0 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a65c0f700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1a5c04c540 con 0x7f1a60106520 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.687+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.888+0000 7f1a65c0f700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:46.888+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:47.289+0000 7f1a65c0f700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:47.289+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:48.090+0000 7f1a65c0f700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:48.090+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:49.691+0000 7f1a65c0f700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2998046640 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:49.691+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-15T22:41:51.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:50.176+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7f1a5c01a950 con 0x7f1a60106520 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:50.176+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 msgr2=0x7f1a4c03a850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:50.176+0000 7f1a577fe700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.177+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f1a5c019cc0 con 0x7f1a60106520 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.177+0000 7f1a577fe700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 0x7f1a4c03e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.177+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4c03af60 con 0x7f1a4c03bcc0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.178+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 0x7f1a4c03e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.178+0000 7f1a65c0f700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 0x7f1a4c03e0a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a50003a10 tx=0x7f1a50009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.179+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f1a4c03af60 con 0x7f1a4c03bcc0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1a60105a20 con 0x7f1a4c03bcc0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a577fe700 1 -- 172.21.15.138:0/3228834420 <== mgr.14118 v2:172.21.15.138:6800/2928099655 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1a60105a20 con 0x7f1a4c03bcc0 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 msgr2=0x7f1a4c03e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a68674700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 0x7f1a4c03e0a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a50003a10 tx=0x7f1a50009290 comp rx=0 tx=0).stop 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 msgr2=0x7f1a60105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:51.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.185+0000 7f1a68674700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009520 tx=0x7f1a5c011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 shutdown_connections 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f1a4c03bcc0 0x7f1a4c03e0a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a60106520 0x7f1a60105e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 --2- 172.21.15.138:0/3228834420 >> [v2:172.21.15.138:6800/2998046640,v1:172.21.15.138:6801/2998046640] conn(0x7f1a4c0383a0 0x7f1a4c03a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 >> 172.21.15.138:0/3228834420 conn(0x7f1a600fff00 msgr2=0x7f1a601015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 shutdown_connections 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:51.186+0000 7f1a68674700 1 -- 172.21.15.138:0/3228834420 wait complete. 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:mgr epoch 5 is available 2024-02-15T22:41:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:Setting orchestrator backend to cephadm... 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: [15/Feb/2024:22:41:50] ENGINE Bus STARTING 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: [15/Feb/2024:22:41:50] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: [15/Feb/2024:22:41:51] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: [15/Feb/2024:22:41:51] ENGINE Bus STARTED 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T22:41:52.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:52 smithi138 ceph-mon[29229]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T22:41:52.841 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.130+0000 7f910de5a700 1 Processor -- start 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f910de5a700 1 -- start start 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f910de5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f910de5a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108106320 con 0x7f91081059d0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37404/0 (socket says 172.21.15.138:37404) 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91077fe700 1 -- 172.21.15.138:0/1583844677 learned_addr learned my addr 172.21.15.138:0/1583844677 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91077fe700 1 -- 172.21.15.138:0/1583844677 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108106460 con 0x7f91081059d0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91077fe700 1 --2- 172.21.15.138:0/1583844677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009870 tx=0x7f90f8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81795bc5070ca64c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.131+0000 7f91067fc700 1 -- 172.21.15.138:0/1583844677 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f8005c30 con 0x7f91081059d0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f91067fc700 1 -- 172.21.15.138:0/1583844677 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90f8005d90 con 0x7f91081059d0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f91067fc700 1 -- 172.21.15.138:0/1583844677 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f8006030 con 0x7f91081059d0 2024-02-15T22:41:52.842 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 -- 172.21.15.138:0/1583844677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 msgr2=0x7f9108105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 --2- 172.21.15.138:0/1583844677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009870 tx=0x7f90f8009b80 comp rx=0 tx=0).stop 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 -- 172.21.15.138:0/1583844677 shutdown_connections 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 --2- 172.21.15.138:0/1583844677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108105de0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 -- 172.21.15.138:0/1583844677 >> 172.21.15.138:0/1583844677 conn(0x7f9108101020 msgr2=0x7f9108103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 -- 172.21.15.138:0/1583844677 shutdown_connections 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.132+0000 7f910de5a700 1 -- 172.21.15.138:0/1583844677 wait complete. 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f910de5a700 1 Processor -- start 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f910de5a700 1 -- start start 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f910de5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f910de5a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108199ba0 con 0x7f91081059d0 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f91077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f91077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37418/0 (socket says 172.21.15.138:37418) 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f91077fe700 1 -- 172.21.15.138:0/4161482731 learned_addr learned my addr 172.21.15.138:0/4161482731 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.133+0000 7f91077fe700 1 -- 172.21.15.138:0/4161482731 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8009500 con 0x7f91081059d0 2024-02-15T22:41:52.843 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f91077fe700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006160 tx=0x7f90f8006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f8004430 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90f8006760 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90f8011d00 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108199da0 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.134+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910819a240 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7f90f8018070 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108062380 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f9104ff9700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 0x7f90f003a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f90f804ba40 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f9106ffd700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 0x7f90f003a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.135+0000 7f9106ffd700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 0x7f90f003a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90fc006fd0 tx=0x7f90fc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.140+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f90f800bb40 con 0x7f91081059d0 2024-02-15T22:41:52.844 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.229+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f90f800bd20 con 0x7f91081059d0 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.342+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f9108102490 con 0x7f90f0038290 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.349+0000 7f9104ff9700 1 -- 172.21.15.138:0/4161482731 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9108102490 con 0x7f90f0038290 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.351+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 msgr2=0x7f90f003a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.351+0000 7f910de5a700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 0x7f90f003a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90fc006fd0 tx=0x7f90fc006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.351+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 msgr2=0x7f9108199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.351+0000 7f910de5a700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006160 tx=0x7f90f8006190 comp rx=0 tx=0).stop 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 shutdown_connections 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f90f0038290 0x7f90f003a740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 --2- 172.21.15.138:0/4161482731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91081059d0 0x7f9108199660 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 >> 172.21.15.138:0/4161482731 conn(0x7f9108101020 msgr2=0x7f9108101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 shutdown_connections 2024-02-15T22:41:52.845 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:52.352+0000 7f910de5a700 1 -- 172.21.15.138:0/4161482731 wait complete. 2024-02-15T22:41:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:53 smithi138 ceph-mon[29229]: mgrmap e8: smithi138.jqscxs(active, since 2s) 2024-02-15T22:41:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:53 smithi138 ceph-mon[29229]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:53 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:53 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d2254a700 1 Processor -- start 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d2254a700 1 -- start start 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d2254a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d2254a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c106320 con 0x7f3d1c1059d0 2024-02-15T22:41:54.156 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d1bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d1bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37424/0 (socket says 172.21.15.138:37424) 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.290+0000 7f3d1bfff700 1 -- 172.21.15.138:0/2459800077 learned_addr learned my addr 172.21.15.138:0/2459800077 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d1bfff700 1 -- 172.21.15.138:0/2459800077 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c106460 con 0x7f3d1c1059d0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d1bfff700 1 --2- 172.21.15.138:0/2459800077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009870 tx=0x7f3d0c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145ec06a5fda74d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d1affd700 1 -- 172.21.15.138:0/2459800077 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d0c005c30 con 0x7f3d1c1059d0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d1affd700 1 -- 172.21.15.138:0/2459800077 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d0c005d90 con 0x7f3d1c1059d0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d1affd700 1 -- 172.21.15.138:0/2459800077 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d0c006030 con 0x7f3d1c1059d0 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d2254a700 1 -- 172.21.15.138:0/2459800077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 msgr2=0x7f3d1c105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.291+0000 7f3d2254a700 1 --2- 172.21.15.138:0/2459800077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009870 tx=0x7f3d0c009b80 comp rx=0 tx=0).stop 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 -- 172.21.15.138:0/2459800077 shutdown_connections 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 --2- 172.21.15.138:0/2459800077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c105de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 -- 172.21.15.138:0/2459800077 >> 172.21.15.138:0/2459800077 conn(0x7f3d1c101020 msgr2=0x7f3d1c103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:54.157 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 -- 172.21.15.138:0/2459800077 shutdown_connections 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 -- 172.21.15.138:0/2459800077 wait complete. 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 Processor -- start 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.292+0000 7f3d2254a700 1 -- start start 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d2254a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d2254a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c199ba0 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d1bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d1bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37430/0 (socket says 172.21.15.138:37430) 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d1bfff700 1 -- 172.21.15.138:0/966660947 learned_addr learned my addr 172.21.15.138:0/966660947 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d1bfff700 1 -- 172.21.15.138:0/966660947 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009500 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d1bfff700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c006160 tx=0x7f3d0c006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d0c004430 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d0c006760 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c199da0 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3d0c011d00 con 0x7f3d1c1059d0 2024-02-15T22:41:54.158 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.293+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c19a240 con 0x7f3d1c1059d0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.294+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3d0c018070 con 0x7f3d1c1059d0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.294+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c062380 con 0x7f3d1c1059d0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.294+0000 7f3d197fa700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 0x7f3d0403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.294+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3d0c04ba60 con 0x7f3d1c1059d0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.294+0000 7f3d1b7fe700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 0x7f3d0403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.295+0000 7f3d1b7fe700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 0x7f3d0403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3d10006fd0 tx=0x7f3d10006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.299+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d0c022350 con 0x7f3d1c1059d0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.488+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d1c102440 con 0x7f3d040383b0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.489+0000 7f3d197fa700 1 -- 172.21.15.138:0/966660947 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f3d1c102440 con 0x7f3d040383b0 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 msgr2=0x7f3d0403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 0x7f3d0403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3d10006fd0 tx=0x7f3d10006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 msgr2=0x7f3d1c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:54.159 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c006160 tx=0x7f3d0c006190 comp rx=0 tx=0).stop 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 shutdown_connections 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3d040383b0 0x7f3d0403a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 --2- 172.21.15.138:0/966660947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d1c1059d0 0x7f3d1c199660 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 >> 172.21.15.138:0/966660947 conn(0x7f3d1c101020 msgr2=0x7f3d1c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 shutdown_connections 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:53.491+0000 7f3d2254a700 1 -- 172.21.15.138:0/966660947 wait complete. 2024-02-15T22:41:54.160 INFO:teuthology.orchestra.run.smithi138.stdout:Generating ssh key... 2024-02-15T22:41:54.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:54 smithi138 ceph-mon[29229]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:55.512 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f307aa4a700 1 Processor -- start 2024-02-15T22:41:55.512 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f307aa4a700 1 -- start start 2024-02-15T22:41:55.512 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f307aa4a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f307aa4a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3074104600 con 0x7f3074103cb0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f3073fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f3073fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45380/0 (socket says 172.21.15.138:45380) 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.574+0000 7f3073fff700 1 -- 172.21.15.138:0/2665516595 learned_addr learned my addr 172.21.15.138:0/2665516595 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.575+0000 7f3073fff700 1 -- 172.21.15.138:0/2665516595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074104740 con 0x7f3074103cb0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.575+0000 7f3073fff700 1 --2- 172.21.15.138:0/2665516595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30640098a0 tx=0x7f3064009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5b4bcd7e318679 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.575+0000 7f3072ffd700 1 -- 172.21.15.138:0/2665516595 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3064004180 con 0x7f3074103cb0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.575+0000 7f3072ffd700 1 -- 172.21.15.138:0/2665516595 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f30640042e0 con 0x7f3074103cb0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.575+0000 7f3072ffd700 1 -- 172.21.15.138:0/2665516595 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3064011a50 con 0x7f3074103cb0 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- 172.21.15.138:0/2665516595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 msgr2=0x7f30741040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 --2- 172.21.15.138:0/2665516595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30640098a0 tx=0x7f3064009bb0 comp rx=0 tx=0).stop 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- 172.21.15.138:0/2665516595 shutdown_connections 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 --2- 172.21.15.138:0/2665516595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f30741040c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:55.513 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- 172.21.15.138:0/2665516595 >> 172.21.15.138:0/2665516595 conn(0x7f30740ff670 msgr2=0x7f3074101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- 172.21.15.138:0/2665516595 shutdown_connections 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- 172.21.15.138:0/2665516595 wait complete. 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 Processor -- start 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.576+0000 7f307aa4a700 1 -- start start 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f307aa4a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f307aa4a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3074199cb0 con 0x7f3074103cb0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f3073fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f3073fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45392/0 (socket says 172.21.15.138:45392) 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f3073fff700 1 -- 172.21.15.138:0/5816217 learned_addr learned my addr 172.21.15.138:0/5816217 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f3073fff700 1 -- 172.21.15.138:0/5816217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064009550 con 0x7f3074103cb0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f3073fff700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3064009520 tx=0x7f3064011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3064003a80 con 0x7f3074103cb0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3064003be0 con 0x7f3074103cb0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30640197b0 con 0x7f3074103cb0 2024-02-15T22:41:55.514 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3074199eb0 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.577+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307419a350 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.578+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3064019a20 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.578+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3074107870 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.578+0000 7f30717fa700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 0x7f305c03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.578+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f306404c770 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.578+0000 7f30737fe700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 0x7f305c03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.579+0000 7f30737fe700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 0x7f305c03a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3068006fd0 tx=0x7f3068006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.583+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f30640189a0 con 0x7f3074103cb0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.771+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f30741019a0 con 0x7f305c0383f0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.949+0000 7f30717fa700 1 -- 172.21.15.138:0/5816217 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f30741019a0 con 0x7f305c0383f0 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 msgr2=0x7f305c03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 0x7f305c03a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3068006fd0 tx=0x7f3068006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 msgr2=0x7f3074199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:55.515 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3064009520 tx=0x7f3064011ab0 comp rx=0 tx=0).stop 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 shutdown_connections 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f305c0383f0 0x7f305c03a8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 --2- 172.21.15.138:0/5816217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3074103cb0 0x7f3074199770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 >> 172.21.15.138:0/5816217 conn(0x7f30740ff670 msgr2=0x7f3074100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 shutdown_connections 2024-02-15T22:41:55.516 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:54.951+0000 7f307aa4a700 1 -- 172.21.15.138:0/5816217 wait complete. 2024-02-15T22:41:56.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:55 smithi138 ceph-mon[29229]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:56.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:55 smithi138 ceph-mon[29229]: Generating ssh key... 2024-02-15T22:41:56.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:55 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:56.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:55 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:41:56.711 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC193HhqFZ8otWaX7PscHE2byjO0dfMwzEuwsPRWdDmGlrcp8yuyjnqUocosp2YiEQT4yKPF7ohwzx8VcjjH88J4B1jynCVYZ1otdOgd4rfY0S0f5miy+IYuUl52oN2oXSL9xG0O4Yk9jf48L91GYd46OXz1aGtng9N3/839lWHPAeYzEc2oTegqSKITmQoW0zIcXbG2eH5DvYBVkgdPV4Fkp3cul13e08ul61ZZfXbxWGu0DktUqveVuNBMJob83jIS0RZNoL92iXLoiIckMm6VyrMP+aGAu6z0u2Dk/do9SwsMl1y3xzRuujrrYScqJ7pt8NmgLBk3NaGCoMwiHDp0TygRgclLC7bcepsBv45345tuzaRAFgzgfFixLkPxJaQYbCxp5ZN5am9r2LMr3K8ly6IMjXTR6T5VLW7AAw4i8PXm3whmvLcOLwr/LSbkdJnC3E0APtn/AhQ0j7G+UBxH4PnUGbsploV8aejJSpsfwW2kyzfcECXRNCz46Mp5ns= ceph-3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:41:56.711 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.920+0000 7f90a0285700 1 Processor -- start 2024-02-15T22:41:56.711 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.920+0000 7f90a0285700 1 -- start start 2024-02-15T22:41:56.711 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f90a0285700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:56.711 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f90a0285700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098106320 con 0x7f90981059d0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909e021700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909e021700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45402/0 (socket says 172.21.15.138:45402) 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909e021700 1 -- 172.21.15.138:0/2291941708 learned_addr learned my addr 172.21.15.138:0/2291941708 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909e021700 1 -- 172.21.15.138:0/2291941708 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098106460 con 0x7f90981059d0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909e021700 1 --2- 172.21.15.138:0/2291941708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9090009870 tx=0x7f9090009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d49a4566662c86 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.921+0000 7f909d01f700 1 -- 172.21.15.138:0/2291941708 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090005c30 con 0x7f90981059d0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f909d01f700 1 -- 172.21.15.138:0/2291941708 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9090005d90 con 0x7f90981059d0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f909d01f700 1 -- 172.21.15.138:0/2291941708 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090006030 con 0x7f90981059d0 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 -- 172.21.15.138:0/2291941708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 msgr2=0x7f9098105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 --2- 172.21.15.138:0/2291941708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9090009870 tx=0x7f9090009b80 comp rx=0 tx=0).stop 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 -- 172.21.15.138:0/2291941708 shutdown_connections 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 --2- 172.21.15.138:0/2291941708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098105de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 -- 172.21.15.138:0/2291941708 >> 172.21.15.138:0/2291941708 conn(0x7f9098101020 msgr2=0x7f9098103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 -- 172.21.15.138:0/2291941708 shutdown_connections 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.922+0000 7f90a0285700 1 -- 172.21.15.138:0/2291941708 wait complete. 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f90a0285700 1 Processor -- start 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f90a0285700 1 -- start start 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f90a0285700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f90a0285700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098199ba0 con 0x7f90981059d0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f909e021700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f909e021700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45406/0 (socket says 172.21.15.138:45406) 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f909e021700 1 -- 172.21.15.138:0/985177022 learned_addr learned my addr 172.21.15.138:0/985177022 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.923+0000 7f909e021700 1 -- 172.21.15.138:0/985177022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009500 con 0x7f90981059d0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f909e021700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9090006160 tx=0x7f9090006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090004430 con 0x7f90981059d0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9090006760 con 0x7f90981059d0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9098199da0 con 0x7f90981059d0 2024-02-15T22:41:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090011d00 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909819a240 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.924+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f9090018070 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.925+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9098062380 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.925+0000 7f908f7fe700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 0x7f908403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.925+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f909004ba50 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.925+0000 7f909d820700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 0x7f908403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.925+0000 7f909d820700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 0x7f908403a8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9088006fd0 tx=0x7f9088006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:55.929+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9090022530 con 0x7f90981059d0 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.116+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9098102440 con 0x7f9084038400 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.117+0000 7f908f7fe700 1 -- 172.21.15.138:0/985177022 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f9098102440 con 0x7f9084038400 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 msgr2=0x7f908403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 0x7f908403a8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9088006fd0 tx=0x7f9088006e40 comp rx=0 tx=0).stop 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 msgr2=0x7f9098199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:41:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9090006160 tx=0x7f9090006190 comp rx=0 tx=0).stop 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 shutdown_connections 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f9084038400 0x7f908403a8b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 --2- 172.21.15.138:0/985177022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90981059d0 0x7f9098199660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 >> 172.21.15.138:0/985177022 conn(0x7f9098101020 msgr2=0x7f9098101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 shutdown_connections 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:56.119+0000 7f90a0285700 1 -- 172.21.15.138:0/985177022 wait complete. 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:Adding key to root@localhost authorized_keys... 2024-02-15T22:41:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:Adding host smithi138... 2024-02-15T22:41:56.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:56 smithi138 ceph-mon[29229]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:58.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:58 smithi138 ceph-mon[29229]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "addr": "172.21.15.138", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:41:59.893 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:41:59 smithi138 ceph-mon[29229]: Deploying cephadm binary to smithi138 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Added host 'smithi138' with addr '172.21.15.138' 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.132+0000 7f2b417b8700 1 Processor -- start 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.132+0000 7f2b417b8700 1 -- start start 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.132+0000 7f2b417b8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.132+0000 7f2b417b8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c07a830 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b3affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b3affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45418/0 (socket says 172.21.15.138:45418) 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b3affd700 1 -- 172.21.15.138:0/1622135442 learned_addr learned my addr 172.21.15.138:0/1622135442 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:00.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b3affd700 1 -- 172.21.15.138:0/1622135442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c07a970 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b3affd700 1 --2- 172.21.15.138:0/1622135442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297ab8f44a1f0060 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b39ffb700 1 -- 172.21.15.138:0/1622135442 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b2c005c30 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b39ffb700 1 -- 172.21.15.138:0/1622135442 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2b2c005d90 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.133+0000 7f2b39ffb700 1 -- 172.21.15.138:0/1622135442 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b2c006030 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 -- 172.21.15.138:0/1622135442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 msgr2=0x7f2b3c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1622135442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c009b80 comp rx=0 tx=0).stop 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 -- 172.21.15.138:0/1622135442 shutdown_connections 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1622135442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c07a2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 -- 172.21.15.138:0/1622135442 >> 172.21.15.138:0/1622135442 conn(0x7f2b3c101020 msgr2=0x7f2b3c103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 -- 172.21.15.138:0/1622135442 shutdown_connections 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 -- 172.21.15.138:0/1622135442 wait complete. 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.134+0000 7f2b417b8700 1 Processor -- start 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b417b8700 1 -- start start 2024-02-15T22:42:00.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b417b8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b417b8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c19bdf0 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b3affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b3affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45430/0 (socket says 172.21.15.138:45430) 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b3affd700 1 -- 172.21.15.138:0/1065033213 learned_addr learned my addr 172.21.15.138:0/1065033213 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b3affd700 1 -- 172.21.15.138:0/1065033213 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009500 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b3affd700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c004230 tx=0x7f2b2c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b2c0044f0 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c19bff0 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c19c490 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2b2c006580 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.135+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b2c011ac0 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.136+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2b2c018070 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.136+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28005320 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.137+0000 7f2b23fff700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 0x7f2b2403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:00.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.137+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b2c04b710 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.137+0000 7f2b3a7fc700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 0x7f2b2403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.137+0000 7f2b3a7fc700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 0x7f2b2403a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b30006fd0 tx=0x7f2b30006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.141+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2b2c018320 con 0x7f2b3c07bdf0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:57.332+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi138", "addr": "172.21.15.138", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b28000bf0 con 0x7f2b240383b0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.890+0000 7f2b23fff700 1 -- 172.21.15.138:0/1065033213 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2b28000bf0 con 0x7f2b240383b0 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 msgr2=0x7f2b2403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 0x7f2b2403a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b30006fd0 tx=0x7f2b30006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 msgr2=0x7f2b3c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c004230 tx=0x7f2b2c004260 comp rx=0 tx=0).stop 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 shutdown_connections 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f2b240383b0 0x7f2b2403a860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 --2- 172.21.15.138:0/1065033213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b3c07bdf0 0x7f2b3c19b8b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 >> 172.21.15.138:0/1065033213 conn(0x7f2b3c101020 msgr2=0x7f2b3c101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 shutdown_connections 2024-02-15T22:42:00.480 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:41:59.893+0000 7f2b417b8700 1 -- 172.21.15.138:0/1065033213 wait complete. 2024-02-15T22:42:00.481 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying mon service with default placement... 2024-02-15T22:42:01.015 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:00 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:01.015 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:00 smithi138 ceph-mon[29229]: Added host smithi138 2024-02-15T22:42:01.015 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:00 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.865+0000 7fc7f9344700 1 Processor -- start 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.865+0000 7fc7f9344700 1 -- start start 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.865+0000 7fc7f9344700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.865+0000 7fc7f9344700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4104600 con 0x7fc7f4103cb0 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45444/0 (socket says 172.21.15.138:45444) 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f2ffd700 1 -- 172.21.15.138:0/702181632 learned_addr learned my addr 172.21.15.138:0/702181632 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f2ffd700 1 -- 172.21.15.138:0/702181632 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4104740 con 0x7fc7f4103cb0 2024-02-15T22:42:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f2ffd700 1 --2- 172.21.15.138:0/702181632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40098a0 tx=0x7fc7e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac31ab9d315b487 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f1ffb700 1 -- 172.21.15.138:0/702181632 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7e4004180 con 0x7fc7f4103cb0 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f1ffb700 1 -- 172.21.15.138:0/702181632 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc7e40042e0 con 0x7fc7f4103cb0 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.866+0000 7fc7f1ffb700 1 -- 172.21.15.138:0/702181632 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7e4011a50 con 0x7fc7f4103cb0 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 -- 172.21.15.138:0/702181632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 msgr2=0x7fc7f41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 --2- 172.21.15.138:0/702181632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40098a0 tx=0x7fc7e4009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 -- 172.21.15.138:0/702181632 shutdown_connections 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 --2- 172.21.15.138:0/702181632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f41040c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 -- 172.21.15.138:0/702181632 >> 172.21.15.138:0/702181632 conn(0x7fc7f40ff670 msgr2=0x7fc7f4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 -- 172.21.15.138:0/702181632 shutdown_connections 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.867+0000 7fc7f9344700 1 -- 172.21.15.138:0/702181632 wait complete. 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f9344700 1 Processor -- start 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f9344700 1 -- start start 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f9344700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f9344700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4199c90 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45456/0 (socket says 172.21.15.138:45456) 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.868+0000 7fc7f2ffd700 1 -- 172.21.15.138:0/3764887426 learned_addr learned my addr 172.21.15.138:0/3764887426 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7f2ffd700 1 -- 172.21.15.138:0/3764887426 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009550 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7f2ffd700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4003de0 tx=0x7fc7e4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7e4003930 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc7e4003a90 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f4199e90 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f419a330 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.869+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7e40196c0 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.870+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc7e40199b0 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.870+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4107870 con 0x7fc7f4103cb0 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.870+0000 7fc7dbfff700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 0x7fc7dc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.870+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc7e404d370 con 0x7fc7f4103cb0 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.870+0000 7fc7f27fc700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 0x7fc7dc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.871+0000 7fc7f27fc700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 0x7fc7dc03a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8006fd0 tx=0x7fc7e8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:00.877+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc7e4023370 con 0x7fc7f4103cb0 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.081+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f41019c0 con 0x7fc7dc038440 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.088+0000 7fc7dbfff700 1 -- 172.21.15.138:0/3764887426 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc7f41019c0 con 0x7fc7dc038440 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 msgr2=0x7fc7dc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 0x7fc7dc03a8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8006fd0 tx=0x7fc7e8006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 msgr2=0x7fc7f4199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4003de0 tx=0x7fc7e4011ab0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 shutdown_connections 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc7dc038440 0x7fc7dc03a8f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 --2- 172.21.15.138:0/3764887426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7f4103cb0 0x7fc7f4199750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 >> 172.21.15.138:0/3764887426 conn(0x7fc7f40ff670 msgr2=0x7fc7f4100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 shutdown_connections 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:01.090+0000 7fc7f9344700 1 -- 172.21.15.138:0/3764887426 wait complete. 2024-02-15T22:42:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying mgr service with default placement... 2024-02-15T22:42:02.340 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:02 smithi138 ceph-mon[29229]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:02.340 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:02 smithi138 ceph-mon[29229]: Saving service mon spec with placement count:5 2024-02-15T22:42:02.340 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:02 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.168+0000 7ff1b179d700 1 Processor -- start 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.168+0000 7ff1b179d700 1 -- start start 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.168+0000 7ff1b179d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1b179d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac106150 con 0x7ff1ac105800 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45464/0 (socket says 172.21.15.138:45464) 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1abfff700 1 -- 172.21.15.138:0/1324462257 learned_addr learned my addr 172.21.15.138:0/1324462257 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1abfff700 1 -- 172.21.15.138:0/1324462257 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac106290 con 0x7ff1ac105800 2024-02-15T22:42:03.548 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1abfff700 1 --2- 172.21.15.138:0/1324462257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00098a0 tx=0x7ff1a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c033a32afb6f3f6c server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1aaffd700 1 -- 172.21.15.138:0/1324462257 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1a0004180 con 0x7ff1ac105800 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1aaffd700 1 -- 172.21.15.138:0/1324462257 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a00042e0 con 0x7ff1ac105800 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.169+0000 7ff1aaffd700 1 -- 172.21.15.138:0/1324462257 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1a0011a50 con 0x7ff1ac105800 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 -- 172.21.15.138:0/1324462257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 msgr2=0x7ff1ac105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1324462257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00098a0 tx=0x7ff1a0009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 -- 172.21.15.138:0/1324462257 shutdown_connections 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1324462257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac105c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 -- 172.21.15.138:0/1324462257 >> 172.21.15.138:0/1324462257 conn(0x7ff1ac100e50 msgr2=0x7ff1ac103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 -- 172.21.15.138:0/1324462257 shutdown_connections 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.170+0000 7ff1b179d700 1 -- 172.21.15.138:0/1324462257 wait complete. 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1b179d700 1 Processor -- start 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1b179d700 1 -- start start 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1b179d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1b179d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac199a90 con 0x7ff1ac105800 2024-02-15T22:42:03.549 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:45468/0 (socket says 172.21.15.138:45468) 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1abfff700 1 -- 172.21.15.138:0/1412226684 learned_addr learned my addr 172.21.15.138:0/1412226684 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.171+0000 7ff1abfff700 1 -- 172.21.15.138:0/1412226684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0009550 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1abfff700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0003de0 tx=0x7ff1a0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1a0003930 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac199c90 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a0003a90 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1a0019730 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.172+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac19a130 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff1a00199b0 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac062380 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1a97fa700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 0x7ff19403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff1a004c640 con 0x7ff1ac105800 2024-02-15T22:42:03.550 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1ab7fe700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 0x7ff19403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.173+0000 7ff1ab7fe700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 0x7ff19403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c006fd0 tx=0x7ff19c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.177+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff1a0010560 con 0x7ff1ac105800 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.396+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1ac103110 con 0x7ff1940383f0 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.400+0000 7ff1a97fa700 1 -- 172.21.15.138:0/1412226684 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff1ac103110 con 0x7ff1940383f0 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.402+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 msgr2=0x7ff19403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.402+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 0x7ff19403a8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c006fd0 tx=0x7ff19c006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.402+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 msgr2=0x7ff1ac199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.402+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0003de0 tx=0x7ff1a0011ab0 comp rx=0 tx=0).stop 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 shutdown_connections 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ff1940383f0 0x7ff19403a8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 --2- 172.21.15.138:0/1412226684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1ac105800 0x7ff1ac199550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:03.551 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 >> 172.21.15.138:0/1412226684 conn(0x7ff1ac100e50 msgr2=0x7ff1ac1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:03.552 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 shutdown_connections 2024-02-15T22:42:03.552 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:02.403+0000 7ff1b179d700 1 -- 172.21.15.138:0/1412226684 wait complete. 2024-02-15T22:42:03.552 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying crash service with default placement... 2024-02-15T22:42:03.657 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:03 smithi138 ceph-mon[29229]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:03.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:03 smithi138 ceph-mon[29229]: Saving service mgr spec with placement count:2 2024-02-15T22:42:03.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:03 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:03.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:03 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:04.729 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.931+0000 7fc30e01a700 1 Processor -- start 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.931+0000 7fc30e01a700 1 -- start start 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc30e01a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc30e01a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc308105710 con 0x7fc308104dc0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41350/0 (socket says 172.21.15.138:41350) 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3077fe700 1 -- 172.21.15.138:0/740574894 learned_addr learned my addr 172.21.15.138:0/740574894 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3077fe700 1 -- 172.21.15.138:0/740574894 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308105850 con 0x7fc308104dc0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3077fe700 1 --2- 172.21.15.138:0/740574894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80098a0 tx=0x7fc2f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1733b4f22cee9d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3067fc700 1 -- 172.21.15.138:0/740574894 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2f8004180 con 0x7fc308104dc0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3067fc700 1 -- 172.21.15.138:0/740574894 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2f80042e0 con 0x7fc308104dc0 2024-02-15T22:42:04.730 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.932+0000 7fc3067fc700 1 -- 172.21.15.138:0/740574894 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2f8011af0 con 0x7fc308104dc0 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 -- 172.21.15.138:0/740574894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 msgr2=0x7fc3081051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 --2- 172.21.15.138:0/740574894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80098a0 tx=0x7fc2f8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 -- 172.21.15.138:0/740574894 shutdown_connections 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 --2- 172.21.15.138:0/740574894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc3081051d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 -- 172.21.15.138:0/740574894 >> 172.21.15.138:0/740574894 conn(0x7fc3080ff670 msgr2=0x7fc308101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:04.731 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 -- 172.21.15.138:0/740574894 shutdown_connections 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.933+0000 7fc30e01a700 1 -- 172.21.15.138:0/740574894 wait complete. 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc30e01a700 1 Processor -- start 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc30e01a700 1 -- start start 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc30e01a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc30e01a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30819c490 con 0x7fc308104dc0 2024-02-15T22:42:04.732 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc3077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41366/0 (socket says 172.21.15.138:41366) 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc3077fe700 1 -- 172.21.15.138:0/3987427553 learned_addr learned my addr 172.21.15.138:0/3987427553 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc3077fe700 1 -- 172.21.15.138:0/3987427553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8009550 con 0x7fc308104dc0 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.934+0000 7fc3077fe700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8011670 tx=0x7fc2f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2f80039c0 con 0x7fc308104dc0 2024-02-15T22:42:04.733 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc2f8003b20 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30819c5d0 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2f80247f0 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30819ca70 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.935+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc2f8024a60 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.936+0000 7fc304ff9700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 0x7fc2f403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.936+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc2f804c2f0 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.936+0000 7fc306ffd700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 0x7fc2f403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.936+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc308062380 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.936+0000 7fc306ffd700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 0x7fc2f403a8b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0006fd0 tx=0x7fc2f0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:03.940+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc2f8024d10 con 0x7fc308104dc0 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.160+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc308100b00 con 0x7fc2f4038400 2024-02-15T22:42:04.734 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.164+0000 7fc304ff9700 1 -- 172.21.15.138:0/3987427553 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc308100b00 con 0x7fc2f4038400 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.166+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 msgr2=0x7fc2f403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.166+0000 7fc30e01a700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 0x7fc2f403a8b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0006fd0 tx=0x7fc2f0006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.166+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 msgr2=0x7fc308104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.166+0000 7fc30e01a700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8011670 tx=0x7fc2f8011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 shutdown_connections 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fc2f4038400 0x7fc2f403a8b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:04.735 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 --2- 172.21.15.138:0/3987427553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc308104dc0 0x7fc308104540 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:04.736 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 >> 172.21.15.138:0/3987427553 conn(0x7fc3080ff670 msgr2=0x7fc308101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:04.736 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 shutdown_connections 2024-02-15T22:42:04.736 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:04.167+0000 7fc30e01a700 1 -- 172.21.15.138:0/3987427553 wait complete. 2024-02-15T22:42:04.736 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying ceph-exporter service with default placement... 2024-02-15T22:42:05.351 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:05 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:05.352 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:05 smithi138 ceph-mon[29229]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:05.352 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:05 smithi138 ceph-mon[29229]: Saving service crash spec with placement * 2024-02-15T22:42:05.352 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:05 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:06.079 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.125+0000 7f623d05e700 1 Processor -- start 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.125+0000 7f623d05e700 1 -- start start 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f623d05e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f623d05e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238107950 con 0x7f6238107000 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:06.080 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41382/0 (socket says 172.21.15.138:41382) 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6236d9d700 1 -- 172.21.15.138:0/1302107550 learned_addr learned my addr 172.21.15.138:0/1302107550 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6236d9d700 1 -- 172.21.15.138:0/1302107550 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238107a90 con 0x7f6238107000 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6236d9d700 1 --2- 172.21.15.138:0/1302107550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62280098a0 tx=0x7f6228009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82969cff51e23034 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6235d9b700 1 -- 172.21.15.138:0/1302107550 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228004180 con 0x7f6238107000 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6235d9b700 1 -- 172.21.15.138:0/1302107550 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62280042e0 con 0x7f6238107000 2024-02-15T22:42:06.081 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.126+0000 7f6235d9b700 1 -- 172.21.15.138:0/1302107550 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228011af0 con 0x7f6238107000 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 -- 172.21.15.138:0/1302107550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 msgr2=0x7f6238107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 --2- 172.21.15.138:0/1302107550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62280098a0 tx=0x7f6228009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 -- 172.21.15.138:0/1302107550 shutdown_connections 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 --2- 172.21.15.138:0/1302107550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238107410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 -- 172.21.15.138:0/1302107550 >> 172.21.15.138:0/1302107550 conn(0x7f62380ff670 msgr2=0x7f6238101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 -- 172.21.15.138:0/1302107550 shutdown_connections 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.127+0000 7f623d05e700 1 -- 172.21.15.138:0/1302107550 wait complete. 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f623d05e700 1 Processor -- start 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f623d05e700 1 -- start start 2024-02-15T22:42:06.082 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f623d05e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f623d05e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238199cb0 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41390/0 (socket says 172.21.15.138:41390) 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.128+0000 7f6236d9d700 1 -- 172.21.15.138:0/2731300330 learned_addr learned my addr 172.21.15.138:0/2731300330 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f6236d9d700 1 -- 172.21.15.138:0/2731300330 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228009550 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f6236d9d700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6228011670 tx=0x7f6228011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228003a40 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6238199eb0 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6228003ba0 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228003a40 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.129+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623819a350 con 0x7f6238107000 2024-02-15T22:42:06.083 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.130+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6238104550 con 0x7f6238107000 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.130+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f6228024770 con 0x7f6238107000 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.130+0000 7f621ffff700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 0x7f622003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.130+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6228018d20 con 0x7f6238107000 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.130+0000 7f623659c700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 0x7f622003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.131+0000 7f623659c700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 0x7f622003a900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f622c006fd0 tx=0x7f622c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.136+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f622802dc50 con 0x7f6238107000 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.350+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f62381019a0 con 0x7f6220038450 2024-02-15T22:42:06.084 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.355+0000 7f621ffff700 1 -- 172.21.15.138:0/2731300330 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f62381019a0 con 0x7f6220038450 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 msgr2=0x7f622003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 0x7f622003a900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f622c006fd0 tx=0x7f622c006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 msgr2=0x7f6238199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6228011670 tx=0x7f6228011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 shutdown_connections 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f6220038450 0x7f622003a900 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 --2- 172.21.15.138:0/2731300330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6238107000 0x7f6238199770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 >> 172.21.15.138:0/2731300330 conn(0x7f62380ff670 msgr2=0x7f6238100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 shutdown_connections 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:05.357+0000 7f623d05e700 1 -- 172.21.15.138:0/2731300330 wait complete. 2024-02-15T22:42:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying prometheus service with default placement... 2024-02-15T22:42:06.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:06 smithi138 ceph-mon[29229]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:06.450 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:06 smithi138 ceph-mon[29229]: Saving service ceph-exporter spec with placement * 2024-02-15T22:42:06.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:06 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc3f4f700 1 Processor -- start 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc3f4f700 1 -- start start 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc3f4f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc3f4f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc079cf0 con 0x7f3cbc106530 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc1ceb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc1ceb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41392/0 (socket says 172.21.15.138:41392) 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.548+0000 7f3cc1ceb700 1 -- 172.21.15.138:0/339004479 learned_addr learned my addr 172.21.15.138:0/339004479 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc1ceb700 1 -- 172.21.15.138:0/339004479 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc079e30 con 0x7f3cbc106530 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc1ceb700 1 --2- 172.21.15.138:0/339004479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80098a0 tx=0x7f3cb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87093184bd38d7f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc0ce9700 1 -- 172.21.15.138:0/339004479 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cb8004180 con 0x7f3cbc106530 2024-02-15T22:42:07.329 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc0ce9700 1 -- 172.21.15.138:0/339004479 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cb80042e0 con 0x7f3cbc106530 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc0ce9700 1 -- 172.21.15.138:0/339004479 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cb8011af0 con 0x7f3cbc106530 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/339004479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 msgr2=0x7f3cbc108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.549+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/339004479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80098a0 tx=0x7f3cb8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/339004479 shutdown_connections 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/339004479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc108910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/339004479 >> 172.21.15.138:0/339004479 conn(0x7f3cbc0ffed0 msgr2=0x7f3cbc102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/339004479 shutdown_connections 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/339004479 wait complete. 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 Processor -- start 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- start start 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.550+0000 7f3cc3f4f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc199cb0 con 0x7f3cbc106530 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc1ceb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc1ceb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41398/0 (socket says 172.21.15.138:41398) 2024-02-15T22:42:07.330 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc1ceb700 1 -- 172.21.15.138:0/2199669991 learned_addr learned my addr 172.21.15.138:0/2199669991 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc1ceb700 1 -- 172.21.15.138:0/2199669991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8009550 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc1ceb700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8011670 tx=0x7f3cb8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cb80039f0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cb8003b50 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc199eb0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3cb80247c0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.551+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc19a350 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.552+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f3cb802d3f0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.552+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc109ab0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.552+0000 7f3cb2ffd700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 0x7f3ca803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.552+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3cb804c5c0 con 0x7f3cbc106530 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.552+0000 7f3cc14ea700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 0x7f3ca803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.553+0000 7f3cc14ea700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 0x7f3ca803a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cac006fd0 tx=0x7f3cac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:07.331 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.557+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3cb8010970 con 0x7f3cbc106530 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.756+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cbc102280 con 0x7f3ca80383f0 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.761+0000 7f3cb2ffd700 1 -- 172.21.15.138:0/2199669991 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f3cbc102280 con 0x7f3ca80383f0 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 msgr2=0x7f3ca803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 0x7f3ca803a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3cac006fd0 tx=0x7f3cac006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 msgr2=0x7f3cbc199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8011670 tx=0x7f3cb8011b50 comp rx=0 tx=0).stop 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 shutdown_connections 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f3ca80383f0 0x7f3ca803a8a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 --2- 172.21.15.138:0/2199669991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cbc106530 0x7f3cbc199770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 >> 172.21.15.138:0/2199669991 conn(0x7f3cbc0ffed0 msgr2=0x7f3cbc101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 shutdown_connections 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:06.763+0000 7f3cc3f4f700 1 -- 172.21.15.138:0/2199669991 wait complete. 2024-02-15T22:42:07.332 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying grafana service with default placement... 2024-02-15T22:42:07.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:07 smithi138 ceph-mon[29229]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:07.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:07 smithi138 ceph-mon[29229]: Saving service prometheus spec with placement count:1 2024-02-15T22:42:07.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:07 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd9a5700700 1 Processor -- start 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd9a5700700 1 -- start start 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd9a5700700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd9a5700700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0106310 con 0x7fd9a01059c0 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd99effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd99effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41402/0 (socket says 172.21.15.138:41402) 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd99effd700 1 -- 172.21.15.138:0/614865940 learned_addr learned my addr 172.21.15.138:0/614865940 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.782+0000 7fd99effd700 1 -- 172.21.15.138:0/614865940 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0106450 con 0x7fd9a01059c0 2024-02-15T22:42:08.570 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd99effd700 1 --2- 172.21.15.138:0/614865940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9900098a0 tx=0x7fd990009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8af7c3f0f758d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd99dffb700 1 -- 172.21.15.138:0/614865940 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd990004180 con 0x7fd9a01059c0 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd99dffb700 1 -- 172.21.15.138:0/614865940 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9900042e0 con 0x7fd9a01059c0 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd99dffb700 1 -- 172.21.15.138:0/614865940 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd990011af0 con 0x7fd9a01059c0 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 -- 172.21.15.138:0/614865940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 msgr2=0x7fd9a0105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 --2- 172.21.15.138:0/614865940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9900098a0 tx=0x7fd990009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 -- 172.21.15.138:0/614865940 shutdown_connections 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 --2- 172.21.15.138:0/614865940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0105dd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 -- 172.21.15.138:0/614865940 >> 172.21.15.138:0/614865940 conn(0x7fd9a0100ff0 msgr2=0x7fd9a0103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 -- 172.21.15.138:0/614865940 shutdown_connections 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.783+0000 7fd9a5700700 1 -- 172.21.15.138:0/614865940 wait complete. 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd9a5700700 1 Processor -- start 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd9a5700700 1 -- start start 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd9a5700700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd9a5700700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0199cb0 con 0x7fd9a01059c0 2024-02-15T22:42:08.571 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd99effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd99effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41406/0 (socket says 172.21.15.138:41406) 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.784+0000 7fd99effd700 1 -- 172.21.15.138:0/1884594676 learned_addr learned my addr 172.21.15.138:0/1884594676 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd99effd700 1 -- 172.21.15.138:0/1884594676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd990009550 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd99effd700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd990011670 tx=0x7fd990011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd990003a40 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd990003ba0 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a0199eb0 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd990024790 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.785+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a019a350 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.786+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd99001a430 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.786+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a0062380 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.786+0000 7fd987fff700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 0x7fd98803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.786+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd99004c510 con 0x7fd9a01059c0 2024-02-15T22:42:08.572 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.786+0000 7fd99e7fc700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 0x7fd98803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.787+0000 7fd99e7fc700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 0x7fd98803a8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd994006fd0 tx=0x7fd994006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:07.791+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd990018b40 con 0x7fd9a01059c0 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.014+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9a019d190 con 0x7fd9880383f0 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.019+0000 7fd987fff700 1 -- 172.21.15.138:0/1884594676 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd9a019d190 con 0x7fd9880383f0 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 msgr2=0x7fd98803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 0x7fd98803a8a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd994006fd0 tx=0x7fd994006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 msgr2=0x7fd9a0199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd990011670 tx=0x7fd990011b50 comp rx=0 tx=0).stop 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 shutdown_connections 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd9880383f0 0x7fd98803a8a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 --2- 172.21.15.138:0/1884594676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9a01059c0 0x7fd9a0199770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 >> 172.21.15.138:0/1884594676 conn(0x7fd9a0100ff0 msgr2=0x7fd9a0102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 shutdown_connections 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:08.021+0000 7fd9a5700700 1 -- 172.21.15.138:0/1884594676 wait complete. 2024-02-15T22:42:08.573 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying node-exporter service with default placement... 2024-02-15T22:42:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:08 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:08 smithi138 ceph-mon[29229]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:08 smithi138 ceph-mon[29229]: Saving service grafana spec with placement count:1 2024-02-15T22:42:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:08 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:09 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:09 smithi138 ceph-mon[29229]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:09 smithi138 ceph-mon[29229]: Saving service node-exporter spec with placement * 2024-02-15T22:42:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:09 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:09.990 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8be326700 1 Processor -- start 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8be326700 1 -- start start 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8be326700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8be326700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80744b0 con 0x7fb8b8106550 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41414/0 (socket says 172.21.15.138:41414) 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8b7fff700 1 -- 172.21.15.138:0/1326063077 learned_addr learned my addr 172.21.15.138:0/1326063077 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8b7fff700 1 -- 172.21.15.138:0/1326063077 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80745f0 con 0x7fb8b8106550 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.069+0000 7fb8b7fff700 1 --2- 172.21.15.138:0/1326063077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098a0 tx=0x7fb8a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923ac66d5889c5b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.070+0000 7fb8b6ffd700 1 -- 172.21.15.138:0/1326063077 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a8004180 con 0x7fb8b8106550 2024-02-15T22:42:09.995 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.070+0000 7fb8b6ffd700 1 -- 172.21.15.138:0/1326063077 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8a80042e0 con 0x7fb8b8106550 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.070+0000 7fb8b6ffd700 1 -- 172.21.15.138:0/1326063077 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a8011af0 con 0x7fb8b8106550 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.070+0000 7fb8be326700 1 -- 172.21.15.138:0/1326063077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 msgr2=0x7fb8b8108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.070+0000 7fb8be326700 1 --2- 172.21.15.138:0/1326063077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098a0 tx=0x7fb8a8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 -- 172.21.15.138:0/1326063077 shutdown_connections 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 --2- 172.21.15.138:0/1326063077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8108930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 -- 172.21.15.138:0/1326063077 >> 172.21.15.138:0/1326063077 conn(0x7fb8b80fff10 msgr2=0x7fb8b8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 -- 172.21.15.138:0/1326063077 shutdown_connections 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 -- 172.21.15.138:0/1326063077 wait complete. 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 Processor -- start 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.071+0000 7fb8be326700 1 -- start start 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8be326700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8be326700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b8199ca0 con 0x7fb8b8106550 2024-02-15T22:42:09.996 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41424/0 (socket says 172.21.15.138:41424) 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b7fff700 1 -- 172.21.15.138:0/458363903 learned_addr learned my addr 172.21.15.138:0/458363903 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b7fff700 1 -- 172.21.15.138:0/458363903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8009550 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b7fff700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011670 tx=0x7fb8a8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a80039c0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8a8003b20 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8be326700 1 -- 172.21.15.138:0/458363903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b8199ea0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a80247f0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.072+0000 7fb8be326700 1 -- 172.21.15.138:0/458363903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b819a340 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.073+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb8a8024ab0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.073+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8980052f0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.074+0000 7fb8b57fa700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 0x7fb8a003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.074+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb8a804c5d0 con 0x7fb8b8106550 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.074+0000 7fb8b77fe700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 0x7fb8a003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.074+0000 7fb8b77fe700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 0x7fb8a003a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:09.997 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.078+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8a8024d60 con 0x7fb8b8106550 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.303+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb898000bc0 con 0x7fb8a00383b0 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.308+0000 7fb8b57fa700 1 -- 172.21.15.138:0/458363903 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb898000bc0 con 0x7fb8a00383b0 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 msgr2=0x7fb8a003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 0x7fb8a003a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 msgr2=0x7fb8b8199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011670 tx=0x7fb8a8011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 shutdown_connections 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fb8a00383b0 0x7fb8a003a860 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 --2- 172.21.15.138:0/458363903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8b8106550 0x7fb8b8199760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 >> 172.21.15.138:0/458363903 conn(0x7fb8b80fff10 msgr2=0x7fb8b8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 shutdown_connections 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:09.310+0000 7fb89effd700 1 -- 172.21.15.138:0/458363903 wait complete. 2024-02-15T22:42:09.998 INFO:teuthology.orchestra.run.smithi138.stdout:Deploying alertmanager service with default placement... 2024-02-15T22:42:11.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:11 smithi138 ceph-mon[29229]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:12.035 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-15T22:42:12.035 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.262+0000 7f5fe7e97700 1 Processor -- start 2024-02-15T22:42:12.035 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe7e97700 1 -- start start 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe7e97700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe7e97700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0106370 con 0x7f5fe0074490 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe5c33700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe5c33700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41430/0 (socket says 172.21.15.138:41430) 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe5c33700 1 -- 172.21.15.138:0/1102610880 learned_addr learned my addr 172.21.15.138:0/1102610880 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe5c33700 1 -- 172.21.15.138:0/1102610880 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe010aec0 con 0x7f5fe0074490 2024-02-15T22:42:12.036 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.263+0000 7f5fe5c33700 1 --2- 172.21.15.138:0/1102610880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0098a0 tx=0x7f5fdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96052a36021a3b09 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe4c31700 1 -- 172.21.15.138:0/1102610880 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fdc004180 con 0x7f5fe0074490 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe4c31700 1 -- 172.21.15.138:0/1102610880 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fdc0042e0 con 0x7f5fe0074490 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe4c31700 1 -- 172.21.15.138:0/1102610880 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fdc011af0 con 0x7f5fe0074490 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1102610880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 msgr2=0x7f5fe010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1102610880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0098a0 tx=0x7f5fdc009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1102610880 shutdown_connections 2024-02-15T22:42:12.037 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1102610880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe0074490 0x7f5fe010a980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1102610880 >> 172.21.15.138:0/1102610880 conn(0x7f5fe00fff10 msgr2=0x7f5fe0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1102610880 shutdown_connections 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.264+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1102610880 wait complete. 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe7e97700 1 Processor -- start 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe7e97700 1 -- start start 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe7e97700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe7e97700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe019c2a0 con 0x7f5fe019b950 2024-02-15T22:42:12.038 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe5c33700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe5c33700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41432/0 (socket says 172.21.15.138:41432) 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe5c33700 1 -- 172.21.15.138:0/1941474013 learned_addr learned my addr 172.21.15.138:0/1941474013 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe5c33700 1 -- 172.21.15.138:0/1941474013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009550 con 0x7f5fe019b950 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.265+0000 7f5fe5c33700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc011670 tx=0x7f5fdc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.266+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fdc0039f0 con 0x7f5fe019b950 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.266+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fdc003b50 con 0x7f5fe019b950 2024-02-15T22:42:12.039 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.266+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe019c4a0 con 0x7f5fe019b950 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.266+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5fdc0247c0 con 0x7f5fe019b950 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.266+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe019f100 con 0x7f5fe019b950 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5fdc01ac00 con 0x7f5fe019b950 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fd6ffd700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 0x7f5fcc03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0074490 con 0x7f5fe019b950 2024-02-15T22:42:12.040 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5fdc04c3b0 con 0x7f5fe019b950 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fe5432700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 0x7f5fcc03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.267+0000 7f5fe5432700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 0x7f5fcc03a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0006fd0 tx=0x7f5fd0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.272+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5fdc02d3f0 con 0x7f5fe019b950 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.472+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fe0102200 con 0x7f5fcc038440 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.478+0000 7f5fd6ffd700 1 -- 172.21.15.138:0/1941474013 <== mgr.14118 v2:172.21.15.138:6800/2928099655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f5fe0102200 con 0x7f5fcc038440 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 msgr2=0x7f5fcc03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 0x7f5fcc03a8f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0006fd0 tx=0x7f5fd0006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:12.041 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 msgr2=0x7f5fe019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc011670 tx=0x7f5fdc011b50 comp rx=0 tx=0).stop 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 shutdown_connections 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f5fcc038440 0x7f5fcc03a8f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 --2- 172.21.15.138:0/1941474013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fe019b950 0x7f5fe019bd60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 >> 172.21.15.138:0/1941474013 conn(0x7f5fe00fff10 msgr2=0x7f5fe01015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.480+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 shutdown_connections 2024-02-15T22:42:12.042 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:11.481+0000 7f5fe7e97700 1 -- 172.21.15.138:0/1941474013 wait complete. 2024-02-15T22:42:12.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:12 smithi138 ceph-mon[29229]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:12.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:12 smithi138 ceph-mon[29229]: Saving service alertmanager spec with placement count:1 2024-02-15T22:42:12.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:12 smithi138 ceph-mon[29229]: from='mgr.14118 172.21.15.138:0/3997549400' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:13.242 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.429+0000 7f827ee22700 1 Processor -- start 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.429+0000 7f827ee22700 1 -- start start 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.429+0000 7f827ee22700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.429+0000 7f827ee22700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827807a810 con 0x7f827807bdd0 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f827cbbe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f827cbbe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41446/0 (socket says 172.21.15.138:41446) 2024-02-15T22:42:13.243 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f827cbbe700 1 -- 172.21.15.138:0/4144707383 learned_addr learned my addr 172.21.15.138:0/4144707383 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f827cbbe700 1 -- 172.21.15.138:0/4144707383 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827807a950 con 0x7f827807bdd0 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f827cbbe700 1 --2- 172.21.15.138:0/4144707383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8274009870 tx=0x7f8274009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8cf899cdf75c8a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f826f7fe700 1 -- 172.21.15.138:0/4144707383 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8274005c30 con 0x7f827807bdd0 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f826f7fe700 1 -- 172.21.15.138:0/4144707383 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82740044e0 con 0x7f827807bdd0 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.430+0000 7f826f7fe700 1 -- 172.21.15.138:0/4144707383 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8274006030 con 0x7f827807bdd0 2024-02-15T22:42:13.244 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- 172.21.15.138:0/4144707383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 msgr2=0x7f827807a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 --2- 172.21.15.138:0/4144707383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8274009870 tx=0x7f8274009b80 comp rx=0 tx=0).stop 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- 172.21.15.138:0/4144707383 shutdown_connections 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 --2- 172.21.15.138:0/4144707383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827807a2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- 172.21.15.138:0/4144707383 >> 172.21.15.138:0/4144707383 conn(0x7f8278101020 msgr2=0x7f8278103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- 172.21.15.138:0/4144707383 shutdown_connections 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- 172.21.15.138:0/4144707383 wait complete. 2024-02-15T22:42:13.245 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 Processor -- start 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.431+0000 7f827ee22700 1 -- start start 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827ee22700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827ee22700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827819bf30 con 0x7f827807bdd0 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827cbbe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827cbbe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41460/0 (socket says 172.21.15.138:41460) 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827cbbe700 1 -- 172.21.15.138:0/3414599428 learned_addr learned my addr 172.21.15.138:0/3414599428 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:13.246 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827cbbe700 1 -- 172.21.15.138:0/3414599428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009500 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827cbbe700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8274013000 tx=0x7f82740042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8274005e40 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8274005fa0 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827819c130 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8274011bc0 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.432+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827819c5d0 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.433+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8274018070 con 0x7f827807bdd0 2024-02-15T22:42:13.247 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.433+0000 7f826dffb700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 0x7f826003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.433+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f827404b910 con 0x7f827807bdd0 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.433+0000 7f826ffff700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 0x7f826003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.434+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8278062380 con 0x7f827807bdd0 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.434+0000 7f826ffff700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 0x7f826003a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8268006fd0 tx=0x7f8268006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.438+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f827401f020 con 0x7f827807bdd0 2024-02-15T22:42:13.248 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.626+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f827819f300 con 0x7f827807bdd0 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.630+0000 7f826dffb700 1 -- 172.21.15.138:0/3414599428 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f827402c350 con 0x7f827807bdd0 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 msgr2=0x7f826003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 0x7f826003a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8268006fd0 tx=0x7f8268006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 msgr2=0x7f827819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8274013000 tx=0x7f82740042e0 comp rx=0 tx=0).stop 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 shutdown_connections 2024-02-15T22:42:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f82600383b0 0x7f826003a860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:13.250 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 --2- 172.21.15.138:0/3414599428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827807bdd0 0x7f827819b9f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:13.250 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.632+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 >> 172.21.15.138:0/3414599428 conn(0x7f8278101020 msgr2=0x7f8278102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:13.250 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.633+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 shutdown_connections 2024-02-15T22:42:13.250 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:12.633+0000 7f827ee22700 1 -- 172.21.15.138:0/3414599428 wait complete. 2024-02-15T22:42:13.902 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:13 smithi138 ceph-mon[29229]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:13.904 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:13 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3414599428' entity='client.admin' 2024-02-15T22:42:14.482 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.704+0000 7fd635787700 1 Processor -- start 2024-02-15T22:42:14.482 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.704+0000 7fd635787700 1 -- start start 2024-02-15T22:42:14.482 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.704+0000 7fd635787700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:14.482 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.704+0000 7fd635787700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630106370 con 0x7fd630074490 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46156/0 (socket says 172.21.15.138:46156) 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62effd700 1 -- 172.21.15.138:0/4207429850 learned_addr learned my addr 172.21.15.138:0/4207429850 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62effd700 1 -- 172.21.15.138:0/4207429850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63010aec0 con 0x7fd630074490 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62effd700 1 --2- 172.21.15.138:0/4207429850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6200098a0 tx=0x7fd620009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298a0330218729c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62e7fc700 1 -- 172.21.15.138:0/4207429850 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd620004180 con 0x7fd630074490 2024-02-15T22:42:14.483 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62e7fc700 1 -- 172.21.15.138:0/4207429850 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6200042e0 con 0x7fd630074490 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.705+0000 7fd62e7fc700 1 -- 172.21.15.138:0/4207429850 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd620011af0 con 0x7fd630074490 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 -- 172.21.15.138:0/4207429850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 msgr2=0x7fd63010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 --2- 172.21.15.138:0/4207429850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6200098a0 tx=0x7fd620009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 -- 172.21.15.138:0/4207429850 shutdown_connections 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 --2- 172.21.15.138:0/4207429850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd630074490 0x7fd63010a980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 -- 172.21.15.138:0/4207429850 >> 172.21.15.138:0/4207429850 conn(0x7fd6300fff10 msgr2=0x7fd630102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 -- 172.21.15.138:0/4207429850 shutdown_connections 2024-02-15T22:42:14.484 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 -- 172.21.15.138:0/4207429850 wait complete. 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.706+0000 7fd635787700 1 Processor -- start 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd635787700 1 -- start start 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd635787700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd635787700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63019c2c0 con 0x7fd63019b970 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46166/0 (socket says 172.21.15.138:46166) 2024-02-15T22:42:14.485 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62effd700 1 -- 172.21.15.138:0/2909811262 learned_addr learned my addr 172.21.15.138:0/2909811262 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62effd700 1 -- 172.21.15.138:0/2909811262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009550 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62effd700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd620011670 tx=0x7fd620011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.707+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6200039c0 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.708+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd620003b20 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.708+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63019c4c0 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.708+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6200247f0 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.708+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63019f120 con 0x7fd63019b970 2024-02-15T22:42:14.486 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.708+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd620024ab0 con 0x7fd63019b970 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.709+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd630074490 con 0x7fd63019b970 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.709+0000 7fd62cff9700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 0x7fd61c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.709+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd62004c4f0 con 0x7fd63019b970 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.709+0000 7fd6267fc700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 0x7fd61c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.709+0000 7fd6267fc700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 0x7fd61c03a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd618006fd0 tx=0x7fd618006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.714+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd620024d60 con 0x7fd63019b970 2024-02-15T22:42:14.487 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.900+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd63019f4b0 con 0x7fd63019b970 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.906+0000 7fd62cff9700 1 -- 172.21.15.138:0/2909811262 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd620018350 con 0x7fd63019b970 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.908+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 msgr2=0x7fd61c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.908+0000 7fd635787700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 0x7fd61c03a860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd618006fd0 tx=0x7fd618006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.908+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 msgr2=0x7fd63019bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.908+0000 7fd635787700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd620011670 tx=0x7fd620011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.908+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 shutdown_connections 2024-02-15T22:42:14.488 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.909+0000 7fd635787700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fd61c0383b0 0x7fd61c03a860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:14.489 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.909+0000 7fd635787700 1 --2- 172.21.15.138:0/2909811262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd63019b970 0x7fd63019bd80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:14.489 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.909+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 >> 172.21.15.138:0/2909811262 conn(0x7fd6300fff10 msgr2=0x7fd6301015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:14.489 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.909+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 shutdown_connections 2024-02-15T22:42:14.489 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:13.909+0000 7fd635787700 1 -- 172.21.15.138:0/2909811262 wait complete. 2024-02-15T22:42:14.489 INFO:teuthology.orchestra.run.smithi138.stdout:Enabling the dashboard module... 2024-02-15T22:42:15.146 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:14 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2909811262' entity='client.admin' 2024-02-15T22:42:15.147 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:14 smithi138 ceph-mon[29229]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:16.217 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:15 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1551482744' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.893+0000 7f5234f6e700 1 Processor -- start 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.893+0000 7f5234f6e700 1 -- start start 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.893+0000 7f5234f6e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.893+0000 7f5234f6e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301067f0 con 0x7f5230105ea0 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.893+0000 7f522e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46176/0 (socket says 172.21.15.138:46176) 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522e59c700 1 -- 172.21.15.138:0/1980371485 learned_addr learned my addr 172.21.15.138:0/1980371485 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522e59c700 1 -- 172.21.15.138:0/1980371485 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230106930 con 0x7f5230105ea0 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522e59c700 1 --2- 172.21.15.138:0/1980371485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52200098a0 tx=0x7f5220009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd577329bb45078 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522dd9b700 1 -- 172.21.15.138:0/1980371485 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220004180 con 0x7f5230105ea0 2024-02-15T22:42:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522dd9b700 1 -- 172.21.15.138:0/1980371485 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52200042e0 con 0x7f5230105ea0 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.894+0000 7f522dd9b700 1 -- 172.21.15.138:0/1980371485 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220011af0 con 0x7f5230105ea0 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 -- 172.21.15.138:0/1980371485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 msgr2=0x7f52301062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1980371485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52200098a0 tx=0x7f5220009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 -- 172.21.15.138:0/1980371485 shutdown_connections 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1980371485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f52301062b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 -- 172.21.15.138:0/1980371485 >> 172.21.15.138:0/1980371485 conn(0x7f52300ff670 msgr2=0x7f5230101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 -- 172.21.15.138:0/1980371485 shutdown_connections 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 -- 172.21.15.138:0/1980371485 wait complete. 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.895+0000 7f5234f6e700 1 Processor -- start 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5234f6e700 1 -- start start 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5234f6e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5234f6e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230190010 con 0x7f5230105ea0 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f522e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f522e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46180/0 (socket says 172.21.15.138:46180) 2024-02-15T22:42:16.477 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f522e59c700 1 -- 172.21.15.138:0/1551482744 learned_addr learned my addr 172.21.15.138:0/1551482744 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f522e59c700 1 -- 172.21.15.138:0/1551482744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220009550 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f522e59c700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5220011670 tx=0x7f5220011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220003a40 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5220003ba0 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523018e120 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220024820 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.896+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523018e5c0 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.897+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f5220024ae0 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.897+0000 7f5227fff700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 0x7f521c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.897+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5230062380 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.897+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f522004c320 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.897+0000 7f5225d9b700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 0x7f521c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.898+0000 7f5225d9b700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 0x7f521c03a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:14.902+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5220022310 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.145+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f52301057e0 con 0x7f5230105ea0 2024-02-15T22:42:16.478 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.915+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f522001ac70 con 0x7f5230105ea0 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.917+0000 7f5227fff700 1 -- 172.21.15.138:0/1551482744 <== mon.0 v2:172.21.15.138:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f5220022310 con 0x7f5230105ea0 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 msgr2=0x7f521c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 0x7f521c03a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 msgr2=0x7f523018fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5220011670 tx=0x7f5220011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 shutdown_connections 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7f521c0383b0 0x7f521c03a860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 --2- 172.21.15.138:0/1551482744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5230105ea0 0x7f523018fad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 >> 172.21.15.138:0/1551482744 conn(0x7f52300ff670 msgr2=0x7f5230104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 shutdown_connections 2024-02-15T22:42:16.479 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:15.920+0000 7f5234f6e700 1 -- 172.21.15.138:0/1551482744 wait complete. 2024-02-15T22:42:16.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:16 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1551482744' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-15T22:42:16.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:16 smithi138 ceph-mon[29229]: mgrmap e9: smithi138.jqscxs(active, since 25s) 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "active_name": "smithi138.jqscxs", 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd3d3b700 1 Processor -- start 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd3d3b700 1 -- start start 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd3d3b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:17.775 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd3d3b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc079d50 con 0x7ffbcc104260 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd1ad7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd1ad7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46214/0 (socket says 172.21.15.138:46214) 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.919+0000 7ffbd1ad7700 1 -- 172.21.15.138:0/4012541248 learned_addr learned my addr 172.21.15.138:0/4012541248 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.920+0000 7ffbd1ad7700 1 -- 172.21.15.138:0/4012541248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc079e90 con 0x7ffbcc104260 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.920+0000 7ffbd1ad7700 1 --2- 172.21.15.138:0/4012541248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098a0 tx=0x7ffbc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d8c2a57e439b62 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.920+0000 7ffbd0ad5700 1 -- 172.21.15.138:0/4012541248 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc8004180 con 0x7ffbcc104260 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.920+0000 7ffbd0ad5700 1 -- 172.21.15.138:0/4012541248 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffbc80042e0 con 0x7ffbcc104260 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.920+0000 7ffbd0ad5700 1 -- 172.21.15.138:0/4012541248 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc8011af0 con 0x7ffbcc104260 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/4012541248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 msgr2=0x7ffbcc106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/4012541248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80098a0 tx=0x7ffbc8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/4012541248 shutdown_connections 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/4012541248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc106680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/4012541248 >> 172.21.15.138:0/4012541248 conn(0x7ffbcc0ffeb0 msgr2=0x7ffbcc1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:17.776 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/4012541248 shutdown_connections 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/4012541248 wait complete. 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 Processor -- start 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 -- start start 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.921+0000 7ffbd3d3b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd3d3b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1a01e0 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd1ad7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd1ad7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46226/0 (socket says 172.21.15.138:46226) 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd1ad7700 1 -- 172.21.15.138:0/2013107476 learned_addr learned my addr 172.21.15.138:0/2013107476 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd1ad7700 1 -- 172.21.15.138:0/2013107476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009550 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd1ad7700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8000c00 tx=0x7ffbc8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc8003a70 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffbc8003bd0 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc1a03e0 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc80238c0 con 0x7ffbcc104260 2024-02-15T22:42:17.777 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.922+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc1a0880 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.923+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7ffbc8023b30 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.923+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc199540 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.924+0000 7ffbc2ffd700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.924+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffbc804c230 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.924+0000 7ffbd12d6700 1 -- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 msgr2=0x7ffbb803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.924+0000 7ffbd12d6700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:16.928+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffbc802b300 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.125+0000 7ffbd12d6700 1 -- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 msgr2=0x7ffbb803a940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.125+0000 7ffbd12d6700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.175+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ffbcc02cc30 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.175+0000 7ffbc2ffd700 1 -- 172.21.15.138:0/2013107476 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ffbc8010b30 con 0x7ffbcc104260 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 msgr2=0x7ffbb803a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 msgr2=0x7ffbcc19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:17.778 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8000c00 tx=0x7ffbc8011b50 comp rx=0 tx=0).stop 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 shutdown_connections 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 --2- 172.21.15.138:0/2013107476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffbcc104260 0x7ffbcc19fca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 >> 172.21.15.138:0/2013107476 conn(0x7ffbcc0ffeb0 msgr2=0x7ffbcc10a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 shutdown_connections 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:17.178+0000 7ffbd3d3b700 1 -- 172.21.15.138:0/2013107476 wait complete. 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for the mgr to restart... 2024-02-15T22:42:17.779 INFO:teuthology.orchestra.run.smithi138.stdout:Waiting for mgr epoch 9... 2024-02-15T22:42:18.093 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:17 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2013107476' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T22:42:23.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: Active manager daemon smithi138.jqscxs restarted 2024-02-15T22:42:23.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:42:23.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: osdmap e3: 0 total, 0 up, 0 in 2024-02-15T22:42:23.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: mgrmap e10: smithi138.jqscxs(active, starting, since 0.00437827s) 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:42:23.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:23 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout { 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout } 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ef082700 1 Processor -- start 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ef082700 1 -- start start 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ef082700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ef082700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80744d0 con 0x7fa1e8106530 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ece1e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ece1e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46232/0 (socket says 172.21.15.138:46232) 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ece1e700 1 -- 172.21.15.138:0/493746420 learned_addr learned my addr 172.21.15.138:0/493746420 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ece1e700 1 -- 172.21.15.138:0/493746420 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8074610 con 0x7fa1e8106530 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.193+0000 7fa1ece1e700 1 --2- 172.21.15.138:0/493746420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0098a0 tx=0x7fa1dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814fb088a8613124 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1e77fe700 1 -- 172.21.15.138:0/493746420 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1dc004180 con 0x7fa1e8106530 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1e77fe700 1 -- 172.21.15.138:0/493746420 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1dc0042e0 con 0x7fa1e8106530 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1e77fe700 1 -- 172.21.15.138:0/493746420 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1dc011af0 con 0x7fa1e8106530 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 -- 172.21.15.138:0/493746420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 msgr2=0x7fa1e8108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 --2- 172.21.15.138:0/493746420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0098a0 tx=0x7fa1dc009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 -- 172.21.15.138:0/493746420 shutdown_connections 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 --2- 172.21.15.138:0/493746420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8108910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 -- 172.21.15.138:0/493746420 >> 172.21.15.138:0/493746420 conn(0x7fa1e80fff10 msgr2=0x7fa1e8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 -- 172.21.15.138:0/493746420 shutdown_connections 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.194+0000 7fa1ef082700 1 -- 172.21.15.138:0/493746420 wait complete. 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ef082700 1 Processor -- start 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ef082700 1 -- start start 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ef082700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ef082700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e81063d0 con 0x7fa1e8106530 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ece1e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ece1e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46246/0 (socket says 172.21.15.138:46246) 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ece1e700 1 -- 172.21.15.138:0/1799325532 learned_addr learned my addr 172.21.15.138:0/1799325532 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.195+0000 7fa1ece1e700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc009550 con 0x7fa1e8106530 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1ece1e700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc011670 tx=0x7fa1dc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1dc0039c0 con 0x7fa1e8106530 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1dc003b20 con 0x7fa1e8106530 2024-02-15T22:42:24.679 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e8104540 con 0x7fa1e8106530 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1dc0247f0 con 0x7fa1e8106530 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.196+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e8104a40 con 0x7fa1e8106530 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fa1dc024ab0 con 0x7fa1e8106530 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1e5ffb700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1e8109a40 con 0x7fa1d8038400 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa1dc04c520 con 0x7fa1e8106530 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1e7fff700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.197+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.398+0000 7fa1e7fff700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.398+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.799+0000 7fa1e7fff700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:18.799+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:19.600+0000 7fa1e7fff700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:24.680 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:19.600+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:21.201+0000 7fa1e7fff700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/2928099655 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:21.201+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:22.747+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7fa1dc01ac70 con 0x7fa1e8106530 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:22.747+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 msgr2=0x7fa1d803a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:22.747+0000 7fa1e5ffb700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.748+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fa1dc04dcb0 con 0x7fa1e8106530 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.748+0000 7fa1e5ffb700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 0x7fa1d803e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.748+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1e8109a40 con 0x7fa1d803bd00 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.748+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 0x7fa1d803e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.749+0000 7fa1e7fff700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 0x7fa1d803e0e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003a10 tx=0x7fa1d40092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.749+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fa1e8109a40 con 0x7fa1d803bd00 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa1e8105a30 con 0x7fa1d803bd00 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1e5ffb700 1 -- 172.21.15.138:0/1799325532 <== mgr.14162 v2:172.21.15.138:6800/3454666203 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fa1e8105a30 con 0x7fa1d803bd00 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 msgr2=0x7fa1d803e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:24.681 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 0x7fa1d803e0e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003a10 tx=0x7fa1d40092b0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 msgr2=0x7fa1e8105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc011670 tx=0x7fa1dc011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 shutdown_connections 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fa1d803bd00 0x7fa1d803e0e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1e8106530 0x7fa1e8105e90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 --2- 172.21.15.138:0/1799325532 >> [v2:172.21.15.138:6800/2928099655,v1:172.21.15.138:6801/2928099655] conn(0x7fa1d8038400 0x7fa1d803a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 >> 172.21.15.138:0/1799325532 conn(0x7fa1e80fff10 msgr2=0x7fa1e8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 shutdown_connections 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:23.756+0000 7fa1ef082700 1 -- 172.21.15.138:0/1799325532 wait complete. 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:mgr epoch 9 is available 2024-02-15T22:42:24.682 INFO:teuthology.orchestra.run.smithi138.stdout:Generating a dashboard self-signed certificate... 2024-02-15T22:42:24.978 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: [15/Feb/2024:22:42:23] ENGINE Bus STARTING 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: [15/Feb/2024:22:42:23] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: [15/Feb/2024:22:42:23] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: [15/Feb/2024:22:42:23] ENGINE Bus STARTED 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: mgrmap e11: smithi138.jqscxs(active, since 1.0062s) 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T22:42:24.979 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:24 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f230d615700 1 Processor -- start 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f230d615700 1 -- start start 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f230d615700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f230d615700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308105200 con 0x7f23081048b0 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f2306ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f2306ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40260/0 (socket says 172.21.15.138:40260) 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f2306ffd700 1 -- 172.21.15.138:0/3871877658 learned_addr learned my addr 172.21.15.138:0/3871877658 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:25.948 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.078+0000 7f2306ffd700 1 -- 172.21.15.138:0/3871877658 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308105340 con 0x7f23081048b0 2024-02-15T22:42:25.949 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f2306ffd700 1 --2- 172.21.15.138:0/3871877658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22f80098a0 tx=0x7f22f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f01bc29da0a1e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:25.951 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f2305ffb700 1 -- 172.21.15.138:0/3871877658 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f8004180 con 0x7f23081048b0 2024-02-15T22:42:25.951 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f2305ffb700 1 -- 172.21.15.138:0/3871877658 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22f80042e0 con 0x7f23081048b0 2024-02-15T22:42:25.951 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f2305ffb700 1 -- 172.21.15.138:0/3871877658 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f8011af0 con 0x7f23081048b0 2024-02-15T22:42:25.951 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 -- 172.21.15.138:0/3871877658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 msgr2=0x7f2308104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:25.951 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 --2- 172.21.15.138:0/3871877658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22f80098a0 tx=0x7f22f8009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 -- 172.21.15.138:0/3871877658 shutdown_connections 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 --2- 172.21.15.138:0/3871877658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f2308104cc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 -- 172.21.15.138:0/3871877658 >> 172.21.15.138:0/3871877658 conn(0x7f23080ffee0 msgr2=0x7f2308102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 -- 172.21.15.138:0/3871877658 shutdown_connections 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.079+0000 7f230d615700 1 -- 172.21.15.138:0/3871877658 wait complete. 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f230d615700 1 Processor -- start 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f230d615700 1 -- start start 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f230d615700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f230d615700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230818ffd0 con 0x7f23081048b0 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f2306ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f2306ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40274/0 (socket says 172.21.15.138:40274) 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.080+0000 7f2306ffd700 1 -- 172.21.15.138:0/393323476 learned_addr learned my addr 172.21.15.138:0/393323476 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:25.952 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f2306ffd700 1 -- 172.21.15.138:0/393323476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8009550 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f2306ffd700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22f8011670 tx=0x7f22f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f8003a40 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f22f8003ba0 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22f8024820 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230818e0e0 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.081+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230818e580 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f22f801ac70 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f22effff700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 0x7f22f003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f22f804c280 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2308062380 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f23067fc700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 0x7f22f003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.082+0000 7f23067fc700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 0x7f22f003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.087+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f22f802d3f0 con 0x7f23081048b0 2024-02-15T22:42:25.953 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.290+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f23081068f0 con 0x7f22f0038330 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.355+0000 7f22effff700 1 -- 172.21.15.138:0/393323476 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f23081068f0 con 0x7f22f0038330 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 msgr2=0x7f22f003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 0x7f22f003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 msgr2=0x7f230818fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22f8011670 tx=0x7f22f8011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 shutdown_connections 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f22f0038330 0x7f22f003a7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 --2- 172.21.15.138:0/393323476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23081048b0 0x7f230818fa90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 >> 172.21.15.138:0/393323476 conn(0x7f23080ffee0 msgr2=0x7f2308101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 shutdown_connections 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:25.358+0000 7f230d615700 1 -- 172.21.15.138:0/393323476 wait complete. 2024-02-15T22:42:25.954 INFO:teuthology.orchestra.run.smithi138.stdout:Creating initial admin user... 2024-02-15T22:42:26.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:26 smithi138 ceph-mon[29229]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:26.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:26 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:26.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:26 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:26.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:26 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:26.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:26 smithi138 ceph-mon[29229]: mgrmap e12: smithi138.jqscxs(active, since 3s) 2024-02-15T22:42:27.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:27 smithi138 ceph-mon[29229]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:27.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:27 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:28.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lu37pvYuj9Ktbmu72m7DeO5.j/c8lKm0e9uef78IoP50LuvBgQxXC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708036946, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-15T22:42:28.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c892e700 1 Processor -- start 2024-02-15T22:42:28.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c892e700 1 -- start start 2024-02-15T22:42:28.044 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c892e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c892e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4105220 con 0x7fe8c41048d0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40278/0 (socket says 172.21.15.138:40278) 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.335+0000 7fe8c259c700 1 -- 172.21.15.138:0/3885161177 learned_addr learned my addr 172.21.15.138:0/3885161177 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.336+0000 7fe8c259c700 1 -- 172.21.15.138:0/3885161177 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4105360 con 0x7fe8c41048d0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.336+0000 7fe8c259c700 1 --2- 172.21.15.138:0/3885161177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098a0 tx=0x7fe8b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79576cefd0061216 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.336+0000 7fe8c159a700 1 -- 172.21.15.138:0/3885161177 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8b4004180 con 0x7fe8c41048d0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.336+0000 7fe8c159a700 1 -- 172.21.15.138:0/3885161177 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8b40042e0 con 0x7fe8c41048d0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.336+0000 7fe8c159a700 1 -- 172.21.15.138:0/3885161177 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8b4011af0 con 0x7fe8c41048d0 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- 172.21.15.138:0/3885161177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 msgr2=0x7fe8c4104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3885161177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098a0 tx=0x7fe8b4009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- 172.21.15.138:0/3885161177 shutdown_connections 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3885161177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4104ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- 172.21.15.138:0/3885161177 >> 172.21.15.138:0/3885161177 conn(0x7fe8c40fff00 msgr2=0x7fe8c4102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:28.045 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- 172.21.15.138:0/3885161177 shutdown_connections 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- 172.21.15.138:0/3885161177 wait complete. 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 Processor -- start 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.337+0000 7fe8c892e700 1 -- start start 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c892e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c892e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4199c60 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40286/0 (socket says 172.21.15.138:40286) 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c259c700 1 -- 172.21.15.138:0/3759540230 learned_addr learned my addr 172.21.15.138:0/3759540230 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c259c700 1 -- 172.21.15.138:0/3759540230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009550 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c259c700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4011670 tx=0x7fe8b4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8b4003a40 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c4199e60 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8b4003ba0 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8b4024820 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.338+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c419a300 con 0x7fe8c41048d0 2024-02-15T22:42:28.046 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.339+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe8b4024ae0 con 0x7fe8c41048d0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.339+0000 7fe8b37fe700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 0x7fe8ac03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.339+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe8b404c510 con 0x7fe8c41048d0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.339+0000 7fe8c1d9b700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 0x7fe8ac03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.339+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4062380 con 0x7fe8c41048d0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.340+0000 7fe8c1d9b700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 0x7fe8ac03a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006fd0 tx=0x7fe8b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.344+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe8b4022310 con 0x7fe8c41048d0 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.555+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe8c40621a0 con 0x7fe8ac038400 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.777+0000 7fe8b37fe700 1 -- 172.21.15.138:0/3759540230 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe8c40621a0 con 0x7fe8ac038400 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 msgr2=0x7fe8ac03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 0x7fe8ac03a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006fd0 tx=0x7fe8b8006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 msgr2=0x7fe8c4199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4011670 tx=0x7fe8b4011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 shutdown_connections 2024-02-15T22:42:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe8ac038400 0x7fe8ac03a8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:28.048 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 --2- 172.21.15.138:0/3759540230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c41048d0 0x7fe8c4199720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:28.048 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 >> 172.21.15.138:0/3759540230 conn(0x7fe8c40fff00 msgr2=0x7fe8c40798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:28.048 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 shutdown_connections 2024-02-15T22:42:28.048 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:26.779+0000 7fe8c892e700 1 -- 172.21.15.138:0/3759540230 wait complete. 2024-02-15T22:42:28.048 INFO:teuthology.orchestra.run.smithi138.stdout:Fetching dashboard port number... 2024-02-15T22:42:28.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3632114271' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stdout 8443 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.439+0000 7f225ec53700 1 Processor -- start 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225ec53700 1 -- start start 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225ec53700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225ec53700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258079d10 con 0x7f2258106510 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225c9ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225c9ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40294/0 (socket says 172.21.15.138:40294) 2024-02-15T22:42:29.209 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225c9ef700 1 -- 172.21.15.138:0/2365207847 learned_addr learned my addr 172.21.15.138:0/2365207847 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225c9ef700 1 -- 172.21.15.138:0/2365207847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258079e50 con 0x7f2258106510 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.440+0000 7f225c9ef700 1 --2- 172.21.15.138:0/2365207847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098a0 tx=0x7f224c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5d756a52329c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f22577fe700 1 -- 172.21.15.138:0/2365207847 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c004180 con 0x7f2258106510 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f22577fe700 1 -- 172.21.15.138:0/2365207847 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f224c0042e0 con 0x7f2258106510 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f22577fe700 1 -- 172.21.15.138:0/2365207847 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c011af0 con 0x7f2258106510 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 -- 172.21.15.138:0/2365207847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 msgr2=0x7f22581088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 --2- 172.21.15.138:0/2365207847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f224c0098a0 tx=0x7f224c009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 -- 172.21.15.138:0/2365207847 shutdown_connections 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 --2- 172.21.15.138:0/2365207847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f22581088f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 -- 172.21.15.138:0/2365207847 >> 172.21.15.138:0/2365207847 conn(0x7f22580ffed0 msgr2=0x7f2258102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 -- 172.21.15.138:0/2365207847 shutdown_connections 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.441+0000 7f225ec53700 1 -- 172.21.15.138:0/2365207847 wait complete. 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225ec53700 1 Processor -- start 2024-02-15T22:42:29.210 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225ec53700 1 -- start start 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225ec53700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225ec53700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22581063b0 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225c9ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225c9ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40300/0 (socket says 172.21.15.138:40300) 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225c9ef700 1 -- 172.21.15.138:0/3632114271 learned_addr learned my addr 172.21.15.138:0/3632114271 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225c9ef700 1 -- 172.21.15.138:0/3632114271 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009550 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.442+0000 7f225c9ef700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f224c011670 tx=0x7f224c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.443+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c0039c0 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.443+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f224c003b20 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.443+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f224c0247f0 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.443+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2258104520 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.443+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2258104a20 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.444+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f224c01ac70 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.444+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2258109a20 con 0x7f2258106510 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.444+0000 7f2255ffb700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 0x7f224803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:29.211 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.444+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f224c04c3e0 con 0x7f2258106510 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.444+0000 7f2257fff700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 0x7f224803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.445+0000 7f2257fff700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 0x7f224803a900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2244006fd0 tx=0x7f2244006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.449+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f224c024a60 con 0x7f2258106510 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.637+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f2258109c40 con 0x7f2258106510 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.638+0000 7f2255ffb700 1 -- 172.21.15.138:0/3632114271 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f224c018350 con 0x7f2258106510 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 msgr2=0x7f224803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 0x7f224803a900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2244006fd0 tx=0x7f2244006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 msgr2=0x7f2258105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f224c011670 tx=0x7f224c011aa0 comp rx=0 tx=0).stop 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 shutdown_connections 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f2248038450 0x7f224803a900 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 --2- 172.21.15.138:0/3632114271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2258106510 0x7f2258105e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 >> 172.21.15.138:0/3632114271 conn(0x7f22580ffed0 msgr2=0x7f22581015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:29.212 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 shutdown_connections 2024-02-15T22:42:29.213 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:28.640+0000 7f225ec53700 1 -- 172.21.15.138:0/3632114271 wait complete. 2024-02-15T22:42:29.215 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-15T22:42:29.216 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout disabled 2024-02-15T22:42:29.222 INFO:teuthology.orchestra.run.smithi138.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-15T22:42:29.222 INFO:teuthology.orchestra.run.smithi138.stdout:systemctl: stdout inactive 2024-02-15T22:42:29.222 INFO:teuthology.orchestra.run.smithi138.stdout:firewalld.service is not enabled 2024-02-15T22:42:29.223 INFO:teuthology.orchestra.run.smithi138.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-15T22:42:29.224 INFO:teuthology.orchestra.run.smithi138.stdout:Ceph Dashboard is now available at: 2024-02-15T22:42:29.224 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: URL: https://smithi138.front.sepia.ceph.com:8443/ 2024-02-15T22:42:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: User: admin 2024-02-15T22:42:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: Password: oe2zkqwnch 2024-02-15T22:42:29.227 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:29.228 INFO:teuthology.orchestra.run.smithi138.stdout:Saving cluster configuration to /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config directory 2024-02-15T22:42:29.228 INFO:teuthology.orchestra.run.smithi138.stdout:Enabling autotune for osd_memory_target 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf6d831700 1 Processor -- start 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf6d831700 1 -- start start 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf6d831700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf6d831700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68106310 con 0x7fcf681059c0 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf66ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf66ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40316/0 (socket says 172.21.15.138:40316) 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf66ffd700 1 -- 172.21.15.138:0/2704407889 learned_addr learned my addr 172.21.15.138:0/2704407889 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf66ffd700 1 -- 172.21.15.138:0/2704407889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68106450 con 0x7fcf681059c0 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.654+0000 7fcf66ffd700 1 --2- 172.21.15.138:0/2704407889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098a0 tx=0x7fcf50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92baa2126ae4b2e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:30.445 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf65ffb700 1 -- 172.21.15.138:0/2704407889 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50004180 con 0x7fcf681059c0 2024-02-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf65ffb700 1 -- 172.21.15.138:0/2704407889 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf500042e0 con 0x7fcf681059c0 2024-02-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf65ffb700 1 -- 172.21.15.138:0/2704407889 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50011af0 con 0x7fcf681059c0 2024-02-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 -- 172.21.15.138:0/2704407889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 msgr2=0x7fcf68105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:30.453 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 --2- 172.21.15.138:0/2704407889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098a0 tx=0x7fcf50009bb0 comp rx=0 tx=0).stop 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 -- 172.21.15.138:0/2704407889 shutdown_connections 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 --2- 172.21.15.138:0/2704407889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68105dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 -- 172.21.15.138:0/2704407889 >> 172.21.15.138:0/2704407889 conn(0x7fcf68100fd0 msgr2=0x7fcf68103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 -- 172.21.15.138:0/2704407889 shutdown_connections 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.655+0000 7fcf6d831700 1 -- 172.21.15.138:0/2704407889 wait complete. 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf6d831700 1 Processor -- start 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf6d831700 1 -- start start 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf6d831700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf6d831700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68199c90 con 0x7fcf681059c0 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf66ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf66ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40328/0 (socket says 172.21.15.138:40328) 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf66ffd700 1 -- 172.21.15.138:0/4290171484 learned_addr learned my addr 172.21.15.138:0/4290171484 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.656+0000 7fcf66ffd700 1 -- 172.21.15.138:0/4290171484 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009550 con 0x7fcf681059c0 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf66ffd700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011670 tx=0x7fcf50011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:30.454 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50003a40 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf50003ba0 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf68199e90 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf50024790 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.657+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6819a330 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fcf5002d3f0 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf6c82f700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 0x7fcf5403a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcf5004c6e0 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf667fc700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 0x7fcf5403a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68062380 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.658+0000 7fcf667fc700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 0x7fcf5403a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.663+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcf5002d740 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.780+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fcf5002d920 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.856+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fcf68109e60 con 0x7fcf681059c0 2024-02-15T22:42:30.455 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.856+0000 7fcf6c82f700 1 -- 172.21.15.138:0/4290171484 <== mon.0 v2:172.21.15.138:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fcf5001ac50 con 0x7fcf681059c0 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.858+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 msgr2=0x7fcf5403a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.858+0000 7fcf6d831700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 0x7fcf5403a8f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcf58006fd0 tx=0x7fcf58006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.858+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 msgr2=0x7fcf68199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.858+0000 7fcf6d831700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf50011670 tx=0x7fcf50011b50 comp rx=0 tx=0).stop 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 shutdown_connections 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fcf54038440 0x7fcf5403a8f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 --2- 172.21.15.138:0/4290171484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf681059c0 0x7fcf68199750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 >> 172.21.15.138:0/4290171484 conn(0x7fcf68100fd0 msgr2=0x7fcf681026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 shutdown_connections 2024-02-15T22:42:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:29.859+0000 7fcf6d831700 1 -- 172.21.15.138:0/4290171484 wait complete. 2024-02-15T22:42:31.166 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:30 smithi138 ceph-mon[29229]: mgrmap e13: smithi138.jqscxs(active, since 7s) 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a04527700 1 Processor -- start 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a04527700 1 -- start start 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a04527700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a04527700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc106320 con 0x7f39fc1059d0 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a022c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a022c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40330/0 (socket says 172.21.15.138:40330) 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.861+0000 7f3a022c3700 1 -- 172.21.15.138:0/3432990451 learned_addr learned my addr 172.21.15.138:0/3432990451 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a022c3700 1 -- 172.21.15.138:0/3432990451 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc106460 con 0x7f39fc1059d0 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a022c3700 1 --2- 172.21.15.138:0/3432990451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009870 tx=0x7f39f8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3163a71648a63d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a012c1700 1 -- 172.21.15.138:0/3432990451 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39f8005c30 con 0x7f39fc1059d0 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a012c1700 1 -- 172.21.15.138:0/3432990451 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39f80044e0 con 0x7f39fc1059d0 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a012c1700 1 -- 172.21.15.138:0/3432990451 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39f8006030 con 0x7f39fc1059d0 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a04527700 1 -- 172.21.15.138:0/3432990451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 msgr2=0x7f39fc105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.862+0000 7f3a04527700 1 --2- 172.21.15.138:0/3432990451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009870 tx=0x7f39f8009b80 comp rx=0 tx=0).stop 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- 172.21.15.138:0/3432990451 shutdown_connections 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 --2- 172.21.15.138:0/3432990451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc105de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- 172.21.15.138:0/3432990451 >> 172.21.15.138:0/3432990451 conn(0x7f39fc101020 msgr2=0x7f39fc103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- 172.21.15.138:0/3432990451 shutdown_connections 2024-02-15T22:42:31.748 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- 172.21.15.138:0/3432990451 wait complete. 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 Processor -- start 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- start start 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a04527700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc199c30 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a022c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a022c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40344/0 (socket says 172.21.15.138:40344) 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.863+0000 7f3a022c3700 1 -- 172.21.15.138:0/3812824687 learned_addr learned my addr 172.21.15.138:0/3812824687 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f3a022c3700 1 -- 172.21.15.138:0/3812824687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8009500 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f3a022c3700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39f80046b0 tx=0x7f39f80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39f8005e40 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39f8006840 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc199e30 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39f8011bc0 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.864+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc19a2d0 con 0x7f39fc1059d0 2024-02-15T22:42:31.749 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.865+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f39f8018070 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.865+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc109e60 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.865+0000 7f39f37fe700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 0x7f39e803a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.865+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f39f804bdd0 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.865+0000 7f3a01ac2700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 0x7f39e803a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.866+0000 7f3a01ac2700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 0x7f39e803a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006fd0 tx=0x7f39ec006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:30.870+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f39f8018500 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.165+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f39fc0623d0 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.170+0000 7f39f37fe700 1 -- 172.21.15.138:0/3812824687 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f39f804d0c0 con 0x7f39fc1059d0 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 msgr2=0x7f39e803a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 0x7f39e803a950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006fd0 tx=0x7f39ec006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 msgr2=0x7f39fc1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39f80046b0 tx=0x7f39f80042e0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 shutdown_connections 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f39e80384a0 0x7f39e803a950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.750 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 --2- 172.21.15.138:0/3812824687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39fc1059d0 0x7f39fc1996f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.172+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 >> 172.21.15.138:0/3812824687 conn(0x7f39fc101020 msgr2=0x7f39fc101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.173+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 shutdown_connections 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr 2024-02-15T22:42:31.173+0000 7f3a04527700 1 -- 172.21.15.138:0/3812824687 wait complete. 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:Or, if you are only running a single cluster on this host: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.751 INFO:teuthology.orchestra.run.smithi138.stdout: ceph telemetry on 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout:For more information see: 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:31.752 INFO:teuthology.orchestra.run.smithi138.stdout:Bootstrap complete. 2024-02-15T22:42:31.778 INFO:tasks.cephadm:Fetching config... 2024-02-15T22:42:31.778 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:42:31.779 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-15T22:42:31.837 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-15T22:42:31.837 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:42:31.837 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-15T22:42:31.897 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-15T22:42:31.897 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:42:31.897 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/keyring of=/dev/stdout 2024-02-15T22:42:31.966 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-15T22:42:31.966 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:42:31.966 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-15T22:42:32.024 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-15T22:42:32.024 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC193HhqFZ8otWaX7PscHE2byjO0dfMwzEuwsPRWdDmGlrcp8yuyjnqUocosp2YiEQT4yKPF7ohwzx8VcjjH88J4B1jynCVYZ1otdOgd4rfY0S0f5miy+IYuUl52oN2oXSL9xG0O4Yk9jf48L91GYd46OXz1aGtng9N3/839lWHPAeYzEc2oTegqSKITmQoW0zIcXbG2eH5DvYBVkgdPV4Fkp3cul13e08ul61ZZfXbxWGu0DktUqveVuNBMJob83jIS0RZNoL92iXLoiIckMm6VyrMP+aGAu6z0u2Dk/do9SwsMl1y3xzRuujrrYScqJ7pt8NmgLBk3NaGCoMwiHDp0TygRgclLC7bcepsBv45345tuzaRAFgzgfFixLkPxJaQYbCxp5ZN5am9r2LMr3K8ly6IMjXTR6T5VLW7AAw4i8PXm3whmvLcOLwr/LSbkdJnC3E0APtn/AhQ0j7G+UBxH4PnUGbsploV8aejJSpsfwW2kyzfcECXRNCz46Mp5ns= ceph-3fa87466-cc53-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T22:42:32.104 INFO:teuthology.orchestra.run.smithi138.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC193HhqFZ8otWaX7PscHE2byjO0dfMwzEuwsPRWdDmGlrcp8yuyjnqUocosp2YiEQT4yKPF7ohwzx8VcjjH88J4B1jynCVYZ1otdOgd4rfY0S0f5miy+IYuUl52oN2oXSL9xG0O4Yk9jf48L91GYd46OXz1aGtng9N3/839lWHPAeYzEc2oTegqSKITmQoW0zIcXbG2eH5DvYBVkgdPV4Fkp3cul13e08ul61ZZfXbxWGu0DktUqveVuNBMJob83jIS0RZNoL92iXLoiIckMm6VyrMP+aGAu6z0u2Dk/do9SwsMl1y3xzRuujrrYScqJ7pt8NmgLBk3NaGCoMwiHDp0TygRgclLC7bcepsBv45345tuzaRAFgzgfFixLkPxJaQYbCxp5ZN5am9r2LMr3K8ly6IMjXTR6T5VLW7AAw4i8PXm3whmvLcOLwr/LSbkdJnC3E0APtn/AhQ0j7G+UBxH4PnUGbsploV8aejJSpsfwW2kyzfcECXRNCz46Mp5ns= ceph-3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:42:32.119 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC193HhqFZ8otWaX7PscHE2byjO0dfMwzEuwsPRWdDmGlrcp8yuyjnqUocosp2YiEQT4yKPF7ohwzx8VcjjH88J4B1jynCVYZ1otdOgd4rfY0S0f5miy+IYuUl52oN2oXSL9xG0O4Yk9jf48L91GYd46OXz1aGtng9N3/839lWHPAeYzEc2oTegqSKITmQoW0zIcXbG2eH5DvYBVkgdPV4Fkp3cul13e08ul61ZZfXbxWGu0DktUqveVuNBMJob83jIS0RZNoL92iXLoiIckMm6VyrMP+aGAu6z0u2Dk/do9SwsMl1y3xzRuujrrYScqJ7pt8NmgLBk3NaGCoMwiHDp0TygRgclLC7bcepsBv45345tuzaRAFgzgfFixLkPxJaQYbCxp5ZN5am9r2LMr3K8ly6IMjXTR6T5VLW7AAw4i8PXm3whmvLcOLwr/LSbkdJnC3E0APtn/AhQ0j7G+UBxH4PnUGbsploV8aejJSpsfwW2kyzfcECXRNCz46Mp5ns= ceph-3fa87466-cc53-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T22:42:32.167 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC193HhqFZ8otWaX7PscHE2byjO0dfMwzEuwsPRWdDmGlrcp8yuyjnqUocosp2YiEQT4yKPF7ohwzx8VcjjH88J4B1jynCVYZ1otdOgd4rfY0S0f5miy+IYuUl52oN2oXSL9xG0O4Yk9jf48L91GYd46OXz1aGtng9N3/839lWHPAeYzEc2oTegqSKITmQoW0zIcXbG2eH5DvYBVkgdPV4Fkp3cul13e08ul61ZZfXbxWGu0DktUqveVuNBMJob83jIS0RZNoL92iXLoiIckMm6VyrMP+aGAu6z0u2Dk/do9SwsMl1y3xzRuujrrYScqJ7pt8NmgLBk3NaGCoMwiHDp0TygRgclLC7bcepsBv45345tuzaRAFgzgfFixLkPxJaQYbCxp5ZN5am9r2LMr3K8ly6IMjXTR6T5VLW7AAw4i8PXm3whmvLcOLwr/LSbkdJnC3E0APtn/AhQ0j7G+UBxH4PnUGbsploV8aejJSpsfwW2kyzfcECXRNCz46Mp5ns= ceph-3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:42:32.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-15T22:42:32.390 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:42:32.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:32 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3812824687' entity='client.admin' 2024-02-15T22:42:35.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 -- 172.21.15.138:0/2171872338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 msgr2=0x7f55a4102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 --2- 172.21.15.138:0/2171872338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4102d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009910 tx=0x7f55a0009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 -- 172.21.15.138:0/2171872338 shutdown_connections 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 --2- 172.21.15.138:0/2171872338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4102d40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 -- 172.21.15.138:0/2171872338 >> 172.21.15.138:0/2171872338 conn(0x7f55a40fa2e0 msgr2=0x7f55a40fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 -- 172.21.15.138:0/2171872338 shutdown_connections 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.155+0000 7f55aafa0700 1 -- 172.21.15.138:0/2171872338 wait complete. 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55aafa0700 1 Processor -- start 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55aafa0700 1 -- start start 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55aafa0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55aafa0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41954c0 con 0x7f55a4100960 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55a8d3c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55a8d3c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37136/0 (socket says 172.21.15.138:37136) 2024-02-15T22:42:35.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55a8d3c700 1 -- 172.21.15.138:0/3122772252 learned_addr learned my addr 172.21.15.138:0/3122772252 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55a8d3c700 1 -- 172.21.15.138:0/3122772252 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00095f0 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55a8d3c700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55a00092e0 tx=0x7f55a0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a001d070 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55a000be10 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a41956c0 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.156+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f55a000f460 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.157+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4195b60 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.157+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f55a000f6d0 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.158+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a418eb10 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.158+0000 7f5599ffb700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 0x7f558c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.158+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f55a004c770 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.158+0000 7f559bfff700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 0x7f558c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.158+0000 7f559bfff700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 0x7f558c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5594006fd0 tx=0x7f5594006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.162+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55a0020bd0 con 0x7f55a4100960 2024-02-15T22:42:35.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.353+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f55a402cc30 con 0x7f55a4100960 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.356+0000 7f5599ffb700 1 -- 172.21.15.138:0/3122772252 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f55a0027020 con 0x7f55a4100960 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 msgr2=0x7f558c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 0x7f558c03a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5594006fd0 tx=0x7f5594006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 msgr2=0x7f55a4194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55a00092e0 tx=0x7f55a0009e60 comp rx=0 tx=0).stop 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 shutdown_connections 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f558c038490 0x7f558c03a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 --2- 172.21.15.138:0/3122772252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55a4100960 0x7f55a4194f80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 >> 172.21.15.138:0/3122772252 conn(0x7f55a40fa2e0 msgr2=0x7f55a40faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 shutdown_connections 2024-02-15T22:42:35.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:35.359+0000 7f55aafa0700 1 -- 172.21.15.138:0/3122772252 wait complete. 2024-02-15T22:42:35.943 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-15T22:42:35.944 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-15T22:42:36.474 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:42:36.600 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:36 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3122772252' entity='client.admin' 2024-02-15T22:42:37.549 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:37.549 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:37.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:37 smithi138 ceph-mon[29229]: Deploying daemon ceph-exporter.smithi138 on smithi138 2024-02-15T22:42:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 -- 172.21.15.138:0/3519546498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 msgr2=0x7fea00102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 --2- 172.21.15.138:0/3519546498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00102ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009910 tx=0x7fe9f0009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 -- 172.21.15.138:0/3519546498 shutdown_connections 2024-02-15T22:42:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 --2- 172.21.15.138:0/3519546498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00102ca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 -- 172.21.15.138:0/3519546498 >> 172.21.15.138:0/3519546498 conn(0x7fea000fa2e0 msgr2=0x7fea000fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 -- 172.21.15.138:0/3519546498 shutdown_connections 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.001+0000 7fea08541700 1 -- 172.21.15.138:0/3519546498 wait complete. 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea08541700 1 Processor -- start 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea08541700 1 -- start start 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea08541700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea08541700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea001954b0 con 0x7fea001008c0 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea062dd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea062dd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37148/0 (socket says 172.21.15.138:37148) 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea062dd700 1 -- 172.21.15.138:0/146155450 learned_addr learned my addr 172.21.15.138:0/146155450 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea062dd700 1 -- 172.21.15.138:0/146155450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00095f0 con 0x7fea001008c0 2024-02-15T22:42:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.002+0000 7fea062dd700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0005b40 tx=0x7fe9f0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.003+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f001d070 con 0x7fea001008c0 2024-02-15T22:42:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.003+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9f000be10 con 0x7fea001008c0 2024-02-15T22:42:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.003+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea001956b0 con 0x7fea001008c0 2024-02-15T22:42:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.003+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9f000f460 con 0x7fea001008c0 2024-02-15T22:42:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.003+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea00195b50 con 0x7fea001008c0 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fe9f000f5c0 con 0x7fea001008c0 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0018eb10 con 0x7fea001008c0 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fe9f77fe700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 0x7fe9ec03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe9f004c5b0 con 0x7fea001008c0 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fea05adc700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 0x7fe9ec03a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.004+0000 7fea05adc700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 0x7fe9ec03a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc006fd0 tx=0x7fe9fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:38.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.009+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe9f002a360 con 0x7fea001008c0 2024-02-15T22:42:38.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.208+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fea00061220 con 0x7fe9ec0384e0 2024-02-15T22:42:38.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.211+0000 7fe9f77fe700 1 -- 172.21.15.138:0/146155450 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fea00061220 con 0x7fe9ec0384e0 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 msgr2=0x7fe9ec03a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 0x7fe9ec03a990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc006fd0 tx=0x7fe9fc006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 msgr2=0x7fea00194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0005b40 tx=0x7fe9f0004740 comp rx=0 tx=0).stop 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 shutdown_connections 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe9ec0384e0 0x7fe9ec03a990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 --2- 172.21.15.138:0/146155450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea001008c0 0x7fea00194f70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 >> 172.21.15.138:0/146155450 conn(0x7fea000fa2e0 msgr2=0x7fea000faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.213+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 shutdown_connections 2024-02-15T22:42:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:38.214+0000 7fea08541700 1 -- 172.21.15.138:0/146155450 wait complete. 2024-02-15T22:42:39.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:39 smithi138 ceph-mon[29229]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:39.389 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:39 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:39.676 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi170 2024-02-15T22:42:39.676 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:42:39.676 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.conf 2024-02-15T22:42:39.694 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:42:39.694 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:42:39.751 INFO:tasks.cephadm:Adding host smithi170 to orchestrator... 2024-02-15T22:42:39.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch host add smithi170 2024-02-15T22:42:40.254 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:42:41.348 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:42:41.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:41 smithi138 ceph-mon[29229]: Deploying daemon crash.smithi138 on smithi138 2024-02-15T22:42:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.811+0000 7fb9746e4700 1 -- 172.21.15.138:0/3487036597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 msgr2=0x7fb96c100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.811+0000 7fb9746e4700 1 --2- 172.21.15.138:0/3487036597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c100250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb968009910 tx=0x7fb968009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.811+0000 7fb9746e4700 1 -- 172.21.15.138:0/3487036597 shutdown_connections 2024-02-15T22:42:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.811+0000 7fb9746e4700 1 --2- 172.21.15.138:0/3487036597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c100250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.811+0000 7fb9746e4700 1 -- 172.21.15.138:0/3487036597 >> 172.21.15.138:0/3487036597 conn(0x7fb96c0fb3d0 msgr2=0x7fb96c0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 -- 172.21.15.138:0/3487036597 shutdown_connections 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 -- 172.21.15.138:0/3487036597 wait complete. 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 Processor -- start 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 -- start start 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb9746e4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c1954d0 con 0x7fb96c0ffe40 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb972480700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb972480700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37178/0 (socket says 172.21.15.138:37178) 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.812+0000 7fb972480700 1 -- 172.21.15.138:0/2298663686 learned_addr learned my addr 172.21.15.138:0/2298663686 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb972480700 1 -- 172.21.15.138:0/2298663686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680095f0 con 0x7fb96c0ffe40 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb972480700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb968005b40 tx=0x7fb968004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb96801d070 con 0x7fb96c0ffe40 2024-02-15T22:42:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb96800be10 con 0x7fb96c0ffe40 2024-02-15T22:42:41.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c1956d0 con 0x7fb96c0ffe40 2024-02-15T22:42:41.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb96800f460 con 0x7fb96c0ffe40 2024-02-15T22:42:41.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.813+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c195b70 con 0x7fb96c0ffe40 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fb96800b960 con 0x7fb96c0ffe40 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb9637fe700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 0x7fb95803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c18eaa0 con 0x7fb96c0ffe40 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb96804c2c0 con 0x7fb96c0ffe40 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb971c7f700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 0x7fb95803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:41.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.814+0000 7fb971c7f700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 0x7fb95803a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb95c006fd0 tx=0x7fb95c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:41.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:41.819+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb96802bba0 con 0x7fb96c0ffe40 2024-02-15T22:42:42.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:42.022+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}) v1 -- 0x7fb96c1008d0 con 0x7fb958038490 2024-02-15T22:42:44.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:43 smithi138 ceph-mon[29229]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:44.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:43 smithi138 ceph-mon[29229]: Deploying cephadm binary to smithi170 2024-02-15T22:42:44.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:43 smithi138 ceph-mon[29229]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:44.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:43 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:44.595 INFO:teuthology.orchestra.run.smithi138.stdout:Added host 'smithi170' with addr '172.21.15.170' 2024-02-15T22:42:44.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.588+0000 7fb9637fe700 1 -- 172.21.15.138:0/2298663686 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb96c1008d0 con 0x7fb958038490 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 msgr2=0x7fb95803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 0x7fb95803a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb95c006fd0 tx=0x7fb95c006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 msgr2=0x7fb96c194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb968005b40 tx=0x7fb968004740 comp rx=0 tx=0).stop 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 shutdown_connections 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb958038490 0x7fb95803a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:44.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 --2- 172.21.15.138:0/2298663686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb96c0ffe40 0x7fb96c194f90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:44.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.595+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 >> 172.21.15.138:0/2298663686 conn(0x7fb96c0fb3d0 msgr2=0x7fb96c0fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.596+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 shutdown_connections 2024-02-15T22:42:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:44.597+0000 7fb9746e4700 1 -- 172.21.15.138:0/2298663686 wait complete. 2024-02-15T22:42:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:44 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:44 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:44 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:44 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:44 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:45.305 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-15T22:42:45.524 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:42:46.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:45 smithi138 ceph-mon[29229]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-15T22:42:46.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:45 smithi138 ceph-mon[29229]: Added host smithi170 2024-02-15T22:42:46.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:45 smithi138 ceph-mon[29229]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:47.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 -- 172.21.15.138:0/3429821902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 msgr2=0x7f3bb40fe8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3429821902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fe8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009910 tx=0x7f3ba8009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 -- 172.21.15.138:0/3429821902 shutdown_connections 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3429821902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fe8c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 -- 172.21.15.138:0/3429821902 >> 172.21.15.138:0/3429821902 conn(0x7f3bb40f9a60 msgr2=0x7f3bb40fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 -- 172.21.15.138:0/3429821902 shutdown_connections 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 -- 172.21.15.138:0/3429821902 wait complete. 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.077+0000 7f3bbb252700 1 Processor -- start 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bbb252700 1 -- start start 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bbb252700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bbb252700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4195b20 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb8fee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb8fee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39168/0 (socket says 172.21.15.138:39168) 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb8fee700 1 -- 172.21.15.138:0/3897513463 learned_addr learned my addr 172.21.15.138:0/3897513463 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:47.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb8fee700 1 -- 172.21.15.138:0/3897513463 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80095f0 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb8fee700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005950 tx=0x7f3ba8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba801d070 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ba800be10 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb419a130 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.078+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ba800f460 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.079+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb419a490 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.079+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f3ba800f690 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.080+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb41042e0 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.080+0000 7f3bb1ffb700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 0x7f3ba403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.080+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3ba804c670 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.080+0000 7f3bb3fff700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 0x7f3ba403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.080+0000 7f3bb3fff700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 0x7f3ba403a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006fd0 tx=0x7f3ba0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:47.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.084+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3ba802a360 con 0x7f3bb40fe4b0 2024-02-15T22:42:47.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.280+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bb40fb6a0 con 0x7f3ba4038490 2024-02-15T22:42:47.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.281+0000 7f3bb1ffb700 1 -- 172.21.15.138:0/3897513463 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f3bb40fb6a0 con 0x7f3ba4038490 2024-02-15T22:42:47.282 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:42:47.282 INFO:teuthology.orchestra.run.smithi138.stdout:[{"addr": "172.21.15.138", "hostname": "smithi138", "labels": [], "status": ""}, {"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}] 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 msgr2=0x7f3ba403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 0x7f3ba403a940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006fd0 tx=0x7f3ba0006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 msgr2=0x7f3bb40fa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005950 tx=0x7f3ba8009e60 comp rx=0 tx=0).stop 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 shutdown_connections 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3ba4038490 0x7f3ba403a940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 --2- 172.21.15.138:0/3897513463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb40fe4b0 0x7f3bb40fa9e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 >> 172.21.15.138:0/3897513463 conn(0x7f3bb40f9a60 msgr2=0x7f3bb40faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 shutdown_connections 2024-02-15T22:42:47.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:47.283+0000 7f3bbb252700 1 -- 172.21.15.138:0/3897513463 wait complete. 2024-02-15T22:42:47.901 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-15T22:42:47.902 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-15T22:42:48.100 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:42:48.222 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:47 smithi138 ceph-mon[29229]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:48.222 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:47 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:49.225 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:48 smithi138 ceph-mon[29229]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:42:50.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 -- 172.21.15.138:0/1586836363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 msgr2=0x7f7ec80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 --2- 172.21.15.138:0/1586836363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec80ff140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009910 tx=0x7f7eb8009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 -- 172.21.15.138:0/1586836363 shutdown_connections 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 --2- 172.21.15.138:0/1586836363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec80ff140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 -- 172.21.15.138:0/1586836363 >> 172.21.15.138:0/1586836363 conn(0x7f7ec80fa2e0 msgr2=0x7f7ec80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.972+0000 7f7ece977700 1 -- 172.21.15.138:0/1586836363 shutdown_connections 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.973+0000 7f7ece977700 1 -- 172.21.15.138:0/1586836363 wait complete. 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.973+0000 7f7ece977700 1 Processor -- start 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.973+0000 7f7ece977700 1 -- start start 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.973+0000 7f7ece977700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.973+0000 7f7ece977700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8195b10 con 0x7f7ec80fed30 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.974+0000 7f7ec7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.974+0000 7f7ec7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39186/0 (socket says 172.21.15.138:39186) 2024-02-15T22:42:50.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.974+0000 7f7ec7fff700 1 -- 172.21.15.138:0/1721804662 learned_addr learned my addr 172.21.15.138:0/1721804662 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.974+0000 7f7ec7fff700 1 -- 172.21.15.138:0/1721804662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80095f0 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.974+0000 7f7ec7fff700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8005950 tx=0x7f7eb8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.975+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7eb801d070 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.975+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec819a120 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.975+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7eb800be10 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.975+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7eb800f460 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.975+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec819a480 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f7eb800f5c0 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec818da10 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ec57fa700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 0x7f7eb003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7eb804c4b0 con 0x7f7ec80fed30 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ec77fe700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 0x7f7eb003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.976+0000 7f7ec77fe700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 0x7f7eb003a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc006fd0 tx=0x7f7ebc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:50.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:49.981+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7eb802a360 con 0x7f7ec80fed30 2024-02-15T22:42:50.173 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:49 smithi138 ceph-mon[29229]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:50.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.196+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7ec802cc30 con 0x7f7ec80fed30 2024-02-15T22:42:50.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.978+0000 7f7ec57fa700 1 -- 172.21.15.138:0/1721804662 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7eb8027070 con 0x7f7ec80fed30 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 msgr2=0x7f7eb003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 0x7f7eb003a990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc006fd0 tx=0x7f7ebc006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 msgr2=0x7f7ec8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8005950 tx=0x7f7eb8009e60 comp rx=0 tx=0).stop 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 shutdown_connections 2024-02-15T22:42:50.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f7eb00384e0 0x7f7eb003a990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:50.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 --2- 172.21.15.138:0/1721804662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ec80fed30 0x7f7ec8068ac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:50.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 >> 172.21.15.138:0/1721804662 conn(0x7f7ec80fa2e0 msgr2=0x7f7ec80faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:50.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 shutdown_connections 2024-02-15T22:42:50.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:42:50.981+0000 7f7ece977700 1 -- 172.21.15.138:0/1721804662 wait complete. 2024-02-15T22:42:50.983 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-02-15T22:42:51.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:50 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1721804662' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-15T22:42:51.835 INFO:tasks.cephadm:Adding mon.smithi138 on smithi138 2024-02-15T22:42:51.835 INFO:tasks.cephadm:Adding mon.smithi170 on smithi170 2024-02-15T22:42:51.835 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch apply mon '2;smithi138:172.21.15.138=smithi138;smithi170:172.21.15.170=smithi170' 2024-02-15T22:42:52.036 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:52.082 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:52.224 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:51 smithi138 ceph-mon[29229]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:52.224 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:51 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1721804662' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-15T22:42:52.224 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:51 smithi138 ceph-mon[29229]: osdmap e4: 0 total, 0 up, 0 in 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/2760456991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 msgr2=0x7fb8f4100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/2760456991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4100290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009910 tx=0x7fb8f0009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/2760456991 shutdown_connections 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/2760456991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4100290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/2760456991 >> 172.21.15.170:0/2760456991 conn(0x7fb8f40fb4a0 msgr2=0x7fb8f40fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/2760456991 shutdown_connections 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/2760456991 wait complete. 2024-02-15T22:42:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 Processor -- start 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.531+0000 7fb8fc5cd700 1 -- start start 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fc5cd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fc5cd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4075030 con 0x7fb8f40ffe80 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fa369700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fa369700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:40810/0 (socket says 172.21.15.170:40810) 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fa369700 1 -- 172.21.15.170:0/3770996544 learned_addr learned my addr 172.21.15.170:0/3770996544 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fa369700 1 -- 172.21.15.170:0/3770996544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00095f0 con 0x7fb8f40ffe80 2024-02-15T22:42:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fa369700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005b40 tx=0x7fb8f0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8f001d070 con 0x7fb8f40ffe80 2024-02-15T22:42:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8f000be10 con 0x7fb8f40ffe80 2024-02-15T22:42:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4073140 con 0x7fb8f40ffe80 2024-02-15T22:42:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8f000f460 con 0x7fb8f40ffe80 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.532+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f40735e0 con 0x7fb8f40ffe80 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.533+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fb8f000f6d0 con 0x7fb8f40ffe80 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.533+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4062380 con 0x7fb8f40ffe80 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.533+0000 7fb8eb7fe700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 0x7fb8e003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.533+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb8f004c5b0 con 0x7fb8f40ffe80 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.534+0000 7fb8f9b68700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 0x7fb8e003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.534+0000 7fb8f9b68700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 0x7fb8e003a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:53.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.539+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8f0020550 con 0x7fb8f40ffe80 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: Deploying daemon alertmanager.smithi138 on smithi138 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:53.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:53 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:53.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.737+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 --> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi138:172.21.15.138=smithi138;smithi170:172.21.15.170=smithi170", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f4073990 con 0x7fb8e0038490 2024-02-15T22:42:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.742+0000 7fb8eb7fe700 1 -- 172.21.15.170:0/3770996544 <== mgr.14162 v2:172.21.15.138:6800/3454666203 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb8f4073990 con 0x7fb8e0038490 2024-02-15T22:42:53.743 INFO:teuthology.orchestra.run.smithi170.stdout:Scheduled mon update... 2024-02-15T22:42:53.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 msgr2=0x7fb8e003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 0x7fb8e003a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4006fd0 tx=0x7fb8e4006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 msgr2=0x7fb8f4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0005b40 tx=0x7fb8f0004740 comp rx=0 tx=0).stop 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 shutdown_connections 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fb8e0038490 0x7fb8e003a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 --2- 172.21.15.170:0/3770996544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f40ffe80 0x7fb8f4074af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 >> 172.21.15.170:0/3770996544 conn(0x7fb8f40fb4a0 msgr2=0x7fb8f40fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 shutdown_connections 2024-02-15T22:42:53.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:53.744+0000 7fb8fc5cd700 1 -- 172.21.15.170:0/3770996544 wait complete. 2024-02-15T22:42:54.347 DEBUG:teuthology.orchestra.run.smithi170:mon.smithi170> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi170.service 2024-02-15T22:42:54.350 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:42:54.350 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:42:54.577 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:55.180 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:54 smithi138 ceph-mon[29229]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi138:172.21.15.138=smithi138;smithi170:172.21.15.170=smithi170", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:42:55.180 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:54 smithi138 ceph-mon[29229]: Saving service mon spec with placement smithi138:172.21.15.138=smithi138;smithi170:172.21.15.170=smithi170;count:2 2024-02-15T22:42:55.180 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:54 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:42:56.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 -- 172.21.15.170:0/846392145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 msgr2=0x7f200c102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 --2- 172.21.15.170:0/846392145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c102d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009910 tx=0x7f1ffc009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 -- 172.21.15.170:0/846392145 shutdown_connections 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 --2- 172.21.15.170:0/846392145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c102d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 -- 172.21.15.170:0/846392145 >> 172.21.15.170:0/846392145 conn(0x7f200c0fa2c0 msgr2=0x7f200c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 -- 172.21.15.170:0/846392145 shutdown_connections 2024-02-15T22:42:56.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.205+0000 7f2010ccc700 1 -- 172.21.15.170:0/846392145 wait complete. 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.206+0000 7f2010ccc700 1 Processor -- start 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.206+0000 7f2010ccc700 1 -- start start 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2010ccc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2010ccc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c195490 con 0x7f200c100940 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f200a59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f200a59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:40818/0 (socket says 172.21.15.170:40818) 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f200a59c700 1 -- 172.21.15.170:0/4015831066 learned_addr learned my addr 172.21.15.170:0/4015831066 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f200a59c700 1 -- 172.21.15.170:0/4015831066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0095f0 con 0x7f200c100940 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f200a59c700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc005b40 tx=0x7f1ffc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ffc01d070 con 0x7f200c100940 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ffc00be10 con 0x7f200c100940 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c195690 con 0x7f200c100940 2024-02-15T22:42:56.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ffc00f460 con 0x7f200c100940 2024-02-15T22:42:56.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.207+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c195b30 con 0x7f200c100940 2024-02-15T22:42:56.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.208+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f1ffc00f6d0 con 0x7f200c100940 2024-02-15T22:42:56.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.208+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c18eb10 con 0x7f200c100940 2024-02-15T22:42:56.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.208+0000 7f2003fff700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 0x7f1ff803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:56.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.208+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ffc04c510 con 0x7f200c100940 2024-02-15T22:42:56.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.209+0000 7f2001d9b700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 0x7f1ff803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:56.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.209+0000 7f2001d9b700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 0x7f1ff803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4006fd0 tx=0x7f1ff4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.213+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1ffc02a360 con 0x7f200c100940 2024-02-15T22:42:56.232 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:55 smithi138 ceph-mon[29229]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:56.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.477+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f200c02cc30 con 0x7f200c100940 2024-02-15T22:42:56.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.477+0000 7f2003fff700 1 -- 172.21.15.170:0/4015831066 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f1ffc027020 con 0x7f200c100940 2024-02-15T22:42:56.479 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:42:56.479 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 msgr2=0x7f1ff803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 0x7f1ff803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4006fd0 tx=0x7f1ff4006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 msgr2=0x7f200c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc005b40 tx=0x7f1ffc004740 comp rx=0 tx=0).stop 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 shutdown_connections 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f1ff8038490 0x7f1ff803a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 --2- 172.21.15.170:0/4015831066 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f200c100940 0x7f200c194f50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 >> 172.21.15.170:0/4015831066 conn(0x7f200c0fa2c0 msgr2=0x7f200c0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 shutdown_connections 2024-02-15T22:42:56.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:56.480+0000 7f2010ccc700 1 -- 172.21.15.170:0/4015831066 wait complete. 2024-02-15T22:42:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:42:57.083 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:56 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/4015831066' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:42:58.000 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:42:58.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:42:58.098 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:57 smithi138 ceph-mon[29229]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:42:58.203 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:58.249 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:42:59.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/734416332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 msgr2=0x7fe5ac0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:59.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/734416332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0ff140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009910 tx=0x7fe5a0009c20 comp rx=0 tx=0).stop 2024-02-15T22:42:59.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/734416332 shutdown_connections 2024-02-15T22:42:59.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/734416332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0ff140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:59.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/734416332 >> 172.21.15.170:0/734416332 conn(0x7fe5ac0fa2e0 msgr2=0x7fe5ac0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/734416332 shutdown_connections 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/734416332 wait complete. 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.576+0000 7fe5b0b2e700 1 Processor -- start 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5b0b2e700 1 -- start start 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5b0b2e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5b0b2e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac0fc7b0 con 0x7fe5ac0fed30 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5aa59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5aa59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:40824/0 (socket says 172.21.15.170:40824) 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5aa59c700 1 -- 172.21.15.170:0/1310182514 learned_addr learned my addr 172.21.15.170:0/1310182514 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5aa59c700 1 -- 172.21.15.170:0/1310182514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00095f0 con 0x7fe5ac0fed30 2024-02-15T22:42:59.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.577+0000 7fe5aa59c700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0005b40 tx=0x7fe5a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:59.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5a001d070 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac0fa8c0 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe5a000be10 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5a000f460 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac0fad60 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fe5a000b960 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.578+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac062380 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.579+0000 7fe59b7fe700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 0x7fe59403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.579+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe5a004c4b0 con 0x7fe5ac0fed30 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.579+0000 7fe5a9d9b700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 0x7fe59403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:42:59.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.579+0000 7fe5a9d9b700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 0x7fe59403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe59c006fd0 tx=0x7fe59c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:42:59.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.584+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe5a002a360 con 0x7fe5ac0fed30 2024-02-15T22:42:59.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.850+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe5ac18e400 con 0x7fe5ac0fed30 2024-02-15T22:42:59.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.851+0000 7fe59b7fe700 1 -- 172.21.15.170:0/1310182514 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe5a0027030 con 0x7fe5ac0fed30 2024-02-15T22:42:59.852 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:42:59.852 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 msgr2=0x7fe59403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 0x7fe59403a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe59c006fd0 tx=0x7fe59c006e40 comp rx=0 tx=0).stop 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 msgr2=0x7fe5ac0fc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0005b40 tx=0x7fe5a0004740 comp rx=0 tx=0).stop 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 shutdown_connections 2024-02-15T22:42:59.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe594038490 0x7fe59403a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:59.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 --2- 172.21.15.170:0/1310182514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5ac0fed30 0x7fe5ac0fc270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:42:59.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 >> 172.21.15.170:0/1310182514 conn(0x7fe5ac0fa2e0 msgr2=0x7fe5ac0690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:42:59.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 shutdown_connections 2024-02-15T22:42:59.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:42:59.853+0000 7fe5b0b2e700 1 -- 172.21.15.170:0/1310182514 wait complete. 2024-02-15T22:42:59.855 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:00.105 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:42:59 smithi138 ceph-mon[29229]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1310182514' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:43:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:00 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:01.321 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:01.322 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:01.526 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:01.572 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:02.122 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:01 smithi138 ceph-mon[29229]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-15T22:43:02.122 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:01 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T22:43:02.122 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:01 smithi138 ceph-mon[29229]: Deploying daemon grafana.smithi138 on smithi138 2024-02-15T22:43:02.122 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:01 smithi138 ceph-mon[29229]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:03.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- 172.21.15.170:0/1312734703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 msgr2=0x7f31880fe8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:03.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 --2- 172.21.15.170:0/1312734703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fe8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f318400aa20 tx=0x7f318400ad30 comp rx=0 tx=0).stop 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- 172.21.15.170:0/1312734703 shutdown_connections 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 --2- 172.21.15.170:0/1312734703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fe8c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- 172.21.15.170:0/1312734703 >> 172.21.15.170:0/1312734703 conn(0x7f31880f9a60 msgr2=0x7f31880fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- 172.21.15.170:0/1312734703 shutdown_connections 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- 172.21.15.170:0/1312734703 wait complete. 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 Processor -- start 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- start start 2024-02-15T22:43:03.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.000+0000 7f318f9c4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880fbf30 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318d760700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318d760700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:41796/0 (socket says 172.21.15.170:41796) 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318d760700 1 -- 172.21.15.170:0/846209634 learned_addr learned my addr 172.21.15.170:0/846209634 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318d760700 1 -- 172.21.15.170:0/846209634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318400a700 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318d760700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3184006010 tx=0x7f3184004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f318401d070 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3184005550 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31880fa040 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f318400e6d0 con 0x7f31880fe4b0 2024-02-15T22:43:03.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.001+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31880fa4e0 con 0x7f31880fe4b0 2024-02-15T22:43:03.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.002+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3188062380 con 0x7f31880fe4b0 2024-02-15T22:43:03.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.002+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f3184016b20 con 0x7f31880fe4b0 2024-02-15T22:43:03.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.002+0000 7f317e7fc700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 0x7f317403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.002+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3184012070 con 0x7f31880fe4b0 2024-02-15T22:43:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.003+0000 7f318cf5f700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 0x7f317403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:03.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.003+0000 7f318cf5f700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 0x7f317403a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3178006fd0 tx=0x7f3178006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:03.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.007+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3184005c00 con 0x7f31880fe4b0 2024-02-15T22:43:03.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.274+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f318818e2a0 con 0x7f31880fe4b0 2024-02-15T22:43:03.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.275+0000 7f317e7fc700 1 -- 172.21.15.170:0/846209634 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f318400db40 con 0x7f31880fe4b0 2024-02-15T22:43:03.276 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:03.276 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 msgr2=0x7f317403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 0x7f317403a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3178006fd0 tx=0x7f3178006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 msgr2=0x7f31880fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3184006010 tx=0x7f3184004ca0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 shutdown_connections 2024-02-15T22:43:03.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f3174038490 0x7f317403a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 --2- 172.21.15.170:0/846209634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31880fe4b0 0x7f31880fb9f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:03.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 >> 172.21.15.170:0/846209634 conn(0x7f31880f9a60 msgr2=0x7f318818ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:03.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 shutdown_connections 2024-02-15T22:43:03.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:03.277+0000 7f318f9c4700 1 -- 172.21.15.170:0/846209634 wait complete. 2024-02-15T22:43:03.279 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:03 smithi138 ceph-mon[29229]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:03 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:04.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:03 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/846209634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:04.920 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:04.920 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:05.113 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:05.159 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:06.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:05 smithi138 ceph-mon[29229]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- 172.21.15.170:0/3117459269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 msgr2=0x7fe534100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/3117459269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534100250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe530009910 tx=0x7fe530009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- 172.21.15.170:0/3117459269 shutdown_connections 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/3117459269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534100250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- 172.21.15.170:0/3117459269 >> 172.21.15.170:0/3117459269 conn(0x7fe5340fb3d0 msgr2=0x7fe5340fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- 172.21.15.170:0/3117459269 shutdown_connections 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- 172.21.15.170:0/3117459269 wait complete. 2024-02-15T22:43:06.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 Processor -- start 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.428+0000 7fe53b3f1700 1 -- start start 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53b3f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53b3f1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5341954d0 con 0x7fe5340ffe40 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53918d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53918d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:41812/0 (socket says 172.21.15.170:41812) 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53918d700 1 -- 172.21.15.170:0/677260281 learned_addr learned my addr 172.21.15.170:0/677260281 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53918d700 1 -- 172.21.15.170:0/677260281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300095f0 con 0x7fe5340ffe40 2024-02-15T22:43:06.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53918d700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe530005b40 tx=0x7fe530004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe53001d070 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe53000be10 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341956d0 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe53000f460 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.429+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534195b70 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.430+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fe53000f6d0 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.430+0000 7fe52a7fc700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 0x7fe52003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.430+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53418eaa0 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.430+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe53004c340 con 0x7fe5340ffe40 2024-02-15T22:43:06.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.431+0000 7fe53898c700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 0x7fe52003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:06.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.431+0000 7fe53898c700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 0x7fe52003a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:06.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.436+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe530027030 con 0x7fe5340ffe40 2024-02-15T22:43:06.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.699+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe5341008d0 con 0x7fe5340ffe40 2024-02-15T22:43:06.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.699+0000 7fe52a7fc700 1 -- 172.21.15.170:0/677260281 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe5341008d0 con 0x7fe5340ffe40 2024-02-15T22:43:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:06.736 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:06.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 msgr2=0x7fe52003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 0x7fe52003a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe524006fd0 tx=0x7fe524006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 msgr2=0x7fe534194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe530005b40 tx=0x7fe530004740 comp rx=0 tx=0).stop 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 shutdown_connections 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fe520038490 0x7fe52003a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 --2- 172.21.15.170:0/677260281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5340ffe40 0x7fe534194f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 >> 172.21.15.170:0/677260281 conn(0x7fe5340fb3d0 msgr2=0x7fe5340fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.701+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 shutdown_connections 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:06.702+0000 7fe53b3f1700 1 -- 172.21.15.170:0/677260281 wait complete. 2024-02-15T22:43:06.737 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:07.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:06 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/677260281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:08.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:07 smithi138 ceph-mon[29229]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:08.263 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:08.263 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:08.465 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:08.511 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:09.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 -- 172.21.15.170:0/2959548569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 msgr2=0x7fabbc100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:09.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 --2- 172.21.15.170:0/2959548569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc100250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fabac009910 tx=0x7fabac009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:09.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 -- 172.21.15.170:0/2959548569 shutdown_connections 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 --2- 172.21.15.170:0/2959548569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc100250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 -- 172.21.15.170:0/2959548569 >> 172.21.15.170:0/2959548569 conn(0x7fabbc0fb3d0 msgr2=0x7fabbc0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 -- 172.21.15.170:0/2959548569 shutdown_connections 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.937+0000 7fabc22e0700 1 -- 172.21.15.170:0/2959548569 wait complete. 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabc22e0700 1 Processor -- start 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabc22e0700 1 -- start start 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabc22e0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabc22e0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1954d0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:41834/0 (socket says 172.21.15.170:41834) 2024-02-15T22:43:09.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.938+0000 7fabbbfff700 1 -- 172.21.15.170:0/1544977014 learned_addr learned my addr 172.21.15.170:0/1544977014 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabbbfff700 1 -- 172.21.15.170:0/1544977014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0095f0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabbbfff700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fabac0092e0 tx=0x7fabac009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabac01d070 con 0x7fabbc0ffe40 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc1956d0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabac00be10 con 0x7fabbc0ffe40 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabac00f460 con 0x7fabbc0ffe40 2024-02-15T22:43:09.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.939+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc195b70 con 0x7fabbc0ffe40 2024-02-15T22:43:09.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.940+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fabac00f6d0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.940+0000 7fabb97fa700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 0x7faba403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:09.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.940+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fabac04c3d0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.940+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc1008d0 con 0x7fabbc0ffe40 2024-02-15T22:43:09.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.940+0000 7fabbb7fe700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 0x7faba403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:09.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.941+0000 7fabbb7fe700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 0x7faba403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fabb0006fd0 tx=0x7fabb0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:09.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:09.946+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fabbc1008d0 con 0x7fabbc0ffe40 2024-02-15T22:43:10.125 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:09 smithi138 ceph-mon[29229]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:10.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.205+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fabbc1008d0 con 0x7fabbc0ffe40 2024-02-15T22:43:10.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.206+0000 7fabb97fa700 1 -- 172.21.15.170:0/1544977014 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fabbc1008d0 con 0x7fabbc0ffe40 2024-02-15T22:43:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:10.208 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:10.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 msgr2=0x7faba403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:10.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 0x7faba403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fabb0006fd0 tx=0x7fabb0006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:10.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 msgr2=0x7fabbc194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:10.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fabac0092e0 tx=0x7fabac009e60 comp rx=0 tx=0).stop 2024-02-15T22:43:10.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 shutdown_connections 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7faba4038490 0x7faba403a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 --2- 172.21.15.170:0/1544977014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabbc0ffe40 0x7fabbc194f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 >> 172.21.15.170:0/1544977014 conn(0x7fabbc0fb3d0 msgr2=0x7fabbc0fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 shutdown_connections 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:10.208+0000 7fabc22e0700 1 -- 172.21.15.170:0/1544977014 wait complete. 2024-02-15T22:43:10.211 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:11.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:10 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1544977014' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:11.792 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:11.793 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:11.992 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:12.038 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:12.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:11 smithi138 ceph-mon[29229]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 -- 172.21.15.170:0/1141563419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 msgr2=0x7fad140ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 --2- 172.21.15.170:0/1141563419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad140ff140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fad04009910 tx=0x7fad04009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 -- 172.21.15.170:0/1141563419 shutdown_connections 2024-02-15T22:43:13.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 --2- 172.21.15.170:0/1141563419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad140ff140 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 -- 172.21.15.170:0/1141563419 >> 172.21.15.170:0/1141563419 conn(0x7fad140fa2e0 msgr2=0x7fad140fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 -- 172.21.15.170:0/1141563419 shutdown_connections 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.361+0000 7fad1aa49700 1 -- 172.21.15.170:0/1141563419 wait complete. 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad1aa49700 1 Processor -- start 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad1aa49700 1 -- start start 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad1aa49700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad1aa49700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14195500 con 0x7fad140fed30 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad13fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad13fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:42732/0 (socket says 172.21.15.170:42732) 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad13fff700 1 -- 172.21.15.170:0/2459827684 learned_addr learned my addr 172.21.15.170:0/2459827684 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:13.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad13fff700 1 -- 172.21.15.170:0/2459827684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040095f0 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.362+0000 7fad13fff700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad04005b40 tx=0x7fad04004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.363+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad0401d070 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.363+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14195700 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.363+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad0400be10 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.363+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad0400f460 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.363+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad14195ba0 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fad0400b960 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1418ea20 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad117fa700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 0x7facfc03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fad0404c3f0 con 0x7fad140fed30 2024-02-15T22:43:13.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad137fe700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 0x7facfc03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:13.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.364+0000 7fad137fe700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 0x7facfc03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:13.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.369+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fad0402a360 con 0x7fad140fed30 2024-02-15T22:43:13.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.635+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fad1402cc30 con 0x7fad140fed30 2024-02-15T22:43:13.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.636+0000 7fad117fa700 1 -- 172.21.15.170:0/2459827684 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fad04027030 con 0x7fad140fed30 2024-02-15T22:43:13.637 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:13.637 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.637+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 msgr2=0x7facfc03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.637+0000 7fad1aa49700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 0x7facfc03a940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.637+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 msgr2=0x7fad14194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.637+0000 7fad1aa49700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad04005b40 tx=0x7fad04004740 comp rx=0 tx=0).stop 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 shutdown_connections 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7facfc038490 0x7facfc03a940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 --2- 172.21.15.170:0/2459827684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad140fed30 0x7fad14194fc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 >> 172.21.15.170:0/2459827684 conn(0x7fad140fa2e0 msgr2=0x7fad140690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 shutdown_connections 2024-02-15T22:43:13.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:13.638+0000 7fad1aa49700 1 -- 172.21.15.170:0/2459827684 wait complete. 2024-02-15T22:43:13.640 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:13.856 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:13 smithi138 ceph-mon[29229]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:14.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:14 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2459827684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:15.203 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:15.203 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:15.395 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:15.441 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:15.626 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:15.626 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:15.626 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:15.626 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:15.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:15.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:15.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:15 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:16.707 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:16 smithi138 ceph-mon[29229]: Deploying daemon prometheus.smithi138 on smithi138 2024-02-15T22:43:16.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.957+0000 7ff4e2244700 1 -- 172.21.15.170:0/768124031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 msgr2=0x7ff4dc100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.957+0000 7ff4e2244700 1 --2- 172.21.15.170:0/768124031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc100250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009910 tx=0x7ff4cc009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- 172.21.15.170:0/768124031 shutdown_connections 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 --2- 172.21.15.170:0/768124031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc100250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- 172.21.15.170:0/768124031 >> 172.21.15.170:0/768124031 conn(0x7ff4dc0fb3d0 msgr2=0x7ff4dc0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- 172.21.15.170:0/768124031 shutdown_connections 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- 172.21.15.170:0/768124031 wait complete. 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 Processor -- start 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- start start 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.958+0000 7ff4e2244700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc075030 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4db7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:16.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4db7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:42752/0 (socket says 172.21.15.170:42752) 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4db7fe700 1 -- 172.21.15.170:0/3560736329 learned_addr learned my addr 172.21.15.170:0/3560736329 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4db7fe700 1 -- 172.21.15.170:0/3560736329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc0095f0 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4db7fe700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0092e0 tx=0x7ff4cc009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4cc01d070 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc073140 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4cc00be10 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc0735e0 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.959+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4cc00f460 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.960+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7ff4cc00b960 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.960+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc062380 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.961+0000 7ff4d97fa700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 0x7ff4c803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.961+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff4cc04c1d0 con 0x7ff4dc0ffe40 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.961+0000 7ff4d2ffd700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 0x7ff4c803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:16.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.961+0000 7ff4d2ffd700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 0x7ff4c803a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006fd0 tx=0x7ff4c4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:16.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:16.965+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff4cc00f5c0 con 0x7ff4dc0ffe40 2024-02-15T22:43:17.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.228+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff4dc18e480 con 0x7ff4dc0ffe40 2024-02-15T22:43:17.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.228+0000 7ff4d97fa700 1 -- 172.21.15.170:0/3560736329 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7ff4cc027030 con 0x7ff4dc0ffe40 2024-02-15T22:43:17.230 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:17.230 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 msgr2=0x7ff4c803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 0x7ff4c803a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4006fd0 tx=0x7ff4c4006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 msgr2=0x7ff4dc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0092e0 tx=0x7ff4cc009e60 comp rx=0 tx=0).stop 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 shutdown_connections 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.230+0000 7ff4e2244700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7ff4c8038490 0x7ff4c803a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.231+0000 7ff4e2244700 1 --2- 172.21.15.170:0/3560736329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4dc0ffe40 0x7ff4dc074af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.231+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 >> 172.21.15.170:0/3560736329 conn(0x7ff4dc0fb3d0 msgr2=0x7ff4dc0fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.231+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 shutdown_connections 2024-02-15T22:43:17.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:17.231+0000 7ff4e2244700 1 -- 172.21.15.170:0/3560736329 wait complete. 2024-02-15T22:43:17.233 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:17.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:17 smithi138 ceph-mon[29229]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:17.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:17 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/3560736329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:18.818 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:18.818 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:19.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:18 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:20.211 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:19 smithi138 ceph-mon[29229]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- 172.21.15.170:0/2845396629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 msgr2=0x7fd0980ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 --2- 172.21.15.170:0/2845396629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980ff700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd08800b0a0 tx=0x7fd08800b3b0 comp rx=0 tx=0).stop 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- 172.21.15.170:0/2845396629 shutdown_connections 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 --2- 172.21.15.170:0/2845396629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980ff700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- 172.21.15.170:0/2845396629 >> 172.21.15.170:0/2845396629 conn(0x7fd0980f9af0 msgr2=0x7fd0980fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- 172.21.15.170:0/2845396629 shutdown_connections 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- 172.21.15.170:0/2845396629 wait complete. 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 Processor -- start 2024-02-15T22:43:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.522+0000 7fd09df02700 1 -- start start 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd09df02700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd09df02700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd098197cc0 con 0x7fd0980ff2f0 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd0977fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd0977fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:42780/0 (socket says 172.21.15.170:42780) 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd0977fe700 1 -- 172.21.15.170:0/1300913688 learned_addr learned my addr 172.21.15.170:0/1300913688 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd0977fe700 1 -- 172.21.15.170:0/1300913688 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009d00 con 0x7fd0980ff2f0 2024-02-15T22:43:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd0977fe700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd088015040 tx=0x7fd08800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd08800e040 con 0x7fd0980ff2f0 2024-02-15T22:43:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd08801d930 con 0x7fd0980ff2f0 2024-02-15T22:43:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd098197e00 con 0x7fd0980ff2f0 2024-02-15T22:43:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0880129d0 con 0x7fd0980ff2f0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.523+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0981981c0 con 0x7fd0980ff2f0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.524+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7fd088012c40 con 0x7fd0980ff2f0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.524+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09818d980 con 0x7fd0980ff2f0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.524+0000 7fd094ff9700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 0x7fd08003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.524+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd08804ca90 con 0x7fd0980ff2f0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.525+0000 7fd096ffd700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 0x7fd08003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.525+0000 7fd096ffd700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 0x7fd08003a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:20.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.531+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd08801aba0 con 0x7fd0980ff2f0 2024-02-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.800+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd09802cc30 con 0x7fd0980ff2f0 2024-02-15T22:43:20.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.800+0000 7fd094ff9700 1 -- 172.21.15.170:0/1300913688 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fd08801aba0 con 0x7fd0980ff2f0 2024-02-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:20.802 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:20.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 msgr2=0x7fd08003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 0x7fd08003a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd08c006fd0 tx=0x7fd08c006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 msgr2=0x7fd0980feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd088015040 tx=0x7fd08800bb10 comp rx=0 tx=0).stop 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 shutdown_connections 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fd0800384e0 0x7fd08003a990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 --2- 172.21.15.170:0/1300913688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0980ff2f0 0x7fd0980feae0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 >> 172.21.15.170:0/1300913688 conn(0x7fd0980f9af0 msgr2=0x7fd0980fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 shutdown_connections 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:20.802+0000 7fd09df02700 1 -- 172.21.15.170:0/1300913688 wait complete. 2024-02-15T22:43:20.804 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:20 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1300913688' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:22.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:21 smithi138 ceph-mon[29229]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:22.252 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:22.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:22.454 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:22.499 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:23.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:23 smithi138 ceph-mon[29229]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:23.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 -- 172.21.15.170:0/3596712014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 msgr2=0x7f89380ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:23.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 --2- 172.21.15.170:0/3596712014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f89380ff140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f893400b0a0 tx=0x7f893400b3b0 comp rx=0 tx=0).stop 2024-02-15T22:43:23.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 -- 172.21.15.170:0/3596712014 shutdown_connections 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 --2- 172.21.15.170:0/3596712014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f89380ff140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 -- 172.21.15.170:0/3596712014 >> 172.21.15.170:0/3596712014 conn(0x7f89380fa2e0 msgr2=0x7f89380fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 -- 172.21.15.170:0/3596712014 shutdown_connections 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.962+0000 7f893f2f7700 1 -- 172.21.15.170:0/3596712014 wait complete. 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893f2f7700 1 Processor -- start 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893f2f7700 1 -- start start 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893f2f7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893f2f7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938195500 con 0x7f89380fed30 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893d093700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893d093700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:57880/0 (socket says 172.21.15.170:57880) 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.963+0000 7f893d093700 1 -- 172.21.15.170:0/2344046496 learned_addr learned my addr 172.21.15.170:0/2344046496 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:23.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f893d093700 1 -- 172.21.15.170:0/2344046496 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934009d00 con 0x7f89380fed30 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f893d093700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f893400b830 tx=0x7f893400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f893400e040 con 0x7f89380fed30 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8938195700 con 0x7f89380fed30 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8934012af0 con 0x7f89380fed30 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8938195b20 con 0x7f89380fed30 2024-02-15T22:43:23.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.964+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f893401d9e0 con 0x7f89380fed30 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.965+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893818ea20 con 0x7f89380fed30 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.965+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 13) v1 ==== 45141+0+0 (secure 0 0 0) 0x7f8934012c60 con 0x7f89380fed30 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.965+0000 7f892e7fc700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 0x7f892403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.965+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f893404c990 con 0x7f89380fed30 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.965+0000 7f893c892700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 0x7f892403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.966+0000 7f893c892700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 0x7f892403a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8928006fd0 tx=0x7f8928006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:23.970+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f893401c5c0 con 0x7f89380fed30 2024-02-15T22:43:24.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.230+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8938062380 con 0x7f89380fed30 2024-02-15T22:43:24.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.230+0000 7f892e7fc700 1 -- 172.21.15.170:0/2344046496 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f893401c3e0 con 0x7f89380fed30 2024-02-15T22:43:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:24.232 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 msgr2=0x7f892403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 0x7f892403a940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8928006fd0 tx=0x7f8928006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 msgr2=0x7f8938194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f893400b830 tx=0x7f893400bd40 comp rx=0 tx=0).stop 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 shutdown_connections 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f8924038490 0x7f892403a940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 --2- 172.21.15.170:0/2344046496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89380fed30 0x7f8938194fc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 >> 172.21.15.170:0/2344046496 conn(0x7f89380fa2e0 msgr2=0x7f89380687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 shutdown_connections 2024-02-15T22:43:24.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:24.233+0000 7f893f2f7700 1 -- 172.21.15.170:0/2344046496 wait complete. 2024-02-15T22:43:24.235 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:24.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:24 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2344046496' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:25.790 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:25.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:25.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:25 smithi138 ceph-mon[29229]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:25.991 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:26.039 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 -- 172.21.15.170:0/63819329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 msgr2=0x7fabd80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/63819329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd80ff140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009910 tx=0x7fabc8009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 -- 172.21.15.170:0/63819329 shutdown_connections 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/63819329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd80ff140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 -- 172.21.15.170:0/63819329 >> 172.21.15.170:0/63819329 conn(0x7fabd80fa2e0 msgr2=0x7fabd80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 -- 172.21.15.170:0/63819329 shutdown_connections 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 -- 172.21.15.170:0/63819329 wait complete. 2024-02-15T22:43:27.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.438+0000 7fabdfbe4700 1 Processor -- start 2024-02-15T22:43:27.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdfbe4700 1 -- start start 2024-02-15T22:43:27.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdfbe4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:27.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdfbe4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8195500 con 0x7fabd80fed30 2024-02-15T22:43:27.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdd980700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:27.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdd980700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:57896/0 (socket says 172.21.15.170:57896) 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdd980700 1 -- 172.21.15.170:0/2400207889 learned_addr learned my addr 172.21.15.170:0/2400207889 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.439+0000 7fabdd980700 1 -- 172.21.15.170:0/2400207889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80095f0 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabdd980700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabc8005b40 tx=0x7fabc8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabc801d070 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8195700 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fabc800be10 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabc800f460 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.440+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8195ba0 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.441+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 14) v1 ==== 45155+0+0 (secure 0 0 0) 0x7fabc800b960 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.441+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd818ea20 con 0x7fabd80fed30 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.441+0000 7fabceffd700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:27.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.441+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fabc804c520 con 0x7fabd80fed30 2024-02-15T22:43:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.446+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fabc802a360 con 0x7fabd80fed30 2024-02-15T22:43:27.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.465+0000 7fabdd17f700 1 -- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 msgr2=0x7fabc403a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=16 : -104 Unknown error -104 2024-02-15T22:43:27.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.465+0000 7fabdd17f700 1 -- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 msgr2=0x7fabc403a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:43:27.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.465+0000 7fabdd17f700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-02-15T22:43:27.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.465+0000 7fabdd17f700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:43:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.666+0000 7fabdd17f700 1 -- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 msgr2=0x7fabc403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/3454666203 2024-02-15T22:43:27.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.666+0000 7fabdd17f700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:43:27.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.720+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fabd802cc30 con 0x7fabd80fed30 2024-02-15T22:43:27.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.721+0000 7fabceffd700 1 -- 172.21.15.170:0/2400207889 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fabc8027030 con 0x7fabd80fed30 2024-02-15T22:43:27.722 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:27.723 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 msgr2=0x7fabc403a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 msgr2=0x7fabd8194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabc8005b40 tx=0x7fabc8004740 comp rx=0 tx=0).stop 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 shutdown_connections 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7fabc40384e0 0x7fabc403a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 --2- 172.21.15.170:0/2400207889 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabd80fed30 0x7fabd8194fc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:27.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.723+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 >> 172.21.15.170:0/2400207889 conn(0x7fabd80fa2e0 msgr2=0x7fabd80690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:27.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.724+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 shutdown_connections 2024-02-15T22:43:27.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:27.724+0000 7fabdfbe4700 1 -- 172.21.15.170:0/2400207889 wait complete. 2024-02-15T22:43:27.726 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:27 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:27 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:27 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:27 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-15T22:43:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:27 smithi138 ceph-mon[29229]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:28 smithi138 ceph-mon[29229]: from='mgr.14162 172.21.15.138:0/4061173313' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-15T22:43:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:28 smithi138 ceph-mon[29229]: mgrmap e14: smithi138.jqscxs(active, since 64s) 2024-02-15T22:43:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2400207889' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:29.244 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:29.244 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:29.447 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:29.493 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:30.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 -- 172.21.15.170:0/1879562236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 msgr2=0x7f9fd80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:30.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/1879562236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd80ff140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009910 tx=0x7f9fd4009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:30.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 -- 172.21.15.170:0/1879562236 shutdown_connections 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/1879562236 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd80ff140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 -- 172.21.15.170:0/1879562236 >> 172.21.15.170:0/1879562236 conn(0x7f9fd80fa2e0 msgr2=0x7f9fd80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 -- 172.21.15.170:0/1879562236 shutdown_connections 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.854+0000 7f9fdfbff700 1 -- 172.21.15.170:0/1879562236 wait complete. 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdfbff700 1 Processor -- start 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdfbff700 1 -- start start 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdfbff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdfbff700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8195500 con 0x7f9fd80fed30 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdd99b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdd99b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:57912/0 (socket says 172.21.15.170:57912) 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdd99b700 1 -- 172.21.15.170:0/826276864 learned_addr learned my addr 172.21.15.170:0/826276864 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdd99b700 1 -- 172.21.15.170:0/826276864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40095f0 con 0x7f9fd80fed30 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.855+0000 7f9fdd99b700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005950 tx=0x7f9fd4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:30.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.856+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fd401d070 con 0x7f9fd80fed30 2024-02-15T22:43:30.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.856+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9fd400be10 con 0x7f9fd80fed30 2024-02-15T22:43:30.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.856+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd8195700 con 0x7f9fd80fed30 2024-02-15T22:43:30.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.856+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9fd400f460 con 0x7f9fd80fed30 2024-02-15T22:43:30.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.856+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd8195ba0 con 0x7f9fd80fed30 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 14) v1 ==== 45155+0+0 (secure 0 0 0) 0x7f9fd40227c0 con 0x7f9fd80fed30 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd818ea20 con 0x7f9fd80fed30 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fceffd700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 0x7f9fc403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9fd404c580 con 0x7f9fd80fed30 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fdd19a700 1 -- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 msgr2=0x7f9fc403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/3454666203 2024-02-15T22:43:30.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.857+0000 7f9fdd19a700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 0x7f9fc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:43:30.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:30.862+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9fd402bba0 con 0x7f9fd80fed30 2024-02-15T22:43:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.058+0000 7f9fdd19a700 1 -- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 msgr2=0x7f9fc403a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.138:6800/3454666203 2024-02-15T22:43:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.058+0000 7f9fdd19a700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 0x7f9fc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-15T22:43:31.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.128+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9fd802cc30 con 0x7f9fd80fed30 2024-02-15T22:43:31.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.128+0000 7f9fceffd700 1 -- 172.21.15.170:0/826276864 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f9fd4027030 con 0x7f9fd80fed30 2024-02-15T22:43:31.130 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:31.130 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 msgr2=0x7f9fc403a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 0x7f9fc403a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 msgr2=0x7f9fd8194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005950 tx=0x7f9fd4009e60 comp rx=0 tx=0).stop 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 shutdown_connections 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:6800/3454666203,v1:172.21.15.138:6801/3454666203] conn(0x7f9fc40384e0 0x7f9fc403a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 --2- 172.21.15.170:0/826276864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fd80fed30 0x7f9fd8194fc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.130+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 >> 172.21.15.170:0/826276864 conn(0x7f9fd80fa2e0 msgr2=0x7f9fd80687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.131+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 shutdown_connections 2024-02-15T22:43:31.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:31.131+0000 7f9fdfbff700 1 -- 172.21.15.170:0/826276864 wait complete. 2024-02-15T22:43:31.133 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:31.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:31 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/826276864' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:32.732 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:32.733 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:32.934 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: Active manager daemon smithi138.jqscxs restarted 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: mgrmap e15: smithi138.jqscxs(active, starting, since 0.00330426s) 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:43:34.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:43:34.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:43:34.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:43:34.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:34.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- 172.21.15.170:0/3232485089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 msgr2=0x7f879c102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 --2- 172.21.15.170:0/3232485089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c102ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8790009910 tx=0x7f8790009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- 172.21.15.170:0/3232485089 shutdown_connections 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 --2- 172.21.15.170:0/3232485089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c102ca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- 172.21.15.170:0/3232485089 >> 172.21.15.170:0/3232485089 conn(0x7f879c0fa2e0 msgr2=0x7f879c0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- 172.21.15.170:0/3232485089 shutdown_connections 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- 172.21.15.170:0/3232485089 wait complete. 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 Processor -- start 2024-02-15T22:43:34.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.364+0000 7f87a31cf700 1 -- start start 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a31cf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a31cf700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1954b0 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a0f6b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a0f6b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:43968/0 (socket says 172.21.15.170:43968) 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a0f6b700 1 -- 172.21.15.170:0/208782207 learned_addr learned my addr 172.21.15.170:0/208782207 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a0f6b700 1 -- 172.21.15.170:0/208782207 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900095f0 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a0f6b700 1 --2- 172.21.15.170:0/208782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8790005b40 tx=0x7f8790004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f879001d070 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f879000be10 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c1956b0 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.365+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f879000f460 con 0x7f879c1008c0 2024-02-15T22:43:34.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.366+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c195b50 con 0x7f879c1008c0 2024-02-15T22:43:34.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.367+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 15) v1 ==== 44878+0+0 (secure 0 0 0) 0x7f87900227e0 con 0x7f879c1008c0 2024-02-15T22:43:34.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.367+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c18eb10 con 0x7f879c1008c0 2024-02-15T22:43:34.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.367+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f879004c180 con 0x7f879c1008c0 2024-02-15T22:43:34.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.372+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f879002bba0 con 0x7f879c1008c0 2024-02-15T22:43:34.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.653+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f879c02cc30 con 0x7f879c1008c0 2024-02-15T22:43:34.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.654+0000 7f8799ffb700 1 -- 172.21.15.170:0/208782207 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8790027020 con 0x7f879c1008c0 2024-02-15T22:43:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:34.656 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:34.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 msgr2=0x7f879c194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:34.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 --2- 172.21.15.170:0/208782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8790005b40 tx=0x7f8790004740 comp rx=0 tx=0).stop 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 shutdown_connections 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 --2- 172.21.15.170:0/208782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f879c1008c0 0x7f879c194f70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 >> 172.21.15.170:0/208782207 conn(0x7f879c0fa2e0 msgr2=0x7f879c0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 shutdown_connections 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:34.656+0000 7f87a31cf700 1 -- 172.21.15.170:0/208782207 wait complete. 2024-02-15T22:43:34.658 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/208782207' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:35.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:35 smithi138 ceph-mon[29229]: mgrmap e16: smithi138.jqscxs(active, since 1.00506s) 2024-02-15T22:43:36.236 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:36.236 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:36.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: [15/Feb/2024:22:43:34] ENGINE Bus STARTING 2024-02-15T22:43:36.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: [15/Feb/2024:22:43:34] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:43:36.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: [15/Feb/2024:22:43:34] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:43:36.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: [15/Feb/2024:22:43:34] ENGINE Bus STARTED 2024-02-15T22:43:36.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:36.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:37.688 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:37 smithi138 ceph-mon[29229]: mgrmap e17: smithi138.jqscxs(active, since 2s) 2024-02-15T22:43:37.785 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 -- 172.21.15.170:0/1539943750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 msgr2=0x7f6ca40fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 --2- 172.21.15.170:0/1539943750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca40fe500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009910 tx=0x7f6c98009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 -- 172.21.15.170:0/1539943750 shutdown_connections 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 --2- 172.21.15.170:0/1539943750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca40fe500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 -- 172.21.15.170:0/1539943750 >> 172.21.15.170:0/1539943750 conn(0x7f6ca40f9a60 msgr2=0x7f6ca40fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 -- 172.21.15.170:0/1539943750 shutdown_connections 2024-02-15T22:43:39.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.717+0000 7f6cab04d700 1 -- 172.21.15.170:0/1539943750 wait complete. 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6cab04d700 1 Processor -- start 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6cab04d700 1 -- start start 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6cab04d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6cab04d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca41954f0 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6ca8de9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6ca8de9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:43994/0 (socket says 172.21.15.170:43994) 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.718+0000 7f6ca8de9700 1 -- 172.21.15.170:0/2296345414 learned_addr learned my addr 172.21.15.170:0/2296345414 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6ca8de9700 1 -- 172.21.15.170:0/2296345414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980095f0 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6ca8de9700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c98005b40 tx=0x7f6c98004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c9801d070 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c9800be10 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca41956f0 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c9800f460 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.719+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca4195b90 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.720+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f6c9800b960 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.720+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca418eb10 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.720+0000 7f6ca1ffb700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 0x7f6c9403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:39.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.720+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6c9804c6b0 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.721+0000 7f6ca3fff700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 0x7f6c9403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:39.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.721+0000 7f6ca3fff700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 0x7f6c9403aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c90006fd0 tx=0x7f6c90006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:39.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.726+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6c9802a360 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.994+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6ca402cc30 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.994+0000 7f6ca1ffb700 1 -- 172.21.15.170:0/2296345414 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f6c98027030 con 0x7f6ca40fe0f0 2024-02-15T22:43:39.996 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:39.996 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.996+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 msgr2=0x7f6c9403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.996+0000 7f6cab04d700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 0x7f6c9403aa30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c90006fd0 tx=0x7f6c90006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.996+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 msgr2=0x7f6ca4194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.996+0000 7f6cab04d700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c98005b40 tx=0x7f6c98004740 comp rx=0 tx=0).stop 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 shutdown_connections 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6c94038580 0x7f6c9403aa30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 --2- 172.21.15.170:0/2296345414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ca40fe0f0 0x7f6ca4194fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 >> 172.21.15.170:0/2296345414 conn(0x7f6ca40f9a60 msgr2=0x7f6ca40fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 shutdown_connections 2024-02-15T22:43:39.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:39.997+0000 7f6cab04d700 1 -- 172.21.15.170:0/2296345414 wait complete. 2024-02-15T22:43:39.999 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:43:40.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:40 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2296345414' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:41.590 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:41.590 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:41.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:41.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:41.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:41.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:43:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:43:41.787 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:42.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:42 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:43:42.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:42 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:43:42.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:42 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:42.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:43.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 -- 172.21.15.170:0/4121649564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 msgr2=0x7ff41c0ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:43.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 --2- 172.21.15.170:0/4121649564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c0ff3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff414009910 tx=0x7ff414009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 -- 172.21.15.170:0/4121649564 shutdown_connections 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 --2- 172.21.15.170:0/4121649564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c0ff3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 -- 172.21.15.170:0/4121649564 >> 172.21.15.170:0/4121649564 conn(0x7ff41c074af0 msgr2=0x7ff41c074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 -- 172.21.15.170:0/4121649564 shutdown_connections 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.314+0000 7ff421913700 1 -- 172.21.15.170:0/4121649564 wait complete. 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.315+0000 7ff421913700 1 Processor -- start 2024-02-15T22:43:43.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.315+0000 7ff421913700 1 -- start start 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff421913700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff421913700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1947a0 con 0x7ff41c0ff020 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff41affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff41affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:42520/0 (socket says 172.21.15.170:42520) 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff41affd700 1 -- 172.21.15.170:0/3569725155 learned_addr learned my addr 172.21.15.170:0/3569725155 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff41affd700 1 -- 172.21.15.170:0/3569725155 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140095f0 con 0x7ff41c0ff020 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff41affd700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff414005b40 tx=0x7ff414004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.316+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff41401d070 con 0x7ff41c0ff020 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.317+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4140044d0 con 0x7ff41c0ff020 2024-02-15T22:43:43.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.317+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c1949a0 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.317+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff414003930 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.317+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c194d60 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.318+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c062380 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.318+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7ff414003bf0 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.318+0000 7ff420911700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 0x7ff40403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.318+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff41404c420 con 0x7ff41c0ff020 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.318+0000 7ff41a7fc700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 0x7ff40403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:43.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.319+0000 7ff41a7fc700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 0x7ff40403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff41000ad30 tx=0x7ff4100093f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:43.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.324+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff41402a540 con 0x7ff41c0ff020 2024-02-15T22:43:43.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.609+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff41c106d70 con 0x7ff41c0ff020 2024-02-15T22:43:43.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.610+0000 7ff420911700 1 -- 172.21.15.170:0/3569725155 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7ff41402a360 con 0x7ff41c0ff020 2024-02-15T22:43:43.611 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:43.611 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 msgr2=0x7ff40403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 0x7ff40403aa30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff41000ad30 tx=0x7ff4100093f0 comp rx=0 tx=0).stop 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 msgr2=0x7ff41c194260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff414005b40 tx=0x7ff414004c80 comp rx=0 tx=0).stop 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 shutdown_connections 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff404038580 0x7ff40403aa30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:43.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 --2- 172.21.15.170:0/3569725155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff41c0ff020 0x7ff41c194260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 >> 172.21.15.170:0/3569725155 conn(0x7ff41c074af0 msgr2=0x7ff41c1031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 shutdown_connections 2024-02-15T22:43:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:43.612+0000 7ff421913700 1 -- 172.21.15.170:0/3569725155 wait complete. 2024-02-15T22:43:43.614 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:43.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:43:43.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:43:43.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:43:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:44.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:44 smithi138 ceph-mon[29229]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-02-15T22:43:44.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:44 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/3569725155' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:46.043 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:46.043 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:46.797 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:46 smithi138 ceph-mon[29229]: Deploying daemon crash.smithi170 on smithi170 2024-02-15T22:43:48.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/2281277316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 msgr2=0x7fb7b80734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:48.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/2281277316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b80734c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009910 tx=0x7fb7b4009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:48.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/2281277316 shutdown_connections 2024-02-15T22:43:48.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/2281277316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b80734c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:48.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/2281277316 >> 172.21.15.170:0/2281277316 conn(0x7fb7b80fb8d0 msgr2=0x7fb7b80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/2281277316 shutdown_connections 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.680+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/2281277316 wait complete. 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bfa2e700 1 Processor -- start 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bfa2e700 1 -- start start 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bfa2e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bfa2e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b81a1be0 con 0x7fb7b80730f0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bd7ca700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bd7ca700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:42544/0 (socket says 172.21.15.170:42544) 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.681+0000 7fb7bd7ca700 1 -- 172.21.15.170:0/1475315952 learned_addr learned my addr 172.21.15.170:0/1475315952 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7bd7ca700 1 -- 172.21.15.170:0/1475315952 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40095f0 con 0x7fb7b80730f0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7bd7ca700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005b40 tx=0x7fb7b4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b401d070 con 0x7fb7b80730f0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7b40044d0 con 0x7fb7b80730f0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b81a1d80 con 0x7fb7b80730f0 2024-02-15T22:43:48.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7b4003930 con 0x7fb7b80730f0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.682+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b81a2140 con 0x7fb7b80730f0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.683+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7fb7b400b960 con 0x7fb7b80730f0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.683+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b8062380 con 0x7fb7b80730f0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.683+0000 7fb7ae7fc700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 0x7fb7a403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.683+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb7b404c3f0 con 0x7fb7b80730f0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.683+0000 7fb7bcfc9700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 0x7fb7a403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.684+0000 7fb7bcfc9700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 0x7fb7a403aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8006fd0 tx=0x7fb7a8006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:48.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.688+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb7b402a540 con 0x7fb7b80730f0 2024-02-15T22:43:48.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.964+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb7b819cc30 con 0x7fb7b80730f0 2024-02-15T22:43:48.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.965+0000 7fb7ae7fc700 1 -- 172.21.15.170:0/1475315952 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fb7b402a360 con 0x7fb7b80730f0 2024-02-15T22:43:48.973 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:48.973 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:48.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 msgr2=0x7fb7a403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:48.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 0x7fb7a403aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8006fd0 tx=0x7fb7a8006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:48.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 msgr2=0x7fb7b81a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005b40 tx=0x7fb7b4004c80 comp rx=0 tx=0).stop 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 shutdown_connections 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb7a4038580 0x7fb7a403aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 --2- 172.21.15.170:0/1475315952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7b80730f0 0x7fb7b81a16a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 >> 172.21.15.170:0/1475315952 conn(0x7fb7b80fb8d0 msgr2=0x7fb7b80fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 shutdown_connections 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:48.967+0000 7fb7bfa2e700 1 -- 172.21.15.170:0/1475315952 wait complete. 2024-02-15T22:43:48.975 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:49.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:49 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1475315952' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:49.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:50.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:50 smithi138 ceph-mon[29229]: Deploying daemon node-exporter.smithi170 on smithi170 2024-02-15T22:43:50.675 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:50.676 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:50.877 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:53.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 -- 172.21.15.170:0/139018897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 msgr2=0x7f942c101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:53.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 --2- 172.21.15.170:0/139018897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c101460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f941c009910 tx=0x7f941c009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:53.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 -- 172.21.15.170:0/139018897 shutdown_connections 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 --2- 172.21.15.170:0/139018897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c101460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 -- 172.21.15.170:0/139018897 >> 172.21.15.170:0/139018897 conn(0x7f942c0fa890 msgr2=0x7f942c0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 -- 172.21.15.170:0/139018897 shutdown_connections 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.824+0000 7f94311a8700 1 -- 172.21.15.170:0/139018897 wait complete. 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.825+0000 7f94311a8700 1 Processor -- start 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.825+0000 7f94311a8700 1 -- start start 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.825+0000 7f94311a8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:53.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.825+0000 7f94311a8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c197ae0 con 0x7f942c101090 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:52928/0 (socket says 172.21.15.170:52928) 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f942ad9d700 1 -- 172.21.15.170:0/3513313214 learned_addr learned my addr 172.21.15.170:0/3513313214 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f942ad9d700 1 -- 172.21.15.170:0/3513313214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0095f0 con 0x7f942c101090 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f942ad9d700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f941c005b40 tx=0x7f941c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f941c01d070 con 0x7f942c101090 2024-02-15T22:43:53.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f941c0044d0 con 0x7f942c101090 2024-02-15T22:43:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f941c003930 con 0x7f942c101090 2024-02-15T22:43:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c197ce0 con 0x7f942c101090 2024-02-15T22:43:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.826+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c1980a0 con 0x7f942c101090 2024-02-15T22:43:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.827+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f941c003bf0 con 0x7f942c101090 2024-02-15T22:43:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.827+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942c062380 con 0x7f942c101090 2024-02-15T22:43:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.828+0000 7f9413fff700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 0x7f941403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.828+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f941c04c530 con 0x7f942c101090 2024-02-15T22:43:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.828+0000 7f942a59c700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 0x7f941403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.828+0000 7f942a59c700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 0x7f941403aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9420006fd0 tx=0x7f9420006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:53.833+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f941c02a950 con 0x7f942c101090 2024-02-15T22:43:54.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.107+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f942c198900 con 0x7f942c101090 2024-02-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.108+0000 7f9413fff700 1 -- 172.21.15.170:0/3513313214 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f941c02a360 con 0x7f942c101090 2024-02-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:54.109 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.109+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 msgr2=0x7f941403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.109+0000 7f94311a8700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 0x7f941403aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9420006fd0 tx=0x7f9420006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.109+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 msgr2=0x7f942c1975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.109+0000 7f94311a8700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f941c005b40 tx=0x7f941c004c80 comp rx=0 tx=0).stop 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 shutdown_connections 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f9414038580 0x7f941403aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 --2- 172.21.15.170:0/3513313214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f942c101090 0x7f942c1975a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 >> 172.21.15.170:0/3513313214 conn(0x7f942c0fa890 msgr2=0x7f942c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 shutdown_connections 2024-02-15T22:43:54.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:54.110+0000 7f94311a8700 1 -- 172.21.15.170:0/3513313214 wait complete. 2024-02-15T22:43:54.112 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:43:54.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-15T22:43:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:43:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:54 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/3513313214' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:55.714 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:43:55.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:43:55.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:55 smithi138 ceph-mon[29229]: Deploying daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:43:55.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:55 smithi138 ceph-mon[29229]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:56.321 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:43:57.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:43:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:43:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:57 smithi138 ceph-mon[29229]: Deploying daemon mon.smithi170 on smithi170 2024-02-15T22:43:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 -- 172.21.15.170:0/3100072662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 msgr2=0x7f87f8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:58.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 --2- 172.21.15.170:0/3100072662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8100480 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009910 tx=0x7f87f4009c20 comp rx=0 tx=0).stop 2024-02-15T22:43:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 -- 172.21.15.170:0/3100072662 shutdown_connections 2024-02-15T22:43:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 --2- 172.21.15.170:0/3100072662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8100480 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 -- 172.21.15.170:0/3100072662 >> 172.21.15.170:0/3100072662 conn(0x7f87f80fb970 msgr2=0x7f87f80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 -- 172.21.15.170:0/3100072662 shutdown_connections 2024-02-15T22:43:58.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.701+0000 7f88003bb700 1 -- 172.21.15.170:0/3100072662 wait complete. 2024-02-15T22:43:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f88003bb700 1 Processor -- start 2024-02-15T22:43:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f88003bb700 1 -- start start 2024-02-15T22:43:58.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f88003bb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f88003bb700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8195880 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f87fe157700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f87fe157700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.170:52966/0 (socket says 172.21.15.170:52966) 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f87fe157700 1 -- 172.21.15.170:0/3384655539 learned_addr learned my addr 172.21.15.170:0/3384655539 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.702+0000 7f87fe157700 1 -- 172.21.15.170:0/3384655539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40095f0 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f87fe157700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005b40 tx=0x7f87f4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87f401d070 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87f40044d0 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f8195a80 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87f4003930 con 0x7f87f81000b0 2024-02-15T22:43:58.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.703+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f8195e40 con 0x7f87f81000b0 2024-02-15T22:43:58.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.704+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) v1 ==== 45199+0+0 (secure 0 0 0) 0x7f87f4003bf0 con 0x7f87f81000b0 2024-02-15T22:43:58.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.704+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8062380 con 0x7f87f81000b0 2024-02-15T22:43:58.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.704+0000 7f87ef7fe700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 0x7f87e403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:43:58.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.704+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f87f404c510 con 0x7f87f81000b0 2024-02-15T22:43:58.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.704+0000 7f87fd956700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 0x7f87e403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:43:58.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.705+0000 7f87fd956700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 0x7f87e403aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:43:58.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.709+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f87f402a950 con 0x7f87f81000b0 2024-02-15T22:43:58.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:58 smithi138 ceph-mon[29229]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:43:58.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.987+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87f8107e50 con 0x7f87f81000b0 2024-02-15T22:43:58.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.988+0000 7f87ef7fe700 1 -- 172.21.15.170:0/3384655539 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f87f402a360 con 0x7f87f81000b0 2024-02-15T22:43:58.989 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:43:58.989 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:41:14.824124Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.991+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 msgr2=0x7f87e403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.991+0000 7f88003bb700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 0x7f87e403aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f87e8006fd0 tx=0x7f87e8006e40 comp rx=0 tx=0).stop 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.991+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 msgr2=0x7f87f8195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.991+0000 7f88003bb700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f87f4005b40 tx=0x7f87f4004c80 comp rx=0 tx=0).stop 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 shutdown_connections 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f87e4038580 0x7f87e403aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 --2- 172.21.15.170:0/3384655539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87f81000b0 0x7f87f8195340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 >> 172.21.15.170:0/3384655539 conn(0x7f87f80fb970 msgr2=0x7f87f8104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 shutdown_connections 2024-02-15T22:43:58.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:43:58.992+0000 7f88003bb700 1 -- 172.21.15.170:0/3384655539 wait complete. 2024-02-15T22:43:58.994 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 1 2024-02-15T22:43:59.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:59 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/3384655539' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:43:59.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:43:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:00.534 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T22:44:00.534 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T22:44:00.872 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:44:00.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:00 smithi138 ceph-mon[29229]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expanded map: {default=false} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expand map: {default=info} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta from 'info' to 'info' 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expanded map: {default=info} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expand map: {default=daemon} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta from 'daemon' to 'daemon' 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expanded map: {default=daemon} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expand map: {default=debug} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta from 'debug' to 'debug' 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: expand_channel_meta expanded map: {default=debug} 2024-02-15T22:44:02.559 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 ceph-mon[35248]: mon.smithi170@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-02-15T22:44:02.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 bash[35196]: 048fb6f13e25a93a13c44d6d4d74aa8ecc12dc6f0503bfad9569d0a4aea28a9c 2024-02-15T22:44:02.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:02 smithi170 systemd[1]: Started Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: mon.smithi138 calling monitor election 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: mon.smithi170 calling monitor election 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: monmap e2: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: fsmap 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: mgrmap e17: smithi138.jqscxs(active, since 33s) 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: overall HEALTH_OK 2024-02-15T22:44:07.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:07.986 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:44:08.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: mon.smithi138 calling monitor election 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: mon.smithi170 calling monitor election 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: monmap e2: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} 2024-02-15T22:44:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: fsmap 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: osdmap e5: 0 total, 0 up, 0 in 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: mgrmap e17: smithi138.jqscxs(active, since 33s) 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: overall HEALTH_OK 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/78830328' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:08.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.804+0000 7fe42b9b9700 1 -- 172.21.15.170:0/987023138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4100035c0 msgr2=0x7fe410005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:08.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.804+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/987023138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4100035c0 0x7fe410005a40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe424078120 tx=0x7fe42000ff50 comp rx=0 tx=0).stop 2024-02-15T22:44:08.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.804+0000 7fe42b9b9700 1 -- 172.21.15.170:0/987023138 shutdown_connections 2024-02-15T22:44:08.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.804+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/987023138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4100035c0 0x7fe410005a40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.804+0000 7fe42b9b9700 1 -- 172.21.15.170:0/987023138 >> 172.21.15.170:0/987023138 conn(0x7fe4240745b0 msgr2=0x7fe4240749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.805+0000 7fe42b9b9700 1 -- 172.21.15.170:0/987023138 shutdown_connections 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.805+0000 7fe42b9b9700 1 -- 172.21.15.170:0/987023138 wait complete. 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.805+0000 7fe42b9b9700 1 Processor -- start 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.805+0000 7fe42b9b9700 1 -- start start 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe42b9b9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe42b9b9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 0x7fe424197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe42b9b9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424193f20 con 0x7fe424193910 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe42b9b9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424194090 con 0x7fe4100035c0 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40826/0 (socket says 172.21.15.170:40826) 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 -- 172.21.15.170:0/2962611652 learned_addr learned my addr 172.21.15.170:0/2962611652 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe428f54700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 0x7fe424197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 -- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 msgr2=0x7fe4241933d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 -- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 msgr2=0x7fe4241933d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe429755700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe428f54700 1 -- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 msgr2=0x7fe4241933d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe428f54700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe428f54700 1 -- 172.21.15.170:0/2962611652 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42000f9a0 con 0x7fe424193910 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.806+0000 7fe428f54700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 0x7fe424197d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b500 tx=0x7fe41400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.807+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe414011800 con 0x7fe424193910 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.807+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe424198380 con 0x7fe424193910 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.807+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe414011e10 con 0x7fe424193910 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.807+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4241988d0 con 0x7fe424193910 2024-02-15T22:44:08.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.807+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41400f2e0 con 0x7fe424193910 2024-02-15T22:44:08.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.808+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe424198c00 con 0x7fe424193910 2024-02-15T22:44:08.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.809+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7fe414011960 con 0x7fe424193910 2024-02-15T22:44:08.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.809+0000 7fe41a7fc700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 0x7fe40806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:08.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.809+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe414089d40 con 0x7fe424193910 2024-02-15T22:44:08.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.809+0000 7fe429755700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 0x7fe40806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:08.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.810+0000 7fe429755700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 0x7fe40806ec00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe420005d10 tx=0x7fe420005c20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:08.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:08.814+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe414055500 con 0x7fe424193910 2024-02-15T22:44:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:08 smithi138 ceph-mon[29229]: mgrmap e18: smithi138.jqscxs(active, since 33s), standbys: smithi170.gczrzt 2024-02-15T22:44:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:08 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:44:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:08 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:08 smithi138 ceph-mon[29229]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:08 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:09.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:08 smithi170 ceph-mon[35248]: mgrmap e18: smithi138.jqscxs(active, since 33s), standbys: smithi170.gczrzt 2024-02-15T22:44:09.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:08 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:44:09.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:08 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:09.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:08 smithi170 ceph-mon[35248]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:09.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:08 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:44:09.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.093+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe42419e020 con 0x7fe424193910 2024-02-15T22:44:09.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.093+0000 7fe41a7fc700 1 -- 172.21.15.170:0/2962611652 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7fe414089500 con 0x7fe424193910 2024-02-15T22:44:09.095 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-15T22:44:09.095 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":2,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","modified":"2024-02-15T22:44:02.560356Z","created":"2024-02-15T22:41:14.824124Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi138","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi170","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 msgr2=0x7fe40806ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 0x7fe40806ec00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe420005d10 tx=0x7fe420005c20 comp rx=0 tx=0).stop 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 msgr2=0x7fe424197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 0x7fe424197d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b500 tx=0x7fe41400b8c0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 shutdown_connections 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe40806c750 0x7fe40806ec00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4100035c0 0x7fe4241933d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 --2- 172.21.15.170:0/2962611652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe424193910 0x7fe424197d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:09.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 >> 172.21.15.170:0/2962611652 conn(0x7fe4240745b0 msgr2=0x7fe424101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:09.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 shutdown_connections 2024-02-15T22:44:09.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:44:09.096+0000 7fe42b9b9700 1 -- 172.21.15.170:0/2962611652 wait complete. 2024-02-15T22:44:09.098 INFO:teuthology.orchestra.run.smithi170.stderr:dumped monmap epoch 2 2024-02-15T22:44:09.681 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-15T22:44:09.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-15T22:44:09.899 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:44:10.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:10 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:10.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:10 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2962611652' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:44:10.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:10 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:10.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:10 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/2962611652' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.363 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:44:11.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:11 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:11.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:44:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:44:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:11 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:12.152 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:12 smithi138 ceph-mon[29229]: Reconfiguring mon.smithi138 (unknown last config time)... 2024-02-15T22:44:12.152 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:12 smithi138 ceph-mon[29229]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- 172.21.15.138:0/1368808979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 msgr2=0x7f077c0ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 --2- 172.21.15.138:0/1368808979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c0ff370 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0770009910 tx=0x7f0770009c20 comp rx=0 tx=0).stop 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- 172.21.15.138:0/1368808979 shutdown_connections 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 --2- 172.21.15.138:0/1368808979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c0ff370 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- 172.21.15.138:0/1368808979 >> 172.21.15.138:0/1368808979 conn(0x7f077c0fa860 msgr2=0x7f077c0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- 172.21.15.138:0/1368808979 shutdown_connections 2024-02-15T22:44:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- 172.21.15.138:0/1368808979 wait complete. 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 Processor -- start 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.169+0000 7f0783009700 1 -- start start 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0783009700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0783009700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f077c100ef0 0x7f077c101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0783009700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1a1700 con 0x7f077c0fefa0 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0783009700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1a1840 con 0x7f077c100ef0 2024-02-15T22:44:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47012/0 (socket says 172.21.15.138:47012) 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 -- 172.21.15.138:0/3817968847 learned_addr learned my addr 172.21.15.138:0/3817968847 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f077bfff700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f077c100ef0 0x7f077c101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 -- 172.21.15.138:0/3817968847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f077c100ef0 msgr2=0x7f077c101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f077c100ef0 0x7f077c101360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 -- 172.21.15.138:0/3817968847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700095f0 con 0x7f077c0fefa0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0780da5700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07700092e0 tx=0x7f077000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f077001d070 con 0x7f077c0fefa0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0770005140 con 0x7f077c0fefa0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0770017440 con 0x7f077c0fefa0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.170+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c1a1980 con 0x7f077c0fefa0 2024-02-15T22:44:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.171+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c1a1e20 con 0x7f077c0fefa0 2024-02-15T22:44:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.172+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c062380 con 0x7f077c0fefa0 2024-02-15T22:44:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.172+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f077000f460 con 0x7f077c0fefa0 2024-02-15T22:44:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.172+0000 7f0779ffb700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 0x7f076c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.172+0000 7f077bfff700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 0x7f076c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.172+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f077008bac0 con 0x7f077c0fefa0 2024-02-15T22:44:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.173+0000 7f077bfff700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 0x7f076c06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07680078e0 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:12.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.177+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0770057300 con 0x7f077c0fefa0 2024-02-15T22:44:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.372+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f077c1a22d0 con 0x7f077c0fefa0 2024-02-15T22:44:12.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.373+0000 7f0779ffb700 1 -- 172.21.15.138:0/3817968847 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f0770026090 con 0x7f077c0fefa0 2024-02-15T22:44:12.374 INFO:teuthology.orchestra.run.smithi138.stdout:# minimal ceph.conf for 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:44:12.374 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-02-15T22:44:12.374 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:44:12.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon_host = [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-02-15T22:44:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 msgr2=0x7f076c06ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 0x7f076c06ec10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f07680078e0 tx=0x7f0768008040 comp rx=0 tx=0).stop 2024-02-15T22:44:12.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 msgr2=0x7f077c1009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f07700092e0 tx=0x7f077000bda0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 shutdown_connections 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f076c06c760 0x7f076c06ec10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f077c0fefa0 0x7f077c1009b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 --2- 172.21.15.138:0/3817968847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f077c100ef0 0x7f077c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 >> 172.21.15.138:0/3817968847 conn(0x7f077c0fa860 msgr2=0x7f077c0687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 shutdown_connections 2024-02-15T22:44:12.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:12.375+0000 7f0783009700 1 -- 172.21.15.138:0/3817968847 wait complete. 2024-02-15T22:44:12.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:12 smithi170 ceph-mon[35248]: Reconfiguring mon.smithi138 (unknown last config time)... 2024-02-15T22:44:12.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:12 smithi170 ceph-mon[35248]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-15T22:44:13.288 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-15T22:44:13.289 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:44:13.289 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3817968847' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:44:13.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:13.320 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:44:13.321 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:44:13.389 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:44:13.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T22:44:13.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:13.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3817968847' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:13.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:13.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:13.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:44:13.420 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:44:13.420 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:13.424 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:44:13.424 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:44:13.495 INFO:tasks.cephadm:Deploying OSDs... 2024-02-15T22:44:13.495 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:44:13.495 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:44:13.511 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:44:13.511 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 22:43:25.731121297 +0000 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 22:36:46.235080003 +0000 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 22:36:46.235080003 +0000 2024-02-15T22:44:13.567 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-15 22:36:46.235080003 +0000 2024-02-15T22:44:13.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:44:13.632 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-15T22:44:13.633 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-15T22:44:13.633 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000202066 s, 2.5 MB/s 2024-02-15T22:44:13.634 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:44:13.691 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 22:43:25.732121276 +0000 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 22:36:46.570072629 +0000 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 22:36:46.570072629 +0000 2024-02-15T22:44:13.746 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-15 22:36:46.570072629 +0000 2024-02-15T22:44:13.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:44:13.812 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-15T22:44:13.812 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-15T22:44:13.812 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00024224 s, 2.1 MB/s 2024-02-15T22:44:13.813 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:44:13.868 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-02-15T22:44:13.922 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:44:13.922 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 22:43:25.732121276 +0000 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 22:36:46.910065146 +0000 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 22:36:46.910065146 +0000 2024-02-15T22:44:13.923 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-15 22:36:46.910065146 +0000 2024-02-15T22:44:13.923 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:44:13.989 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-15T22:44:13.989 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-15T22:44:13.989 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000212114 s, 2.4 MB/s 2024-02-15T22:44:13.990 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:44:14.048 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-02-15T22:44:14.103 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:44:14.103 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-02-15 22:43:25.733121254 +0000 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 22:36:47.252057618 +0000 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 22:36:47.252057618 +0000 2024-02-15T22:44:14.104 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-15 22:36:47.252057618 +0000 2024-02-15T22:44:14.104 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:44:14.169 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-02-15T22:44:14.169 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-02-15T22:44:14.169 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000163126 s, 3.1 MB/s 2024-02-15T22:44:14.170 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:44:14.225 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:44:14.226 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T22:44:14.244 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T22:44:14.244 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-15 22:44:00.925686694 +0000 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-15 22:36:46.217622918 +0000 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-15 22:36:46.217622918 +0000 2024-02-15T22:44:14.303 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-15 22:36:46.217622918 +0000 2024-02-15T22:44:14.304 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T22:44:14.368 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:14 smithi170 ceph-mon[35248]: Reconfiguring mgr.smithi138.jqscxs (unknown last config time)... 2024-02-15T22:44:14.368 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:14 smithi170 ceph-mon[35248]: Reconfiguring daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:44:14.371 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-15T22:44:14.371 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-15T22:44:14.371 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000105332 s, 4.9 MB/s 2024-02-15T22:44:14.372 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T22:44:14.417 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:14 smithi138 ceph-mon[29229]: Reconfiguring mgr.smithi138.jqscxs (unknown last config time)... 2024-02-15T22:44:14.417 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:14 smithi138 ceph-mon[29229]: Reconfiguring daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:44:14.429 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-15 22:44:00.925686694 +0000 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-15 22:36:46.550614962 +0000 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-15 22:36:46.550614962 +0000 2024-02-15T22:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-15 22:36:46.550614962 +0000 2024-02-15T22:44:14.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T22:44:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-15T22:44:14.555 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-15T22:44:14.555 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000100977 s, 5.1 MB/s 2024-02-15T22:44:14.556 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T22:44:14.612 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-02-15T22:44:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-15 22:44:00.925686694 +0000 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-15 22:36:46.875607195 +0000 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-15 22:36:46.875607195 +0000 2024-02-15T22:44:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-15 22:36:46.875607195 +0000 2024-02-15T22:44:14.668 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T22:44:14.734 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-15T22:44:14.734 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-15T22:44:14.734 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000110205 s, 4.6 MB/s 2024-02-15T22:44:14.735 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T22:44:14.792 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-02-15T22:44:14.847 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T22:44:14.847 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T22:44:14.847 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-15T22:44:14.847 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:44:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T22:44:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-15 22:44:00.926686671 +0000 2024-02-15T22:44:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-15 22:36:47.210599189 +0000 2024-02-15T22:44:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-15 22:36:47.210599189 +0000 2024-02-15T22:44:14.848 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-15 22:36:47.210599189 +0000 2024-02-15T22:44:14.848 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T22:44:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-15T22:44:14.913 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-15T22:44:14.914 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000108804 s, 4.7 MB/s 2024-02-15T22:44:14.915 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T22:44:14.970 INFO:tasks.cephadm:Deploying osd.0 on smithi138 with /dev/vg_nvme/lv_4... 2024-02-15T22:44:14.970 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T22:44:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: Reconfiguring ceph-exporter.smithi138 (monmap changed)... 2024-02-15T22:44:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:44:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:15 smithi138 ceph-mon[29229]: Reconfiguring daemon ceph-exporter.smithi138 on smithi138 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: Reconfiguring ceph-exporter.smithi138 (monmap changed)... 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:44:15.738 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:15.739 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:15 smithi170 ceph-mon[35248]: Reconfiguring daemon ceph-exporter.smithi138 on smithi138 2024-02-15T22:44:15.937 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:44:16.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-15T22:44:16.957 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:16 smithi138 ceph-mon[29229]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:17.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:17.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:17.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-15T22:44:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:44:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-15T22:44:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:16 smithi170 ceph-mon[35248]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128493 s, 816 MB/s 2024-02-15T22:44:18.452 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-15T22:44:18.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:18 smithi138 ceph-mon[29229]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:18.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:18.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:19.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:18 smithi170 ceph-mon[35248]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:19.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:19.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:19.148 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_4 2024-02-15T22:44:19.694 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:19 smithi138 ceph-mon[29229]: Reconfiguring alertmanager.smithi138 (dependencies changed)... 2024-02-15T22:44:19.694 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:19 smithi138 ceph-mon[29229]: Reconfiguring daemon alertmanager.smithi138 on smithi138 2024-02-15T22:44:19.695 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:19 smithi170 ceph-mon[35248]: Reconfiguring alertmanager.smithi138 (dependencies changed)... 2024-02-15T22:44:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:19 smithi170 ceph-mon[35248]: Reconfiguring daemon alertmanager.smithi138 on smithi138 2024-02-15T22:44:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:20.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:20 smithi138 ceph-mon[29229]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:21.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:20 smithi170 ceph-mon[35248]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:21.441 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:44:23.306 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:23 smithi138 ceph-mon[29229]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:23.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:23 smithi170 ceph-mon[35248]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:23.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 -- 172.21.15.138:0/1315693412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148100c40 msgr2=0x7f8148103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:23.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 --2- 172.21.15.138:0/1315693412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148100c40 0x7f8148103020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8138009910 tx=0x7f8138009c20 comp rx=0 tx=0).stop 2024-02-15T22:44:23.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 -- 172.21.15.138:0/1315693412 shutdown_connections 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 --2- 172.21.15.138:0/1315693412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148103560 0x7f8148105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 --2- 172.21.15.138:0/1315693412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148100c40 0x7f8148103020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 -- 172.21.15.138:0/1315693412 >> 172.21.15.138:0/1315693412 conn(0x7f81480fa600 msgr2=0x7f81480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 -- 172.21.15.138:0/1315693412 shutdown_connections 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 -- 172.21.15.138:0/1315693412 wait complete. 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.674+0000 7f814d529700 1 Processor -- start 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f814d529700 1 -- start start 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f814d529700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148100c40 0x7f81481959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f814d529700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f814d529700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148196530 con 0x7f8148103560 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f814d529700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148196670 con 0x7f8148100c40 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:34490/0 (socket says 172.21.15.138:34490) 2024-02-15T22:44:23.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 -- 172.21.15.138:0/466705386 learned_addr learned my addr 172.21.15.138:0/466705386 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f8146ffd700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148100c40 0x7f81481959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 -- 172.21.15.138:0/466705386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148100c40 msgr2=0x7f81481959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148100c40 0x7f81481959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 -- 172.21.15.138:0/466705386 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380095f0 con 0x7f8148103560 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f813e7fc700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f813000b4b0 tx=0x7f813000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.675+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8130011800 con 0x7f8148103560 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.676+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8130011e10 con 0x7f8148103560 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.676+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814819b120 con 0x7f8148103560 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.676+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813000f2e0 con 0x7f8148103560 2024-02-15T22:44:23.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.676+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814819b6f0 con 0x7f8148103560 2024-02-15T22:44:23.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.677+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814818fbf0 con 0x7f8148103560 2024-02-15T22:44:23.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.677+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f8130010380 con 0x7f8148103560 2024-02-15T22:44:23.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.677+0000 7f8144ff9700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 0x7f813406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:23.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.678+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f813008a3e0 con 0x7f8148103560 2024-02-15T22:44:23.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.678+0000 7f8146ffd700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 0x7f813406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:23.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.678+0000 7f8146ffd700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 0x7f813406eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81380059d0 tx=0x7f8138005920 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:23.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.682+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8130059630 con 0x7f8148103560 2024-02-15T22:44:23.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:23.884+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8148061190 con 0x7f813406c600 2024-02-15T22:44:24.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:24 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:44:24.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:24 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:44:24.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:24 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:24 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:44:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:24 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:44:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:24 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:25.245 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:25 smithi138 ceph-mon[29229]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:25.246 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:25 smithi138 ceph-mon[29229]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:25.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:25 smithi170 ceph-mon[35248]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:25.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:25 smithi170 ceph-mon[35248]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:27 smithi138 ceph-mon[29229]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:27 smithi138 ceph-mon[29229]: Reconfiguring grafana.smithi138 (dependencies changed)... 2024-02-15T22:44:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:27 smithi138 ceph-mon[29229]: Reconfiguring daemon grafana.smithi138 on smithi138 2024-02-15T22:44:27.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:27 smithi170 ceph-mon[35248]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:27.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:27.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:27 smithi170 ceph-mon[35248]: Reconfiguring grafana.smithi138 (dependencies changed)... 2024-02-15T22:44:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:27 smithi170 ceph-mon[35248]: Reconfiguring daemon grafana.smithi138 on smithi138 2024-02-15T22:44:28.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:28 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1657417556' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b48c426e-a38f-47a7-9e05-ad8da75e241a"}]: dispatch 2024-02-15T22:44:28.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:28 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1657417556' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b48c426e-a38f-47a7-9e05-ad8da75e241a"}]': finished 2024-02-15T22:44:28.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:28 smithi170 ceph-mon[35248]: osdmap e6: 1 total, 0 up, 1 in 2024-02-15T22:44:28.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:28 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:28.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:28 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/535960805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:44:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1657417556' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b48c426e-a38f-47a7-9e05-ad8da75e241a"}]: dispatch 2024-02-15T22:44:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1657417556' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b48c426e-a38f-47a7-9e05-ad8da75e241a"}]': finished 2024-02-15T22:44:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:28 smithi138 ceph-mon[29229]: osdmap e6: 1 total, 0 up, 1 in 2024-02-15T22:44:28.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:28 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:28.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:28 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/535960805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:44:29.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:29 smithi170 ceph-mon[35248]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:29.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:29 smithi138 ceph-mon[29229]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:31.445 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:31 smithi138 ceph-mon[29229]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:31.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:31 smithi170 ceph-mon[35248]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:33.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:33 smithi170 ceph-mon[35248]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:33.540 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:33 smithi138 ceph-mon[29229]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:34.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:34.506 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:35.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:35 smithi170 ceph-mon[35248]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:35.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:35 smithi138 ceph-mon[29229]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:37.394 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:37 smithi138 ceph-mon[29229]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:37.394 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:37.394 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:37.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:37 smithi170 ceph-mon[35248]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:37.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:37.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:38.547 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:38 smithi138 ceph-mon[29229]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:44:38.547 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:38 smithi138 ceph-mon[29229]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:44:38.548 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:38 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:44:38.548 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:38 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:38.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:38 smithi170 ceph-mon[35248]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:44:38.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:38 smithi170 ceph-mon[35248]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:44:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:38 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:44:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:38 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:39.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:39 smithi138 ceph-mon[29229]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:39.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:39 smithi138 ceph-mon[29229]: Deploying daemon osd.0 on smithi138 2024-02-15T22:44:39.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:39 smithi170 ceph-mon[35248]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:39.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:39 smithi170 ceph-mon[35248]: Deploying daemon osd.0 on smithi138 2024-02-15T22:44:41.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:41 smithi138 ceph-mon[29229]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:41.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:41 smithi170 ceph-mon[35248]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:43.581 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:43 smithi138 ceph-mon[29229]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:43.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:43 smithi170 ceph-mon[35248]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-02-15T22:44:44.863 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:44.863 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:44.863 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: Reconfiguring crash.smithi170 (monmap changed)... 2024-02-15T22:44:44.863 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:44:44.864 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:44.864 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: Reconfiguring daemon crash.smithi170 on smithi170 2024-02-15T22:44:44.864 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:44 smithi138 ceph-mon[29229]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:45.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: Reconfiguring crash.smithi170 (monmap changed)... 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: Reconfiguring daemon crash.smithi170 on smithi170 2024-02-15T22:44:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:44 smithi170 ceph-mon[35248]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:46.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: Reconfiguring mgr.smithi170.gczrzt (monmap changed)... 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:46.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:46 smithi138 ceph-mon[29229]: Reconfiguring daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:44:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: Reconfiguring mgr.smithi170.gczrzt (monmap changed)... 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:46 smithi170 ceph-mon[35248]: Reconfiguring daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: Reconfiguring mon.smithi170 (monmap changed)... 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:47.349 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:47 smithi138 ceph-mon[29229]: Reconfiguring daemon mon.smithi170 on smithi170 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: Reconfiguring mon.smithi170 (monmap changed)... 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:44:47.587 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:44:47.588 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:44:47.588 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:47 smithi170 ceph-mon[35248]: Reconfiguring daemon mon.smithi170 on smithi170 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi138.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi138.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi138.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:48 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi138.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi138.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:44:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:44:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi138.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:44:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:48 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:44:49.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:49.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi138.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi138.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi138.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:49.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:44:49.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi138.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T22:44:49.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:44:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi138.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T22:44:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:44:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi138.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T22:44:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:44:50.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:50.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:50.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:50 smithi170 ceph-mon[35248]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:50.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:50.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:50.791 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:50 smithi138 ceph-mon[29229]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:51.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.181+0000 7f8144ff9700 1 -- 172.21.15.138:0/466705386 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8148061190 con 0x7f813406c600 2024-02-15T22:44:51.184 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 0 on host 'smithi138' 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.183+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 msgr2=0x7f813406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.183+0000 7f814d529700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 0x7f813406eab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81380059d0 tx=0x7f8138005920 comp rx=0 tx=0).stop 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.183+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 msgr2=0x7f8148195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f813000b4b0 tx=0x7f813000b870 comp rx=0 tx=0).stop 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 shutdown_connections 2024-02-15T22:44:51.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f813406c600 0x7f813406eab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8148100c40 0x7f81481959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 --2- 172.21.15.138:0/466705386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8148103560 0x7f8148195f10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 >> 172.21.15.138:0/466705386 conn(0x7f81480fa600 msgr2=0x7f81480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 shutdown_connections 2024-02-15T22:44:51.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:51.184+0000 7f814d529700 1 -- 172.21.15.138:0/466705386 wait complete. 2024-02-15T22:44:51.799 DEBUG:teuthology.orchestra.run.smithi138:osd.0> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.0.service 2024-02-15T22:44:51.802 INFO:tasks.cephadm:Deploying osd.1 on smithi138 with /dev/vg_nvme/lv_3... 2024-02-15T22:44:51.802 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T22:44:52.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:52.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:52.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:52 smithi138 ceph-mon[29229]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:44:52.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:52.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:52.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:52 smithi170 ceph-mon[35248]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:44:52.615 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:44:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-mon[29229]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-mon[29229]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:44:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-mon[29229]: osdmap e7: 1 total, 0 up, 1 in 2024-02-15T22:44:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-mon[29229]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:44:53.484 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[44140]: 2024-02-15T22:44:53.145+0000 7feeb6842700 -1 osd.0 0 waiting for initial osdmap 2024-02-15T22:44:53.484 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:44:53 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[44140]: 2024-02-15T22:44:53.148+0000 7feeb1635700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:44:53.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:53 smithi170 ceph-mon[35248]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:53.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:53 smithi170 ceph-mon[35248]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:44:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:53 smithi170 ceph-mon[35248]: osdmap e7: 1 total, 0 up, 1 in 2024-02-15T22:44:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:53 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:53 smithi170 ceph-mon[35248]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:44:54.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:54 smithi138 ceph-mon[29229]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:44:54.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:54 smithi138 ceph-mon[29229]: osdmap e8: 1 total, 0 up, 1 in 2024-02-15T22:44:54.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:54.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:54.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:54 smithi170 ceph-mon[35248]: from='osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:44:54.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:54 smithi170 ceph-mon[35248]: osdmap e8: 1 total, 0 up, 1 in 2024-02-15T22:44:54.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:54.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:55.232 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:44:55.232 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:44:55.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:55.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] boot 2024-02-15T22:44:55.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: osdmap e9: 1 total, 1 up, 1 in 2024-02-15T22:44:55.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:55 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: osd.0 [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] boot 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: osdmap e9: 1 total, 1 up, 1 in 2024-02-15T22:44:55.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:55 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:44:56.184 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T22:44:56.184 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T22:44:56.185 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-15T22:44:56.185 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-15T22:44:56.185 INFO:teuthology.orchestra.run.smithi138.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121135 s, 866 MB/s 2024-02-15T22:44:56.185 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-15T22:44:56.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:56 smithi138 ceph-mon[29229]: osdmap e10: 1 total, 1 up, 1 in 2024-02-15T22:44:56.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:56 smithi170 ceph-mon[35248]: osdmap e10: 1 total, 1 up, 1 in 2024-02-15T22:44:56.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_3 2024-02-15T22:44:57.172 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:44:57.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:57 smithi138 ceph-mon[29229]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:44:57.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:57.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:57.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:57 smithi170 ceph-mon[35248]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:44:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:44:58.640 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:58 smithi138 ceph-mon[29229]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:44:59.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:58 smithi170 ceph-mon[35248]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:44:59.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.188+0000 7f1a0459f700 1 -- 172.21.15.138:0/32427536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 msgr2=0x7f19fc100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:59.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.188+0000 7f1a0459f700 1 --2- 172.21.15.138:0/32427536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc100580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009910 tx=0x7f19f8009c20 comp rx=0 tx=0).stop 2024-02-15T22:44:59.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 -- 172.21.15.138:0/32427536 shutdown_connections 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 --2- 172.21.15.138:0/32427536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 0x7f19fc1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 --2- 172.21.15.138:0/32427536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc100580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 -- 172.21.15.138:0/32427536 >> 172.21.15.138:0/32427536 conn(0x7f19fc0fb6e0 msgr2=0x7f19fc0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 -- 172.21.15.138:0/32427536 shutdown_connections 2024-02-15T22:44:59.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 -- 172.21.15.138:0/32427536 wait complete. 2024-02-15T22:44:59.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 Processor -- start 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.189+0000 7f1a0459f700 1 -- start start 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 0x7f19fc195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc196520 con 0x7f19fc100170 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc196660 con 0x7f19fc101370 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51536/0 (socket says 172.21.15.138:51536) 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 -- 172.21.15.138:0/544685842 learned_addr learned my addr 172.21.15.138:0/544685842 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a01b3a700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 0x7f19fc195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 -- 172.21.15.138:0/544685842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 msgr2=0x7f19fc195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 0x7f19fc195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 -- 172.21.15.138:0/544685842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80095f0 con 0x7f19fc100170 2024-02-15T22:44:59.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0233b700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19f800bda0 tx=0x7f19f800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f801d070 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f19f800f460 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f8021640 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc19b0b0 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.190+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc19b5a0 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.191+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc108cc0 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.192+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f19f800fa00 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.192+0000 7f19f37fe700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 0x7f19e806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.192+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f19f808bd40 con 0x7f19fc100170 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.192+0000 7f1a01b3a700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 0x7f19e806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:44:59.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.193+0000 7f1a01b3a700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 0x7f19e806eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005950 tx=0x7f19ec0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:44:59.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.197+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f19f805ad30 con 0x7f19fc100170 2024-02-15T22:44:59.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:44:59.400+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f19fc105cc0 con 0x7f19e806c600 2024-02-15T22:44:59.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:59 smithi138 ceph-mon[29229]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:44:59.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:44:59.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:44:59.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:44:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:00.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:59 smithi170 ceph-mon[35248]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:00.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:45:00.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:45:00.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:44:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:00.731 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:00 smithi138 ceph-mon[29229]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:01.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:00 smithi170 ceph-mon[35248]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:03.357 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi138 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi138 to 11840M 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.358 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:03.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:03.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi138 2024-02-15T22:45:03.364 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi138 to 11840M 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:03.365 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:04.472 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/4064693642' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ade298e-e38b-40c0-b0bf-943e3979d389"}]: dispatch 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/4064693642' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ade298e-e38b-40c0-b0bf-943e3979d389"}]': finished 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: osdmap e11: 2 total, 1 up, 2 in 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:04.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/4064693642' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2ade298e-e38b-40c0-b0bf-943e3979d389"}]: dispatch 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/4064693642' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ade298e-e38b-40c0-b0bf-943e3979d389"}]': finished 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: osdmap e11: 2 total, 1 up, 2 in 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:05.383 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:05 smithi138 ceph-mon[29229]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:05.383 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:05 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3033777681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:45:05.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:05 smithi170 ceph-mon[35248]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:05 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3033777681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:45:07.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:07.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:07.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:08.928 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:08 smithi138 ceph-mon[29229]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:09.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:08 smithi170 ceph-mon[35248]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:11.219 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:11 smithi138 ceph-mon[29229]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:11.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:11 smithi170 ceph-mon[35248]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:12.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:12 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:45:12.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:12 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:12.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:12 smithi138 ceph-mon[29229]: Deploying daemon osd.1 on smithi138 2024-02-15T22:45:12.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:12 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:45:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:12 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:12.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:12 smithi170 ceph-mon[35248]: Deploying daemon osd.1 on smithi138 2024-02-15T22:45:13.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:13 smithi138 ceph-mon[29229]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:13.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:13 smithi170 ceph-mon[35248]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:15.360 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:15 smithi138 ceph-mon[29229]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:15.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:15 smithi170 ceph-mon[35248]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:17.341 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:17 smithi138 ceph-mon[29229]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:17.342 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:17 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:17.342 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:17 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:17.342 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:17 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:17.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:17 smithi170 ceph-mon[35248]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:17 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:17 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:17 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:18.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:18 smithi138 ceph-mon[29229]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:19.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:18 smithi170 ceph-mon[35248]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:19.938 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:19.938 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:19.939 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:19.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.978+0000 7f19f37fe700 1 -- 172.21.15.138:0/544685842 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f19fc105cc0 con 0x7f19e806c600 2024-02-15T22:45:19.980 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 1 on host 'smithi138' 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 msgr2=0x7f19e806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 0x7f19e806eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005950 tx=0x7f19ec0058e0 comp rx=0 tx=0).stop 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 msgr2=0x7f19fc1959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f19f800bda0 tx=0x7f19f800be80 comp rx=0 tx=0).stop 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 shutdown_connections 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f19e806c600 0x7f19e806eab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19fc100170 0x7f19fc1959c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 --2- 172.21.15.138:0/544685842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19fc101370 0x7f19fc195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:19.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 >> 172.21.15.138:0/544685842 conn(0x7f19fc0fb6e0 msgr2=0x7f19fc1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:19.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 shutdown_connections 2024-02-15T22:45:19.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:19.980+0000 7f1a0459f700 1 -- 172.21.15.138:0/544685842 wait complete. 2024-02-15T22:45:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:20.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:20.950 DEBUG:teuthology.orchestra.run.smithi138:osd.1> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.1.service 2024-02-15T22:45:20.952 INFO:tasks.cephadm:Deploying osd.2 on smithi138 with /dev/vg_nvme/lv_2... 2024-02-15T22:45:20.952 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T22:45:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:20 smithi138 ceph-mon[29229]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:20 smithi138 ceph-mon[29229]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:45:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:20 smithi170 ceph-mon[35248]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:20 smithi170 ceph-mon[35248]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:45:21.847 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:45:22.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-mon[29229]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:45:22.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-mon[29229]: osdmap e12: 2 total, 1 up, 2 in 2024-02-15T22:45:22.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:22.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-mon[29229]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:45:22.234 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[49751]: 2024-02-15T22:45:21.980+0000 7fc11ad39700 -1 osd.1 0 waiting for initial osdmap 2024-02-15T22:45:22.234 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[49751]: 2024-02-15T22:45:21.983+0000 7fc113327700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:45:22.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:21 smithi170 ceph-mon[35248]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:45:22.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:21 smithi170 ceph-mon[35248]: osdmap e12: 2 total, 1 up, 2 in 2024-02-15T22:45:22.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:21 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:22.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:21 smithi170 ceph-mon[35248]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:45:23.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:22 smithi138 ceph-mon[29229]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:45:23.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:22 smithi138 ceph-mon[29229]: osdmap e13: 2 total, 1 up, 2 in 2024-02-15T22:45:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:22 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:22 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:22 smithi138 ceph-mon[29229]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:23.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:22 smithi170 ceph-mon[35248]: from='osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:45:23.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:22 smithi170 ceph-mon[35248]: osdmap e13: 2 total, 1 up, 2 in 2024-02-15T22:45:23.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:22 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:22 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:22 smithi170 ceph-mon[35248]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-15T22:45:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:23 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:45:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:23 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:45:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:23 smithi170 ceph-mon[35248]: osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] boot 2024-02-15T22:45:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:23 smithi170 ceph-mon[35248]: osdmap e14: 2 total, 2 up, 2 in 2024-02-15T22:45:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:23 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:24.428 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:23 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:45:24.428 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:23 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:45:24.428 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:23 smithi138 ceph-mon[29229]: osd.1 [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] boot 2024-02-15T22:45:24.428 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:23 smithi138 ceph-mon[29229]: osdmap e14: 2 total, 2 up, 2 in 2024-02-15T22:45:24.428 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:23 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10+0 records in 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr:10+0 records out 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122529 s, 856 MB/s 2024-02-15T22:45:25.079 INFO:teuthology.orchestra.run.smithi138.stderr:--> Zapping successful for: 2024-02-15T22:45:25.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:24 smithi138 ceph-mon[29229]: osdmap e15: 2 total, 2 up, 2 in 2024-02-15T22:45:25.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:24 smithi138 ceph-mon[29229]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:25.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:24 smithi170 ceph-mon[35248]: osdmap e15: 2 total, 2 up, 2 in 2024-02-15T22:45:25.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:24 smithi170 ceph-mon[35248]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:26.078 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi138:vg_nvme/lv_2 2024-02-15T22:45:26.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:26.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:26.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:26 smithi138 ceph-mon[29229]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:27.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:27.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:27.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:26 smithi170 ceph-mon[35248]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:27.358 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:45:28.925 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:28 smithi138 ceph-mon[29229]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:29.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:28 smithi170 ceph-mon[35248]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 -- 172.21.15.138:0/3712211618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 msgr2=0x7f11340ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 --2- 172.21.15.138:0/3712211618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f11340ff460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1128009910 tx=0x7f1128009c20 comp rx=0 tx=0).stop 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 -- 172.21.15.138:0/3712211618 shutdown_connections 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 --2- 172.21.15.138:0/3712211618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 0x7f11341006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 --2- 172.21.15.138:0/3712211618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f11340ff460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 -- 172.21.15.138:0/3712211618 >> 172.21.15.138:0/3712211618 conn(0x7f11340fa5e0 msgr2=0x7f11340fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 -- 172.21.15.138:0/3712211618 shutdown_connections 2024-02-15T22:45:29.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.607+0000 7f113a13f700 1 -- 172.21.15.138:0/3712211618 wait complete. 2024-02-15T22:45:29.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.608+0000 7f113a13f700 1 Processor -- start 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.608+0000 7f113a13f700 1 -- start start 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.608+0000 7f113a13f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.608+0000 7f113a13f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 0x7f113419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.608+0000 7f113a13f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113419aca0 con 0x7f11340ff050 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f113a13f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113419ae10 con 0x7f1134100250 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33074/0 (socket says 172.21.15.138:33074) 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 -- 172.21.15.138:0/2879680609 learned_addr learned my addr 172.21.15.138:0/2879680609 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f1132ffd700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 0x7f113419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 -- 172.21.15.138:0/2879680609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 msgr2=0x7f113419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 0x7f113419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:29.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 -- 172.21.15.138:0/2879680609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280095f0 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f11337fe700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1128000c00 tx=0x7f112800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112801d070 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1128005dc0 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113419b090 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1128022470 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.609+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113419b580 con 0x7f11340ff050 2024-02-15T22:45:29.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.610+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1134107ba0 con 0x7f11340ff050 2024-02-15T22:45:29.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.611+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) v1 ==== 89860+0+0 (secure 0 0 0) 0x7f112800fa70 con 0x7f11340ff050 2024-02-15T22:45:29.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.611+0000 7f1130ff9700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 0x7f111c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:29.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.611+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f112808c000 con 0x7f11340ff050 2024-02-15T22:45:29.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.611+0000 7f1132ffd700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 0x7f111c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:29.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.611+0000 7f1132ffd700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 0x7f111c06eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f11340694b0 tx=0x7f1124009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:29.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.616+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f112805aec0 con 0x7f11340ff050 2024-02-15T22:45:29.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:29.816+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1134104ba0 con 0x7f111c06c600 2024-02-15T22:45:30.227 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:29 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:45:30.227 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:29 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:45:30.227 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:29 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:30.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:29 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:45:30.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:29 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:45:30.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:29 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi138 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:31.477 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi138 to 5920M 2024-02-15T22:45:31.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:31.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:31.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.478 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:31.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi138 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi138 to 5920M 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:31.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:31.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:31.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2940933574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d5defd8-a53d-4fd3-a6b4-d26923472061"}]: dispatch 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2940933574' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d5defd8-a53d-4fd3-a6b4-d26923472061"}]': finished 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: osdmap e16: 3 total, 2 up, 3 in 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:33 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3545282072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:45:33.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:33.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:33.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2940933574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d5defd8-a53d-4fd3-a6b4-d26923472061"}]: dispatch 2024-02-15T22:45:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2940933574' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d5defd8-a53d-4fd3-a6b4-d26923472061"}]': finished 2024-02-15T22:45:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: osdmap e16: 3 total, 2 up, 3 in 2024-02-15T22:45:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:33 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3545282072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:45:34.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:34.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:35.537 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:35 smithi138 ceph-mon[29229]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:35.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:35 smithi170 ceph-mon[35248]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:36.969 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:36.970 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:36.970 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:36.970 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:36.970 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:36.970 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:36 smithi138 ceph-mon[29229]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:37.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:37.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:37.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:37.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:37.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:37.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:36 smithi170 ceph-mon[35248]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:38.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:38 smithi138 ceph-mon[29229]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:39.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:38 smithi170 ceph-mon[35248]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:40.228 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:45:40.228 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:40.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:45:40.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:41.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:40 smithi138 ceph-mon[29229]: Deploying daemon osd.2 on smithi138 2024-02-15T22:45:41.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:40 smithi138 ceph-mon[29229]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:41.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:40 smithi170 ceph-mon[35248]: Deploying daemon osd.2 on smithi138 2024-02-15T22:45:41.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:40 smithi170 ceph-mon[35248]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:43.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:43 smithi138 ceph-mon[29229]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:43.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:43 smithi170 ceph-mon[35248]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:45.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:45 smithi138 ceph-mon[29229]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:45.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:45 smithi170 ceph-mon[35248]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:46.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:46.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:46.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:46.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:47.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:47 smithi138 ceph-mon[29229]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:47.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:47 smithi170 ceph-mon[35248]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:48.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:48 smithi138 ceph-mon[29229]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:49.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:48 smithi170 ceph-mon[35248]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:49.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.728+0000 7f1130ff9700 1 -- 172.21.15.138:0/2879680609 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1134104ba0 con 0x7f111c06c600 2024-02-15T22:45:49.730 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 2 on host 'smithi138' 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 msgr2=0x7f111c06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 0x7f111c06eab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f11340694b0 tx=0x7f1124009260 comp rx=0 tx=0).stop 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 msgr2=0x7f1134068f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1128000c00 tx=0x7f112800f690 comp rx=0 tx=0).stop 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 shutdown_connections 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f111c06c600 0x7f111c06eab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11340ff050 0x7f1134068f50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 --2- 172.21.15.138:0/2879680609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1134100250 0x7f113419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 >> 172.21.15.138:0/2879680609 conn(0x7f11340fa5e0 msgr2=0x7f1134103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 shutdown_connections 2024-02-15T22:45:49.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:45:49.730+0000 7f113a13f700 1 -- 172.21.15.138:0/2879680609 wait complete. 2024-02-15T22:45:49.973 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:49.973 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:49 smithi138 ceph-mon[29229]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:45:50.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:45:50.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:49 smithi170 ceph-mon[35248]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:45:50.623 DEBUG:teuthology.orchestra.run.smithi138:osd.2> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.2.service 2024-02-15T22:45:50.626 INFO:tasks.cephadm:Deploying osd.3 on smithi170 with /dev/vg_nvme/lv_4... 2024-02-15T22:45:50.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T22:45:50.841 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: osdmap e17: 3 total, 2 up, 3 in 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:50.862 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:50 smithi138 ceph-mon[29229]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: osdmap e17: 3 total, 2 up, 3 in 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:50.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:50 smithi170 ceph-mon[35248]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:51.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:51 smithi170 ceph-mon[35248]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:45:51.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:51 smithi170 ceph-mon[35248]: osdmap e18: 3 total, 2 up, 3 in 2024-02-15T22:45:51.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:51 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:51.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:51 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:51.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:51 smithi138 ceph-mon[29229]: from='osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-02-15T22:45:51.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:51 smithi138 ceph-mon[29229]: osdmap e18: 3 total, 2 up, 3 in 2024-02-15T22:45:51.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:51 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:51.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:51 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:52.544 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T22:45:52.544 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T22:45:52.544 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-02-15T22:45:52.545 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-02-15T22:45:52.545 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00863733 s, 1.2 GB/s 2024-02-15T22:45:52.545 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] boot 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: osdmap e19: 3 total, 3 up, 3 in 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:52.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:52 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:45:53.000 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: osd.2 [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] boot 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: osdmap e19: 3 total, 3 up, 3 in 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:53.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:52 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:45:53.303 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-02-15T22:45:53.515 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:45:54.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-15T22:45:54.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:54 smithi138 ceph-mon[29229]: osdmap e20: 3 total, 3 up, 3 in 2024-02-15T22:45:54.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:45:54.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-15T22:45:54.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:54 smithi170 ceph-mon[35248]: osdmap e20: 3 total, 3 up, 3 in 2024-02-15T22:45:54.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-15T22:45:54.983 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:54 smithi138 sudo[57564]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:45:54.983 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:54 smithi138 sudo[57564]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:54.984 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:54 smithi138 sudo[57564]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:54.984 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:54 smithi138 sudo[57564]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 -- 172.21.15.170:0/2311732561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 msgr2=0x7f8c241017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2311732561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c241017c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009910 tx=0x7f8c18009c20 comp rx=0 tx=0).stop 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 -- 172.21.15.170:0/2311732561 shutdown_connections 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2311732561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c241017c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2311732561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 0x7f8c24100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 -- 172.21.15.170:0/2311732561 >> 172.21.15.170:0/2311732561 conn(0x7f8c240fb6e0 msgr2=0x7f8c240fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 -- 172.21.15.170:0/2311732561 shutdown_connections 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.076+0000 7f8c2a394700 1 -- 172.21.15.170:0/2311732561 wait complete. 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 Processor -- start 2024-02-15T22:45:55.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 -- start start 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 0x7f8c24195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241964f0 con 0x7f8c24100170 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.077+0000 7f8c2a394700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24196630 con 0x7f8c24101370 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c23fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 0x7f8c24195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35530/0 (socket says 172.21.15.170:35530) 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 -- 172.21.15.170:0/2778665709 learned_addr learned my addr 172.21.15.170:0/2778665709 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 -- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 msgr2=0x7f8c24195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 0x7f8c24195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:45:55.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 -- 172.21.15.170:0/2778665709 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180095f0 con 0x7f8c24101370 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c237fe700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006010 tx=0x7f8c1800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1801d070 con 0x7f8c24101370 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c1800f460 con 0x7f8c24101370 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2419b080 con 0x7f8c24101370 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c18021640 con 0x7f8c24101370 2024-02-15T22:45:55.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.078+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2419b570 con 0x7f8c24101370 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.079+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24108cc0 con 0x7f8c24101370 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.080+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f8c18003a60 con 0x7f8c24101370 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.080+0000 7f8c217fa700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 0x7f8c0c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.080+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7f8c1808c2a0 con 0x7f8c24101370 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.080+0000 7f8c23fff700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 0x7f8c0c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:45:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.081+0000 7f8c23fff700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 0x7f8c0c06eb30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c241011d0 tx=0x7f8c1400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:45:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.085+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8c1805acd0 con 0x7f8c24101370 2024-02-15T22:45:55.087 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:55 smithi170 ceph-mon[35248]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:55.087 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:55 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-15T22:45:55.087 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:55 smithi170 ceph-mon[35248]: osdmap e21: 3 total, 3 up, 3 in 2024-02-15T22:45:55.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:45:55.279+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c24105cc0 con 0x7f8c0c06c680 2024-02-15T22:45:55.336 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:55 smithi138 ceph-mon[29229]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:55.336 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:55 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-15T22:45:55.336 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:55 smithi138 ceph-mon[29229]: osdmap e21: 3 total, 3 up, 3 in 2024-02-15T22:45:55.336 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57570]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:45:55.336 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57570]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:55.336 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57570]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:55.336 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57570]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:55.602 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57574]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:45:55.602 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57574]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:55.602 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57574]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:55.602 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57574]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:55.870 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57675]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:45:55.870 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57675]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:55.870 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57675]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:55.870 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57675]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:56.137 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57719]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:45:56.137 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:56.137 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57719]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:56.137 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:55 smithi138 sudo[57719]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:56.137 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: osdmap e22: 3 total, 3 up, 3 in 2024-02-15T22:45:56.137 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: mgrmap e19: smithi138.jqscxs(active, since 2m), standbys: smithi170.gczrzt 2024-02-15T22:45:56.137 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.137 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi138 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi138 to 3946M 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:56.389 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57768]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:45:56.390 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57768]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:56.390 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57768]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:56.390 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57768]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: osdmap e22: 3 total, 3 up, 3 in 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: mgrmap e19: smithi138.jqscxs(active, since 2m), standbys: smithi170.gczrzt 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:45:56.414 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi138 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi138 to 3946M 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:56.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:45:56.649 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57790]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:45:56.649 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:56.649 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57790]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:56.649 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57790]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:56.972 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 sudo[39046]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-15T22:45:56.972 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 sudo[39046]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:56.973 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 sudo[39046]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:56.973 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:56 smithi170 sudo[39046]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:56.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57805]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:45:56.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57805]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:56.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57805]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:56.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:56 smithi138 sudo[57805]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 sudo[39055]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 sudo[39055]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 sudo[39055]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 sudo[39055]: pam_unix(sudo:session): session closed for user root 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:45:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:45:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:45:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:57 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:45:57.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:57.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:45:57.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:45:57.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:45:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:45:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:45:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:57 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:45:58.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1177297783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]: dispatch 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]: dispatch 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]': finished 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: osdmap e23: 4 total, 3 up, 4 in 2024-02-15T22:45:58.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:58 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/1177297783' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]: dispatch 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]: dispatch 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52212675-7520-48c1-8880-e94ecffaa51e"}]': finished 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: osdmap e23: 4 total, 3 up, 4 in 2024-02-15T22:45:58.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:58 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:45:59.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:59 smithi138 ceph-mon[29229]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:59.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:45:59 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/463209576' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:45:59.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:59 smithi170 ceph-mon[35248]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:45:59.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:45:59 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/463209576' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:46:01.151 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:01.151 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:01.151 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:01.152 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:01.152 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:01.152 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:00 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:00 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:03.306 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:03 smithi170 ceph-mon[35248]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:03.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:03 smithi138 ceph-mon[29229]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:04.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:04.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:05.080 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:05 smithi170 ceph-mon[35248]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:05.081 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:05 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:46:05.081 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:05 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:05.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:05 smithi138 ceph-mon[29229]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:05.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:05 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:46:05.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:05 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:06.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:06 smithi170 ceph-mon[35248]: Deploying daemon osd.3 on smithi170 2024-02-15T22:46:06.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:06 smithi138 ceph-mon[29229]: Deploying daemon osd.3 on smithi170 2024-02-15T22:46:07.338 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:07 smithi170 ceph-mon[35248]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:07.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:07 smithi138 ceph-mon[29229]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:08.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:08 smithi170 ceph-mon[35248]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:08 smithi138 ceph-mon[29229]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:09.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:09 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:09.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:09 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:09 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:10.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:09 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:10.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:09 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:10.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:09 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:10.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:10 smithi138 ceph-mon[29229]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:11.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:10 smithi170 ceph-mon[35248]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:12.388 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 3 on host 'smithi170' 2024-02-15T22:46:12.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.386+0000 7f8c217fa700 1 -- 172.21.15.170:0/2778665709 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c24105cc0 con 0x7f8c0c06c680 2024-02-15T22:46:12.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.388+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 msgr2=0x7f8c0c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:12.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.388+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 0x7f8c0c06eb30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c241011d0 tx=0x7f8c1400b410 comp rx=0 tx=0).stop 2024-02-15T22:46:12.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 msgr2=0x7f8c24195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:12.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006010 tx=0x7f8c1800bd70 comp rx=0 tx=0).stop 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 shutdown_connections 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8c0c06c680 0x7f8c0c06eb30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c24100170 0x7f8c24195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 --2- 172.21.15.170:0/2778665709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c24101370 0x7f8c24195ed0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 >> 172.21.15.170:0/2778665709 conn(0x7f8c240fb6e0 msgr2=0x7f8c241045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 shutdown_connections 2024-02-15T22:46:12.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:12.389+0000 7f8c2a394700 1 -- 172.21.15.170:0/2778665709 wait complete. 2024-02-15T22:46:13.281 DEBUG:teuthology.orchestra.run.smithi170:osd.3> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.3.service 2024-02-15T22:46:13.283 INFO:tasks.cephadm:Deploying osd.4 on smithi170 with /dev/vg_nvme/lv_3... 2024-02-15T22:46:13.283 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T22:46:13.529 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:13 smithi170 ceph-mon[35248]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:13.529 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:13.529 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:13 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:13.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:13 smithi138 ceph-mon[29229]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:13.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:13.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:13 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:14.011 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:46:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:46:13.586+0000 7f43c99ac640 -1 osd.3 0 log_to_monitors true 2024-02-15T22:46:14.041 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:46:14.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:14 smithi170 ceph-mon[35248]: from='osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:46:14.415 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:14 smithi170 ceph-mon[35248]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:46:14.416 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:14 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:14.416 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:14 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:14.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:14 smithi138 ceph-mon[29229]: from='osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:46:14.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:14 smithi138 ceph-mon[29229]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:46:14.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:14 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:14.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:14 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:15.490 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:46:15.383+0000 7f43be822700 -1 osd.3 0 waiting for initial osdmap 2024-02-15T22:46:15.490 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:46:15.388+0000 7f43b7e12700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: osdmap e24: 4 total, 3 up, 4 in 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: from='osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:15.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:15 smithi170 ceph-mon[35248]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:46:15.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: osdmap e24: 4 total, 3 up, 4 in 2024-02-15T22:46:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: from='osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:15 smithi138 ceph-mon[29229]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010244 s, 1.0 GB/s 2024-02-15T22:46:15.910 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-02-15T22:46:16.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:16 smithi138 ceph-mon[29229]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:46:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:16 smithi138 ceph-mon[29229]: osdmap e25: 4 total, 3 up, 4 in 2024-02-15T22:46:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:16 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:16.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:16 smithi170 ceph-mon[35248]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:46:16.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:16 smithi170 ceph-mon[35248]: osdmap e25: 4 total, 3 up, 4 in 2024-02-15T22:46:16.489 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:16.489 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:16 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:16.805 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-02-15T22:46:17.245 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:46:17.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] boot 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: osdmap e26: 4 total, 4 up, 4 in 2024-02-15T22:46:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:17 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:17.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:46:17.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:46:17.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-15T22:46:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: osd.3 [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] boot 2024-02-15T22:46:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: osdmap e26: 4 total, 4 up, 4 in 2024-02-15T22:46:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:17 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:46:18.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:18 smithi170 ceph-mon[35248]: osdmap e27: 4 total, 4 up, 4 in 2024-02-15T22:46:18.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:18 smithi138 ceph-mon[29229]: osdmap e27: 4 total, 4 up, 4 in 2024-02-15T22:46:19.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 -- 172.21.15.170:0/44860215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db00ff370 msgr2=0x7f1db00ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/44860215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db00ff370 0x7f1db00ff7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009910 tx=0x7f1da4009c20 comp rx=0 tx=0).stop 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 -- 172.21.15.170:0/44860215 shutdown_connections 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/44860215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db00ff370 0x7f1db00ff7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/44860215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db0100630 0x7f1db0100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 -- 172.21.15.170:0/44860215 >> 172.21.15.170:0/44860215 conn(0x7f1db00f9db0 msgr2=0x7f1db00fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 -- 172.21.15.170:0/44860215 shutdown_connections 2024-02-15T22:46:19.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.442+0000 7f1db4ab4700 1 -- 172.21.15.170:0/44860215 wait complete. 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 Processor -- start 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 -- start start 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db00ff370 0x7f1db0195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01964f0 con 0x7f1db00ff370 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1db4ab4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0196630 con 0x7f1db0100630 2024-02-15T22:46:19.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58328/0 (socket says 172.21.15.170:58328) 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 -- 172.21.15.170:0/973257077 learned_addr learned my addr 172.21.15.170:0/973257077 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dae59c700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db00ff370 0x7f1db0195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 -- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db00ff370 msgr2=0x7f1db0195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db00ff370 0x7f1db0195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 -- 172.21.15.170:0/973257077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40095f0 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.443+0000 7f1dadd9b700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.444+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da401d070 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.444+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db019b080 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.444+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1da400f460 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.444+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da4021640 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.444+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db019b570 con 0x7f1db0100630 2024-02-15T22:46:19.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.445+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0108ce0 con 0x7f1db0100630 2024-02-15T22:46:19.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.445+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1da400fab0 con 0x7f1db0100630 2024-02-15T22:46:19.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.445+0000 7f1d9f7fe700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 0x7f1d9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:19.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.446+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f1da408c6c0 con 0x7f1db0100630 2024-02-15T22:46:19.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.446+0000 7f1dae59c700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 0x7f1d9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:19.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.446+0000 7f1dae59c700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 0x7f1d9806eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007720 tx=0x7f1da00076b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:19.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.450+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1da405aed0 con 0x7f1db0100630 2024-02-15T22:46:19.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:19 smithi170 ceph-mon[35248]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:19 smithi170 ceph-mon[35248]: osdmap e28: 4 total, 4 up, 4 in 2024-02-15T22:46:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:19.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:19.651+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1db0104cd0 con 0x7f1d9806c680 2024-02-15T22:46:19.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:19 smithi138 ceph-mon[29229]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:19 smithi138 ceph-mon[29229]: osdmap e28: 4 total, 4 up, 4 in 2024-02-15T22:46:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: osdmap e29: 4 total, 4 up, 4 in 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:20.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:20.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:20 smithi138 ceph-mon[29229]: osdmap e30: 4 total, 4 up, 4 in 2024-02-15T22:46:20.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: osdmap e29: 4 total, 4 up, 4 in 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:20.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:20 smithi170 ceph-mon[35248]: osdmap e30: 4 total, 4 up, 4 in 2024-02-15T22:46:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:21 smithi170 ceph-mon[35248]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:21 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi170 2024-02-15T22:46:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:21 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi170 to 14912M 2024-02-15T22:46:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:21 smithi170 ceph-mon[35248]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-15T22:46:21.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:21 smithi138 ceph-mon[29229]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:21.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:21 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi170 2024-02-15T22:46:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:21 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi170 to 14912M 2024-02-15T22:46:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:21 smithi138 ceph-mon[29229]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-15T22:46:22.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:22 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/2447058885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]: dispatch 2024-02-15T22:46:22.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:22 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]: dispatch 2024-02-15T22:46:22.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:22 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]': finished 2024-02-15T22:46:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:22 smithi138 ceph-mon[29229]: osdmap e31: 5 total, 4 up, 5 in 2024-02-15T22:46:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:22 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:22 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/2447058885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]: dispatch 2024-02-15T22:46:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:22 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]: dispatch 2024-02-15T22:46:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:22 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "71361c8d-cc5d-40e9-87f7-b560e9450531"}]': finished 2024-02-15T22:46:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:22 smithi170 ceph-mon[35248]: osdmap e31: 5 total, 4 up, 5 in 2024-02-15T22:46:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:22 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:23.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:23 smithi138 ceph-mon[29229]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-02-15T22:46:23.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:23 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1934646991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:46:23.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:23 smithi170 ceph-mon[35248]: pgmap v102: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-02-15T22:46:23.760 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:23 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/1934646991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:46:25.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:25 smithi170 ceph-mon[35248]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-15T22:46:25.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:25 smithi138 ceph-mon[29229]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-02-15T22:46:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:27 smithi138 ceph-mon[29229]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:27.747 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:27 smithi170 ceph-mon[35248]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:28.840 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:28 smithi170 ceph-mon[35248]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:28.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:28 smithi138 ceph-mon[29229]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:29.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:29 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:46:29.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:29 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:29.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:29 smithi138 ceph-mon[29229]: Deploying daemon osd.4 on smithi170 2024-02-15T22:46:30.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:29 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:46:30.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:29 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:30.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:29 smithi170 ceph-mon[35248]: Deploying daemon osd.4 on smithi170 2024-02-15T22:46:30.758 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:30 smithi170 ceph-mon[35248]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:30.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:30 smithi138 ceph-mon[29229]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:33.187 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:33 smithi170 ceph-mon[35248]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:33.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:33 smithi138 ceph-mon[29229]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:34.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:34.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:34.442 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:34.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:34.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:34.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:35.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:35 smithi170 ceph-mon[35248]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:35.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:35 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:35.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:35 smithi138 ceph-mon[29229]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:35.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:35 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:37.386 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:37 smithi170 ceph-mon[35248]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:37.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.462+0000 7f1d9f7fe700 1 -- 172.21.15.170:0/973257077 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1db0104cd0 con 0x7f1d9806c680 2024-02-15T22:46:37.464 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 4 on host 'smithi170' 2024-02-15T22:46:37.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 msgr2=0x7f1d9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:37.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 0x7f1d9806eb30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007720 tx=0x7f1da00076b0 comp rx=0 tx=0).stop 2024-02-15T22:46:37.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 msgr2=0x7f1db0195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:37.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da400be20 comp rx=0 tx=0).stop 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 shutdown_connections 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1d9806c680 0x7f1d9806eb30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1db00ff370 0x7f1db0195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 --2- 172.21.15.170:0/973257077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1db0100630 0x7f1db0195ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 >> 172.21.15.170:0/973257077 conn(0x7f1db00f9db0 msgr2=0x7f1db01035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 shutdown_connections 2024-02-15T22:46:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:37.464+0000 7f1db4ab4700 1 -- 172.21.15.170:0/973257077 wait complete. 2024-02-15T22:46:37.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:37 smithi138 ceph-mon[29229]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:38.388 DEBUG:teuthology.orchestra.run.smithi170:osd.4> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.4.service 2024-02-15T22:46:38.390 INFO:tasks.cephadm:Deploying osd.5 on smithi170 with /dev/vg_nvme/lv_2... 2024-02-15T22:46:38.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T22:46:38.637 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:46:38.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:38 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:38.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:38 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:38 smithi138 ceph-mon[29229]: from='osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:46:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:38 smithi138 ceph-mon[29229]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:46:38.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:38 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:38.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:38 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:38.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:38 smithi170 ceph-mon[35248]: from='osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:46:38.759 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:38 smithi170 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: osdmap e32: 5 total, 4 up, 5 in 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:39.634 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: osdmap e32: 5 total, 4 up, 5 in 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:39 smithi138 ceph-mon[29229]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:46:40.011 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[45881]: 2024-02-15T22:46:39.630+0000 7fbc22471700 -1 osd.4 0 waiting for initial osdmap 2024-02-15T22:46:40.011 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:46:39 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[45881]: 2024-02-15T22:46:39.639+0000 7fbc1ca63700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:46:40.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:40 smithi170 ceph-mon[35248]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:46:40.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:40 smithi170 ceph-mon[35248]: osdmap e33: 5 total, 4 up, 5 in 2024-02-15T22:46:40.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:40 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:40.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:40 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:40.976 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:40 smithi170 ceph-mon[35248]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:40.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:40 smithi138 ceph-mon[29229]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:46:40.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:40 smithi138 ceph-mon[29229]: osdmap e33: 5 total, 4 up, 5 in 2024-02-15T22:46:40.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:40.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:40 smithi138 ceph-mon[29229]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-15T22:46:41.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:41 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:46:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:41 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:46:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:41 smithi138 ceph-mon[29229]: osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] boot 2024-02-15T22:46:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:41 smithi138 ceph-mon[29229]: osdmap e34: 5 total, 5 up, 5 in 2024-02-15T22:46:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00975761 s, 1.1 GB/s 2024-02-15T22:46:41.967 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-02-15T22:46:41.968 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:41 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:46:41.968 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:41 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:46:41.968 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:41 smithi170 ceph-mon[35248]: osd.4 [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] boot 2024-02-15T22:46:41.968 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:41 smithi170 ceph-mon[35248]: osdmap e34: 5 total, 5 up, 5 in 2024-02-15T22:46:41.968 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:41 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: osdmap e35: 5 total, 5 up, 5 in 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi170 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:42.829 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi170 to 7456M 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:42.830 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-02-15T22:46:42.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: osdmap e35: 5 total, 5 up, 5 in 2024-02-15T22:46:42.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi170 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi170 to 7456M 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:46:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:46:43.054 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:46:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 -- 172.21.15.170:0/2922396683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 msgr2=0x7f4d80100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 --2- 172.21.15.170:0/2922396683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d80100580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009910 tx=0x7f4d74009c20 comp rx=0 tx=0).stop 2024-02-15T22:46:44.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 -- 172.21.15.170:0/2922396683 shutdown_connections 2024-02-15T22:46:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 --2- 172.21.15.170:0/2922396683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d80101370 0x7f4d801017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 --2- 172.21.15.170:0/2922396683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d80100580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.473+0000 7f4d87124700 1 -- 172.21.15.170:0/2922396683 >> 172.21.15.170:0/2922396683 conn(0x7f4d800fb6e0 msgr2=0x7f4d800fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:46:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 -- 172.21.15.170:0/2922396683 shutdown_connections 2024-02-15T22:46:44.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 -- 172.21.15.170:0/2922396683 wait complete. 2024-02-15T22:46:44.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 Processor -- start 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 -- start start 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d80101370 0x7f4d80195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80196480 con 0x7f4d80101370 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.474+0000 7f4d87124700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801965c0 con 0x7f4d80100170 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:39344/0 (socket says 172.21.15.170:39344) 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 -- 172.21.15.170:0/3664207229 learned_addr learned my addr 172.21.15.170:0/3664207229 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 -- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d80101370 msgr2=0x7f4d80195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d80101370 0x7f4d80195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 -- 172.21.15.170:0/3664207229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740095f0 con 0x7f4d80100170 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d84ec0700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400bda0 tx=0x7f4d7400be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:44.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d7401d070 con 0x7f4d80100170 2024-02-15T22:46:44.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d74004c50 con 0x7f4d80100170 2024-02-15T22:46:44.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8019b020 con 0x7f4d80100170 2024-02-15T22:46:44.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d7400f690 con 0x7f4d80100170 2024-02-15T22:46:44.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.475+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8019b4e0 con 0x7f4d80100170 2024-02-15T22:46:44.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.476+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80108cc0 con 0x7f4d80100170 2024-02-15T22:46:44.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.477+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f4d74022a20 con 0x7f4d80100170 2024-02-15T22:46:44.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.477+0000 7f4d7dffb700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 0x7f4d7006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:46:44.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.477+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f4d7408c990 con 0x7f4d80100170 2024-02-15T22:46:44.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.477+0000 7f4d7ffff700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 0x7f4d7006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:46:44.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.478+0000 7f4d7ffff700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 0x7f4d7006eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005fd0 tx=0x7f4d6c005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:46:44.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.482+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4d7405b120 con 0x7f4d80100170 2024-02-15T22:46:44.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:46:44.678+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d80105cc0 con 0x7f4d7006c680 2024-02-15T22:46:45.350 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:45 smithi170 ceph-mon[35248]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:45.350 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:45 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:46:45.350 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:45 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:46:45.350 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:45 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:45.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:45 smithi138 ceph-mon[29229]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:45.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:45 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T22:46:45.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:45 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T22:46:45.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:45 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:46.233 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:46 smithi170 ceph-mon[35248]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:46.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:46 smithi138 ceph-mon[29229]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:46:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/1403387663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]: dispatch 2024-02-15T22:46:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]: dispatch 2024-02-15T22:46:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]': finished 2024-02-15T22:46:47.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: osdmap e36: 6 total, 5 up, 6 in 2024-02-15T22:46:47.350 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:46:47.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1403387663' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]: dispatch 2024-02-15T22:46:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]: dispatch 2024-02-15T22:46:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca"}]': finished 2024-02-15T22:46:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: osdmap e36: 6 total, 5 up, 6 in 2024-02-15T22:46:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:46:48.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:48 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/715857760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:46:48.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:48 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/715857760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T22:46:49.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:49 smithi138 ceph-mon[29229]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:49.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:49.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:49 smithi170 ceph-mon[35248]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:49.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:46:51.245 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:51 smithi170 ceph-mon[35248]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:51.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:51 smithi138 ceph-mon[29229]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:53.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:53 smithi138 ceph-mon[29229]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:53.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:53 smithi170 ceph-mon[35248]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:54.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:46:54.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:54 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:54.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:46:54.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:54 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:46:55.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:55 smithi170 ceph-mon[35248]: Deploying daemon osd.5 on smithi170 2024-02-15T22:46:55.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:55 smithi170 ceph-mon[35248]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:55.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:55 smithi138 ceph-mon[29229]: Deploying daemon osd.5 on smithi170 2024-02-15T22:46:55.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:55 smithi138 ceph-mon[29229]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:57.387 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:57 smithi170 ceph-mon[35248]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:57.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:57 smithi138 ceph-mon[29229]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:58.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:58 smithi170 ceph-mon[35248]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:46:58.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:58 smithi138 ceph-mon[29229]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:00.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:00.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:00.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:46:59 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:00.260 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:00.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:00.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:46:59 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:01.069 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:00 smithi170 ceph-mon[35248]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:00 smithi138 ceph-mon[29229]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:02.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.990+0000 7f4d7dffb700 1 -- 172.21.15.170:0/3664207229 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4d80105cc0 con 0x7f4d7006c680 2024-02-15T22:47:02.992 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 5 on host 'smithi170' 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 msgr2=0x7f4d7006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 0x7f4d7006eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005fd0 tx=0x7f4d6c005d00 comp rx=0 tx=0).stop 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 msgr2=0x7f4d801959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400bda0 tx=0x7f4d7400be80 comp rx=0 tx=0).stop 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 shutdown_connections 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d7006c680 0x7f4d7006eb30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:02.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d80100170 0x7f4d801959b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:02.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 --2- 172.21.15.170:0/3664207229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d80101370 0x7f4d80195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:02.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 >> 172.21.15.170:0/3664207229 conn(0x7f4d800fb6e0 msgr2=0x7f4d801045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:02.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 shutdown_connections 2024-02-15T22:47:02.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:02.993+0000 7f4d87124700 1 -- 172.21.15.170:0/3664207229 wait complete. 2024-02-15T22:47:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:03 smithi170 ceph-mon[35248]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:03 smithi170 ceph-mon[35248]: from='osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:47:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:03 smithi170 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:47:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:03 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:03.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:03 smithi138 ceph-mon[29229]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:03.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:03 smithi138 ceph-mon[29229]: from='osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:47:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:03 smithi138 ceph-mon[29229]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T22:47:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:03 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:03.575 DEBUG:teuthology.orchestra.run.smithi170:osd.5> sudo journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.5.service 2024-02-15T22:47:03.577 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-15T22:47:03.577 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T22:47:03.804 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:04.867 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: osdmap e37: 6 total, 5 up, 6 in 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:04.868 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:04.868 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[50588]: 2024-02-15T22:47:04.634+0000 7f47c4555700 -1 osd.5 0 waiting for initial osdmap 2024-02-15T22:47:04.868 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 22:47:04 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[50588]: 2024-02-15T22:47:04.642+0000 7f47bd344700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:47:04.954 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: osdmap e37: 6 total, 5 up, 6 in 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:04.955 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 -- 172.21.15.138:0/2592991547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb40ff060 msgr2=0x7feeb40ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 --2- 172.21.15.138:0/2592991547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb40ff060 0x7feeb40ff470 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feea4009910 tx=0x7feea4009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 -- 172.21.15.138:0/2592991547 shutdown_connections 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 --2- 172.21.15.138:0/2592991547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4100260 0x7feeb41006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 --2- 172.21.15.138:0/2592991547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb40ff060 0x7feeb40ff470 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 -- 172.21.15.138:0/2592991547 >> 172.21.15.138:0/2592991547 conn(0x7feeb40fa610 msgr2=0x7feeb40fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 -- 172.21.15.138:0/2592991547 shutdown_connections 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.578+0000 7feeba447700 1 -- 172.21.15.138:0/2592991547 wait complete. 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 Processor -- start 2024-02-15T22:47:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 -- start start 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb40ff060 0x7feeb40698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb419ad40 con 0x7feeb4100260 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeba447700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb419aeb0 con 0x7feeb40ff060 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeb37fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeb37fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38164/0 (socket says 172.21.15.138:38164) 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.579+0000 7feeb37fe700 1 -- 172.21.15.138:0/2261550857 learned_addr learned my addr 172.21.15.138:0/2261550857 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb3fff700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb40ff060 0x7feeb40698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb37fe700 1 -- 172.21.15.138:0/2261550857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb40ff060 msgr2=0x7feeb40698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb37fe700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb40ff060 0x7feeb40698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb37fe700 1 -- 172.21.15.138:0/2261550857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40095f0 con 0x7feeb4100260 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb37fe700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feea800b4b0 tx=0x7feea800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea8011800 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb419b190 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feea8011e10 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea800f2e0 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.580+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb419b760 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.581+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4107c30 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.582+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7feea8010380 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.582+0000 7feeb17fa700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 0x7fee9c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.582+0000 7feeb3fff700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 0x7fee9c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.582+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7feea808aff0 con 0x7feeb4100260 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.582+0000 7feeb3fff700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 0x7fee9c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feea4006010 tx=0x7feea400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:05.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.587+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feea80595b0 con 0x7feeb4100260 2024-02-15T22:47:05.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:05 smithi138 ceph-mon[29229]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:47:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:05 smithi138 ceph-mon[29229]: osdmap e38: 6 total, 5 up, 6 in 2024-02-15T22:47:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:05 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:05 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:05 smithi170 ceph-mon[35248]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-02-15T22:47:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:05 smithi170 ceph-mon[35248]: osdmap e38: 6 total, 5 up, 6 in 2024-02-15T22:47:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:05 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:05 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:05.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.780+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7feeb4107e20 con 0x7feeb4100260 2024-02-15T22:47:05.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.781+0000 7feeb17fa700 1 -- 172.21.15.138:0/2261550857 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7feea8059140 con 0x7feeb4100260 2024-02-15T22:47:05.782 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:05.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 msgr2=0x7fee9c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 0x7fee9c06eb30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feea4006010 tx=0x7feea400b540 comp rx=0 tx=0).stop 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 msgr2=0x7feeb419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feea800b4b0 tx=0x7feea800b7c0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 shutdown_connections 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fee9c06c680 0x7fee9c06eb30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb40ff060 0x7feeb40698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 --2- 172.21.15.138:0/2261550857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb4100260 0x7feeb419a770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 >> 172.21.15.138:0/2261550857 conn(0x7feeb40fa610 msgr2=0x7feeb4103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 shutdown_connections 2024-02-15T22:47:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:05.783+0000 7feeba447700 1 -- 172.21.15.138:0/2261550857 wait complete. 2024-02-15T22:47:06.523 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1708037225,"num_in_osds":6,"osd_in_since":1708037206,"num_remapped_pgs":0} 2024-02-15T22:47:06.524 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:47:06.738 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:06.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: purged_snaps scrub starts 2024-02-15T22:47:06.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: purged_snaps scrub ok 2024-02-15T22:47:06.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:06.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] boot 2024-02-15T22:47:06.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: osdmap e39: 6 total, 6 up, 6 in 2024-02-15T22:47:06.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:06.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2261550857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T22:47:06.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:06 smithi138 ceph-mon[29229]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:06.892 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: purged_snaps scrub starts 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: purged_snaps scrub ok 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: osd.5 [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] boot 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: osdmap e39: 6 total, 6 up, 6 in 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2261550857' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T22:47:06.893 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:06 smithi170 ceph-mon[35248]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-15T22:47:07.962 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: osdmap e40: 6 total, 6 up, 6 in 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: Detected new or changed devices on smithi170 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi170 to 4970M 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:07.963 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:07.964 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:07 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: osdmap e40: 6 total, 6 up, 6 in 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi170 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi170 to 4970M 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:08.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:47:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:47:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:47:08.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:07 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/1138088072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101320 msgr2=0x7fd7c01016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/1138088072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101320 0x7fd7c01016f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009910 tx=0x7fd7b8009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/1138088072 shutdown_connections 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/1138088072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101c30 0x7fd7c010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/1138088072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101320 0x7fd7c01016f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/1138088072 >> 172.21.15.138:0/1138088072 conn(0x7fd7c00fab80 msgr2=0x7fd7c00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/1138088072 shutdown_connections 2024-02-15T22:47:08.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.466+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/1138088072 wait complete. 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 Processor -- start 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 -- start start 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101320 0x7fd7c00fef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0100d30 con 0x7fd7c0101c30 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7c4b7d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0100ea0 con 0x7fd7c0101320 2024-02-15T22:47:08.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38168/0 (socket says 172.21.15.138:38168) 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 -- 172.21.15.138:0/2838568106 learned_addr learned my addr 172.21.15.138:0/2838568106 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7be59c700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101320 0x7fd7c00fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 -- 172.21.15.138:0/2838568106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101320 msgr2=0x7fd7c00fef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101320 0x7fd7c00fef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.467+0000 7fd7bdd9b700 1 -- 172.21.15.138:0/2838568106 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b80095f0 con 0x7fd7c0101c30 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7bdd9b700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400ef10 tx=0x7fd7b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b400c9f0 con 0x7fd7c0101c30 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c00ffa60 con 0x7fd7c0101c30 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd7b400f040 con 0x7fd7c0101c30 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b40146b0 con 0x7fd7c0101c30 2024-02-15T22:47:08.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.468+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c00ffde0 con 0x7fd7c0101c30 2024-02-15T22:47:08.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.469+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c0107800 con 0x7fd7c0101c30 2024-02-15T22:47:08.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.469+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd7b4014970 con 0x7fd7c0101c30 2024-02-15T22:47:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.470+0000 7fd7af7fe700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 0x7fd7a806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.470+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd7b408b8c0 con 0x7fd7c0101c30 2024-02-15T22:47:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.470+0000 7fd7be59c700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 0x7fd7a806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:08.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.470+0000 7fd7be59c700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 0x7fd7a806eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80059d0 tx=0x7fd7b8005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:08.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.474+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd7b4056430 con 0x7fd7c0101c30 2024-02-15T22:47:08.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.667+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c004ea50 con 0x7fd7c0101c30 2024-02-15T22:47:08.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.668+0000 7fd7af7fe700 1 -- 172.21.15.138:0/2838568106 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11399 (secure 0 0 0) 0x7fd7b4059a50 con 0x7fd7c0101c30 2024-02-15T22:47:08.670 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:08.670 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T22:47:06.649552+0000","last_up_change":"2024-02-15T22:47:05.647792+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6803","nonce":3342481307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6805","nonce":3342481307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6809","nonce":3342481307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6807","nonce":3342481307}]},"public_addr":"172.21.15.138:6803/3342481307","cluster_addr":"172.21.15.138:6805/3342481307","heartbeat_back_addr":"172.21.15.138:6809/3342481307","heartbeat_front_addr":"172.21.15.138:6807/3342481307","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6811","nonce":1037257202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6813","nonce":1037257202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6817","nonce":1037257202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6815","nonce":1037257202}]},"public_addr":"172.21.15.138:6811/1037257202","cluster_addr":"172.21.15.138:6813/1037257202","heartbeat_back_addr":"172.21.15.138:6817/1037257202","heartbeat_front_addr":"172.21.15.138:6815/1037257202","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6819","nonce":1720307660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6821","nonce":1720307660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6825","nonce":1720307660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6823","nonce":1720307660}]},"public_addr":"172.21.15.138:6819/1720307660","cluster_addr":"172.21.15.138:6821/1720307660","heartbeat_back_addr":"172.21.15.138:6825/1720307660","heartbeat_front_addr":"172.21.15.138:6823/1720307660","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6801","nonce":4178670664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6803","nonce":4178670664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6807","nonce":4178670664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6805","nonce":4178670664}]},"public_addr":"172.21.15.170:6801/4178670664","cluster_addr":"172.21.15.170:6803/4178670664","heartbeat_back_addr":"172.21.15.170:6807/4178670664","heartbeat_front_addr":"172.21.15.170:6805/4178670664","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6809","nonce":2960661555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6811","nonce":2960661555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6815","nonce":2960661555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6813","nonce":2960661555}]},"public_addr":"172.21.15.170:6809/2960661555","cluster_addr":"172.21.15.170:6811/2960661555","heartbeat_back_addr":"172.21.15.170:6815/2960661555","heartbeat_front_addr":"172.21.15.170:6813/2960661555","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6817","nonce":3806552370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6819","nonce":3806552370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6823","nonce":3806552370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6821","nonce":3806552370}]},"public_addr":"172.21.15.170:6817/3806552370","cluster_addr":"172.21.15.170:6819/3806552370","heartbeat_back_addr":"172.21.15.170:6823/3806552370","heartbeat_front_addr":"172.21.15.170:6821/3806552370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:47:08.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 msgr2=0x7fd7a806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:08.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 0x7fd7a806eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80059d0 tx=0x7fd7b8005940 comp rx=0 tx=0).stop 2024-02-15T22:47:08.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 msgr2=0x7fd7c00ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:08.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400ef10 tx=0x7fd7b400c3a0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 shutdown_connections 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd7a806c680 0x7fd7a806eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd7c0101320 0x7fd7c00fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 --2- 172.21.15.138:0/2838568106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7c0101c30 0x7fd7c00ff4c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 >> 172.21.15.138:0/2838568106 conn(0x7fd7c00fab80 msgr2=0x7fd7c0104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 shutdown_connections 2024-02-15T22:47:08.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:08.670+0000 7fd7c4b7d700 1 -- 172.21.15.138:0/2838568106 wait complete. 2024-02-15T22:47:08.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:08 smithi138 ceph-mon[29229]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:09.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:08 smithi170 ceph-mon[35248]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:09.515 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:45:52.286926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T22:47:09.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-15T22:47:09.731 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:09.853 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:09 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2838568106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:10.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:09 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2838568106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:10.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:10 smithi138 ceph-mon[29229]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:11.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:10 smithi170 ceph-mon[35248]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:11.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 -- 172.21.15.138:0/3310291583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8100d80 msgr2=0x7fbfc8104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 --2- 172.21.15.138:0/3310291583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8100d80 0x7fbfc8104d50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009910 tx=0x7fbfb4009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 -- 172.21.15.138:0/3310291583 shutdown_connections 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 --2- 172.21.15.138:0/3310291583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc8100d80 0x7fbfc8104d50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 --2- 172.21.15.138:0/3310291583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc81003e0 0x7fbfc81007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.512+0000 7fbfcec94700 1 -- 172.21.15.138:0/3310291583 >> 172.21.15.138:0/3310291583 conn(0x7fbfc80fbca0 msgr2=0x7fbfc80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.513+0000 7fbfcec94700 1 -- 172.21.15.138:0/3310291583 shutdown_connections 2024-02-15T22:47:11.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.513+0000 7fbfcec94700 1 -- 172.21.15.138:0/3310291583 wait complete. 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.513+0000 7fbfcec94700 1 Processor -- start 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 -- start start 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc8100d80 0x7fbfc8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81969f0 con 0x7fbfc81003e0 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc819a780 con 0x7fbfc8100d80 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38190/0 (socket says 172.21.15.138:38190) 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 -- 172.21.15.138:0/139495626 learned_addr learned my addr 172.21.15.138:0/139495626 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 -- 172.21.15.138:0/139495626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc8100d80 msgr2=0x7fbfc8196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:11.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc8100d80 0x7fbfc8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 -- 172.21.15.138:0/139495626 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40095f0 con 0x7fbfc81003e0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcca30700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c8a0 tx=0x7fbfbc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc00cea0 con 0x7fbfc81003e0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbfbc004830 con 0x7fbfc81003e0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc819aa60 con 0x7fbfc81003e0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.514+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc0055b0 con 0x7fbfc81003e0 2024-02-15T22:47:11.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.515+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc819afb0 con 0x7fbfc81003e0 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.515+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc804ea50 con 0x7fbfc81003e0 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.516+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fbfbc007ad0 con 0x7fbfc81003e0 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.516+0000 7fbfc5ffb700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 0x7fbfb806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.516+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbfbc08b2a0 con 0x7fbfc81003e0 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.516+0000 7fbfc7fff700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 0x7fbfb806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:11.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.517+0000 7fbfc7fff700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 0x7fbfb806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400b5c0 tx=0x7fbfb4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:11.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.520+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbfbc055cc0 con 0x7fbfc81003e0 2024-02-15T22:47:11.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.709+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfc819b460 con 0x7fbfc81003e0 2024-02-15T22:47:11.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.709+0000 7fbfc5ffb700 1 -- 172.21.15.138:0/139495626 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfbc0592e0 con 0x7fbfc81003e0 2024-02-15T22:47:11.711 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-02-15T22:47:11.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 msgr2=0x7fbfb806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:11.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 0x7fbfb806eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400b5c0 tx=0x7fbfb4005960 comp rx=0 tx=0).stop 2024-02-15T22:47:11.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 msgr2=0x7fbfc8195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c8a0 tx=0x7fbfbc00cc60 comp rx=0 tx=0).stop 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 shutdown_connections 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbfb806c680 0x7fbfb806eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc81003e0 0x7fbfc8195dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 --2- 172.21.15.138:0/139495626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc8100d80 0x7fbfc8196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 >> 172.21.15.138:0/139495626 conn(0x7fbfc80fbca0 msgr2=0x7fbfc80fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 shutdown_connections 2024-02-15T22:47:11.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:11.711+0000 7fbfcec94700 1 -- 172.21.15.138:0/139495626 wait complete. 2024-02-15T22:47:11.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:11 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/139495626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:47:12.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:11 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/139495626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:47:12.481 INFO:tasks.cephadm:Setting up client nodes... 2024-02-15T22:47:12.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T22:47:12.691 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:13.085 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:12 smithi138 ceph-mon[29229]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:12 smithi170 ceph-mon[35248]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 -- 172.21.15.138:0/1537447261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 msgr2=0x7fbea40ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:14.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 --2- 172.21.15.138:0/1537447261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea40ff460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009910 tx=0x7fbe94009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 -- 172.21.15.138:0/1537447261 shutdown_connections 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 --2- 172.21.15.138:0/1537447261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea4100250 0x7fbea41006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 --2- 172.21.15.138:0/1537447261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea40ff460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 -- 172.21.15.138:0/1537447261 >> 172.21.15.138:0/1537447261 conn(0x7fbea40fa5e0 msgr2=0x7fbea40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 -- 172.21.15.138:0/1537447261 shutdown_connections 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 -- 172.21.15.138:0/1537447261 wait complete. 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.504+0000 7fbea9225700 1 Processor -- start 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea9225700 1 -- start start 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea9225700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea9225700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea4100250 0x7fbea419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:14.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea9225700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41965e0 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea9225700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea419d0b0 con 0x7fbea4100250 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33900/0 (socket says 172.21.15.138:33900) 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 -- 172.21.15.138:0/1062071761 learned_addr learned my addr 172.21.15.138:0/1062071761 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 -- 172.21.15.138:0/1062071761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea4100250 msgr2=0x7fbea419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea4100250 0x7fbea419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 -- 172.21.15.138:0/1062071761 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940095f0 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.505+0000 7fbea2d9d700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400bdd0 tx=0x7fbe9400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.506+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9401d070 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.506+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe94004c50 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.506+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea419d300 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.506+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe94021640 con 0x7fbea40ff050 2024-02-15T22:47:14.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.506+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea419d870 con 0x7fbea40ff050 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.507+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea4107c20 con 0x7fbea40ff050 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.507+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fbe9400fa10 con 0x7fbea40ff050 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.507+0000 7fbe8bfff700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 0x7fbe8c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.507+0000 7fbea259c700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 0x7fbe8c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.507+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbe9408ca60 con 0x7fbea40ff050 2024-02-15T22:47:14.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.508+0000 7fbea259c700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 0x7fbe8c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbea40694b0 tx=0x7fbe98006d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:14.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.512+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbe9405af10 con 0x7fbea40ff050 2024-02-15T22:47:14.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.778+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fbea419deb0 con 0x7fbea40ff050 2024-02-15T22:47:14.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.782+0000 7fbe8bfff700 1 -- 172.21.15.138:0/1062071761 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fbe94026020 con 0x7fbea40ff050 2024-02-15T22:47:14.784 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-02-15T22:47:14.784 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBylM5l2Kd3LhAAjzqc4GOJTmtUpWzdd6RQCw== 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 msgr2=0x7fbe8c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 0x7fbe8c06eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbea40694b0 tx=0x7fbe98006d20 comp rx=0 tx=0).stop 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 msgr2=0x7fbea4068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400bdd0 tx=0x7fbe9400beb0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 shutdown_connections 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe8c06c680 0x7fbe8c06eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea40ff050 0x7fbea4068f30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 --2- 172.21.15.138:0/1062071761 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbea4100250 0x7fbea419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:14.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 >> 172.21.15.138:0/1062071761 conn(0x7fbea40fa5e0 msgr2=0x7fbea4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:14.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 shutdown_connections 2024-02-15T22:47:14.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:14.784+0000 7fbea9225700 1 -- 172.21.15.138:0/1062071761 wait complete. 2024-02-15T22:47:15.475 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:15 smithi138 ceph-mon[29229]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:15.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:15 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1062071761' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:15.476 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:15 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1062071761' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:47:15.500 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:47:15.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-15T22:47:15.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T22:47:15.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:15 smithi170 ceph-mon[35248]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:15.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:15 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1062071761' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:15.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:15 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1062071761' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:47:15.546 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T22:47:15.765 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi170/config 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 -- 172.21.15.170:0/2901025340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6940ff330 msgr2=0x7fd6940ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/2901025340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6940ff330 0x7fd6940ff7a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd688009910 tx=0x7fd688009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 -- 172.21.15.170:0/2901025340 shutdown_connections 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/2901025340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6940ff330 0x7fd6940ff7a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/2901025340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6941006d0 0x7fd694100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 -- 172.21.15.170:0/2901025340 >> 172.21.15.170:0/2901025340 conn(0x7fd6940f9dd0 msgr2=0x7fd6940fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 -- 172.21.15.170:0/2901025340 shutdown_connections 2024-02-15T22:47:17.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.283+0000 7fd69a9e6700 1 -- 172.21.15.170:0/2901025340 wait complete. 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 Processor -- start 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 -- start start 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6940ff330 0x7fd694195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694196620 con 0x7fd6940ff330 2024-02-15T22:47:17.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd69a9e6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694196760 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd6937fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd6937fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34076/0 (socket says 172.21.15.170:34076) 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.284+0000 7fd6937fe700 1 -- 172.21.15.170:0/1464182789 learned_addr learned my addr 172.21.15.170:0/1464182789 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd693fff700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6940ff330 0x7fd694195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6937fe700 1 -- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6940ff330 msgr2=0x7fd694195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6937fe700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6940ff330 0x7fd694195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6937fe700 1 -- 172.21.15.170:0/1464182789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880095f0 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6937fe700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd688006010 tx=0x7fd68800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd68801d070 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69419b1b0 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd68800f460 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd688021640 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.285+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69419b720 con 0x7fd6941006d0 2024-02-15T22:47:17.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.286+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd694107cc0 con 0x7fd6941006d0 2024-02-15T22:47:17.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.286+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd68800faf0 con 0x7fd6941006d0 2024-02-15T22:47:17.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.287+0000 7fd6917fa700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 0x7fd67c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:17.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.287+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd68808c980 con 0x7fd6941006d0 2024-02-15T22:47:17.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.287+0000 7fd693fff700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 0x7fd67c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:17.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.288+0000 7fd693fff700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 0x7fd67c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd684006fd0 tx=0x7fd684008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:17.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.291+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd68805ae30 con 0x7fd6941006d0 2024-02-15T22:47:17.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:17 smithi138 ceph-mon[29229]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:17 smithi170 ceph-mon[35248]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:17.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.556+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd69419be00 con 0x7fd6941006d0 2024-02-15T22:47:17.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.563+0000 7fd6917fa700 1 -- 172.21.15.170:0/1464182789 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd6880260f0 con 0x7fd6941006d0 2024-02-15T22:47:17.566 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2024-02-15T22:47:17.566 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQB1lM5lD0BUIRAAXrW6ejB0hvkIRG3FqIGceA== 2024-02-15T22:47:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 msgr2=0x7fd67c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 0x7fd67c06eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd684006fd0 tx=0x7fd684008040 comp rx=0 tx=0).stop 2024-02-15T22:47:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 msgr2=0x7fd694196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd688006010 tx=0x7fd68800be20 comp rx=0 tx=0).stop 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 shutdown_connections 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd67c06c680 0x7fd67c06eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6940ff330 0x7fd694195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.565+0000 7fd69a9e6700 1 --2- 172.21.15.170:0/1464182789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6941006d0 0x7fd694196000 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.566+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 >> 172.21.15.170:0/1464182789 conn(0x7fd6940f9dd0 msgr2=0x7fd6940fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.566+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 shutdown_connections 2024-02-15T22:47:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-15T22:47:17.566+0000 7fd69a9e6700 1 -- 172.21.15.170:0/1464182789 wait complete. 2024-02-15T22:47:18.144 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:47:18.144 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-15T22:47:18.144 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-15T22:47:18.186 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T22:47:18.186 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-15T22:47:18.186 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-15T22:47:18.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:18 smithi170 ceph-mon[35248]: from='client.? 172.21.15.170:0/1464182789' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:18.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:18 smithi170 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:18.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:18 smithi170 ceph-mon[35248]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:47:18.402 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:18.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:18 smithi138 ceph-mon[29229]: from='client.? 172.21.15.170:0/1464182789' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:18.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:18 smithi138 ceph-mon[29229]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T22:47:18.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:18 smithi138 ceph-mon[29229]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T22:47:19.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:19 smithi138 ceph-mon[29229]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:19.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:19 smithi170 ceph-mon[35248]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 -- 172.21.15.138:0/3048738580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ff290 msgr2=0x7f51600ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 --2- 172.21.15.138:0/3048738580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ff290 0x7f51600ff660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5150009910 tx=0x7f5150009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 -- 172.21.15.138:0/3048738580 shutdown_connections 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 --2- 172.21.15.138:0/3048738580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ffba0 0x7f516010a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 --2- 172.21.15.138:0/3048738580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ff290 0x7f51600ff660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 -- 172.21.15.138:0/3048738580 >> 172.21.15.138:0/3048738580 conn(0x7f5160074850 msgr2=0x7f5160074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 -- 172.21.15.138:0/3048738580 shutdown_connections 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.295+0000 7f5168079700 1 -- 172.21.15.138:0/3048738580 wait complete. 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 Processor -- start 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 -- start start 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ff290 0x7f5160195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160196990 con 0x7f51600ffba0 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5168079700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516019a720 con 0x7f51600ff290 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5165614700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5165614700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33908/0 (socket says 172.21.15.138:33908) 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.296+0000 7f5165614700 1 -- 172.21.15.138:0/3784965958 learned_addr learned my addr 172.21.15.138:0/3784965958 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5165e15700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ff290 0x7f5160195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5165614700 1 -- 172.21.15.138:0/3784965958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ff290 msgr2=0x7f5160195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:20.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5165614700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ff290 0x7f5160195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5165614700 1 -- 172.21.15.138:0/3784965958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500095f0 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5165614700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f515c00d900 tx=0x7f515c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515c0041f0 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f515c004ce0 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516019aa00 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515c00b750 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.297+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516019af50 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.298+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5160107d10 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.298+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f515c004350 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.299+0000 7f5156ffd700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 0x7f514c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.299+0000 7f5165e15700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 0x7f514c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.299+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f515c08b710 con 0x7f51600ffba0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.299+0000 7f5165e15700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 0x7f514c06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5150005b40 tx=0x7f515001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:20.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.303+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f515c056130 con 0x7f51600ffba0 2024-02-15T22:47:20.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.549+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f516019b170 con 0x7f51600ffba0 2024-02-15T22:47:20.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.552+0000 7f5156ffd700 1 -- 172.21.15.138:0/3784965958 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172860 (secure 0 0 0) 0x7f515c016090 con 0x7f51600ffba0 2024-02-15T22:47:20.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 msgr2=0x7f514c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 0x7f514c06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5150005b40 tx=0x7f515001a040 comp rx=0 tx=0).stop 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 msgr2=0x7f51601962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f515c00d900 tx=0x7f515c00dcc0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 shutdown_connections 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f514c06c680 0x7f514c06eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51600ff290 0x7f5160195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 --2- 172.21.15.138:0/3784965958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51600ffba0 0x7f51601962b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 >> 172.21.15.138:0/3784965958 conn(0x7f5160074850 msgr2=0x7f5160104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:20.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 shutdown_connections 2024-02-15T22:47:20.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:20.554+0000 7f5168079700 1 -- 172.21.15.138:0/3784965958 wait complete. 2024-02-15T22:47:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:21 smithi138 ceph-mon[29229]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:21 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3784965958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T22:47:21.293 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":19,"active_gid":14217,"active_name":"smithi138.jqscxs","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":499746587},{"type":"v1","addr":"172.21.15.138:6801","nonce":499746587}]},"active_addr":"172.21.15.138:6801/499746587","active_change":"2024-02-15T22:43:33.959234+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14238,"name":"smithi170.gczrzt","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.138:8443/","prometheus":"http://172.21.15.138:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1857695595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":464877437}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1233270825}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":4136599694}]}]} 2024-02-15T22:47:21.297 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-15T22:47:21.297 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-15T22:47:21.298 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:47:21.508 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:21.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:21 smithi170 ceph-mon[35248]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:21.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:21 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3784965958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 -- 172.21.15.138:0/498578003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ffba0 msgr2=0x7f419010a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 --2- 172.21.15.138:0/498578003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ffba0 0x7f419010a610 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4184009940 tx=0x7f4184009c50 comp rx=0 tx=0).stop 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 -- 172.21.15.138:0/498578003 shutdown_connections 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 --2- 172.21.15.138:0/498578003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ffba0 0x7f419010a610 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 --2- 172.21.15.138:0/498578003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ff290 0x7f41900ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 -- 172.21.15.138:0/498578003 >> 172.21.15.138:0/498578003 conn(0x7f4190074850 msgr2=0x7f4190074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 -- 172.21.15.138:0/498578003 shutdown_connections 2024-02-15T22:47:23.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.170+0000 7f4196874700 1 -- 172.21.15.138:0/498578003 wait complete. 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 Processor -- start 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 -- start start 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 0x7f41901962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901969b0 con 0x7f41900ff290 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f4196874700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419019a740 con 0x7f41900ffba0 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33924/0 (socket says 172.21.15.138:33924) 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 -- 172.21.15.138:0/3856286525 learned_addr learned my addr 172.21.15.138:0/3856286525 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418f7fe700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 0x7f41901962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 -- 172.21.15.138:0/3856286525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 msgr2=0x7f41901962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 0x7f41901962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418ffff700 1 -- 172.21.15.138:0/3856286525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840095f0 con 0x7f41900ff290 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.171+0000 7f418f7fe700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 0x7f41901962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:23.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f418ffff700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f418000d8d0 tx=0x7f418000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4180009940 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4180010460 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419019aa20 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418000f5f0 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.172+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419019af70 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.173+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4190107d10 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.173+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f41800105d0 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.174+0000 7f418d7fa700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 0x7f417806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.174+0000 7f418f7fe700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 0x7f417806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.174+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f418008b4d0 con 0x7f41900ff290 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.174+0000 7f418f7fe700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 0x7f417806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4184006010 tx=0x7f4184005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:23.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.178+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4180055f10 con 0x7f41900ff290 2024-02-15T22:47:23.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:23 smithi138 ceph-mon[29229]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:23.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.373+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f419004ea50 con 0x7f41900ff290 2024-02-15T22:47:23.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.373+0000 7f418d7fa700 1 -- 172.21.15.138:0/3856286525 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11399 (secure 0 0 0) 0x7f418005de60 con 0x7f41900ff290 2024-02-15T22:47:23.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:23.376 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T22:47:06.649552+0000","last_up_change":"2024-02-15T22:47:05.647792+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6803","nonce":3342481307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6805","nonce":3342481307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6809","nonce":3342481307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6807","nonce":3342481307}]},"public_addr":"172.21.15.138:6803/3342481307","cluster_addr":"172.21.15.138:6805/3342481307","heartbeat_back_addr":"172.21.15.138:6809/3342481307","heartbeat_front_addr":"172.21.15.138:6807/3342481307","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6811","nonce":1037257202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6813","nonce":1037257202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6817","nonce":1037257202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6815","nonce":1037257202}]},"public_addr":"172.21.15.138:6811/1037257202","cluster_addr":"172.21.15.138:6813/1037257202","heartbeat_back_addr":"172.21.15.138:6817/1037257202","heartbeat_front_addr":"172.21.15.138:6815/1037257202","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6819","nonce":1720307660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6821","nonce":1720307660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6825","nonce":1720307660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6823","nonce":1720307660}]},"public_addr":"172.21.15.138:6819/1720307660","cluster_addr":"172.21.15.138:6821/1720307660","heartbeat_back_addr":"172.21.15.138:6825/1720307660","heartbeat_front_addr":"172.21.15.138:6823/1720307660","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6801","nonce":4178670664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6803","nonce":4178670664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6807","nonce":4178670664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6805","nonce":4178670664}]},"public_addr":"172.21.15.170:6801/4178670664","cluster_addr":"172.21.15.170:6803/4178670664","heartbeat_back_addr":"172.21.15.170:6807/4178670664","heartbeat_front_addr":"172.21.15.170:6805/4178670664","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6809","nonce":2960661555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6811","nonce":2960661555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6815","nonce":2960661555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6813","nonce":2960661555}]},"public_addr":"172.21.15.170:6809/2960661555","cluster_addr":"172.21.15.170:6811/2960661555","heartbeat_back_addr":"172.21.15.170:6815/2960661555","heartbeat_front_addr":"172.21.15.170:6813/2960661555","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6817","nonce":3806552370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6819","nonce":3806552370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6823","nonce":3806552370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6821","nonce":3806552370}]},"public_addr":"172.21.15.170:6817/3806552370","cluster_addr":"172.21.15.170:6819/3806552370","heartbeat_back_addr":"172.21.15.170:6823/3806552370","heartbeat_front_addr":"172.21.15.170:6821/3806552370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 msgr2=0x7f417806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 0x7f417806eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4184006010 tx=0x7f4184005960 comp rx=0 tx=0).stop 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 msgr2=0x7f4190195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f418000d8d0 tx=0x7f418000dc90 comp rx=0 tx=0).stop 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 shutdown_connections 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f417806c680 0x7f417806eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f41900ff290 0x7f4190195d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 --2- 172.21.15.138:0/3856286525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41900ffba0 0x7f41901962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 >> 172.21.15.138:0/3856286525 conn(0x7f4190074850 msgr2=0x7f4190104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 shutdown_connections 2024-02-15T22:47:23.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:23.376+0000 7f4196874700 1 -- 172.21.15.138:0/3856286525 wait complete. 2024-02-15T22:47:23.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:23 smithi170 ceph-mon[35248]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:24.090 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-15T22:47:24.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T22:47:24.296 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:24.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:24 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3856286525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:24 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3856286525' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:25.436 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:25 smithi138 ceph-mon[29229]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:25 smithi170 ceph-mon[35248]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:26.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 -- 172.21.15.138:0/384860733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ffd30 msgr2=0x7f2648103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 --2- 172.21.15.138:0/384860733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ffd30 0x7f2648103ce0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2630009910 tx=0x7f2630009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 -- 172.21.15.138:0/384860733 shutdown_connections 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 --2- 172.21.15.138:0/384860733 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ffd30 0x7f2648103ce0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 --2- 172.21.15.138:0/384860733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ff390 0x7f26480ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 -- 172.21.15.138:0/384860733 >> 172.21.15.138:0/384860733 conn(0x7f2648074f50 msgr2=0x7f2648075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 -- 172.21.15.138:0/384860733 shutdown_connections 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.139+0000 7f264da6b700 1 -- 172.21.15.138:0/384860733 wait complete. 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 Processor -- start 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 -- start start 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 0x7f2648196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:26.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648196a70 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f264da6b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264819a800 con 0x7f26480ffd30 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56758/0 (socket says 172.21.15.138:56758) 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 -- 172.21.15.138:0/865599844 learned_addr learned my addr 172.21.15.138:0/865599844 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f2646ffd700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 0x7f2648196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 -- 172.21.15.138:0/865599844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 msgr2=0x7f2648196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 0x7f2648196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f26477fe700 1 -- 172.21.15.138:0/865599844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300095f0 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.140+0000 7f2646ffd700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 0x7f2648196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f26477fe700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f264000ba50 tx=0x7f264000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264000ca00 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264819aae0 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f264000cb60 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2640007580 con 0x7f26480ff390 2024-02-15T22:47:26.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.141+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264819b030 con 0x7f26480ff390 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.142+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2648108680 con 0x7f26480ff390 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.142+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f264000ccd0 con 0x7f26480ff390 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.142+0000 7f2644ff9700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.143+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2640006e40 con 0x7f26480ff390 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.143+0000 7f2646ffd700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.143+0000 7f2646ffd700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f263000b5c0 tx=0x7f2630005480 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.147+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f264004e720 con 0x7f26480ff390 2024-02-15T22:47:26.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.339+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f264804ea50 con 0x7f26480ff390 2024-02-15T22:47:26.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.340+0000 7f2644ff9700 1 -- 172.21.15.138:0/865599844 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11399 (secure 0 0 0) 0x7f2640059270 con 0x7f26480ff390 2024-02-15T22:47:26.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:26.343 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T22:47:06.649552+0000","last_up_change":"2024-02-15T22:47:05.647792+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6803","nonce":3342481307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6805","nonce":3342481307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6809","nonce":3342481307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6807","nonce":3342481307}]},"public_addr":"172.21.15.138:6803/3342481307","cluster_addr":"172.21.15.138:6805/3342481307","heartbeat_back_addr":"172.21.15.138:6809/3342481307","heartbeat_front_addr":"172.21.15.138:6807/3342481307","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6811","nonce":1037257202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6813","nonce":1037257202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6817","nonce":1037257202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6815","nonce":1037257202}]},"public_addr":"172.21.15.138:6811/1037257202","cluster_addr":"172.21.15.138:6813/1037257202","heartbeat_back_addr":"172.21.15.138:6817/1037257202","heartbeat_front_addr":"172.21.15.138:6815/1037257202","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6819","nonce":1720307660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6821","nonce":1720307660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6825","nonce":1720307660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6823","nonce":1720307660}]},"public_addr":"172.21.15.138:6819/1720307660","cluster_addr":"172.21.15.138:6821/1720307660","heartbeat_back_addr":"172.21.15.138:6825/1720307660","heartbeat_front_addr":"172.21.15.138:6823/1720307660","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6801","nonce":4178670664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6803","nonce":4178670664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6807","nonce":4178670664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6805","nonce":4178670664}]},"public_addr":"172.21.15.170:6801/4178670664","cluster_addr":"172.21.15.170:6803/4178670664","heartbeat_back_addr":"172.21.15.170:6807/4178670664","heartbeat_front_addr":"172.21.15.170:6805/4178670664","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6809","nonce":2960661555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6811","nonce":2960661555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6815","nonce":2960661555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6813","nonce":2960661555}]},"public_addr":"172.21.15.170:6809/2960661555","cluster_addr":"172.21.15.170:6811/2960661555","heartbeat_back_addr":"172.21.15.170:6815/2960661555","heartbeat_front_addr":"172.21.15.170:6813/2960661555","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6817","nonce":3806552370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6819","nonce":3806552370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6823","nonce":3806552370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6821","nonce":3806552370}]},"public_addr":"172.21.15.170:6817/3806552370","cluster_addr":"172.21.15.170:6819/3806552370","heartbeat_back_addr":"172.21.15.170:6823/3806552370","heartbeat_front_addr":"172.21.15.170:6821/3806552370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 msgr2=0x7f263406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 0x7f263406eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f263000b5c0 tx=0x7f2630005480 comp rx=0 tx=0).stop 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 msgr2=0x7f2648195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f264000ba50 tx=0x7f264000be10 comp rx=0 tx=0).stop 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 shutdown_connections 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f263406c680 0x7f263406eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26480ff390 0x7f2648195e50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 --2- 172.21.15.138:0/865599844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26480ffd30 0x7f2648196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:26.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 >> 172.21.15.138:0/865599844 conn(0x7f2648074f50 msgr2=0x7f26480686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:26.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 shutdown_connections 2024-02-15T22:47:26.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:26.342+0000 7f264da6b700 1 -- 172.21.15.138:0/865599844 wait complete. 2024-02-15T22:47:27.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-15T22:47:27.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-15T22:47:27.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-15T22:47:27.153 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-15T22:47:27.153 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-15T22:47:27.154 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-15T22:47:27.413 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:27.444 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:27 smithi138 ceph-mon[29229]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:27 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/865599844' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:27.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:27 smithi170 ceph-mon[35248]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:27 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/865599844' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:47:28.154 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:28.155 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:28.407 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:28.958 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:28 smithi138 ceph-mon[29229]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:29.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:28 smithi170 ceph-mon[35248]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:31.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:31 smithi138 ceph-mon[29229]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:31.331 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:31 smithi170 ceph-mon[35248]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 -- 172.21.15.138:0/673886985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 msgr2=0x7ff3580ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 --2- 172.21.15.138:0/673886985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff3580ff6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff348009910 tx=0x7ff348009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 -- 172.21.15.138:0/673886985 shutdown_connections 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 --2- 172.21.15.138:0/673886985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3580ffc30 0x7ff35810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 --2- 172.21.15.138:0/673886985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff3580ff6f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 -- 172.21.15.138:0/673886985 >> 172.21.15.138:0/673886985 conn(0x7ff3580748b0 msgr2=0x7ff358074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 -- 172.21.15.138:0/673886985 shutdown_connections 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.402+0000 7ff35d27d700 1 -- 172.21.15.138:0/673886985 wait complete. 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 Processor -- start 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 -- start start 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3580ffc30 0x7ff35819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:32.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35819c630 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff35d27d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff358195b30 con 0x7ff3580ffc30 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56776/0 (socket says 172.21.15.138:56776) 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 -- 172.21.15.138:0/4059458341 learned_addr learned my addr 172.21.15.138:0/4059458341 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 -- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3580ffc30 msgr2=0x7ff35819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3580ffc30 0x7ff35819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.403+0000 7ff356ffd700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3480095f0 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff356ffd700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff348006010 tx=0x7ff34800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff34801d070 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff358195db0 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff34800f460 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff348021640 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3581962a0 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.404+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff35810d650 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.405+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff34800faf0 con 0x7ff3580ff320 2024-02-15T22:47:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.405+0000 7ff354ff9700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 0x7ff34406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.405+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff34808c890 con 0x7ff3580ff320 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff34e7fc700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 0x7ff34406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff354ff9700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 0x7ff344074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff344074e10 con 0x7ff344072350 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3480912a0 con 0x7ff3580ff320 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff3577fe700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 0x7ff344074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff34e7fc700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 0x7ff34406eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3580fdda0 tx=0x7ff340005c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.406+0000 7ff3577fe700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 0x7ff344074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.407+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== osd.4 v2:172.21.15.170:6808/2960661555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff344074e10 con 0x7ff344072350 2024-02-15T22:47:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.423+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 --> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff358196700 con 0x7ff344072350 2024-02-15T22:47:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff354ff9700 1 -- 172.21.15.138:0/4059458341 <== osd.4 v2:172.21.15.170:6808/2960661555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff358196700 con 0x7ff344072350 2024-02-15T22:47:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 msgr2=0x7ff344074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 0x7ff344074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 msgr2=0x7ff34406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 0x7ff34406eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3580fdda0 tx=0x7ff340005c80 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 msgr2=0x7ff35819ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.424+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff348006010 tx=0x7ff34800be20 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 shutdown_connections 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:6808/2960661555,v1:172.21.15.170:6809/2960661555] conn(0x7ff344072350 0x7ff344074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff34406c680 0x7ff34406eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3580ff320 0x7ff35819ba60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 --2- 172.21.15.138:0/4059458341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3580ffc30 0x7ff35819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 >> 172.21.15.138:0/4059458341 conn(0x7ff3580748b0 msgr2=0x7ff358104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 shutdown_connections 2024-02-15T22:47:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:32.425+0000 7ff35d27d700 1 -- 172.21.15.138:0/4059458341 wait complete. 2024-02-15T22:47:32.902 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:33.381 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:33 smithi138 ceph-mon[29229]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:33.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:33 smithi170 ceph-mon[35248]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:34.337 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:34.358 INFO:teuthology.orchestra.run.smithi138.stdout:146028888077 2024-02-15T22:47:34.358 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-15T22:47:34.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.574+0000 7f5d95291700 1 -- 172.21.15.138:0/3152211724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101c30 msgr2=0x7f5d9010a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.574+0000 7f5d95291700 1 --2- 172.21.15.138:0/3152211724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101c30 0x7f5d9010a130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009940 tx=0x7f5d84009c50 comp rx=0 tx=0).stop 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.574+0000 7f5d95291700 1 -- 172.21.15.138:0/3152211724 shutdown_connections 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 --2- 172.21.15.138:0/3152211724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101c30 0x7f5d9010a130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 --2- 172.21.15.138:0/3152211724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101320 0x7f5d901016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 -- 172.21.15.138:0/3152211724 >> 172.21.15.138:0/3152211724 conn(0x7f5d900fab80 msgr2=0x7f5d900fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 -- 172.21.15.138:0/3152211724 shutdown_connections 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 -- 172.21.15.138:0/3152211724 wait complete. 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 Processor -- start 2024-02-15T22:47:34.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 -- start start 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.575+0000 7f5d95291700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d95291700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 0x7f5d900ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d95291700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900ffa00 con 0x7f5d90101320 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d95291700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900ffb40 con 0x7f5d90101c30 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8e7fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 0x7f5d900ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57840/0 (socket says 172.21.15.138:57840) 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 -- 172.21.15.138:0/2684990222 learned_addr learned my addr 172.21.15.138:0/2684990222 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 -- 172.21.15.138:0/2684990222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 msgr2=0x7f5d900ff4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 0x7f5d900ff4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840095f0 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8e7fc700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 0x7f5d900ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d8effd700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000e920 tx=0x7f5d8000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8000c9d0 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d80010430 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d901a1e70 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d80018650 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.576+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d901a2220 con 0x7f5d90101320 2024-02-15T22:47:34.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.577+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d9010d570 con 0x7f5d90101320 2024-02-15T22:47:34.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.578+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f5d800105a0 con 0x7f5d90101320 2024-02-15T22:47:34.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.578+0000 7f5d77fff700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 0x7f5d7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.578+0000 7f5d8e7fc700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 0x7f5d7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.578+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5d80014070 con 0x7f5d90101320 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d77fff700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 0x7f5d78074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d78074e10 con 0x7f5d78072350 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d8008c370 con 0x7f5d90101320 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d8f7fe700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 0x7f5d78074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d8e7fc700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 0x7f5d7806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d84006010 tx=0x7f5d84005ad0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.579+0000 7f5d8f7fe700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 0x7f5d78074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.580+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== osd.0 v2:172.21.15.138:6802/3342481307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5d78074e10 con 0x7f5d78072350 2024-02-15T22:47:34.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.596+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 --> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d9004ea50 con 0x7f5d78072350 2024-02-15T22:47:34.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d77fff700 1 -- 172.21.15.138:0/2684990222 <== osd.0 v2:172.21.15.138:6802/3342481307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d9004ea50 con 0x7f5d78072350 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 msgr2=0x7f5d78074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 0x7f5d78074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 msgr2=0x7f5d7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 0x7f5d7806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d84006010 tx=0x7f5d84005ad0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 msgr2=0x7f5d900fef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d8000e920 tx=0x7f5d8000ec30 comp rx=0 tx=0).stop 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 shutdown_connections 2024-02-15T22:47:34.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6802/3342481307,v1:172.21.15.138:6803/3342481307] conn(0x7f5d78072350 0x7f5d78074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f5d7806c680 0x7f5d7806eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d90101320 0x7f5d900fef80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 --2- 172.21.15.138:0/2684990222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d90101c30 0x7f5d900ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 >> 172.21.15.138:0/2684990222 conn(0x7f5d900fab80 msgr2=0x7f5d901048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 shutdown_connections 2024-02-15T22:47:34.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.597+0000 7f5d95291700 1 -- 172.21.15.138:0/2684990222 wait complete. 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 -- 172.21.15.138:0/4067833288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc938100d70 msgr2=0x7fc938104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 --2- 172.21.15.138:0/4067833288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc938100d70 0x7fc938104d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc928009910 tx=0x7fc928009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 -- 172.21.15.138:0/4067833288 shutdown_connections 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 --2- 172.21.15.138:0/4067833288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc938100d70 0x7fc938104d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 --2- 172.21.15.138:0/4067833288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9381003d0 0x7fc9381007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 -- 172.21.15.138:0/4067833288 >> 172.21.15.138:0/4067833288 conn(0x7fc9380fbc50 msgr2=0x7fc9380fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 -- 172.21.15.138:0/4067833288 shutdown_connections 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.831+0000 7fc9400b3700 1 -- 172.21.15.138:0/4067833288 wait complete. 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 Processor -- start 2024-02-15T22:47:34.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 -- start start 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc938100d70 0x7fc938196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938196a20 con 0x7fc9381003d0 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc9400b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93819a7b0 con 0x7fc938100d70 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57866/0 (socket says 172.21.15.138:57866) 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 -- 172.21.15.138:0/2416426416 learned_addr learned my addr 172.21.15.138:0/2416426416 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93d64e700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc938100d70 0x7fc938196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 -- 172.21.15.138:0/2416426416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc938100d70 msgr2=0x7fc938196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc938100d70 0x7fc938196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.832+0000 7fc93de4f700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280095f0 con 0x7fc9381003d0 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc93de4f700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc93400d8d0 tx=0x7fc93400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9340098a0 con 0x7fc9381003d0 2024-02-15T22:47:34.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc934010460 con 0x7fc9381003d0 2024-02-15T22:47:34.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93819aa90 con 0x7fc9381003d0 2024-02-15T22:47:34.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93400f5f0 con 0x7fc9381003d0 2024-02-15T22:47:34.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.833+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93819afe0 con 0x7fc9381003d0 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.834+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc93810d540 con 0x7fc9381003d0 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.834+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fc934009a00 con 0x7fc9381003d0 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc92effd700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 0x7fc92406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc93408b8b0 con 0x7fc9381003d0 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc93d64e700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 0x7fc92406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc92effd700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 0x7fc924074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:34.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc924074e10 con 0x7fc924072350 2024-02-15T22:47:34.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc93408bd10 con 0x7fc9381003d0 2024-02-15T22:47:34.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc93e650700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 0x7fc924074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:34.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc93d64e700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 0x7fc92406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc938197420 tx=0x7fc92801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.835+0000 7fc93e650700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 0x7fc924074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:34.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.836+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== osd.2 v2:172.21.15.138:6818/1720307660 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc924074e10 con 0x7fc924072350 2024-02-15T22:47:34.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 --> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc93804ea50 con 0x7fc924072350 2024-02-15T22:47:34.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc92effd700 1 -- 172.21.15.138:0/2416426416 <== osd.2 v2:172.21.15.138:6818/1720307660 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc93804ea50 con 0x7fc924072350 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 msgr2=0x7fc924074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 0x7fc924074760 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 msgr2=0x7fc92406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 0x7fc92406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc938197420 tx=0x7fc92801a040 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 msgr2=0x7fc938195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.852+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc93400d8d0 tx=0x7fc93400dbe0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 shutdown_connections 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6818/1720307660,v1:172.21.15.138:6819/1720307660] conn(0x7fc924072350 0x7fc924074760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fc92406c680 0x7fc92406eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9381003d0 0x7fc938195e00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 --2- 172.21.15.138:0/2416426416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc938100d70 0x7fc938196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 >> 172.21.15.138:0/2416426416 conn(0x7fc9380fbc50 msgr2=0x7fc9380fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:34.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 shutdown_connections 2024-02-15T22:47:34.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:34.853+0000 7fc9400b3700 1 -- 172.21.15.138:0/2416426416 wait complete. 2024-02-15T22:47:35.185 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:35 smithi138 ceph-mon[29229]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:35.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:35 smithi170 ceph-mon[35248]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:35.611 INFO:teuthology.orchestra.run.smithi138.stdout:38654705699 2024-02-15T22:47:35.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-15T22:47:36.225 INFO:teuthology.orchestra.run.smithi138.stdout:81604378647 2024-02-15T22:47:36.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-15T22:47:36.260 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:37.269 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:37 smithi138 ceph-mon[29229]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:37.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:37 smithi170 ceph-mon[35248]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 -- 172.21.15.138:0/3155387314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 msgr2=0x7fa948068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3155387314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948068a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b0a0 tx=0x7fa94000b3b0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 -- 172.21.15.138:0/3155387314 shutdown_connections 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3155387314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa948068fd0 0x7fa948104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3155387314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948068a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 -- 172.21.15.138:0/3155387314 >> 172.21.15.138:0/3155387314 conn(0x7fa948074f50 msgr2=0x7fa948075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 -- 172.21.15.138:0/3155387314 shutdown_connections 2024-02-15T22:47:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 -- 172.21.15.138:0/3155387314 wait complete. 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.474+0000 7fa94eb56700 1 Processor -- start 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 -- start start 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa948068fd0 0x7fa948196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948196950 con 0x7fa948068630 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94819a6e0 con 0x7fa948068fd0 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57882/0 (socket says 172.21.15.138:57882) 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 -- 172.21.15.138:0/3770666092 learned_addr learned my addr 172.21.15.138:0/3770666092 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 -- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa948068fd0 msgr2=0x7fa948196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa948068fd0 0x7fa948196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009d00 con 0x7fa948068630 2024-02-15T22:47:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94c8f2700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa940000f80 tx=0x7fa94000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa94000e040 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa940003de0 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94819a960 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.475+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa94001d9a0 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.476+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94819ae50 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.476+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa94810d670 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.477+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa940004040 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.477+0000 7fa945ffb700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 0x7fa93006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.477+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa94008ce80 con 0x7fa948068630 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa947fff700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 0x7fa93006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa945ffb700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 0x7fa930074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa930074e10 con 0x7fa930072350 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa940092500 con 0x7fa948068630 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa947fff700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 0x7fa93006eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa93c005950 tx=0x7fa93c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa94d0f3700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 0x7fa930074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.478+0000 7fa94d0f3700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 0x7fa930074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.479+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== osd.3 v2:172.21.15.170:6800/4178670664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa930074e10 con 0x7fa930072350 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.495+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 --> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa94804ea50 con 0x7fa930072350 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa945ffb700 1 -- 172.21.15.138:0/3770666092 <== osd.3 v2:172.21.15.170:6800/4178670664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa94804ea50 con 0x7fa930072350 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 msgr2=0x7fa930074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 0x7fa930074760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 msgr2=0x7fa93006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 0x7fa93006eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa93c005950 tx=0x7fa93c0058e0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 msgr2=0x7fa948195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa940000f80 tx=0x7fa94000cdd0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 shutdown_connections 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:6800/4178670664,v1:172.21.15.170:6801/4178670664] conn(0x7fa930072350 0x7fa930074760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa93006c680 0x7fa93006eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa948068630 0x7fa948195d30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 --2- 172.21.15.138:0/3770666092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa948068fd0 0x7fa948196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 >> 172.21.15.138:0/3770666092 conn(0x7fa948074f50 msgr2=0x7fa9480fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 shutdown_connections 2024-02-15T22:47:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:37.496+0000 7fa94eb56700 1 -- 172.21.15.138:0/3770666092 wait complete. 2024-02-15T22:47:38.888 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:38.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:38 smithi138 ceph-mon[29229]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:39.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:38 smithi170 ceph-mon[35248]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:39.372 INFO:teuthology.orchestra.run.smithi138.stdout:111669149716 2024-02-15T22:47:39.372 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-15T22:47:41.101 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 -- 172.21.15.138:0/3687350414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 msgr2=0x7ffb04104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/3687350414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb04104d30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009910 tx=0x7ffaf4009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 -- 172.21.15.138:0/3687350414 shutdown_connections 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/3687350414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb04104d30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/3687350414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 0x7ffb04100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 -- 172.21.15.138:0/3687350414 >> 172.21.15.138:0/3687350414 conn(0x7ffb040fbca0 msgr2=0x7ffb040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 -- 172.21.15.138:0/3687350414 shutdown_connections 2024-02-15T22:47:41.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.122+0000 7ffb0ba61700 1 -- 172.21.15.138:0/3687350414 wait complete. 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 Processor -- start 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 -- start start 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 0x7ffb04195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb041969b0 con 0x7ffb04100d60 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb0ba61700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0419a740 con 0x7ffb041003c0 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb08ffc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb08ffc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57896/0 (socket says 172.21.15.138:57896) 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb08ffc700 1 -- 172.21.15.138:0/750853044 learned_addr learned my addr 172.21.15.138:0/750853044 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.123+0000 7ffb097fd700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 0x7ffb04195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb08ffc700 1 -- 172.21.15.138:0/750853044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 msgr2=0x7ffb04195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb08ffc700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 0x7ffb04195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb08ffc700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40095f0 con 0x7ffb04100d60 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb08ffc700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009fd0 tx=0x7ffaf400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf401d070 con 0x7ffb04100d60 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffaf4005640 con 0x7ffb04100d60 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0419a9c0 con 0x7ffb04100d60 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4017630 con 0x7ffb04100d60 2024-02-15T22:47:41.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.124+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0419ae50 con 0x7ffb04100d60 2024-02-15T22:47:41.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.125+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb0410d530 con 0x7ffb04100d60 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.125+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ffaf4005080 con 0x7ffb04100d60 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffafa7fc700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 0x7ffaf006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffaf408cb50 con 0x7ffb04100d60 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffb097fd700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 0x7ffaf006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffafa7fc700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 0x7ffaf0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffaf0074e10 con 0x7ffaf0072350 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffaf40912a0 con 0x7ffb04100d60 2024-02-15T22:47:41.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffb09ffe700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 0x7ffaf0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffb097fd700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 0x7ffaf006eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009bf0 tx=0x7ffb00009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.126+0000 7ffb09ffe700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 0x7ffaf0074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.127+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== osd.1 v2:172.21.15.138:6810/1037257202 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffaf0074e10 con 0x7ffaf0072350 2024-02-15T22:47:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 --> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb0404ea50 con 0x7ffaf0072350 2024-02-15T22:47:41.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffafa7fc700 1 -- 172.21.15.138:0/750853044 <== osd.1 v2:172.21.15.138:6810/1037257202 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffb0404ea50 con 0x7ffaf0072350 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 msgr2=0x7ffaf0074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 0x7ffaf0074760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 msgr2=0x7ffaf006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 0x7ffaf006eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009bf0 tx=0x7ffb00009260 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 msgr2=0x7ffb041962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009fd0 tx=0x7ffaf400fab0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 shutdown_connections 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6810/1037257202,v1:172.21.15.138:6811/1037257202] conn(0x7ffaf0072350 0x7ffaf0074760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ffaf006c680 0x7ffaf006eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb041003c0 0x7ffb04195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 --2- 172.21.15.138:0/750853044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffb04100d60 0x7ffb041962d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 >> 172.21.15.138:0/750853044 conn(0x7ffb040fbca0 msgr2=0x7ffb040fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 shutdown_connections 2024-02-15T22:47:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.143+0000 7ffb0ba61700 1 -- 172.21.15.138:0/750853044 wait complete. 2024-02-15T22:47:41.271 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:41 smithi138 ceph-mon[29229]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 -- 172.21.15.138:0/2695711923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ffd30 msgr2=0x7fba88103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 --2- 172.21.15.138:0/2695711923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ffd30 0x7fba88103ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009910 tx=0x7fba7c009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 -- 172.21.15.138:0/2695711923 shutdown_connections 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 --2- 172.21.15.138:0/2695711923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ffd30 0x7fba88103ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 --2- 172.21.15.138:0/2695711923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ff390 0x7fba880ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 -- 172.21.15.138:0/2695711923 >> 172.21.15.138:0/2695711923 conn(0x7fba88074f50 msgr2=0x7fba88075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 -- 172.21.15.138:0/2695711923 shutdown_connections 2024-02-15T22:47:41.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.307+0000 7fba8fe55700 1 -- 172.21.15.138:0/2695711923 wait complete. 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 Processor -- start 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 -- start start 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ffd30 0x7fba881984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88198bc0 con 0x7fba880ff390 2024-02-15T22:47:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8fe55700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8819c950 con 0x7fba880ffd30 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57922/0 (socket says 172.21.15.138:57922) 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 -- 172.21.15.138:0/72418405 learned_addr learned my addr 172.21.15.138:0/72418405 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8d3f0700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ffd30 0x7fba881984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 -- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ffd30 msgr2=0x7fba881984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ffd30 0x7fba881984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0095f0 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.308+0000 7fba8dbf1700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba8000ef10 tx=0x7fba8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8000c9f0 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba8000f040 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8819cbd0 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba800146b0 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8819d0f0 con 0x7fba880ff390 2024-02-15T22:47:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.309+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba8810c4e0 con 0x7fba880ff390 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.310+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fba800078b0 con 0x7fba880ff390 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.310+0000 7fba86ffd700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 0x7fba7006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.310+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fba8008b7c0 con 0x7fba880ff390 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.310+0000 7fba8d3f0700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 0x7fba7006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba86ffd700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 0x7fba700747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba70074e60 con 0x7fba700723a0 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba800902a0 con 0x7fba880ff390 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba8e3f2700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 0x7fba700747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba8d3f0700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 0x7fba7006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0059d0 tx=0x7fba7c005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.311+0000 7fba8e3f2700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 0x7fba700747b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.312+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== osd.5 v2:172.21.15.170:6816/3806552370 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fba70074e60 con 0x7fba700723a0 2024-02-15T22:47:41.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.327+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 --> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba8804ea50 con 0x7fba700723a0 2024-02-15T22:47:41.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.328+0000 7fba86ffd700 1 -- 172.21.15.138:0/72418405 <== osd.5 v2:172.21.15.170:6816/3806552370 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fba8804ea50 con 0x7fba700723a0 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.328+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 msgr2=0x7fba700747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.328+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 0x7fba700747b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 msgr2=0x7fba7006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 0x7fba7006eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0059d0 tx=0x7fba7c005940 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 msgr2=0x7fba88197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba8000ef10 tx=0x7fba8000c3a0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 shutdown_connections 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:6816/3806552370,v1:172.21.15.170:6817/3806552370] conn(0x7fba700723a0 0x7fba700747b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fba7006c680 0x7fba7006eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba880ff390 0x7fba88197fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 --2- 172.21.15.138:0/72418405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba880ffd30 0x7fba881984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 >> 172.21.15.138:0/72418405 conn(0x7fba88074f50 msgr2=0x7fba880fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 shutdown_connections 2024-02-15T22:47:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:41.329+0000 7fba8fe55700 1 -- 172.21.15.138:0/72418405 wait complete. 2024-02-15T22:47:41.406 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:41 smithi170 ceph-mon[35248]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:42.081 INFO:teuthology.orchestra.run.smithi138.stdout:167503724554 2024-02-15T22:47:42.081 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-15T22:47:42.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 -- 172.21.15.138:0/1501684424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 msgr2=0x7fa7ec1062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:42.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 --2- 172.21.15.138:0/1501684424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec1062f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009910 tx=0x7fa7e8009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:42.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 -- 172.21.15.138:0/1501684424 shutdown_connections 2024-02-15T22:47:42.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 --2- 172.21.15.138:0/1501684424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 0x7fa7ec0ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 --2- 172.21.15.138:0/1501684424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec1062f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.547+0000 7fa7f389c700 1 -- 172.21.15.138:0/1501684424 >> 172.21.15.138:0/1501684424 conn(0x7fa7ec074850 msgr2=0x7fa7ec074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 -- 172.21.15.138:0/1501684424 shutdown_connections 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 -- 172.21.15.138:0/1501684424 wait complete. 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 Processor -- start 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 -- start start 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 0x7fa7ec19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec19cfb0 con 0x7fa7ec0ff290 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f389c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1a0d40 con 0x7fa7ec0ff660 2024-02-15T22:47:42.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f1638700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f1638700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:57936/0 (socket says 172.21.15.138:57936) 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.548+0000 7fa7f1638700 1 -- 172.21.15.138:0/3265404032 learned_addr learned my addr 172.21.15.138:0/3265404032 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f0e37700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 0x7fa7ec19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f1638700 1 -- 172.21.15.138:0/3265404032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 msgr2=0x7fa7ec19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f1638700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 0x7fa7ec19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f1638700 1 -- 172.21.15.138:0/3265404032 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80095f0 con 0x7fa7ec0ff290 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f1638700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006010 tx=0x7fa7e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e801d070 con 0x7fa7ec0ff290 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec1a1020 con 0x7fa7ec0ff290 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa7e8004fa0 con 0x7fa7ec0ff290 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e800f690 con 0x7fa7ec0ff290 2024-02-15T22:47:42.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.549+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1a1570 con 0x7fa7ec0ff290 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.550+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec1039e0 con 0x7fa7ec0ff290 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.550+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa7e8022470 con 0x7fa7ec0ff290 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.551+0000 7fa7e27fc700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 0x7fa7d806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.551+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa7e808cce0 con 0x7fa7ec0ff290 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.551+0000 7fa7f0e37700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 0x7fa7d806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:42.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.551+0000 7fa7f0e37700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 0x7fa7d806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec19d9b0 tx=0x7fa7dc009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:42.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.555+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa7e8057700 con 0x7fa7ec0ff290 2024-02-15T22:47:42.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.750+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa7ec04ea50 con 0x7fa7ec0ff290 2024-02-15T22:47:42.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.751+0000 7fa7e27fc700 1 -- 172.21.15.138:0/3265404032 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7e8027020 con 0x7fa7ec0ff290 2024-02-15T22:47:42.753 INFO:teuthology.orchestra.run.smithi138.stdout:146028888079 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 msgr2=0x7fa7d806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 0x7fa7d806eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec19d9b0 tx=0x7fa7dc009190 comp rx=0 tx=0).stop 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 msgr2=0x7fa7ec19c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006010 tx=0x7fa7e800bd70 comp rx=0 tx=0).stop 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 shutdown_connections 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa7d806c680 0x7fa7d806eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7ec0ff290 0x7fa7ec19c390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 --2- 172.21.15.138:0/3265404032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7ec0ff660 0x7fa7ec19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:42.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 >> 172.21.15.138:0/3265404032 conn(0x7fa7ec074850 msgr2=0x7fa7ec0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:42.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 shutdown_connections 2024-02-15T22:47:42.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:42.753+0000 7fa7f389c700 1 -- 172.21.15.138:0/3265404032 wait complete. 2024-02-15T22:47:43.079 INFO:teuthology.orchestra.run.smithi138.stdout:60129542175 2024-02-15T22:47:43.079 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-15T22:47:43.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:43 smithi138 ceph-mon[29229]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:43.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:43 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3265404032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T22:47:43.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:43 smithi170 ceph-mon[35248]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:43.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:43 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3265404032' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T22:47:43.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888077 got 146028888079 for osd.4 2024-02-15T22:47:43.906 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:44.336 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:44.338 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:45.322 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:45 smithi138 ceph-mon[29229]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:45.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:45 smithi170 ceph-mon[35248]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:47.167 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:47 smithi138 ceph-mon[29229]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:47.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:47 smithi170 ceph-mon[35248]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 -- 172.21.15.138:0/1825510585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 msgr2=0x7f937c0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 --2- 172.21.15.138:0/1825510585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c0ff6a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f936c009910 tx=0x7f936c009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 -- 172.21.15.138:0/1825510585 shutdown_connections 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 --2- 172.21.15.138:0/1825510585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 0x7f937c103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 --2- 172.21.15.138:0/1825510585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c0ff6a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 -- 172.21.15.138:0/1825510585 >> 172.21.15.138:0/1825510585 conn(0x7f937c0fabb0 msgr2=0x7f937c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 -- 172.21.15.138:0/1825510585 shutdown_connections 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.788+0000 7f9384173700 1 -- 172.21.15.138:0/1825510585 wait complete. 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 Processor -- start 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 -- start start 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:47.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 0x7f937c101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c101760 con 0x7f937c0ff2d0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9384173700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c1018a0 con 0x7f937c0ffc70 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59848/0 (socket says 172.21.15.138:59848) 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 -- 172.21.15.138:0/87014960 learned_addr learned my addr 172.21.15.138:0/87014960 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f938170e700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 0x7f937c101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 -- 172.21.15.138:0/87014960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 msgr2=0x7f937c101220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 0x7f937c101220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.789+0000 7f9381f0f700 1 -- 172.21.15.138:0/87014960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0095f0 con 0x7f937c0ff2d0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9381f0f700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f936c006010 tx=0x7f936c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f936c01d070 con 0x7f937c0ff2d0 2024-02-15T22:47:47.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f936c004fa0 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c101b20 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f936c00f690 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.790+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c1a2230 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.791+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c04ea50 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.791+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f936c022470 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.792+0000 7f9372ffd700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 0x7f936806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.792+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f936c08cc30 con 0x7f937c0ff2d0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.792+0000 7f938170e700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 0x7f936806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.792+0000 7f938170e700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 0x7f936806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f937c1024d0 tx=0x7f937800a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:47.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:47.796+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f936c057650 con 0x7f937c0ff2d0 2024-02-15T22:47:47.851 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.000+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f937c102210 con 0x7f937c0ff2d0 2024-02-15T22:47:48.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.000+0000 7f9372ffd700 1 -- 172.21.15.138:0/87014960 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f936c027020 con 0x7f937c0ff2d0 2024-02-15T22:47:48.002 INFO:teuthology.orchestra.run.smithi138.stdout:38654705702 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 msgr2=0x7f936806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 0x7f936806eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f937c1024d0 tx=0x7f937800a380 comp rx=0 tx=0).stop 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 msgr2=0x7f937c100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f936c006010 tx=0x7f936c00bd70 comp rx=0 tx=0).stop 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 shutdown_connections 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f936806c680 0x7f936806eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f937c0ff2d0 0x7f937c100ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 --2- 172.21.15.138:0/87014960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f937c0ffc70 0x7f937c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 >> 172.21.15.138:0/87014960 conn(0x7f937c0fabb0 msgr2=0x7f937c068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 shutdown_connections 2024-02-15T22:47:48.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:48.002+0000 7f9384173700 1 -- 172.21.15.138:0/87014960 wait complete. 2024-02-15T22:47:48.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:48 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/87014960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T22:47:48.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:48 smithi138 ceph-mon[29229]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:49.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:48 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/87014960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T22:47:49.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:48 smithi170 ceph-mon[35248]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 -- 172.21.15.138:0/2497620144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ffd30 msgr2=0x7f248c103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:49.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 --2- 172.21.15.138:0/2497620144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ffd30 0x7f248c103ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2474009910 tx=0x7f2474009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 -- 172.21.15.138:0/2497620144 shutdown_connections 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 --2- 172.21.15.138:0/2497620144 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ffd30 0x7f248c103ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 --2- 172.21.15.138:0/2497620144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ff390 0x7f248c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 -- 172.21.15.138:0/2497620144 >> 172.21.15.138:0/2497620144 conn(0x7f248c074f50 msgr2=0x7f248c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 -- 172.21.15.138:0/2497620144 shutdown_connections 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 -- 172.21.15.138:0/2497620144 wait complete. 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.086+0000 7f2491745700 1 Processor -- start 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 -- start start 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 0x7f248c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1978a0 con 0x7f248c0ff390 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1979e0 con 0x7f248c0ffd30 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:49.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59868/0 (socket says 172.21.15.138:59868) 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 -- 172.21.15.138:0/250642783 learned_addr learned my addr 172.21.15.138:0/250642783 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2483fff700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 0x7f248c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 -- 172.21.15.138:0/250642783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 msgr2=0x7f248c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 0x7f248c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 -- 172.21.15.138:0/250642783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740095f0 con 0x7f248c0ff390 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2483fff700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 0x7f248c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f248affd700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b4b0 tx=0x7f247c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c011800 con 0x7f248c0ff390 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f247c011e10 con 0x7f248c0ff390 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.087+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c19fd50 con 0x7f248c0ff390 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.088+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c00f2e0 con 0x7f248c0ff390 2024-02-15T22:47:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.088+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c1a0270 con 0x7f248c0ff390 2024-02-15T22:47:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.089+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c107670 con 0x7f248c0ff390 2024-02-15T22:47:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.089+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f247c010380 con 0x7f248c0ff390 2024-02-15T22:47:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.089+0000 7f2488ff9700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 0x7f247806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.089+0000 7f2483fff700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 0x7f247806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.089+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f247c08b1d0 con 0x7f248c0ff390 2024-02-15T22:47:49.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.090+0000 7f2483fff700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 0x7f247806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f247400b5c0 tx=0x7f2474005480 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:49.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.094+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f247c055bf0 con 0x7f248c0ff390 2024-02-15T22:47:49.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.288+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f248c04ea50 con 0x7f248c0ff390 2024-02-15T22:47:49.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.289+0000 7f2488ff9700 1 -- 172.21.15.138:0/250642783 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f247c059210 con 0x7f248c0ff390 2024-02-15T22:47:49.291 INFO:teuthology.orchestra.run.smithi138.stdout:81604378650 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 msgr2=0x7f247806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 0x7f247806eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f247400b5c0 tx=0x7f2474005480 comp rx=0 tx=0).stop 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 msgr2=0x7f248c196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b4b0 tx=0x7f247c00b870 comp rx=0 tx=0).stop 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 shutdown_connections 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f247806c680 0x7f247806eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c0ff390 0x7f248c196c80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 --2- 172.21.15.138:0/250642783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c0ffd30 0x7f248c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:49.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 >> 172.21.15.138:0/250642783 conn(0x7f248c074f50 msgr2=0x7f248c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:49.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 shutdown_connections 2024-02-15T22:47:49.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:49.291+0000 7f2491745700 1 -- 172.21.15.138:0/250642783 wait complete. 2024-02-15T22:47:49.966 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:49.966 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:49 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/250642783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T22:47:49.987 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705702 for osd.0 2024-02-15T22:47:49.987 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:50.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:47:50.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:49 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/250642783' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T22:47:50.897 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:50 smithi138 ceph-mon[29229]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:51.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:50 smithi170 ceph-mon[35248]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:51.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 -- 172.21.15.138:0/3493437966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 msgr2=0x7f27080ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:51.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3493437966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f27080ff6f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009940 tx=0x7f26f8009c50 comp rx=0 tx=0).stop 2024-02-15T22:47:51.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 -- 172.21.15.138:0/3493437966 shutdown_connections 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3493437966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 0x7f270810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3493437966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f27080ff6f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 -- 172.21.15.138:0/3493437966 >> 172.21.15.138:0/3493437966 conn(0x7f27080748b0 msgr2=0x7f2708074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 -- 172.21.15.138:0/3493437966 shutdown_connections 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 -- 172.21.15.138:0/3493437966 wait complete. 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.003+0000 7f270c9b3700 1 Processor -- start 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270c9b3700 1 -- start start 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270c9b3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270c9b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 0x7f270819bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270c9b3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270819c570 con 0x7f27080ff320 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270c9b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708195ab0 con 0x7f27080ffc30 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59882/0 (socket says 172.21.15.138:59882) 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 -- 172.21.15.138:0/3962902429 learned_addr learned my addr 172.21.15.138:0/3962902429 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f26fdd9b700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 0x7f270819bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 -- 172.21.15.138:0/3962902429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 msgr2=0x7f270819bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 0x7f270819bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 -- 172.21.15.138:0/3962902429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80095f0 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.004+0000 7f270659c700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26f8000c00 tx=0x7f26f80056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.005+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f801d070 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.005+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708195d90 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.005+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f26f8003ba0 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.005+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f8021640 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.005+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27081962e0 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.006+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708107da0 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.006+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f26f8003d10 con 0x7f27080ff320 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.007+0000 7f26fffff700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 0x7f26f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:51.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.007+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f26f808c9e0 con 0x7f27080ff320 2024-02-15T22:47:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.007+0000 7f26fdd9b700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 0x7f26f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.007+0000 7f26fdd9b700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 0x7f26f406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27080fdea0 tx=0x7f26f0005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.011+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f26f805ae90 con 0x7f27080ff320 2024-02-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.204+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2708196560 con 0x7f27080ff320 2024-02-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.205+0000 7f26fffff700 1 -- 172.21.15.138:0/3962902429 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26f805aa20 con 0x7f27080ff320 2024-02-15T22:47:51.207 INFO:teuthology.orchestra.run.smithi138.stdout:167503724556 2024-02-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 msgr2=0x7f26f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 0x7f26f406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27080fdea0 tx=0x7f26f0005d50 comp rx=0 tx=0).stop 2024-02-15T22:47:51.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 msgr2=0x7f270819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26f8000c00 tx=0x7f26f80056a0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 shutdown_connections 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f26f406c680 0x7f26f406eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27080ff320 0x7f270819ba30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 --2- 172.21.15.138:0/3962902429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27080ffc30 0x7f270819bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.208+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 >> 172.21.15.138:0/3962902429 conn(0x7f27080748b0 msgr2=0x7f2708104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.209+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 shutdown_connections 2024-02-15T22:47:51.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:51.209+0000 7f270c9b3700 1 -- 172.21.15.138:0/3962902429 wait complete. 2024-02-15T22:47:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:51 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3962902429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T22:47:51.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-02-15T22:47:51.860 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:51.944 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:51 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3962902429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 -- 172.21.15.138:0/3796876552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101b20 msgr2=0x7f70b010a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 --2- 172.21.15.138:0/3796876552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101b20 0x7f70b010a1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f709c009910 tx=0x7f709c009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 -- 172.21.15.138:0/3796876552 shutdown_connections 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 --2- 172.21.15.138:0/3796876552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101b20 0x7f70b010a1f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 --2- 172.21.15.138:0/3796876552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101210 0x7f70b01015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 -- 172.21.15.138:0/3796876552 >> 172.21.15.138:0/3796876552 conn(0x7f70b00fab80 msgr2=0x7f70b00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 -- 172.21.15.138:0/3796876552 shutdown_connections 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.431+0000 7f70b6eee700 1 -- 172.21.15.138:0/3796876552 wait complete. 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 Processor -- start 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 -- start start 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 0x7f70b01962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01968f0 con 0x7f70b0101210 2024-02-15T22:47:52.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b6eee700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0196a30 con 0x7f70b0101b20 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59904/0 (socket says 172.21.15.138:59904) 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 -- 172.21.15.138:0/160303210 learned_addr learned my addr 172.21.15.138:0/160303210 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70affff700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 0x7f70b01962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 -- 172.21.15.138:0/160303210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 msgr2=0x7f70b01962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 0x7f70b01962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70b4c8a700 1 -- 172.21.15.138:0/160303210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0095f0 con 0x7f70b0101210 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.432+0000 7f70affff700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 0x7f70b01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70b4c8a700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70a400c930 tx=0x7f70a400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a4007ad0 con 0x7f70b0101210 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f70a4007c30 con 0x7f70b0101210 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b019a880 con 0x7f70b0101210 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a4018630 con 0x7f70b0101210 2024-02-15T22:47:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.433+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b019add0 con 0x7f70b0101210 2024-02-15T22:47:52.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.434+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b01078f0 con 0x7f70b0101210 2024-02-15T22:47:52.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.434+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f70a400f450 con 0x7f70b0101210 2024-02-15T22:47:52.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.435+0000 7f70adffb700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 0x7f70a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:52.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.435+0000 7f70affff700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 0x7f70a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:52.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.435+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f70a408b770 con 0x7f70b0101210 2024-02-15T22:47:52.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.435+0000 7f70affff700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 0x7f70a006eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f709c00b5c0 tx=0x7f709c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:52.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.439+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f70a4056190 con 0x7f70b0101210 2024-02-15T22:47:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.632+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70b002ccf0 con 0x7f70b0101210 2024-02-15T22:47:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.632+0000 7f70adffb700 1 -- 172.21.15.138:0/160303210 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70a40597b0 con 0x7f70b0101210 2024-02-15T22:47:52.634 INFO:teuthology.orchestra.run.smithi138.stdout:111669149718 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 msgr2=0x7f70a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 0x7f70a006eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f709c00b5c0 tx=0x7f709c005960 comp rx=0 tx=0).stop 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 msgr2=0x7f70b0195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70a400c930 tx=0x7f70a400ccf0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 shutdown_connections 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f70a006c680 0x7f70a006eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70b0101210 0x7f70b0195d60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 --2- 172.21.15.138:0/160303210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70b0101b20 0x7f70b01962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:52.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 >> 172.21.15.138:0/160303210 conn(0x7f70b00fab80 msgr2=0x7f70b0104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:52.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 shutdown_connections 2024-02-15T22:47:52.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:52.634+0000 7f70b6eee700 1 -- 172.21.15.138:0/160303210 wait complete. 2024-02-15T22:47:52.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:52 smithi138 ceph-mon[29229]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:52.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:52 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/160303210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T22:47:53.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:52 smithi170 ceph-mon[35248]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:53.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:52 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/160303210' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T22:47:53.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724554 got 167503724556 for osd.5 2024-02-15T22:47:53.509 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:53.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149718 for osd.3 2024-02-15T22:47:53.961 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- 172.21.15.138:0/1869547775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ffd30 msgr2=0x7fbeb0103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/1869547775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ffd30 0x7fbeb0103ce0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009910 tx=0x7fbea4009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- 172.21.15.138:0/1869547775 shutdown_connections 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/1869547775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ffd30 0x7fbeb0103ce0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/1869547775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ff390 0x7fbeb00ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- 172.21.15.138:0/1869547775 >> 172.21.15.138:0/1869547775 conn(0x7fbeb0074f50 msgr2=0x7fbeb0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- 172.21.15.138:0/1869547775 shutdown_connections 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- 172.21.15.138:0/1869547775 wait complete. 2024-02-15T22:47:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 Processor -- start 2024-02-15T22:47:54.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.393+0000 7fbeb6a06700 1 -- start start 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeb6a06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeb6a06700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ffd30 0x7fbeb01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeb6a06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb01969a0 con 0x7fbeb00ff390 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeb6a06700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb019a730 con 0x7fbeb00ffd30 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52004/0 (socket says 172.21.15.138:52004) 2024-02-15T22:47:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 -- 172.21.15.138:0/2908230922 learned_addr learned my addr 172.21.15.138:0/2908230922 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaf7fe700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ffd30 0x7fbeb01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 -- 172.21.15.138:0/2908230922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ffd30 msgr2=0x7fbeb01962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ffd30 0x7fbeb01962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 -- 172.21.15.138:0/2908230922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea40095f0 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeaffff700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbea000d8d0 tx=0x7fbea000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea00098a0 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbea0010460 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.394+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb019aa10 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.395+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbea000f5f0 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.395+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb019af60 con 0x7fbeb00ff390 2024-02-15T22:47:54.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.395+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb004ea50 con 0x7fbeb00ff390 2024-02-15T22:47:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.396+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fbea0009a00 con 0x7fbeb00ff390 2024-02-15T22:47:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.396+0000 7fbead7fa700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 0x7fbe9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.396+0000 7fbeaf7fe700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 0x7fbe9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.396+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbea008b370 con 0x7fbeb00ff390 2024-02-15T22:47:54.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.397+0000 7fbeaf7fe700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 0x7fbe9806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbeb01973a0 tx=0x7fbea401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:54.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.401+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbea0055e10 con 0x7fbeb00ff390 2024-02-15T22:47:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.593+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbeb01970e0 con 0x7fbeb00ff390 2024-02-15T22:47:54.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.593+0000 7fbead7fa700 1 -- 172.21.15.138:0/2908230922 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbea0059430 con 0x7fbeb00ff390 2024-02-15T22:47:54.596 INFO:teuthology.orchestra.run.smithi138.stdout:60129542178 2024-02-15T22:47:54.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.595+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 msgr2=0x7fbe9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:54.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.595+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 0x7fbe9806eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbeb01973a0 tx=0x7fbea401a040 comp rx=0 tx=0).stop 2024-02-15T22:47:54.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.595+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 msgr2=0x7fbeb0195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:54.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.595+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbea000d8d0 tx=0x7fbea000dbe0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 shutdown_connections 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbe9806c680 0x7fbe9806eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbeb00ff390 0x7fbeb0195d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 --2- 172.21.15.138:0/2908230922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbeb00ffd30 0x7fbeb01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 >> 172.21.15.138:0/2908230922 conn(0x7fbeb0074f50 msgr2=0x7fbeb00fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 shutdown_connections 2024-02-15T22:47:54.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:54.596+0000 7fbeb6a06700 1 -- 172.21.15.138:0/2908230922 wait complete. 2024-02-15T22:47:55.235 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542178 for osd.1 2024-02-15T22:47:55.235 DEBUG:teuthology.parallel:result is None 2024-02-15T22:47:55.236 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-15T22:47:55.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T22:47:55.443 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:55.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:55 smithi138 ceph-mon[29229]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:55.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:55 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2908230922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T22:47:55.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:55 smithi170 ceph-mon[35248]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:55 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2908230922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T22:47:57.173 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:57 smithi138 ceph-mon[29229]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 -- 172.21.15.138:0/3943049033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 msgr2=0x7f362410a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 --2- 172.21.15.138:0/3943049033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f362410a1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3610009910 tx=0x7f3610009c20 comp rx=0 tx=0).stop 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 -- 172.21.15.138:0/3943049033 shutdown_connections 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 --2- 172.21.15.138:0/3943049033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f362410a1a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 --2- 172.21.15.138:0/3943049033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 0x7f3624101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 -- 172.21.15.138:0/3943049033 >> 172.21.15.138:0/3943049033 conn(0x7f36240fabb0 msgr2=0x7f36240fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 -- 172.21.15.138:0/3943049033 shutdown_connections 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.197+0000 7f362ac72700 1 -- 172.21.15.138:0/3943049033 wait complete. 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 Processor -- start 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 -- start start 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 0x7f3624195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3624196930 con 0x7f3624101ca0 2024-02-15T22:47:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f362ac72700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362419a6c0 con 0x7f3624101390 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52018/0 (socket says 172.21.15.138:52018) 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 -- 172.21.15.138:0/2122482474 learned_addr learned my addr 172.21.15.138:0/2122482474 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3628a0e700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 0x7f3624195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 -- 172.21.15.138:0/2122482474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 msgr2=0x7f3624195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 0x7f3624195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.198+0000 7f3623fff700 1 -- 172.21.15.138:0/2122482474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100095f0 con 0x7f3624101ca0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f3623fff700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3610006010 tx=0x7f361000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361001d070 con 0x7f3624101ca0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f361000f460 con 0x7f3624101ca0 2024-02-15T22:47:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362419a940 con 0x7f3624101ca0 2024-02-15T22:47:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3610021640 con 0x7f3624101ca0 2024-02-15T22:47:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.199+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362419ae30 con 0x7f3624101ca0 2024-02-15T22:47:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.200+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624107810 con 0x7f3624101ca0 2024-02-15T22:47:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.200+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f361000faf0 con 0x7f3624101ca0 2024-02-15T22:47:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.201+0000 7f3621ffb700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 0x7f361406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:47:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.201+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f361008c8b0 con 0x7f3624101ca0 2024-02-15T22:47:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.201+0000 7f3628a0e700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 0x7f361406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:47:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.201+0000 7f3628a0e700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 0x7f361406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3618005fd0 tx=0x7f361800a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:47:57.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.205+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f36100572d0 con 0x7f3624101ca0 2024-02-15T22:47:57.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.389+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f362402cd20 con 0x7f361406c680 2024-02-15T22:47:57.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.391+0000 7f3621ffb700 1 -- 172.21.15.138:0/2122482474 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28070 (secure 0 0 0) 0x7f362402cd20 con 0x7f361406c680 2024-02-15T22:47:57.393 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 msgr2=0x7f361406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 0x7f361406eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3618005fd0 tx=0x7f361800a560 comp rx=0 tx=0).stop 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 msgr2=0x7f3624196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3610006010 tx=0x7f361000be20 comp rx=0 tx=0).stop 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 shutdown_connections 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f361406c680 0x7f361406eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3624101390 0x7f3624195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 --2- 172.21.15.138:0/2122482474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3624101ca0 0x7f3624196250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:47:57.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 >> 172.21.15.138:0/2122482474 conn(0x7f36240fabb0 msgr2=0x7f3624104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:47:57.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 shutdown_connections 2024-02-15T22:47:57.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:47:57.393+0000 7f362ac72700 1 -- 172.21.15.138:0/2122482474 wait complete. 2024-02-15T22:47:57.396 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-02-15T22:47:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:57 smithi170 ceph-mon[35248]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-02-15T22:47:56.026345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002259"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-15T22:47:05.650745+0000","last_change":"2024-02-15T22:46:40.636269+0000","last_active":"2024-02-15T22:47:05.650745+0000","last_peered":"2024-02-15T22:47:05.650745+0000","last_clean":"2024-02-15T22:47:05.650745+0000","last_became_active":"2024-02-15T22:46:40.635931+0000","last_became_peered":"2024-02-15T22:46:40.635931+0000","last_unstale":"2024-02-15T22:47:05.650745+0000","last_undegraded":"2024-02-15T22:47:05.650745+0000","last_fullsized":"2024-02-15T22:47:05.650745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:45:53.042134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:45:53.042134+0000","last_clean_scrub_stamp":"2024-02-15T22:45:53.042134+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:20:10.819384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63}]},{"osd":3,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.504}]},{"osd":2,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.36399999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.42399999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Feb 15 22:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41099999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.436},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:47:25 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.314,"15min":0.307},"min":{"1min":0.251,"5min":0.214,"15min":0.214},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.28000000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.29799999999999999},"min":{"1min":0.21099999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.318}]},{"osd":3,"last update":"Thu Feb 15 22:47:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.624},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:47:58.160 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T22:47:58.366 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:47:58.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:58 smithi138 ceph-mon[29229]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:47:58.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:58 smithi170 ceph-mon[35248]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:47:59.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:47:59 smithi138 ceph-mon[29229]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:47:59.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:47:59 smithi170 ceph-mon[35248]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 -- 172.21.15.138:0/3008064338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100da0 msgr2=0x7fd9d4104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 --2- 172.21.15.138:0/3008064338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100da0 0x7fd9d4104d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009910 tx=0x7fd9c0009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 -- 172.21.15.138:0/3008064338 shutdown_connections 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 --2- 172.21.15.138:0/3008064338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100da0 0x7fd9d4104d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 --2- 172.21.15.138:0/3008064338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100400 0x7fd9d41007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 -- 172.21.15.138:0/3008064338 >> 172.21.15.138:0/3008064338 conn(0x7fd9d40fbca0 msgr2=0x7fd9d40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 -- 172.21.15.138:0/3008064338 shutdown_connections 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.087+0000 7fd9db149700 1 -- 172.21.15.138:0/3008064338 wait complete. 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 Processor -- start 2024-02-15T22:48:00.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 -- start start 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100da0 0x7fd9d4196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d4196970 con 0x7fd9d4100400 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9db149700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d419a700 con 0x7fd9d4100da0 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9d8ee5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9d8ee5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52024/0 (socket says 172.21.15.138:52024) 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9d8ee5700 1 -- 172.21.15.138:0/3740543097 learned_addr learned my addr 172.21.15.138:0/3740543097 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.088+0000 7fd9d3fff700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100da0 0x7fd9d4196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d8ee5700 1 -- 172.21.15.138:0/3740543097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100da0 msgr2=0x7fd9d4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d8ee5700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100da0 0x7fd9d4196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d8ee5700 1 -- 172.21.15.138:0/3740543097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00095f0 con 0x7fd9d4100400 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d8ee5700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e920 tx=0x7fd9c800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:00.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c800c9d0 con 0x7fd9d4100400 2024-02-15T22:48:00.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9c8010430 con 0x7fd9d4100400 2024-02-15T22:48:00.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d419a9e0 con 0x7fd9d4100400 2024-02-15T22:48:00.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c8018650 con 0x7fd9d4100400 2024-02-15T22:48:00.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.089+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d419af00 con 0x7fd9d4100400 2024-02-15T22:48:00.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.090+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4108770 con 0x7fd9d4100400 2024-02-15T22:48:00.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.091+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd9c80105a0 con 0x7fd9d4100400 2024-02-15T22:48:00.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.091+0000 7fd9d1ffb700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 0x7fd9c406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:00.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.091+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd9c8014070 con 0x7fd9d4100400 2024-02-15T22:48:00.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.091+0000 7fd9d3fff700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 0x7fd9c406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:00.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.091+0000 7fd9d3fff700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 0x7fd9c406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00059d0 tx=0x7fd9c0005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:00.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.095+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd9c8051720 con 0x7fd9d4100400 2024-02-15T22:48:00.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.284+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9d419b230 con 0x7fd9c406c680 2024-02-15T22:48:00.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.285+0000 7fd9d1ffb700 1 -- 172.21.15.138:0/3740543097 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28041 (secure 0 0 0) 0x7fd9d419b230 con 0x7fd9c406c680 2024-02-15T22:48:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 msgr2=0x7fd9c406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 0x7fd9c406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00059d0 tx=0x7fd9c0005940 comp rx=0 tx=0).stop 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 msgr2=0x7fd9d4195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e920 tx=0x7fd9c800ec30 comp rx=0 tx=0).stop 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 shutdown_connections 2024-02-15T22:48:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd9c406c680 0x7fd9c406eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9d4100400 0x7fd9d4195d50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 --2- 172.21.15.138:0/3740543097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9d4100da0 0x7fd9d4196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 >> 172.21.15.138:0/3740543097 conn(0x7fd9d40fbca0 msgr2=0x7fd9d40fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 shutdown_connections 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:00.287+0000 7fd9db149700 1 -- 172.21.15.138:0/3740543097 wait complete. 2024-02-15T22:48:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-02-15T22:48:00.912 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-02-15T22:48:00.026974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002106"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-15T22:47:05.650745+0000","last_change":"2024-02-15T22:46:40.636269+0000","last_active":"2024-02-15T22:47:05.650745+0000","last_peered":"2024-02-15T22:47:05.650745+0000","last_clean":"2024-02-15T22:47:05.650745+0000","last_became_active":"2024-02-15T22:46:40.635931+0000","last_became_peered":"2024-02-15T22:46:40.635931+0000","last_unstale":"2024-02-15T22:47:05.650745+0000","last_undegraded":"2024-02-15T22:47:05.650745+0000","last_fullsized":"2024-02-15T22:47:05.650745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T22:45:53.042134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T22:45:53.042134+0000","last_clean_scrub_stamp":"2024-02-15T22:45:53.042134+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-17T06:20:10.819384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.32700000000000001,"15min":0.33200000000000002},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.36399999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.42399999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Feb 15 22:47:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41099999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.35699999999999998,"15min":0.35999999999999999},"min":{"1min":0.28399999999999997,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.41099999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Feb 15 22:47:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Feb 15 22:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 22:47:25 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.314,"15min":0.307},"min":{"1min":0.251,"5min":0.214,"15min":0.214},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.28000000000000003,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Feb 15 22:46:54 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Feb 15 22:47:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 22:47:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.29799999999999999},"min":{"1min":0.21099999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.318},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.23100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.251}]},{"osd":2,"last update":"Thu Feb 15 22:47:58 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.42899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.26500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Feb 15 22:47:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Feb 15 22:47:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T22:48:00.913 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-15T22:48:00.913 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T22:48:00.914 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-15T22:48:00.914 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-15T22:48:01.122 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:01.382 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:01 smithi138 ceph-mon[29229]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:01.382 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:01 smithi138 ceph-mon[29229]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:48:01.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:01 smithi170 ceph-mon[35248]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:01.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:01 smithi170 ceph-mon[35248]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T22:48:02.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 -- 172.21.15.138:0/4029105255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ff310 msgr2=0x7f8f0c0ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 --2- 172.21.15.138:0/4029105255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c0ff6e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009910 tx=0x7f8f08009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 -- 172.21.15.138:0/4029105255 shutdown_connections 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 --2- 172.21.15.138:0/4029105255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 --2- 172.21.15.138:0/4029105255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c0ff6e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.850+0000 7f8f147aa700 1 -- 172.21.15.138:0/4029105255 >> 172.21.15.138:0/4029105255 conn(0x7f8f0c0fabd0 msgr2=0x7f8f0c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 -- 172.21.15.138:0/4029105255 shutdown_connections 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 -- 172.21.15.138:0/4029105255 wait complete. 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 Processor -- start 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 -- start start 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:02.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1969f0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f147aa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c19a780 con 0x7f8f0c0ff310 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f11d45700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f11d45700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52032/0 (socket says 172.21.15.138:52032) 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.851+0000 7f8f11d45700 1 -- 172.21.15.138:0/1813998482 learned_addr learned my addr 172.21.15.138:0/1813998482 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f12546700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f11d45700 1 -- 172.21.15.138:0/1813998482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ff310 msgr2=0x7f8f0c195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f11d45700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f11d45700 1 -- 172.21.15.138:0/1813998482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080095f0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f11d45700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00b480 tx=0x7f8efc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8efc011800 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8efc011e10 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c19aa60 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8efc010ea0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.852+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c19afb0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.853+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c04ea50 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.854+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f8efc010380 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.854+0000 7f8f037fe700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 0x7f8ef806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:02.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.854+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8efc08b0b0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:02.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.854+0000 7f8f12546700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 0x7f8ef806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:02.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.854+0000 7f8f12546700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 0x7f8ef806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f08006010 tx=0x7f8f0801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:02.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:02.859+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8efc055ad0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:03.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.087+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8f0c19b3b0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:03.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.088+0000 7f8f037fe700 1 -- 172.21.15.138:0/1813998482 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8efc0590f0 con 0x7f8f0c0ffcb0 2024-02-15T22:48:03.091 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:03.091 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T22:48:03.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 msgr2=0x7f8ef806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:03.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 0x7f8ef806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f08006010 tx=0x7f8f0801a040 comp rx=0 tx=0).stop 2024-02-15T22:48:03.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 msgr2=0x7f8f0c196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:03.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00b480 tx=0x7f8efc00b790 comp rx=0 tx=0).stop 2024-02-15T22:48:03.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 shutdown_connections 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8ef806c680 0x7f8ef806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f0c0ff310 0x7f8f0c195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 --2- 172.21.15.138:0/1813998482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f0c0ffcb0 0x7f8f0c196310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 >> 172.21.15.138:0/1813998482 conn(0x7f8f0c0fabd0 msgr2=0x7f8f0c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 shutdown_connections 2024-02-15T22:48:03.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:03.091+0000 7f8f147aa700 1 -- 172.21.15.138:0/1813998482 wait complete. 2024-02-15T22:48:03.404 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:03 smithi138 ceph-mon[29229]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:03.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:03 smithi170 ceph-mon[35248]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:03.727 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-15T22:48:03.728 INFO:tasks.cephadm:Setup complete, yielding 2024-02-15T22:48:03.728 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:48:03.737 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-02-15T22:48:03.737 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:03.762 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:03.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-15T22:48:03.970 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:04.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:04 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1813998482' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T22:48:04.344 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:04 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1813998482' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T22:48:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:05.424 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:05 smithi138 ceph-mon[29229]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:05 smithi170 ceph-mon[35248]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 -- 172.21.15.138:0/2509567677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c100be0 msgr2=0x7f1c6c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 --2- 172.21.15.138:0/2509567677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c100be0 0x7f1c6c102fc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009910 tx=0x7f1c5c009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 -- 172.21.15.138:0/2509567677 shutdown_connections 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 --2- 172.21.15.138:0/2509567677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c103500 0x7f1c6c1058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 --2- 172.21.15.138:0/2509567677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c100be0 0x7f1c6c102fc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 -- 172.21.15.138:0/2509567677 >> 172.21.15.138:0/2509567677 conn(0x7f1c6c0fa600 msgr2=0x7f1c6c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 -- 172.21.15.138:0/2509567677 shutdown_connections 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.637+0000 7f1c7251d700 1 -- 172.21.15.138:0/2509567677 wait complete. 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 Processor -- start 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 -- start start 2024-02-15T22:48:05.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 0x7f1c6c1004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0ff0d0 con 0x7f1c6c103500 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c7251d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0ff210 con 0x7f1c6c100be0 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60238/0 (socket says 172.21.15.138:60238) 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 -- 172.21.15.138:0/1323266850 learned_addr learned my addr 172.21.15.138:0/1323266850 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c6bfff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 0x7f1c6c1004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 -- 172.21.15.138:0/1323266850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 msgr2=0x7f1c6c1004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 0x7f1c6c1004f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c63fff700 1 -- 172.21.15.138:0/1323266850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0095f0 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.638+0000 7f1c6bfff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 0x7f1c6c1004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c63fff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400d8d0 tx=0x7f1c5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c54009940 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c54010460 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0ff4f0 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5400f5f0 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.639+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c19d9e0 con 0x7f1c6c103500 2024-02-15T22:48:05.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.640+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c18fb70 con 0x7f1c6c103500 2024-02-15T22:48:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.640+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1c540105d0 con 0x7f1c6c103500 2024-02-15T22:48:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.641+0000 7f1c69ffb700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 0x7f1c5806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.641+0000 7f1c6bfff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 0x7f1c5806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.641+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1c5408b470 con 0x7f1c6c103500 2024-02-15T22:48:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.641+0000 7f1c6bfff700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 0x7f1c5806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005b40 tx=0x7f1c5c005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:05.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.645+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1c540599a0 con 0x7f1c6c103500 2024-02-15T22:48:05.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.836+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f1c6c061960 con 0x7f1c6c103500 2024-02-15T22:48:05.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.840+0000 7f1c69ffb700 1 -- 172.21.15.138:0/1323266850 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f1c5405de60 con 0x7f1c6c103500 2024-02-15T22:48:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 msgr2=0x7f1c5806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 0x7f1c5806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005b40 tx=0x7f1c5c005a90 comp rx=0 tx=0).stop 2024-02-15T22:48:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 msgr2=0x7f1c6c0feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400d8d0 tx=0x7f1c5400dc90 comp rx=0 tx=0).stop 2024-02-15T22:48:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 shutdown_connections 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f1c5806c680 0x7f1c5806eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c6c100be0 0x7f1c6c1004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 --2- 172.21.15.138:0/1323266850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c103500 0x7f1c6c0feb90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 >> 172.21.15.138:0/1323266850 conn(0x7f1c6c0fa600 msgr2=0x7f1c6c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 shutdown_connections 2024-02-15T22:48:05.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:05.843+0000 7f1c7251d700 1 -- 172.21.15.138:0/1323266850 wait complete. 2024-02-15T22:48:06.496 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:48:06.509 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-15T22:48:06.509 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:06.545 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:06.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph orch status' 2024-02-15T22:48:06.752 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1323266850' entity='client.admin' 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:07.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:06 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:07.095 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1323266850' entity='client.admin' 2024-02-15T22:48:07.095 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:07.095 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:07.095 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:07.096 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:07.096 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:06 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 -- 172.21.15.138:0/1930682753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 msgr2=0x7f281c0ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 --2- 172.21.15.138:0/1930682753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0ff4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f280c009910 tx=0x7f280c009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 -- 172.21.15.138:0/1930682753 shutdown_connections 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 --2- 172.21.15.138:0/1930682753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f281c100290 0x7f281c1006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 --2- 172.21.15.138:0/1930682753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0ff4a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 -- 172.21.15.138:0/1930682753 >> 172.21.15.138:0/1930682753 conn(0x7f281c0fa620 msgr2=0x7f281c0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:08.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 -- 172.21.15.138:0/1930682753 shutdown_connections 2024-02-15T22:48:08.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.393+0000 7f2823f00700 1 -- 172.21.15.138:0/1930682753 wait complete. 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 Processor -- start 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 -- start start 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f281c100290 0x7f281c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19ad90 con 0x7f281c0ff090 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2823f00700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19aed0 con 0x7f281c100290 2024-02-15T22:48:08.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60258/0 (socket says 172.21.15.138:60258) 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 -- 172.21.15.138:0/270042022 learned_addr learned my addr 172.21.15.138:0/270042022 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 -- 172.21.15.138:0/270042022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f281c100290 msgr2=0x7f281c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f281c100290 0x7f281c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.394+0000 7f2821c9c700 1 -- 172.21.15.138:0/270042022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0095f0 con 0x7f281c0ff090 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2821c9c700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f280c00bda0 tx=0x7f280c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c01d070 con 0x7f281c0ff090 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f280c004c50 con 0x7f281c0ff090 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c19b150 con 0x7f281c0ff090 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c00f690 con 0x7f281c0ff090 2024-02-15T22:48:08.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.395+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c19b6c0 con 0x7f281c0ff090 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.396+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c107c60 con 0x7f281c0ff090 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.396+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f280c0229b0 con 0x7f281c0ff090 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.397+0000 7f2812ffd700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 0x7f280806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.397+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f280c08cbe0 con 0x7f281c0ff090 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.397+0000 7f282149b700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 0x7f280806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:08.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.397+0000 7f282149b700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 0x7f280806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f281c069e30 tx=0x7f2818006d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:08.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.401+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f280c05b140 con 0x7f281c0ff090 2024-02-15T22:48:08.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.605+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f281c104be0 con 0x7f280806c680 2024-02-15T22:48:08.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.606+0000 7f2812ffd700 1 -- 172.21.15.138:0/270042022 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f281c104be0 con 0x7f280806c680 2024-02-15T22:48:08.608 INFO:teuthology.orchestra.run.smithi138.stdout:Backend: cephadm 2024-02-15T22:48:08.608 INFO:teuthology.orchestra.run.smithi138.stdout:Available: Yes 2024-02-15T22:48:08.608 INFO:teuthology.orchestra.run.smithi138.stdout:Paused: No 2024-02-15T22:48:08.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.608+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 msgr2=0x7f280806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:08.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.608+0000 7f2823f00700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 0x7f280806eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f281c069e30 tx=0x7f2818006d20 comp rx=0 tx=0).stop 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.608+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 msgr2=0x7f281c0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.608+0000 7f2823f00700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f280c00bda0 tx=0x7f280c00be80 comp rx=0 tx=0).stop 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 shutdown_connections 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f280806c680 0x7f280806eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f281c0ff090 0x7f281c0698b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 --2- 172.21.15.138:0/270042022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f281c100290 0x7f281c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 >> 172.21.15.138:0/270042022 conn(0x7f281c0fa620 msgr2=0x7f281c1034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 shutdown_connections 2024-02-15T22:48:08.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:08.609+0000 7f2823f00700 1 -- 172.21.15.138:0/270042022 wait complete. 2024-02-15T22:48:08.923 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:08 smithi138 ceph-mon[29229]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:08 smithi170 ceph-mon[35248]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:09.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-15T22:48:09.453 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:09.827 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:09 smithi138 ceph-mon[29229]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:10.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:09 smithi170 ceph-mon[35248]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:10.773 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:10 smithi138 ceph-mon[29229]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:11.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:10 smithi170 ceph-mon[35248]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:11.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 -- 172.21.15.138:0/297237624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 msgr2=0x7f78f81037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/297237624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f81037e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009910 tx=0x7f78ec009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 -- 172.21.15.138:0/297237624 shutdown_connections 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/297237624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f81037e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/297237624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 0x7f78f8100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 -- 172.21.15.138:0/297237624 >> 172.21.15.138:0/297237624 conn(0x7f78f80fa630 msgr2=0x7f78f80fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 -- 172.21.15.138:0/297237624 shutdown_connections 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.131+0000 7f78fe1fd700 1 -- 172.21.15.138:0/297237624 wait complete. 2024-02-15T22:48:11.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 Processor -- start 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 -- start start 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 0x7f78f819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819caa0 con 0x7f78f8101360 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78fe1fd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f819cbe0 con 0x7f78f80fea00 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.132+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60286/0 (socket says 172.21.15.138:60286) 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 -- 172.21.15.138:0/2351393503 learned_addr learned my addr 172.21.15.138:0/2351393503 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f77fe700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 0x7f78f819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 -- 172.21.15.138:0/2351393503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 msgr2=0x7f78f819bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 0x7f78f819bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 -- 172.21.15.138:0/2351393503 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0095f0 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f6ffd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ec01d070 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f78ec00f460 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f81a1630 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ec021640 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.133+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f81a1b20 con 0x7f78f8101360 2024-02-15T22:48:11.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.134+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f81961a0 con 0x7f78f8101360 2024-02-15T22:48:11.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.135+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f78ec00fab0 con 0x7f78f8101360 2024-02-15T22:48:11.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.135+0000 7f78f4ff9700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 0x7f78e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:11.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.135+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f78ec08c810 con 0x7f78f8101360 2024-02-15T22:48:11.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.135+0000 7f78f77fe700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 0x7f78e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:11.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.135+0000 7f78f77fe700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 0x7f78e006eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005950 tx=0x7f78e800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:11.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.139+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f78ec05acc0 con 0x7f78f8101360 2024-02-15T22:48:11.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.338+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f78f8061190 con 0x7f78e006c680 2024-02-15T22:48:11.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.348+0000 7f78f4ff9700 1 -- 172.21.15.138:0/2351393503 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f78f8061190 con 0x7f78e006c680 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (3m) 2m ago 5m 28.6M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (5m) 2m ago 5m 7054k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (4m) 67s ago 4m 6941k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (5m) 2m ago 5m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (4m) 67s ago 4m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (3m) 2m ago 4m 80.1M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.0 dc2bc1663786 8807f70e9831 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (4m) 67s ago 4m 438M - 18.2.0 dc2bc1663786 47b88133c81f 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (6m) 2m ago 6m 50.2M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (4m) 67s ago 4m 42.6M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 2m ago 5m 14.1M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (4m) 67s ago 4m 15.9M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (3m) 2m ago 3m 41.6M 3946M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:48:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (2m) 2m ago 2m 41.5M 3946M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:48:11.351 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (2m) 2m ago 2m 42.2M 3946M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:48:11.351 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (2m) 67s ago 2m 43.5M 4970M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:48:11.351 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (97s) 67s ago 97s 40.8M 4970M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:48:11.351 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (72s) 67s ago 72s 10.4M 4970M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:48:11.351 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (3m) 2m ago 4m 40.4M - 2.43.0 a07b618ecd1d 52e833c326a0 2024-02-15T22:48:11.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 msgr2=0x7f78e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:11.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 0x7f78e006eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78e8005950 tx=0x7f78e800b410 comp rx=0 tx=0).stop 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 msgr2=0x7f78f819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec00bd70 comp rx=0 tx=0).stop 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 shutdown_connections 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f78e006c680 0x7f78e006eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78f80fea00 0x7f78f819bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 --2- 172.21.15.138:0/2351393503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78f8101360 0x7f78f819c480 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.350+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 >> 172.21.15.138:0/2351393503 conn(0x7f78f80fa630 msgr2=0x7f78f80fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.351+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 shutdown_connections 2024-02-15T22:48:11.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:11.351+0000 7f78fe1fd700 1 -- 172.21.15.138:0/2351393503 wait complete. 2024-02-15T22:48:11.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:11 smithi138 ceph-mon[29229]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:12.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:11 smithi170 ceph-mon[35248]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:12.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-15T22:48:12.225 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:12 smithi138 ceph-mon[29229]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:13.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:12 smithi170 ceph-mon[35248]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 -- 172.21.15.138:0/3706288268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec100170 msgr2=0x7fedec100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 --2- 172.21.15.138:0/3706288268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec100170 0x7fedec100580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fede0009910 tx=0x7fede0009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 -- 172.21.15.138:0/3706288268 shutdown_connections 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 --2- 172.21.15.138:0/3706288268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec101370 0x7fedec1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 --2- 172.21.15.138:0/3706288268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec100170 0x7fedec100580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.912+0000 7fedf2b60700 1 -- 172.21.15.138:0/3706288268 >> 172.21.15.138:0/3706288268 conn(0x7fedec0fb6e0 msgr2=0x7fedec0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 -- 172.21.15.138:0/3706288268 shutdown_connections 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 -- 172.21.15.138:0/3706288268 wait complete. 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 Processor -- start 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 -- start start 2024-02-15T22:48:13.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 0x7fedec195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec1964f0 con 0x7fedec101370 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedf2b60700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec196630 con 0x7fedec100170 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedebfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedebfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41582/0 (socket says 172.21.15.138:41582) 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.913+0000 7fedebfff700 1 -- 172.21.15.138:0/1289723722 learned_addr learned my addr 172.21.15.138:0/1289723722 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedf08fc700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 0x7fedec195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedebfff700 1 -- 172.21.15.138:0/1289723722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 msgr2=0x7fedec195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedebfff700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 0x7fedec195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedebfff700 1 -- 172.21.15.138:0/1289723722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00095f0 con 0x7fedec101370 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedf08fc700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 0x7fedec195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedebfff700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedd800d8d0 tx=0x7fedd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd8009940 con 0x7fedec101370 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fedd8010460 con 0x7fedec101370 2024-02-15T22:48:13.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec19b0e0 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd800f5f0 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.914+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec19b630 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.915+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec108cc0 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.915+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fedd80105d0 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.916+0000 7fede9ffb700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 0x7feddc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.916+0000 7fedf08fc700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 0x7feddc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.916+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fedd808b4d0 con 0x7fedec101370 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.916+0000 7fedf08fc700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 0x7feddc06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fede000b5c0 tx=0x7fede0005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:13.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:13.921+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fedd80599a0 con 0x7fedec101370 2024-02-15T22:48:14.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.117+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fedec105cc0 con 0x7feddc06c680 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.122+0000 7fede9ffb700 1 -- 172.21.15.138:0/1289723722 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7fedec105cc0 con 0x7feddc06c680 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter 2/2 2m ago 6m * 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:crash 2/2 2m ago 6m * 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:mgr 2/2 2m ago 6m count:2 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:mon 2/2 2m ago 5m smithi138:172.21.15.138=smithi138;smithi170:172.21.15.170=smithi170;count:2 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:osd 6 2m ago - 2024-02-15T22:48:14.125 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 msgr2=0x7feddc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 0x7feddc06eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fede000b5c0 tx=0x7fede0005e20 comp rx=0 tx=0).stop 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 msgr2=0x7fedec195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedd800d8d0 tx=0x7fedd800dc90 comp rx=0 tx=0).stop 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 shutdown_connections 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feddc06c680 0x7feddc06eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedec100170 0x7fedec195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:14.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 --2- 172.21.15.138:0/1289723722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec101370 0x7fedec195ed0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:14.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 >> 172.21.15.138:0/1289723722 conn(0x7fedec0fb6e0 msgr2=0x7fedec1045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:14.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 shutdown_connections 2024-02-15T22:48:14.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:14.124+0000 7fedf2b60700 1 -- 172.21.15.138:0/1289723722 wait complete. 2024-02-15T22:48:14.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-15T22:48:15.027 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:15.370 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:15 smithi138 ceph-mon[29229]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:15.371 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:15 smithi138 ceph-mon[29229]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:15.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:15 smithi170 ceph-mon[35248]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:15.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:15 smithi170 ceph-mon[35248]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:16.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- 172.21.15.138:0/876288284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 msgr2=0x7f15841006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:16.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 --2- 172.21.15.138:0/876288284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f15841006a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1578009910 tx=0x7f1578009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- 172.21.15.138:0/876288284 shutdown_connections 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 --2- 172.21.15.138:0/876288284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f15841006a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 --2- 172.21.15.138:0/876288284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 0x7f15840ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- 172.21.15.138:0/876288284 >> 172.21.15.138:0/876288284 conn(0x7f15840fa600 msgr2=0x7f15840fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- 172.21.15.138:0/876288284 shutdown_connections 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- 172.21.15.138:0/876288284 wait complete. 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 Processor -- start 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.652+0000 7f158937a700 1 -- start start 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 0x7f15840697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158419ac90 con 0x7f1584100250 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158419add0 con 0x7f15840ff050 2024-02-15T22:48:16.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41600/0 (socket says 172.21.15.138:41600) 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 -- 172.21.15.138:0/1409484005 learned_addr learned my addr 172.21.15.138:0/1409484005 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f1582ffd700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 0x7f15840697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 -- 172.21.15.138:0/1409484005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 msgr2=0x7f15840697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 0x7f15840697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 -- 172.21.15.138:0/1409484005 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780095f0 con 0x7f1584100250 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f15827fc700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15780092e0 tx=0x7f157800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157801d070 con 0x7f1584100250 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f157800f460 con 0x7f1584100250 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578021620 con 0x7f1584100250 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158419b050 con 0x7f1584100250 2024-02-15T22:48:16.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.653+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158419b570 con 0x7f1584100250 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.654+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1584107ba0 con 0x7f1584100250 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.655+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f157800fa70 con 0x7f1584100250 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.655+0000 7f156bfff700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 0x7f156c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.655+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f157808c770 con 0x7f1584100250 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.655+0000 7f1582ffd700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 0x7f156c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:16.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.656+0000 7f1582ffd700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 0x7f156c06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15841000b0 tx=0x7f157400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:16.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.660+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f157805ac20 con 0x7f1584100250 2024-02-15T22:48:16.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.859+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1584104ba0 con 0x7f156c06c680 2024-02-15T22:48:16.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.860+0000 7f156bfff700 1 -- 172.21.15.138:0/1409484005 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f1584104ba0 con 0x7f156c06c680 2024-02-15T22:48:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:HOST ADDR LABELS STATUS 2024-02-15T22:48:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138 172.21.15.138 2024-02-15T22:48:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:smithi170 172.21.15.170 2024-02-15T22:48:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:2 hosts in cluster 2024-02-15T22:48:16.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 msgr2=0x7f156c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:16.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 0x7f156c06eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15841000b0 tx=0x7f157400b410 comp rx=0 tx=0).stop 2024-02-15T22:48:16.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 msgr2=0x7f158419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:16.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15780092e0 tx=0x7f157800bd70 comp rx=0 tx=0).stop 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 shutdown_connections 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f156c06c680 0x7f156c06eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15840ff050 0x7f15840697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 --2- 172.21.15.138:0/1409484005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1584100250 0x7f158419a6c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.862+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 >> 172.21.15.138:0/1409484005 conn(0x7f15840fa600 msgr2=0x7f1584103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.863+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 shutdown_connections 2024-02-15T22:48:16.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:16.863+0000 7f158937a700 1 -- 172.21.15.138:0/1409484005 wait complete. 2024-02-15T22:48:17.195 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:17 smithi138 ceph-mon[29229]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:17 smithi170 ceph-mon[35248]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:17.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-15T22:48:17.752 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:18.219 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:18 smithi138 ceph-mon[29229]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:18.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:18 smithi170 ceph-mon[35248]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:19.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:19 smithi138 ceph-mon[29229]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:19.226 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- 172.21.15.138:0/4291011413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 msgr2=0x7f09b4073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 --2- 172.21.15.138:0/4291011413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4073ba0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09a4009910 tx=0x7f09a4009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- 172.21.15.138:0/4291011413 shutdown_connections 2024-02-15T22:48:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 --2- 172.21.15.138:0/4291011413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4073ba0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 --2- 172.21.15.138:0/4291011413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 0x7f09b4073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- 172.21.15.138:0/4291011413 >> 172.21.15.138:0/4291011413 conn(0x7f09b40fb720 msgr2=0x7f09b40fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- 172.21.15.138:0/4291011413 shutdown_connections 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- 172.21.15.138:0/4291011413 wait complete. 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 Processor -- start 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.451+0000 7f09bc558700 1 -- start start 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 0x7f09b4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b41986a0 con 0x7f09b4073730 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b41987e0 con 0x7f09b4074d00 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41620/0 (socket says 172.21.15.138:41620) 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 -- 172.21.15.138:0/4237398703 learned_addr learned my addr 172.21.15.138:0/4237398703 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09b9af3700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 0x7f09b4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:19.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 -- 172.21.15.138:0/4237398703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 msgr2=0x7f09b4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 0x7f09b4198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 -- 172.21.15.138:0/4237398703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40095f0 con 0x7f09b4073730 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ba2f4700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09b000c8a0 tx=0x7f09b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09b00078e0 con 0x7f09b4073730 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09b000f450 con 0x7f09b4073730 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b419d290 con 0x7f09b4073730 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09b000e5e0 con 0x7f09b4073730 2024-02-15T22:48:19.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.452+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b419d7e0 con 0x7f09b4073730 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.453+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b410aec0 con 0x7f09b4073730 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.454+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f09b000f5c0 con 0x7f09b4073730 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.454+0000 7f09ab7fe700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 0x7f09a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.454+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f09b008b540 con 0x7f09b4073730 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.454+0000 7f09b9af3700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 0x7f09a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:19.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.454+0000 7f09b9af3700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 0x7f09a006eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:19.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.458+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f09b00599f0 con 0x7f09b4073730 2024-02-15T22:48:19.510 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:19 smithi170 ceph-mon[35248]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:19.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.659+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f09b4107710 con 0x7f09a006c680 2024-02-15T22:48:19.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.661+0000 7f09ab7fe700 1 -- 172.21.15.138:0/4237398703 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f09b4107710 con 0x7f09a006c680 2024-02-15T22:48:19.663 INFO:teuthology.orchestra.run.smithi138.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-15T22:48:19.663 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6161003C400BGN 372G No 2m ago LVM detected, locked 2024-02-15T22:48:19.664 INFO:teuthology.orchestra.run.smithi138.stdout:smithi170 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002R480DGN 447G No 72s ago LVM detected, locked 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 msgr2=0x7f09a006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 0x7f09a006eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09a4006010 tx=0x7f09a400b540 comp rx=0 tx=0).stop 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 msgr2=0x7f09b4197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f09b000c8a0 tx=0x7f09b000cbb0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 shutdown_connections 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f09a006c680 0x7f09a006eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b4073730 0x7f09b4197b40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 --2- 172.21.15.138:0/4237398703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b4074d00 0x7f09b4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 >> 172.21.15.138:0/4237398703 conn(0x7f09b40fb720 msgr2=0x7f09b4105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 shutdown_connections 2024-02-15T22:48:19.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:19.663+0000 7f09bc558700 1 -- 172.21.15.138:0/4237398703 wait complete. 2024-02-15T22:48:20.294 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:20.326 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:20.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-15T22:48:20.534 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:21.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:21 smithi138 ceph-mon[29229]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:21 smithi138 ceph-mon[29229]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:21 smithi170 ceph-mon[35248]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:21 smithi170 ceph-mon[35248]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 -- 172.21.15.138:0/2556711787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 msgr2=0x7fe928101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 --2- 172.21.15.138:0/2556711787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928101bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe924009910 tx=0x7fe924009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 -- 172.21.15.138:0/2556711787 shutdown_connections 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 --2- 172.21.15.138:0/2556711787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe9280fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 --2- 172.21.15.138:0/2556711787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928101bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.246+0000 7fe92fa77700 1 -- 172.21.15.138:0/2556711787 >> 172.21.15.138:0/2556711787 conn(0x7fe9280f9dd0 msgr2=0x7fe9280fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 -- 172.21.15.138:0/2556711787 shutdown_connections 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 -- 172.21.15.138:0/2556711787 wait complete. 2024-02-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 Processor -- start 2024-02-15T22:48:22.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 -- start start 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe928195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928196590 con 0x7fe9281017a0 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.247+0000 7fe92fa77700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9281966d0 con 0x7fe928102180 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41642/0 (socket says 172.21.15.138:41642) 2024-02-15T22:48:22.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 -- 172.21.15.138:0/1347786221 learned_addr learned my addr 172.21.15.138:0/1347786221 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 -- 172.21.15.138:0/1347786221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 msgr2=0x7fe928195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d012700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe928195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe928195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 -- 172.21.15.138:0/1347786221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240095f0 con 0x7fe9281017a0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d012700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe928195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92d813700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe92400bda0 tx=0x7fe92400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92401d070 con 0x7fe9281017a0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe92400f460 con 0x7fe9281017a0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92819b120 con 0x7fe9281017a0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe924017630 con 0x7fe9281017a0 2024-02-15T22:48:22.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.248+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92819b610 con 0x7fe9281017a0 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.250+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe928108d30 con 0x7fe9281017a0 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.250+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fe92400fad0 con 0x7fe9281017a0 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.250+0000 7fe91effd700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 0x7fe91406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.251+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe92408c960 con 0x7fe9281017a0 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.251+0000 7fe92d012700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 0x7fe91406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:22.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.251+0000 7fe92d012700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 0x7fe91406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe918005d90 tx=0x7fe918005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:22.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.258+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe92405ae10 con 0x7fe9281017a0 2024-02-15T22:48:22.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:22.473+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe92819bd60 con 0x7fe91406c680 2024-02-15T22:48:23.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:23 smithi138 ceph-mon[29229]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:23.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:23 smithi138 ceph-mon[29229]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:23.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:23 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T22:48:23.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:23 smithi170 ceph-mon[35248]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:23.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:23 smithi170 ceph-mon[35248]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:48:23.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:23 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T22:48:24.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.131+0000 7fe91effd700 1 -- 172.21.15.138:0/1347786221 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe92819bd60 con 0x7fe91406c680 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 msgr2=0x7fe91406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 0x7fe91406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe918005d90 tx=0x7fe918005d20 comp rx=0 tx=0).stop 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 msgr2=0x7fe928195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe92400bda0 tx=0x7fe92400be80 comp rx=0 tx=0).stop 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 shutdown_connections 2024-02-15T22:48:24.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fe91406c680 0x7fe91406eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:24.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9281017a0 0x7fe928195a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:24.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 --2- 172.21.15.138:0/1347786221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe928102180 0x7fe928195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:24.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 >> 172.21.15.138:0/1347786221 conn(0x7fe9280f9dd0 msgr2=0x7fe928104770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:24.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 shutdown_connections 2024-02-15T22:48:24.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:24.134+0000 7fe92fa77700 1 -- 172.21.15.138:0/1347786221 wait complete. 2024-02-15T22:48:24.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:24 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T22:48:24.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:24 smithi138 ceph-mon[29229]: osdmap e41: 6 total, 6 up, 6 in 2024-02-15T22:48:24.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:24 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:48:24.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[29225]: 2024-02-15T22:48:24.114+0000 7ffbbedd3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:48:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:24 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T22:48:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:24 smithi170 ceph-mon[35248]: osdmap e41: 6 total, 6 up, 6 in 2024-02-15T22:48:24.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:24 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:48:24.900 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T22:48:25.114 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: pgmap v174: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: osdmap e42: 6 total, 6 up, 6 in 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: osdmap e43: 6 total, 6 up, 6 in 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: fsmap cephfs:0 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: Saving service mds.cephfs spec with placement count:4 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:25 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: pgmap v174: 33 pgs: 7 creating+peering, 1 active+clean, 25 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: osdmap e42: 6 total, 6 up, 6 in 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: osdmap e43: 6 total, 6 up, 6 in 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: fsmap cephfs:0 2024-02-15T22:48:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: Saving service mds.cephfs spec with placement count:4 2024-02-15T22:48:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:25 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:26.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:26.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:26.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:26.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: osdmap e44: 6 total, 6 up, 6 in 2024-02-15T22:48:26.388 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:26.389 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:26.389 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:26.389 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:26 smithi138 ceph-mon[29229]: Deploying daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: osdmap e44: 6 total, 6 up, 6 in 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:26.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:26 smithi170 ceph-mon[35248]: Deploying daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 -- 172.21.15.138:0/210204642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 msgr2=0x7f23d0103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/210204642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0103040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00b0a0 tx=0x7f23cc00b3b0 comp rx=0 tx=0).stop 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 -- 172.21.15.138:0/210204642 shutdown_connections 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/210204642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/210204642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0103040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 -- 172.21.15.138:0/210204642 >> 172.21.15.138:0/210204642 conn(0x7f23d00fa600 msgr2=0x7f23d00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 -- 172.21.15.138:0/210204642 shutdown_connections 2024-02-15T22:48:26.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.814+0000 7f23d6f6e700 1 -- 172.21.15.138:0/210204642 wait complete. 2024-02-15T22:48:26.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 Processor -- start 2024-02-15T22:48:26.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 -- start start 2024-02-15T22:48:26.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:26.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0196580 con 0x7f23d0100c60 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d6f6e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d01966c0 con 0x7f23d0103580 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40896/0 (socket says 172.21.15.138:40896) 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 -- 172.21.15.138:0/3579483948 learned_addr learned my addr 172.21.15.138:0/3579483948 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23c7fff700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 -- 172.21.15.138:0/3579483948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 msgr2=0x7f23d0195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 -- 172.21.15.138:0/3579483948 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009d00 con 0x7f23d0100c60 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23c7fff700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.815+0000 7f23d4d0a700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0077b0 tx=0x7f23cc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.816+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23cc00e040 con 0x7f23d0100c60 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.816+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d019b110 con 0x7f23d0100c60 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.816+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23cc00ce60 con 0x7f23d0100c60 2024-02-15T22:48:26.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.816+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23cc01daf0 con 0x7f23d0100c60 2024-02-15T22:48:26.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.816+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d019b680 con 0x7f23d0100c60 2024-02-15T22:48:26.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.817+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d018fbf0 con 0x7f23d0100c60 2024-02-15T22:48:26.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.817+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f23cc004250 con 0x7f23d0100c60 2024-02-15T22:48:26.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.818+0000 7f23c5ffb700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 0x7f23b806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:26.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.818+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f23cc08d270 con 0x7f23d0100c60 2024-02-15T22:48:26.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.818+0000 7f23c7fff700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 0x7f23b806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:26.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.818+0000 7f23c7fff700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 0x7f23b806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c0007900 tx=0x7f23c0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:26.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:26.822+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f23cc05b460 con 0x7f23d0100c60 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.059+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23d002cc30 con 0x7f23d0100c60 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.059+0000 7f23c5ffb700 1 -- 172.21.15.138:0/3579483948 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f23cc05aff0 con 0x7f23d0100c60 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stdout:e2 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:27.061 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 2 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:48:24.115557+0000 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 0 2024-02-15T22:48:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 1 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:in 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:up {} 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 0 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:27.063 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 msgr2=0x7f23b806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 0x7f23b806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23c0007900 tx=0x7f23c0008040 comp rx=0 tx=0).stop 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 msgr2=0x7f23d0195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0077b0 tx=0x7f23cc003ce0 comp rx=0 tx=0).stop 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 shutdown_connections 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f23b806c680 0x7f23b806eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23d0100c60 0x7f23d0195a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:27.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 --2- 172.21.15.138:0/3579483948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23d0103580 0x7f23d0195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:27.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 >> 172.21.15.138:0/3579483948 conn(0x7f23d00fa600 msgr2=0x7f23d00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:27.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 shutdown_connections 2024-02-15T22:48:27.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:27.061+0000 7f23d6f6e700 1 -- 172.21.15.138:0/3579483948 wait complete. 2024-02-15T22:48:27.065 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 2 2024-02-15T22:48:27.270 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:27 smithi138 ceph-mon[29229]: pgmap v178: 65 pgs: 7 creating+peering, 10 active+clean, 48 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:27.270 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:27 smithi138 ceph-mon[29229]: osdmap e45: 6 total, 6 up, 6 in 2024-02-15T22:48:27.270 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:27 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3579483948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:27 smithi170 ceph-mon[35248]: pgmap v178: 65 pgs: 7 creating+peering, 10 active+clean, 48 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:27 smithi170 ceph-mon[35248]: osdmap e45: 6 total, 6 up, 6 in 2024-02-15T22:48:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:27 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3579483948' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:28.121 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:28.130 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:28.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-15T22:48:28.676 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:28.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:28 smithi138 ceph-mon[29229]: pgmap v180: 65 pgs: 7 creating+peering, 53 active+clean, 5 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:29.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:28 smithi170 ceph-mon[35248]: pgmap v180: 65 pgs: 7 creating+peering, 53 active+clean, 5 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:30.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 -- 172.21.15.138:0/3970704394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e140fe410 msgr2=0x7f6e140fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/3970704394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e140fe410 0x7f6e140fe820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b0a0 tx=0x7f6e0c00b3b0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 -- 172.21.15.138:0/3970704394 shutdown_connections 2024-02-15T22:48:30.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/3970704394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e141013f0 0x7f6e14101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/3970704394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e140fe410 0x7f6e140fe820 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 -- 172.21.15.138:0/3970704394 >> 172.21.15.138:0/3970704394 conn(0x7f6e140f9d80 msgr2=0x7f6e140fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 -- 172.21.15.138:0/3970704394 shutdown_connections 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.372+0000 7f6e19d4c700 1 -- 172.21.15.138:0/3970704394 wait complete. 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 Processor -- start 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 -- start start 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e140fe410 0x7f6e14195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141964e0 con 0x7f6e141013f0 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e19d4c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14196620 con 0x7f6e140fe410 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40918/0 (socket says 172.21.15.138:40918) 2024-02-15T22:48:30.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 -- 172.21.15.138:0/2034059741 learned_addr learned my addr 172.21.15.138:0/2034059741 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e137fe700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e140fe410 0x7f6e14195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 -- 172.21.15.138:0/2034059741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e140fe410 msgr2=0x7f6e14195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e140fe410 0x7f6e14195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.373+0000 7f6e12ffd700 1 -- 172.21.15.138:0/2034059741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c009d00 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e12ffd700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d8d0 tx=0x7f6e0800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e080098a0 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1419b0d0 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e08010460 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0800f5f0 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.374+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1419b6a0 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.375+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14108c90 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.375+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f6e08009a00 con 0x7f6e141013f0 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.376+0000 7f6e10ff9700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 0x7f6dfc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:30.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.376+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6e0808b760 con 0x7f6e141013f0 2024-02-15T22:48:30.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.376+0000 7f6e137fe700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 0x7f6dfc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:30.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.376+0000 7f6e137fe700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 0x7f6dfc06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b830 tx=0x7f6e0c0060c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:30.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.380+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6e080598d0 con 0x7f6e141013f0 2024-02-15T22:48:30.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:30.617+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f6e1419c0e0 con 0x7f6e141013f0 2024-02-15T22:48:31.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.091+0000 7f6e10ff9700 1 -- 172.21.15.138:0/2034059741 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v3) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6e08059460 con 0x7f6e141013f0 2024-02-15T22:48:31.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 msgr2=0x7f6dfc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 0x7f6dfc06eb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00b830 tx=0x7f6e0c0060c0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 msgr2=0x7f6e14195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d8d0 tx=0x7f6e0800dbe0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 shutdown_connections 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f6dfc06c680 0x7f6dfc06eb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e140fe410 0x7f6e14195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 --2- 172.21.15.138:0/2034059741 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e141013f0 0x7f6e14195ec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 >> 172.21.15.138:0/2034059741 conn(0x7f6e140f9d80 msgr2=0x7f6e14104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 shutdown_connections 2024-02-15T22:48:31.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:31.094+0000 7f6e19d4c700 1 -- 172.21.15.138:0/2034059741 wait complete. 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2034059741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:31.393 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:31.394 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:31 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: pgmap v181: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2034059741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:31.418 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:31 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:31.773 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:31.783 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:31.784 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-15T22:48:31.994 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:32.382 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: Deploying daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2034059741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6826/2782905632,v1:172.21.15.138:6827/2782905632] up:boot 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: daemon mds.cephfs.smithi138.bnqzne assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: fsmap cephfs:0 1 up:standby 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:creating} 2024-02-15T22:48:32.383 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:32 smithi170 ceph-mon[35248]: daemon mds.cephfs.smithi138.bnqzne is now active in filesystem cephfs as rank 0 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: Deploying daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2034059741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6826/2782905632,v1:172.21.15.138:6827/2782905632] up:boot 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: daemon mds.cephfs.smithi138.bnqzne assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: fsmap cephfs:0 1 up:standby 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:creating} 2024-02-15T22:48:32.405 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:32 smithi138 ceph-mon[29229]: daemon mds.cephfs.smithi138.bnqzne is now active in filesystem cephfs as rank 0 2024-02-15T22:48:33.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:33 smithi170 ceph-mon[35248]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 129 B/s wr, 0 op/s 2024-02-15T22:48:33.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:33 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6826/2782905632,v1:172.21.15.138:6827/2782905632] up:active 2024-02-15T22:48:33.404 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:33 smithi170 ceph-mon[35248]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:active} 2024-02-15T22:48:33.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:33 smithi138 ceph-mon[29229]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 129 B/s wr, 0 op/s 2024-02-15T22:48:33.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:33 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6826/2782905632,v1:172.21.15.138:6827/2782905632] up:active 2024-02-15T22:48:33.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:33 smithi138 ceph-mon[29229]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:active} 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 -- 172.21.15.138:0/2526070330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 msgr2=0x7fbd30100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2526070330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30100540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009910 tx=0x7fbd20009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 -- 172.21.15.138:0/2526070330 shutdown_connections 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2526070330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd30101330 0x7fbd30101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2526070330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30100540 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:33.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 -- 172.21.15.138:0/2526070330 >> 172.21.15.138:0/2526070330 conn(0x7fbd300fb6e0 msgr2=0x7fbd300fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 -- 172.21.15.138:0/2526070330 shutdown_connections 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 -- 172.21.15.138:0/2526070330 wait complete. 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.933+0000 7fbd368bc700 1 Processor -- start 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd368bc700 1 -- start start 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd368bc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd368bc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd30101330 0x7fbd30195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd368bc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30196590 con 0x7fbd30100130 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd368bc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301966d0 con 0x7fbd30101330 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43102/0 (socket says 172.21.15.138:43102) 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 -- 172.21.15.138:0/2262013199 learned_addr learned my addr 172.21.15.138:0/2262013199 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 -- 172.21.15.138:0/2262013199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd30101330 msgr2=0x7fbd30195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd30101330 0x7fbd30195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 -- 172.21.15.138:0/2262013199 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200095f0 con 0x7fbd30100130 2024-02-15T22:48:33.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2ffff700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000bd70 tx=0x7fbd2000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.934+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd2001d070 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.935+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3019b120 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.935+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbd20022470 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.935+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd2000f690 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.935+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3019b690 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.935+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30108d00 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.936+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fbd200225e0 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.936+0000 7fbd2d7fa700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 0x7fbd1806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.936+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fbd2008d000 con 0x7fbd30100130 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.936+0000 7fbd2f7fe700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 0x7fbd1806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:33.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.937+0000 7fbd2f7fe700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 0x7fbd1806eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd240097b0 tx=0x7fbd24006d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:33.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:33.941+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbd2005b1f0 con 0x7fbd30100130 2024-02-15T22:48:34.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:34.195+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fbd30108f20 con 0x7fbd30100130 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: Deploying daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T22:48:34.711 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:boot 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: daemon mds.cephfs.smithi170.banvev assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:active} 1 up:standby 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:creating} 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: daemon mds.cephfs.smithi170.banvev is now active in filesystem cephfs as rank 1 2024-02-15T22:48:34.712 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:34 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2262013199' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: Deploying daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:boot 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: daemon mds.cephfs.smithi170.banvev assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T22:48:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T22:48:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: fsmap cephfs:1 {0=cephfs.smithi138.bnqzne=up:active} 1 up:standby 2024-02-15T22:48:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:48:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:creating} 2024-02-15T22:48:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: daemon mds.cephfs.smithi170.banvev is now active in filesystem cephfs as rank 1 2024-02-15T22:48:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:34 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2262013199' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-15T22:48:35.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.114+0000 7fbd2d7fa700 1 -- 172.21.15.138:0/2262013199 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7fbd2005ad80 con 0x7fbd30100130 2024-02-15T22:48:35.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.116+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 msgr2=0x7fbd1806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:35.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.116+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 0x7fbd1806eb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd240097b0 tx=0x7fbd24006d20 comp rx=0 tx=0).stop 2024-02-15T22:48:35.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.116+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 msgr2=0x7fbd30195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.116+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000bd70 tx=0x7fbd2000be50 comp rx=0 tx=0).stop 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 shutdown_connections 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fbd1806c680 0x7fbd1806eb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd30100130 0x7fbd30195a30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 --2- 172.21.15.138:0/2262013199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd30101330 0x7fbd30195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 >> 172.21.15.138:0/2262013199 conn(0x7fbd300fb6e0 msgr2=0x7fbd30104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 shutdown_connections 2024-02-15T22:48:35.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:35.117+0000 7fbd368bc700 1 -- 172.21.15.138:0/2262013199 wait complete. 2024-02-15T22:48:35.700 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:35 smithi138 ceph-mon[29229]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 689 B/s wr, 4 op/s 2024-02-15T22:48:35.700 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:35 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:active 2024-02-15T22:48:35.700 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:35 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2262013199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-15T22:48:35.700 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:35 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2024-02-15T22:48:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:35 smithi170 ceph-mon[35248]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 689 B/s wr, 4 op/s 2024-02-15T22:48:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:35 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:active 2024-02-15T22:48:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:35 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2262013199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-15T22:48:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:35 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2024-02-15T22:48:36.105 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:36.115 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:36.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-15T22:48:36.796 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:37.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:37.625 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:37 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:37.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T22:48:37.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:37 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 -- 172.21.15.138:0/960065411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf500ff050 msgr2=0x7faf500ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 --2- 172.21.15.138:0/960065411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf500ff050 0x7faf500ff460 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf40009910 tx=0x7faf40009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 -- 172.21.15.138:0/960065411 shutdown_connections 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 --2- 172.21.15.138:0/960065411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf50100250 0x7faf501006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 --2- 172.21.15.138:0/960065411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf500ff050 0x7faf500ff460 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 -- 172.21.15.138:0/960065411 >> 172.21.15.138:0/960065411 conn(0x7faf500fa5e0 msgr2=0x7faf500fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 -- 172.21.15.138:0/960065411 shutdown_connections 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.566+0000 7faf56a10700 1 -- 172.21.15.138:0/960065411 wait complete. 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 Processor -- start 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 -- start start 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf500ff050 0x7faf501959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50196500 con 0x7faf50100250 2024-02-15T22:48:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf56a10700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50196640 con 0x7faf500ff050 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf500ff050 0x7faf501959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43140/0 (socket says 172.21.15.138:43140) 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 -- 172.21.15.138:0/3068615390 learned_addr learned my addr 172.21.15.138:0/3068615390 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 -- 172.21.15.138:0/3068615390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf500ff050 msgr2=0x7faf501959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf500ff050 0x7faf501959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.567+0000 7faf4f7fe700 1 -- 172.21.15.138:0/3068615390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf400095f0 con 0x7faf50100250 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf4f7fe700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d8d0 tx=0x7faf4400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf440098a0 con 0x7faf50100250 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf44010460 con 0x7faf50100250 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5019b0f0 con 0x7faf50100250 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4400f5f0 con 0x7faf50100250 2024-02-15T22:48:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.568+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5019b640 con 0x7faf50100250 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: Deploying daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: Cluster is now healthy 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:boot 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:48:38.572 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:38 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 2024-02-15T22:48:38.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.569+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf50107ba0 con 0x7faf50100250 2024-02-15T22:48:38.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.569+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7faf44009a00 con 0x7faf50100250 2024-02-15T22:48:38.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.570+0000 7faf4d7fa700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 0x7faf3806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:38.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.570+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7faf4408b760 con 0x7faf50100250 2024-02-15T22:48:38.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.570+0000 7faf4ffff700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 0x7faf3806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.570+0000 7faf4ffff700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 0x7faf3806eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf40006010 tx=0x7faf40005ec0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:38.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.574+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf440598d0 con 0x7faf50100250 2024-02-15T22:48:38.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: Deploying daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: Cluster is now healthy 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:boot 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:48:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:38 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 2024-02-15T22:48:38.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:38.812+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7faf5019bc80 con 0x7faf50100250 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 6 op/s 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3068615390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s wr, 6 op/s 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3068615390' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:39.646 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:39.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.723+0000 7faf4d7fa700 1 -- 172.21.15.138:0/3068615390 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7faf44059460 con 0x7faf50100250 2024-02-15T22:48:39.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 msgr2=0x7faf3806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:39.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 0x7faf3806eb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf40006010 tx=0x7faf40005ec0 comp rx=0 tx=0).stop 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 msgr2=0x7faf50195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d8d0 tx=0x7faf4400dbe0 comp rx=0 tx=0).stop 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 shutdown_connections 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf3806c680 0x7faf3806eb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf500ff050 0x7faf501959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 --2- 172.21.15.138:0/3068615390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf50100250 0x7faf50195ee0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.726+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 >> 172.21.15.138:0/3068615390 conn(0x7faf500fa5e0 msgr2=0x7faf500683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.727+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 shutdown_connections 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:39.727+0000 7faf56a10700 1 -- 172.21.15.138:0/3068615390 wait complete. 2024-02-15T22:48:39.729 INFO:teuthology.orchestra.run.smithi138.stderr:inline data disabled 2024-02-15T22:48:40.373 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T22:48:40.383 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:48:40.383 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T22:48:40.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3068615390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T22:48:40.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] up:boot 2024-02-15T22:48:40.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:40.887 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:48:40.888 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:40.888 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:40 smithi138 ceph-mon[29229]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3068615390' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] up:boot 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:41.007 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:40 smithi170 ceph-mon[35248]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-02-15T22:48:41.184 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:standby-replay 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: Dropping low affinity active daemon mds.cephfs.smithi138.bnqzne in favor of higher affinity standby. 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: Replacing daemon mds.cephfs.smithi138.bnqzne as rank 0 with standby daemon mds.cephfs.smithi138.fzypgq 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: osdmap e46: 6 total, 6 up, 6 in 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:replay,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:41 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:standby-replay 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: Dropping low affinity active daemon mds.cephfs.smithi138.bnqzne in favor of higher affinity standby. 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: Replacing daemon mds.cephfs.smithi138.bnqzne as rank 0 with standby daemon mds.cephfs.smithi138.fzypgq 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: osdmap e46: 6 total, 6 up, 6 in 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:replay,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:41 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- 172.21.15.138:0/3913904646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228100c70 msgr2=0x7f2228103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 --2- 172.21.15.138:0/3913904646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228100c70 0x7f2228103050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f221c009910 tx=0x7f221c009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- 172.21.15.138:0/3913904646 shutdown_connections 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 --2- 172.21.15.138:0/3913904646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228103590 0x7f2228105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 --2- 172.21.15.138:0/3913904646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228100c70 0x7f2228103050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- 172.21.15.138:0/3913904646 >> 172.21.15.138:0/3913904646 conn(0x7f22280fa630 msgr2=0x7f22280fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- 172.21.15.138:0/3913904646 shutdown_connections 2024-02-15T22:48:42.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- 172.21.15.138:0/3913904646 wait complete. 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 Processor -- start 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.932+0000 7f222ef85700 1 -- start start 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 0x7f2228195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281964c0 con 0x7f2228103590 2024-02-15T22:48:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228196600 con 0x7f2228100c70 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43180/0 (socket says 172.21.15.138:43180) 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 -- 172.21.15.138:0/2274284350 learned_addr learned my addr 172.21.15.138:0/2274284350 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222cd21700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 0x7f2228195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 -- 172.21.15.138:0/2274284350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 msgr2=0x7f2228195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 0x7f2228195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 -- 172.21.15.138:0/2274284350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0095f0 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222cd21700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 0x7f2228195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2227fff700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f221400e920 tx=0x7f221400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2214009790 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222819b0b0 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f221400cba0 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2214018630 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.933+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222819b600 con 0x7f2228103590 2024-02-15T22:48:42.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.934+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222818fba0 con 0x7f2228103590 2024-02-15T22:48:42.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.935+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f221400cd10 con 0x7f2228103590 2024-02-15T22:48:42.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.935+0000 7f2225ffb700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 0x7f221806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:42.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.935+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2214014070 con 0x7f2228103590 2024-02-15T22:48:42.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.935+0000 7f222cd21700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 0x7f221806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:42.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.936+0000 7f222cd21700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 0x7f221806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f221c000c00 tx=0x7f221c009f70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:42.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:42.940+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2214051720 con 0x7f2228103590 2024-02-15T22:48:42.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:42 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] up:boot 2024-02-15T22:48:42.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:42 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:resolve 2024-02-15T22:48:42.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:42 smithi138 ceph-mon[29229]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:resolve,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:42 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:48:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:42 smithi138 ceph-mon[29229]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-02-15T22:48:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:42 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] up:boot 2024-02-15T22:48:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:42 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:resolve 2024-02-15T22:48:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:42 smithi170 ceph-mon[35248]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:resolve,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:42 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:48:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:42 smithi170 ceph-mon[35248]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 818 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-02-15T22:48:43.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.183+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f222802cc30 con 0x7f2228103590 2024-02-15T22:48:43.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.183+0000 7f2225ffb700 1 -- 172.21.15.138:0/2274284350 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f2214059c40 con 0x7f2228103590 2024-02-15T22:48:43.185 INFO:teuthology.orchestra.run.smithi138.stdout:e16 2024-02-15T22:48:43.185 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 16 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:48:42.735575+0000 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:48:43.186 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:reconnect seq 4 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:43.188 INFO:teuthology.orchestra.run.smithi138.stdout:Standby daemons: 2024-02-15T22:48:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:43.188 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{-1:14486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 msgr2=0x7f221806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 0x7f221806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f221c000c00 tx=0x7f221c009f70 comp rx=0 tx=0).stop 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 msgr2=0x7f2228195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f221400e920 tx=0x7f221400ece0 comp rx=0 tx=0).stop 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 shutdown_connections 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f221806c680 0x7f221806eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2228100c70 0x7f2228195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 --2- 172.21.15.138:0/2274284350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2228103590 0x7f2228195ea0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.185+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 >> 172.21.15.138:0/2274284350 conn(0x7f22280fa630 msgr2=0x7f22280fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.186+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 shutdown_connections 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:43.186+0000 7f222ef85700 1 -- 172.21.15.138:0/2274284350 wait complete. 2024-02-15T22:48:43.189 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 16 2024-02-15T22:48:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:43 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:reconnect 2024-02-15T22:48:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:43 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:active 2024-02-15T22:48:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:43 smithi138 ceph-mon[29229]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:reconnect,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:43 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2274284350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:44.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:43 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:reconnect 2024-02-15T22:48:44.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:43 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] up:active 2024-02-15T22:48:44.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:43 smithi170 ceph-mon[35248]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:reconnect,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:43 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2274284350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:48:44.370 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:rejoin 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] up:standby-replay 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:rejoin,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: daemon mds.cephfs.smithi138.fzypgq is now active in filesystem cephfs as rank 0 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:48:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:44 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:rejoin 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] up:standby-replay 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: fsmap cephfs:2/2 {0=cephfs.smithi138.fzypgq=up:rejoin,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: daemon mds.cephfs.smithi138.fzypgq is now active in filesystem cephfs as rank 0 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-02-15T22:48:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:44 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:45.461 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:46.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:45 smithi170 ceph-mon[35248]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T22:48:46.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:45 smithi170 ceph-mon[35248]: Cluster is now healthy 2024-02-15T22:48:46.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:45 smithi170 ceph-mon[35248]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:active 2024-02-15T22:48:46.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:45 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:46.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:45 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:46.101 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:45 smithi138 ceph-mon[29229]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T22:48:46.101 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:45 smithi138 ceph-mon[29229]: Cluster is now healthy 2024-02-15T22:48:46.101 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:45 smithi138 ceph-mon[29229]: mds.? [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] up:active 2024-02-15T22:48:46.101 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:45 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 1 up:standby-replay 1 up:standby 2024-02-15T22:48:46.101 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:45 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:48:47.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:46 smithi170 ceph-mon[35248]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-15T22:48:47.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:46 smithi138 ceph-mon[29229]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 -- 172.21.15.138:0/438987084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70103540 msgr2=0x7faf70105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 --2- 172.21.15.138:0/438987084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70103540 0x7faf70105920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faf64009910 tx=0x7faf64009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 -- 172.21.15.138:0/438987084 shutdown_connections 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 --2- 172.21.15.138:0/438987084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70103540 0x7faf70105920 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 --2- 172.21.15.138:0/438987084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70100c20 0x7faf70103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 -- 172.21.15.138:0/438987084 >> 172.21.15.138:0/438987084 conn(0x7faf700fa5c0 msgr2=0x7faf700fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 -- 172.21.15.138:0/438987084 shutdown_connections 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.154+0000 7faf74856700 1 -- 172.21.15.138:0/438987084 wait complete. 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 Processor -- start 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 -- start start 2024-02-15T22:48:48.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70103540 0x7faf70195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf70196500 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf74856700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf70196640 con 0x7faf70103540 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf6e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf6e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50458/0 (socket says 172.21.15.138:50458) 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf6e59c700 1 -- 172.21.15.138:0/1448760124 learned_addr learned my addr 172.21.15.138:0/1448760124 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.155+0000 7faf6dd9b700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70103540 0x7faf70195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf6e59c700 1 -- 172.21.15.138:0/1448760124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70103540 msgr2=0x7faf70195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf6e59c700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70103540 0x7faf70195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf6e59c700 1 -- 172.21.15.138:0/1448760124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640095f0 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf6e59c700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b4b0 tx=0x7faf6000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf60011800 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7019b0f0 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faf60011e10 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6000f2e0 con 0x7faf70100c20 2024-02-15T22:48:48.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.156+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7019b6c0 con 0x7faf70100c20 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.157+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7018fbf0 con 0x7faf70100c20 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.157+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7faf60011960 con 0x7faf70100c20 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.158+0000 7faf5f7fe700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 0x7faf5806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.158+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faf6008b4b0 con 0x7faf70100c20 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.158+0000 7faf6dd9b700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 0x7faf5806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.158+0000 7faf6dd9b700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 0x7faf5806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf64006010 tx=0x7faf6400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:48.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.162+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7faf600595c0 con 0x7faf70100c20 2024-02-15T22:48:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.406+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf7002d0c0 con 0x7faf70100c20 2024-02-15T22:48:48.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.407+0000 7faf5f7fe700 1 -- 172.21.15.138:0/1448760124 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4782 (secure 0 0 0) 0x7faf60059150 con 0x7faf70100c20 2024-02-15T22:48:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 msgr2=0x7faf5806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 0x7faf5806eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf64006010 tx=0x7faf6400b540 comp rx=0 tx=0).stop 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 msgr2=0x7faf701959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b4b0 tx=0x7faf6000b7c0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 shutdown_connections 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7faf5806c680 0x7faf5806eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf70100c20 0x7faf701959a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 --2- 172.21.15.138:0/1448760124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf70103540 0x7faf70195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 >> 172.21.15.138:0/1448760124 conn(0x7faf700fa5c0 msgr2=0x7faf700fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 shutdown_connections 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:48.410+0000 7faf74856700 1 -- 172.21.15.138:0/1448760124 wait complete. 2024-02-15T22:48:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 19 2024-02-15T22:48:48.422 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:48:49.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-15T22:48:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 409 B/s wr, 12 op/s 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1448760124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:49 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:49.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 409 B/s wr, 12 op/s 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1448760124' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:49 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:48:49.874 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:51.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.553+0000 7f34f83ca700 1 -- 172.21.15.138:0/3269739283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0100150 msgr2=0x7f34f0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:51.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.553+0000 7f34f83ca700 1 --2- 172.21.15.138:0/3269739283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0100150 0x7f34f0100560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009910 tx=0x7f34ec009c20 comp rx=0 tx=0).stop 2024-02-15T22:48:51.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- 172.21.15.138:0/3269739283 shutdown_connections 2024-02-15T22:48:51.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 --2- 172.21.15.138:0/3269739283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0101350 0x7f34f01017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 --2- 172.21.15.138:0/3269739283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0100150 0x7f34f0100560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- 172.21.15.138:0/3269739283 >> 172.21.15.138:0/3269739283 conn(0x7f34f00fb6e0 msgr2=0x7f34f00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- 172.21.15.138:0/3269739283 shutdown_connections 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- 172.21.15.138:0/3269739283 wait complete. 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 Processor -- start 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- start start 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0100150 0x7f34f0195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01964f0 con 0x7f34f0101350 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.554+0000 7f34f83ca700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0196630 con 0x7f34f0100150 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50470/0 (socket says 172.21.15.138:50470) 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 -- 172.21.15.138:0/4109771081 learned_addr learned my addr 172.21.15.138:0/4109771081 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f6166700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0100150 0x7f34f0195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 -- 172.21.15.138:0/4109771081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0100150 msgr2=0x7f34f0195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:51.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0100150 0x7f34f0195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 -- 172.21.15.138:0/4109771081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0095f0 con 0x7f34f0101350 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f5965700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c8f0 tx=0x7f34e000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0004a00 con 0x7f34f0101350 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f34e00054d0 con 0x7f34f0101350 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0007ce0 con 0x7f34f0101350 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f019b0e0 con 0x7f34f0101350 2024-02-15T22:48:51.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.555+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f019b630 con 0x7f34f0101350 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.556+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0108cc0 con 0x7f34f0101350 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.557+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f34e0005020 con 0x7f34f0101350 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.557+0000 7f34e77fe700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 0x7f34dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.557+0000 7f34f6166700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 0x7f34dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.557+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f34e0013070 con 0x7f34f0101350 2024-02-15T22:48:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.557+0000 7f34f6166700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 0x7f34dc06eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006010 tx=0x7f34ec00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:51.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.561+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f34e0059860 con 0x7f34f0101350 2024-02-15T22:48:51.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:51 smithi138 ceph-mon[29229]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-15T22:48:51.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:51 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:51.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:51 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:51 smithi170 ceph-mon[35248]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-15T22:48:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:51 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:51 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.862+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f34f0108e80 con 0x7f34f0101350 2024-02-15T22:48:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.862+0000 7f34e77fe700 1 -- 172.21.15.138:0/4109771081 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+83 (secure 0 0 0) 0x7f34e0004b60 con 0x7f34f0101350 2024-02-15T22:48:51.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 msgr2=0x7f34dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:51.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 0x7f34dc06eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006010 tx=0x7f34ec00b540 comp rx=0 tx=0).stop 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 msgr2=0x7f34f0195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f34e000c8f0 tx=0x7f34e000cc00 comp rx=0 tx=0).stop 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 shutdown_connections 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f34dc06c680 0x7f34dc06eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34f0100150 0x7f34f0195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.864+0000 7f34f83ca700 1 --2- 172.21.15.138:0/4109771081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34f0101350 0x7f34f0195ed0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.865+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 >> 172.21.15.138:0/4109771081 conn(0x7f34f00fb6e0 msgr2=0x7f34f0104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.865+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 shutdown_connections 2024-02-15T22:48:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:51.865+0000 7f34f83ca700 1 -- 172.21.15.138:0/4109771081 wait complete. 2024-02-15T22:48:51.878 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:48:52.551 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:52 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/4109771081' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T22:48:52.573 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-15T22:48:52.585 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 -- 172.21.15.138:0/2665382594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788102ab0 msgr2=0x7f2788104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 --2- 172.21.15.138:0/2665382594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788102ab0 0x7f2788104e90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f277c009880 tx=0x7f277c02bce0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 -- 172.21.15.138:0/2665382594 shutdown_connections 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 --2- 172.21.15.138:0/2665382594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788102ab0 0x7f2788104e90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 --2- 172.21.15.138:0/2665382594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788100190 0x7f2788102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 -- 172.21.15.138:0/2665382594 >> 172.21.15.138:0/2665382594 conn(0x7f27880f9a90 msgr2=0x7f27880fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 -- 172.21.15.138:0/2665382594 shutdown_connections 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.720+0000 7f278e127640 1 -- 172.21.15.138:0/2665382594 wait complete. 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 Processor -- start 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 -- start start 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 0x7f27881953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27881959a0 con 0x7f2788100190 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f278e127640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788195b10 con 0x7f2788102ab0 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50488/0 (socket says 172.21.15.138:50488) 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 -- 172.21.15.138:0/812443759 learned_addr learned my addr 172.21.15.138:0/812443759 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f2786ffd640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 0x7f27881953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 -- 172.21.15.138:0/812443759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 msgr2=0x7f27881953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 0x7f27881953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 -- 172.21.15.138:0/812443759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009560 con 0x7f2788100190 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f2786ffd640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 0x7f27881953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.721+0000 7f27877fe640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f277800c810 tx=0x7f277800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.722+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27780041f0 con 0x7f2788100190 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.722+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278819a5a0 con 0x7f2788100190 2024-02-15T22:48:52.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.722+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2778007e60 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.722+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27780049d0 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.722+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278819ab00 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.723+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278818f060 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.723+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f27780079b0 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.723+0000 7f2784ff9640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 0x7f277006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.724+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f277808b730 con 0x7f2788100190 2024-02-15T22:48:52.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.724+0000 7f2786ffd640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 0x7f277006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:52.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.724+0000 7f2786ffd640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 0x7f277006eb60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f277c036040 tx=0x7f277c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:52.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.728+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2778055db0 con 0x7f2788100190 2024-02-15T22:48:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:52 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/4109771081' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T22:48:52.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.902+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f278819a730 con 0x7f2788100190 2024-02-15T22:48:52.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.903+0000 7f2784ff9640 1 -- 172.21.15.138:0/812443759 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15194 (secure 0 0 0) 0x7f278819a730 con 0x7f2788100190 2024-02-15T22:48:52.905 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:52.905 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":46,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T22:48:40.730526+0000","last_up_change":"2024-02-15T22:47:05.647792+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:48:22.710517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:48:23.345890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6803","nonce":3342481307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6805","nonce":3342481307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6809","nonce":3342481307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3342481307},{"type":"v1","addr":"172.21.15.138:6807","nonce":3342481307}]},"public_addr":"172.21.15.138:6803/3342481307","cluster_addr":"172.21.15.138:6805/3342481307","heartbeat_back_addr":"172.21.15.138:6809/3342481307","heartbeat_front_addr":"172.21.15.138:6807/3342481307","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6811","nonce":1037257202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6813","nonce":1037257202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6817","nonce":1037257202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1037257202},{"type":"v1","addr":"172.21.15.138:6815","nonce":1037257202}]},"public_addr":"172.21.15.138:6811/1037257202","cluster_addr":"172.21.15.138:6813/1037257202","heartbeat_back_addr":"172.21.15.138:6817/1037257202","heartbeat_front_addr":"172.21.15.138:6815/1037257202","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6819","nonce":1720307660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6821","nonce":1720307660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6825","nonce":1720307660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":1720307660},{"type":"v1","addr":"172.21.15.138:6823","nonce":1720307660}]},"public_addr":"172.21.15.138:6819/1720307660","cluster_addr":"172.21.15.138:6821/1720307660","heartbeat_back_addr":"172.21.15.138:6825/1720307660","heartbeat_front_addr":"172.21.15.138:6823/1720307660","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6801","nonce":4178670664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6803","nonce":4178670664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6807","nonce":4178670664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4178670664},{"type":"v1","addr":"172.21.15.170:6805","nonce":4178670664}]},"public_addr":"172.21.15.170:6801/4178670664","cluster_addr":"172.21.15.170:6803/4178670664","heartbeat_back_addr":"172.21.15.170:6807/4178670664","heartbeat_front_addr":"172.21.15.170:6805/4178670664","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6809","nonce":2960661555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6811","nonce":2960661555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6815","nonce":2960661555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2960661555},{"type":"v1","addr":"172.21.15.170:6813","nonce":2960661555}]},"public_addr":"172.21.15.170:6809/2960661555","cluster_addr":"172.21.15.170:6811/2960661555","heartbeat_back_addr":"172.21.15.170:6815/2960661555","heartbeat_front_addr":"172.21.15.170:6813/2960661555","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6817","nonce":3806552370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6819","nonce":3806552370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6823","nonce":3806552370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3806552370},{"type":"v1","addr":"172.21.15.170:6821","nonce":3806552370}]},"public_addr":"172.21.15.170:6817/3806552370","cluster_addr":"172.21.15.170:6819/3806552370","heartbeat_back_addr":"172.21.15.170:6823/3806552370","heartbeat_front_addr":"172.21.15.170:6821/3806552370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6827/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6826/2782905632":"2024-02-16T22:48:40.730490+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 msgr2=0x7f277006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 0x7f277006eb60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f277c036040 tx=0x7f277c000bc0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 msgr2=0x7f2788194e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f277800c810 tx=0x7f277800ccd0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 shutdown_connections 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f277006c6b0 0x7f277006eb60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2788102ab0 0x7f27881953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 --2- 172.21.15.138:0/812443759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2788100190 0x7f2788194e90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 >> 172.21.15.138:0/812443759 conn(0x7f27880f9a90 msgr2=0x7f27880fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 shutdown_connections 2024-02-15T22:48:52.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:52.905+0000 7f278e127640 1 -- 172.21.15.138:0/812443759 wait complete. 2024-02-15T22:48:52.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:45:52.286926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:48:22.710517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:48:23.345890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T22:48:52.919 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T22:48:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 -- 172.21.15.138:0/365197846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 msgr2=0x7f527c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 --2- 172.21.15.138:0/365197846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c100cb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5270009880 tx=0x7f527002bce0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 -- 172.21.15.138:0/365197846 shutdown_connections 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 --2- 172.21.15.138:0/365197846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c100cb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 --2- 172.21.15.138:0/365197846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f527c0ff650 0x7f527c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 -- 172.21.15.138:0/365197846 >> 172.21.15.138:0/365197846 conn(0x7f527c0fabd0 msgr2=0x7f527c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 -- 172.21.15.138:0/365197846 shutdown_connections 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.028+0000 7f52824d2640 1 -- 172.21.15.138:0/365197846 wait complete. 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 Processor -- start 2024-02-15T22:48:53.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 -- start start 2024-02-15T22:48:53.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f527c0ff650 0x7f527c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c195a60 con 0x7f527c100840 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f52824d2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c195bd0 con 0x7f527c0ff650 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50494/0 (socket says 172.21.15.138:50494) 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 -- 172.21.15.138:0/2773076196 learned_addr learned my addr 172.21.15.138:0/2773076196 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 -- 172.21.15.138:0/2773076196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f527c0ff650 msgr2=0x7f527c194f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f527c0ff650 0x7f527c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.029+0000 7f527b7fe640 1 -- 172.21.15.138:0/2773076196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009560 con 0x7f527c100840 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f527b7fe640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5270009230 tx=0x7f5270004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5270004520 con 0x7f527c100840 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52700054b0 con 0x7f527c100840 2024-02-15T22:48:53.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5270034670 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c19a600 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.030+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c19ab00 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.031+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c108370 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.031+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f52700038b0 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.032+0000 7f52797fa640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 0x7f526406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.032+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f52700ade00 con 0x7f527c100840 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.032+0000 7f527bfff640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 0x7f526406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.032+0000 7f527bfff640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 0x7f526406eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f527c1006a0 tx=0x7f526c005ed0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.036+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f5270078480 con 0x7f527c100840 2024-02-15T22:48:53.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.206+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f527c19ad20 con 0x7f527c100840 2024-02-15T22:48:53.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.207+0000 7f52797fa640 1 -- 172.21.15.138:0/2773076196 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f527004b020 con 0x7f527c100840 2024-02-15T22:48:53.209 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 msgr2=0x7f526406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 0x7f526406eaa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f527c1006a0 tx=0x7f526c005ed0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 msgr2=0x7f527c195490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5270009230 tx=0x7f5270004e30 comp rx=0 tx=0).stop 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 shutdown_connections 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f526406c5f0 0x7f526406eaa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f527c100840 0x7f527c195490 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 --2- 172.21.15.138:0/2773076196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f527c0ff650 0x7f527c194f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 >> 172.21.15.138:0/2773076196 conn(0x7f527c0fabd0 msgr2=0x7f527c103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 shutdown_connections 2024-02-15T22:48:53.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.209+0000 7f52824d2640 1 -- 172.21.15.138:0/2773076196 wait complete. 2024-02-15T22:48:53.223 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 -- 172.21.15.138:0/4265010478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 msgr2=0x7f06141024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 --2- 172.21.15.138:0/4265010478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f06141024a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f06040098b0 tx=0x7f060402bcd0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 -- 172.21.15.138:0/4265010478 shutdown_connections 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 --2- 172.21.15.138:0/4265010478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 0x7f0614104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 --2- 172.21.15.138:0/4265010478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f06141024a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 -- 172.21.15.138:0/4265010478 >> 172.21.15.138:0/4265010478 conn(0x7f06140f9ac0 msgr2=0x7f06140fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 -- 172.21.15.138:0/4265010478 shutdown_connections 2024-02-15T22:48:53.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 -- 172.21.15.138:0/4265010478 wait complete. 2024-02-15T22:48:53.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.330+0000 7f06192ce640 1 Processor -- start 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 -- start start 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 0x7f0614195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614195af0 con 0x7f06141000c0 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614195c60 con 0x7f06141029e0 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50510/0 (socket says 172.21.15.138:50510) 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 -- 172.21.15.138:0/273947431 learned_addr learned my addr 172.21.15.138:0/273947431 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f060bfff640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 0x7f0614195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 -- 172.21.15.138:0/273947431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 msgr2=0x7f0614195520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 0x7f0614195520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 -- 172.21.15.138:0/273947431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009560 con 0x7f06141000c0 2024-02-15T22:48:53.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0612ffd640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0604009880 tx=0x7f0604004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604005000 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0604005610 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061419a690 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604034440 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.331+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061419ab90 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.332+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614108370 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.333+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f0604003880 con 0x7f06141000c0 2024-02-15T22:48:53.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.333+0000 7f0610ff9640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 0x7f060006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.333+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f06040ade80 con 0x7f06141000c0 2024-02-15T22:48:53.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.333+0000 7f060bfff640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 0x7f060006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.334+0000 7f060bfff640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 0x7f060006eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005fd0 tx=0x7f05fc005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.338+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0604078500 con 0x7f06141000c0 2024-02-15T22:48:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:53 smithi138 ceph-mon[29229]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-15T22:48:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:53 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/812443759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:48:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:53 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2773076196' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:48:53.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.508+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f061419adb0 con 0x7f06141000c0 2024-02-15T22:48:53.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.509+0000 7f0610ff9640 1 -- 172.21.15.138:0/273947431 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0604041020 con 0x7f06141000c0 2024-02-15T22:48:53.511 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T22:48:53.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.510+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 msgr2=0x7f060006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.510+0000 7f06192ce640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 0x7f060006eaa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005fd0 tx=0x7f05fc005850 comp rx=0 tx=0).stop 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.510+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 msgr2=0x7f0614194fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.510+0000 7f06192ce640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0604009880 tx=0x7f0604004e30 comp rx=0 tx=0).stop 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 shutdown_connections 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f060006c5f0 0x7f060006eaa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06141029e0 0x7f0614195520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 --2- 172.21.15.138:0/273947431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06141000c0 0x7f0614194fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 >> 172.21.15.138:0/273947431 conn(0x7f06140f9ac0 msgr2=0x7f06140fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 shutdown_connections 2024-02-15T22:48:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.511+0000 7f06192ce640 1 -- 172.21.15.138:0/273947431 wait complete. 2024-02-15T22:48:53.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 -- 172.21.15.138:0/1469540648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc10102a00 msgr2=0x7fdc10104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 --2- 172.21.15.138:0/1469540648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc10102a00 0x7fdc10104de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdc040098b0 tx=0x7fdc0402bcd0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 -- 172.21.15.138:0/1469540648 shutdown_connections 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 --2- 172.21.15.138:0/1469540648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc10102a00 0x7fdc10104de0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 --2- 172.21.15.138:0/1469540648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc101000e0 0x7fdc101024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 -- 172.21.15.138:0/1469540648 >> 172.21.15.138:0/1469540648 conn(0x7fdc100f9ac0 msgr2=0x7fdc100fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 -- 172.21.15.138:0/1469540648 shutdown_connections 2024-02-15T22:48:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.625+0000 7fdc1668b640 1 -- 172.21.15.138:0/1469540648 wait complete. 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 Processor -- start 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 -- start start 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc10102a00 0x7fdc10195500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10195ad0 con 0x7fdc101000e0 2024-02-15T22:48:53.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc1668b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10195c40 con 0x7fdc10102a00 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37018/0 (socket says 172.21.15.138:37018) 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 -- 172.21.15.138:0/4268915590 learned_addr learned my addr 172.21.15.138:0/4268915590 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0f7fe640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc10102a00 0x7fdc10195500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 -- 172.21.15.138:0/4268915590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc10102a00 msgr2=0x7fdc10195500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc10102a00 0x7fdc10195500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.626+0000 7fdc0ffff640 1 -- 172.21.15.138:0/4268915590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009560 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc0ffff640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000d6f0 tx=0x7fdc0000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc00009a30 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1019a6d0 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc000054d0 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc00010460 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.627+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1019ac30 con 0x7fdc101000e0 2024-02-15T22:48:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.628+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1018f090 con 0x7fdc101000e0 2024-02-15T22:48:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.628+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fdc00009b90 con 0x7fdc101000e0 2024-02-15T22:48:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.629+0000 7fdc0d7fa640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 0x7fdbf806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.629+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdc0008b520 con 0x7fdc101000e0 2024-02-15T22:48:53.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.629+0000 7fdc0f7fe640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 0x7fdbf806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.629+0000 7fdc0f7fe640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 0x7fdbf806eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc04036040 tx=0x7fdc04005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.633+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fdc00055b00 con 0x7fdc101000e0 2024-02-15T22:48:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:53 smithi170 ceph-mon[35248]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-15T22:48:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:53 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/812443759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T22:48:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:53 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2773076196' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T22:48:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.825+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fdc10108320 con 0x7fdc101000e0 2024-02-15T22:48:53.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.825+0000 7fdc0d7fa640 1 -- 172.21.15.138:0/4268915590 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdc00089e60 con 0x7fdc101000e0 2024-02-15T22:48:53.827 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T22:48:53.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 msgr2=0x7fdbf806eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 0x7fdbf806eaa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc04036040 tx=0x7fdc04005fd0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 msgr2=0x7fdc10194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000d6f0 tx=0x7fdc0000dbb0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 shutdown_connections 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdbf806c5f0 0x7fdbf806eaa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc10102a00 0x7fdc10195500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 --2- 172.21.15.138:0/4268915590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc101000e0 0x7fdc10194fc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.827+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 >> 172.21.15.138:0/4268915590 conn(0x7fdc100f9ac0 msgr2=0x7fdc100fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.828+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 shutdown_connections 2024-02-15T22:48:53.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.828+0000 7fdc1668b640 1 -- 172.21.15.138:0/4268915590 wait complete. 2024-02-15T22:48:53.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T22:48:53.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 -- 172.21.15.138:0/547991034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00fe540 msgr2=0x7f77a00fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 --2- 172.21.15.138:0/547991034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00fe540 0x7f77a00fe950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7798009c20 tx=0x7f779802c1b0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 -- 172.21.15.138:0/547991034 shutdown_connections 2024-02-15T22:48:53.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 --2- 172.21.15.138:0/547991034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00ff730 0x7f77a00ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 --2- 172.21.15.138:0/547991034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00fe540 0x7f77a00fe950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 -- 172.21.15.138:0/547991034 >> 172.21.15.138:0/547991034 conn(0x7f77a00f9ac0 msgr2=0x7f77a00fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 -- 172.21.15.138:0/547991034 shutdown_connections 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.940+0000 7f77a530a640 1 -- 172.21.15.138:0/547991034 wait complete. 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 Processor -- start 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 -- start start 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00fe540 0x7f77a0194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a01959c0 con 0x7f77a00ff730 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f77a530a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a0195b30 con 0x7f77a00fe540 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f779e7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f779e7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37040/0 (socket says 172.21.15.138:37040) 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.941+0000 7f779e7fc640 1 -- 172.21.15.138:0/2779592818 learned_addr learned my addr 172.21.15.138:0/2779592818 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f779effd640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00fe540 0x7f77a0194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f779e7fc640 1 -- 172.21.15.138:0/2779592818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00fe540 msgr2=0x7f77a0194eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f779e7fc640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00fe540 0x7f77a0194eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f779e7fc640 1 -- 172.21.15.138:0/2779592818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009900 con 0x7f77a00ff730 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f779e7fc640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f778800d8d0 tx=0x7f778800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7788009c00 con 0x7f77a00ff730 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77880044d0 con 0x7f77a00ff730 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a019a5c0 con 0x7f77a00ff730 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77880049d0 con 0x7f77a00ff730 2024-02-15T22:48:53.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.942+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a019ab20 con 0x7f77a00ff730 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.943+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0108350 con 0x7f77a00ff730 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.944+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f7788004020 con 0x7f77a00ff730 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.944+0000 7f7797fff640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 0x7f778c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.944+0000 7f779effd640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 0x7f778c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.944+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f778808b630 con 0x7f77a00ff730 2024-02-15T22:48:53.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.944+0000 7f779effd640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 0x7f778c06eb60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7798006010 tx=0x7f7798009800 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:53.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:53.948+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7788055cb0 con 0x7f77a00ff730 2024-02-15T22:48:54.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.169+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a019afb0 con 0x7f77a00ff730 2024-02-15T22:48:54.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.169+0000 7f7797fff640 1 -- 172.21.15.138:0/2779592818 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4782 (secure 0 0 0) 0x7f778800ee60 con 0x7f77a00ff730 2024-02-15T22:48:54.171 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:48:54.171 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T22:48:44.753840+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2716267624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2716267624},{"type":"v1","addr":"172.21.15.138:6827","nonce":2716267624}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.170:6827/2026647764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2026647764},{"type":"v1","addr":"172.21.15.170:6827","nonce":2026647764}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T22:48:54.172 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 19 2024-02-15T22:48:54.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 msgr2=0x7f778c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:54.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 0x7f778c06eb60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7798006010 tx=0x7f7798009800 comp rx=0 tx=0).stop 2024-02-15T22:48:54.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 msgr2=0x7f77a01953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:54.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f778800d8d0 tx=0x7f778800dd90 comp rx=0 tx=0).stop 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 shutdown_connections 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f778c06c6b0 0x7f778c06eb60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77a00ff730 0x7f77a01953f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 --2- 172.21.15.138:0/2779592818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77a00fe540 0x7f77a0194eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 >> 172.21.15.138:0/2779592818 conn(0x7f77a00f9ac0 msgr2=0x7f77a0102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 shutdown_connections 2024-02-15T22:48:54.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:54.171+0000 7f77a530a640 1 -- 172.21.15.138:0/2779592818 wait complete. 2024-02-15T22:48:54.184 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-02-15T22:48:54.184 INFO:teuthology.run_tasks:Running task kclient... 2024-02-15T22:48:54.211 INFO:tasks.kclient:Mounting kernel clients... 2024-02-15T22:48:54.211 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-15T22:48:54.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:54.212 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-15T22:48:54.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:54.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-15T22:48:54.295 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2024-02-15T22:48:54.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:48:54.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:54.297 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-02-15T22:48:54.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:54.317 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-02-15T22:48:54.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T22:48:54.396 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-02-15T22:48:54.396 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-15T22:48:54.397 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-15T22:48:54.397 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T22:48:54.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-15T22:48:54.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:54 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/273947431' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:48:54.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:54 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/4268915590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:48:54.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:54 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2779592818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:48:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:54 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/273947431' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T22:48:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:54 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/4268915590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T22:48:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:54 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2779592818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T22:48:55.262 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:48:55.652 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:55 smithi138 ceph-mon[29229]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.4 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-15T22:48:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:55 smithi170 ceph-mon[35248]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.4 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:56 smithi138 ceph-mon[29229]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-15T22:48:56.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- 172.21.15.138:0/1928923710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 msgr2=0x7fd464101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 --2- 172.21.15.138:0/1928923710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd464101740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd458009940 tx=0x7fd458009c50 comp rx=0 tx=0).stop 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- 172.21.15.138:0/1928923710 shutdown_connections 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 --2- 172.21.15.138:0/1928923710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 0x7fd46410a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 --2- 172.21.15.138:0/1928923710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd464101740 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- 172.21.15.138:0/1928923710 >> 172.21.15.138:0/1928923710 conn(0x7fd4640fabd0 msgr2=0x7fd4640fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- 172.21.15.138:0/1928923710 shutdown_connections 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- 172.21.15.138:0/1928923710 wait complete. 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 Processor -- start 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- start start 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 0x7fd46419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:56.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46419c6a0 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.974+0000 7fd46aa91700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464195b50 con 0x7fd464101c80 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37052/0 (socket says 172.21.15.138:37052) 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 -- 172.21.15.138:0/2351390629 learned_addr learned my addr 172.21.15.138:0/2351390629 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd463fff700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 0x7fd46419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 -- 172.21.15.138:0/2351390629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 msgr2=0x7fd46419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 0x7fd46419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 -- 172.21.15.138:0/2351390629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580095f0 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46882d700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd4580055f0 tx=0x7fd4580056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45801d070 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd45800f460 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd458021640 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464195dd0 con 0x7fd464101370 2024-02-15T22:48:56.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.975+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4641962c0 con 0x7fd464101370 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.976+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464107850 con 0x7fd464101370 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.977+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fd45800fab0 con 0x7fd464101370 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.977+0000 7fd461ffb700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 0x7fd45406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.977+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd45808ca60 con 0x7fd464101370 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.977+0000 7fd463fff700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 0x7fd45406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.978+0000 7fd463fff700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 0x7fd45406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd450005950 tx=0x7fd4500058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:48:56.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:56.982+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd45805abf0 con 0x7fd464101370 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:48:57.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:56 smithi170 ceph-mon[35248]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-15T22:48:57.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.219+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd46404ea50 con 0x7fd464101370 2024-02-15T22:48:57.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.220+0000 7fd461ffb700 1 -- 172.21.15.138:0/2351390629 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd45805a780 con 0x7fd464101370 2024-02-15T22:48:57.222 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T22:48:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 msgr2=0x7fd45406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 0x7fd45406eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd450005950 tx=0x7fd4500058e0 comp rx=0 tx=0).stop 2024-02-15T22:48:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 msgr2=0x7fd46419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:48:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd4580055f0 tx=0x7fd4580056d0 comp rx=0 tx=0).stop 2024-02-15T22:48:57.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 shutdown_connections 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fd45406c680 0x7fd45406eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd464101370 0x7fd46419bad0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 --2- 172.21.15.138:0/2351390629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd464101c80 0x7fd46419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 >> 172.21.15.138:0/2351390629 conn(0x7fd4640fabd0 msgr2=0x7fd464104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 shutdown_connections 2024-02-15T22:48:57.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:48:57.222+0000 7fd46aa91700 1 -- 172.21.15.138:0/2351390629 wait complete. 2024-02-15T22:48:57.888 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:57 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2351390629' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T22:48:57.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T22:48:57.911 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T22:48:57.911 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-15T22:48:57.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:57.911 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2024-02-15T22:48:57.966 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:48:57.967 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42194sec preferred_lft 42194sec 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2024-02-15T22:48:57.968 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:48:57.969 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T22:48:57.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T22:48:57.969 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-15T22:48:58.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:57 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2351390629' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:48:58.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.140 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T22:48:58.166 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-02-15T22:48:58.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.168 DEBUG:teuthology.orchestra.run.smithi138:> route 2024-02-15T22:48:58.241 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2024-02-15T22:48:58.242 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T22:48:58.242 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T22:48:58.242 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T22:48:58.242 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T22:48:58.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.242 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-15T22:48:58.242 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-15T22:48:58.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T22:48:58.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T22:48:58.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T22:48:58.243 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-15T22:48:58.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.536 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-15T22:48:58.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.551 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2024-02-15T22:48:58.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.605 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-15T22:48:58.605 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-15T22:48:58.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T22:48:58.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-15T22:48:58.606 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-15T22:48:58.689 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-15T22:48:58.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-15T22:48:58.689 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-15T22:48:58.690 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-15T22:48:58.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.823 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2024-02-15T22:48:58.823 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2024-02-15T22:48:58.823 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2024-02-15T22:48:58.823 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T22:48:58.823 DEBUG:teuthology.orchestra.run.smithi138:> ') 2024-02-15T22:48:58.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:48:58.865 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-15T22:48:58.920 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-15T22:48:58.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:48:58.921 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-15T22:48:58.975 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-15T22:48:58.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:58.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:48:58.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:48:58 smithi138 ceph-mon[29229]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-15T22:48:59.010 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:48:58 smithi170 ceph-mon[35248]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-15T22:48:59.044 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:48:59.044 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:48:59.044 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-15T22:48:59.161 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:48:59.162 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:48:59.162 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-15T22:48:59.162 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.170:3300" 2024-02-15T22:48:59.162 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:48:59.166 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:invalid new device string format 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.170:3300" 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.138:6789,172.21.15.170:6789" 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.138:6789,172.21.15.170:6789:/ 2024-02-15T22:48:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3fa87466-cc53-11ee-95ba-87774f69a715" will pass to kernel 2024-02-15T22:48:59.168 INFO:teuthology.orchestra.run.smithi138.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-15T22:48:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: You just mounted a file system that supports labels which does not 2024-02-15T22:48:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-15T22:48:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: applications will generate AVC messages and not be allowed access to 2024-02-15T22:48:59.168 INFO:teuthology.orchestra.run.smithi138.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-15T22:48:59.170 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T22:48:59.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:59.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-15T22:48:59.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:59.198 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:48:59.259 INFO:teuthology.orchestra.run.smithi138.stdout:client14524 2024-02-15T22:48:59.259 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:48:59.259 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:48:59.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:59.319 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:48:59.379 INFO:teuthology.orchestra.run.smithi138.stdout:client14524 2024-02-15T22:48:59.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:59.380 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:48:59.441 INFO:teuthology.orchestra.run.smithi138.stdout:client14524 2024-02-15T22:48:59.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:48:59.441 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3fa87466-cc53-11ee-95ba-87774f69a715.client14524/status') 2024-02-15T22:48:59.510 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.14524 (3)192.168.0.1:0/588191077 2024-02-15T22:48:59.510 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2024-02-15T22:48:59.511 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2024-02-15T22:48:59.511 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2024-02-15T22:48:59.511 INFO:teuthology.orchestra.run.smithi138.stderr:69 bytes copied, 2.1046e-05 s, 3.3 MB/s 2024-02-15T22:48:59.512 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-15T22:48:59.512 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-15T22:48:59.512 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T22:48:59.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- ceph fs ls 2024-02-15T22:48:59.763 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:01.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:01 smithi138 ceph-mon[29229]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-15T22:49:01.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:01 smithi170 ceph-mon[35248]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-15T22:49:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 -- 172.21.15.138:0/709719930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ffc60 msgr2=0x7f06d4103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 --2- 172.21.15.138:0/709719930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ffc60 0x7f06d4103c30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009910 tx=0x7f06c8009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 -- 172.21.15.138:0/709719930 shutdown_connections 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 --2- 172.21.15.138:0/709719930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ffc60 0x7f06d4103c30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 --2- 172.21.15.138:0/709719930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ff2c0 0x7f06d40ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 -- 172.21.15.138:0/709719930 >> 172.21.15.138:0/709719930 conn(0x7f06d40fab80 msgr2=0x7f06d40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 -- 172.21.15.138:0/709719930 shutdown_connections 2024-02-15T22:49:01.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.618+0000 7f06d9253700 1 -- 172.21.15.138:0/709719930 wait complete. 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.619+0000 7f06d9253700 1 Processor -- start 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.619+0000 7f06d9253700 1 -- start start 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d9253700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d9253700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ffc60 0x7f06d41962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d9253700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41969a0 con 0x7f06d40ff2c0 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d9253700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d419a730 con 0x7f06d40ffc60 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37072/0 (socket says 172.21.15.138:37072) 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 -- 172.21.15.138:0/1672077876 learned_addr learned my addr 172.21.15.138:0/1672077876 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d259c700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ffc60 0x7f06d41962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 -- 172.21.15.138:0/1672077876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ffc60 msgr2=0x7f06d41962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ffc60 0x7f06d41962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 -- 172.21.15.138:0/1672077876 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80095f0 con 0x7f06d40ff2c0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d2d9d700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d8d0 tx=0x7f06c400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c40098a0 con 0x7f06d40ff2c0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d419aa10 con 0x7f06d40ff2c0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06c4010460 con 0x7f06d40ff2c0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.620+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c400f5f0 con 0x7f06d40ff2c0 2024-02-15T22:49:01.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.621+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d419af60 con 0x7f06d40ff2c0 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.621+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4108640 con 0x7f06d40ff2c0 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.622+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f06c4009a00 con 0x7f06d40ff2c0 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.622+0000 7f06bbfff700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 0x7f06bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.622+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f06c408b7c0 con 0x7f06d40ff2c0 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.622+0000 7f06d259c700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 0x7f06bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:01.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.623+0000 7f06d259c700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 0x7f06bc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06d41973a0 tx=0x7f06c801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:01.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.627+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f06c4055e40 con 0x7f06d40ff2c0 2024-02-15T22:49:01.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.862+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06d419b220 con 0x7f06d40ff2c0 2024-02-15T22:49:01.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.862+0000 7f06bbfff700 1 -- 172.21.15.138:0/1672077876 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f06c4059460 con 0x7f06d40ff2c0 2024-02-15T22:49:01.864 INFO:teuthology.orchestra.run.smithi138.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T22:49:01.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 msgr2=0x7f06bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 0x7f06bc06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06d41973a0 tx=0x7f06c801a040 comp rx=0 tx=0).stop 2024-02-15T22:49:01.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 msgr2=0x7f06d4195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d8d0 tx=0x7f06c400dbe0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 shutdown_connections 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f06bc06c680 0x7f06bc06eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06d40ff2c0 0x7f06d4195d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 --2- 172.21.15.138:0/1672077876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06d40ffc60 0x7f06d41962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.864+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 >> 172.21.15.138:0/1672077876 conn(0x7f06d40fab80 msgr2=0x7f06d4068f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.865+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 shutdown_connections 2024-02-15T22:49:01.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:01.865+0000 7f06d9253700 1 -- 172.21.15.138:0/1672077876 wait complete. 2024-02-15T22:49:02.222 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:02 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1672077876' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:49:02.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:02 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1672077876' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T22:49:02.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-15T22:49:02.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:02.538 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-02-15T22:49:02.556 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T22:49:02.556 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T22:49:02.556 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T22:49:02.557 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-02-15T22:49:02.558 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T22:49:02.558 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-02-15T22:49:02.558 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-02-15T22:49:02.558 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-02-15T22:49:02.558 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T22:49:02.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:02.558 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-02-15T22:49:02.558 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-02-15T22:49:02.558 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2024-02-15T22:49:02.558 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2024-02-15T22:49:02.558 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2024-02-15T22:49:02.559 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T22:49:02.559 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-02-15T22:49:02.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:02.724 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T22:49:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-02-15T22:49:02.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:02.752 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-02-15T22:49:02.821 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-02-15T22:49:02.822 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T22:49:02.822 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T22:49:02.822 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T22:49:02.822 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T22:49:02.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:02.822 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-02-15T22:49:02.822 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-02-15T22:49:02.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T22:49:02.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T22:49:02.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T22:49:02.823 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-02-15T22:49:03.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.113 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-02-15T22:49:03.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.128 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-02-15T22:49:03.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.183 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-02-15T22:49:03.183 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-02-15T22:49:03.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T22:49:03.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-15T22:49:03.183 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-02-15T22:49:03.248 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:03 smithi170 ceph-mon[35248]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:03.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-15T22:49:03.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.268 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-02-15T22:49:03.268 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-02-15T22:49:03.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-15T22:49:03.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T22:49:03.269 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-15T22:49:03.269 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-15T22:49:03.269 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-15T22:49:03.269 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-02-15T22:49:03.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.406 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-02-15T22:49:03.406 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-02-15T22:49:03.406 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-02-15T22:49:03.406 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T22:49:03.407 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-02-15T22:49:03.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:49:03.448 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:03.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:03 smithi138 ceph-mon[29229]: pgmap v198: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:03.503 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-15T22:49:03.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-15T22:49:03.503 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:03.558 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-15T22:49:03.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.558 DEBUG:teuthology.orchestra.run.smithi170:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:49:03.653 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:49:03.653 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:49:03.653 INFO:teuthology.orchestra.run.smithi170.stdout:invalid new device string format 2024-02-15T22:49:03.765 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:49:03.766 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:49:03.766 INFO:teuthology.orchestra.run.smithi170.stdout:invalid new device string format 2024-02-15T22:49:03.766 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.170:3300" 2024-02-15T22:49:03.766 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:49:03.774 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:invalid new device string format 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.138:3300,172.21.15.170:3300" 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.138:6789,172.21.15.170:6789" 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.138:6789,172.21.15.170:6789:/ 2024-02-15T22:49:03.775 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3fa87466-cc53-11ee-95ba-87774f69a715" will pass to kernel 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run.smithi170.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run.smithi170.stdout: You just mounted a file system that supports labels which does not 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run.smithi170.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run.smithi170.stdout: applications will generate AVC messages and not be allowed access to 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run.smithi170.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-15T22:49:03.781 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T22:49:03.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:03.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.809 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:49:03.865 INFO:teuthology.orchestra.run.smithi170.stdout:client24313 2024-02-15T22:49:03.866 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:49:03.866 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T22:49:03.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.923 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:49:03.979 INFO:teuthology.orchestra.run.smithi170.stdout:client24313 2024-02-15T22:49:03.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:03.980 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-15T22:49:04.035 INFO:teuthology.orchestra.run.smithi170.stdout:client24313 2024-02-15T22:49:04.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T22:49:04.035 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/3fa87466-cc53-11ee-95ba-87774f69a715.client24313/status') 2024-02-15T22:49:04.102 INFO:teuthology.orchestra.run.smithi170.stdout:instance: client.24313 (3)192.168.0.1:0/1393612965 2024-02-15T22:49:04.102 INFO:teuthology.orchestra.run.smithi170.stdout:blocklisted: false 2024-02-15T22:49:04.102 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records in 2024-02-15T22:49:04.102 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records out 2024-02-15T22:49:04.102 INFO:teuthology.orchestra.run.smithi170.stderr:70 bytes copied, 2.3711e-05 s, 3.0 MB/s 2024-02-15T22:49:04.104 INFO:teuthology.run_tasks:Running task print... 2024-02-15T22:49:04.115 INFO:teuthology.task.print:**** done client 2024-02-15T22:49:04.115 INFO:teuthology.run_tasks:Running task parallel... 2024-02-15T22:49:04.152 INFO:teuthology.task.parallel:starting parallel... 2024-02-15T22:49:04.153 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T22:49:04.153 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:49:04.154 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:49:04.154 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T22:49:04.154 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T22:49:04.155 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-15T22:49:04.161 INFO:tasks.workunit:Pulling workunits from ref f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:04.162 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-15T22:49:04.162 INFO:tasks.workunit:timeout=3h 2024-02-15T22:49:04.162 INFO:tasks.workunit:cleanup=True 2024-02-15T22:49:04.162 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-15T22:49:04.180 INFO:teuthology.orchestra.run.smithi138.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 9fh/159d Inode: 1 Links: 2 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-02-15 22:48:31.097582560 +0000 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-02-15 22:48:59.194012402 +0000 2024-02-15T22:49:04.181 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-02-15 22:48:31.097582560 +0000 2024-02-15T22:49:04.181 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-15T22:49:04.181 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-15T22:49:04.253 DEBUG:teuthology.orchestra.run.smithi170:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:04.269 INFO:teuthology.orchestra.run.smithi170.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 7eh/126d Inode: 1 Links: 3 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-15 22:49:04.246904501 +0000 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-15 22:49:04.246904501 +0000 2024-02-15T22:49:04.270 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-15 22:48:31.097582560 +0000 2024-02-15T22:49:04.270 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-15T22:49:04.271 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-15T22:49:04.343 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:04.343 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:04.359 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-15T22:49:04.381 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:04.397 INFO:tasks.workunit.client.1.smithi170.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-15T22:49:04.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:04.484 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:05.462 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:05 smithi138 ceph-mon[29229]: pgmap v199: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:49:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:05 smithi170 ceph-mon[35248]: pgmap v199: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 -- 172.21.15.138:0/3904259964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 msgr2=0x7feb840ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 --2- 172.21.15.138:0/3904259964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb840ff480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb74009910 tx=0x7feb74009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 -- 172.21.15.138:0/3904259964 shutdown_connections 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 --2- 172.21.15.138:0/3904259964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 0x7feb841006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 --2- 172.21.15.138:0/3904259964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb840ff480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 -- 172.21.15.138:0/3904259964 >> 172.21.15.138:0/3904259964 conn(0x7feb840fa600 msgr2=0x7feb840fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 -- 172.21.15.138:0/3904259964 shutdown_connections 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.019+0000 7feb891b4700 1 -- 172.21.15.138:0/3904259964 wait complete. 2024-02-15T22:49:06.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 Processor -- start 2024-02-15T22:49:06.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 -- start start 2024-02-15T22:49:06.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:06.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 0x7feb84194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:06.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841953f0 con 0x7feb840ff070 2024-02-15T22:49:06.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.020+0000 7feb891b4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84195530 con 0x7feb84100270 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53502/0 (socket says 172.21.15.138:53502) 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 -- 172.21.15.138:0/2022293241 learned_addr learned my addr 172.21.15.138:0/2022293241 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb8259c700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 0x7feb84194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 -- 172.21.15.138:0/2022293241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 msgr2=0x7feb84194dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 0x7feb84194dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 -- 172.21.15.138:0/2022293241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb740095f0 con 0x7feb840ff070 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb82d9d700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb7400bda0 tx=0x7feb7400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7401d070 con 0x7feb840ff070 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb84199f80 con 0x7feb840ff070 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb7400f460 con 0x7feb840ff070 2024-02-15T22:49:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb74021620 con 0x7feb840ff070 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.021+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8419a3f0 con 0x7feb840ff070 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.022+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb84107bc0 con 0x7feb840ff070 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.023+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7feb7400f5d0 con 0x7feb840ff070 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.023+0000 7feb6bfff700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 0x7feb6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.023+0000 7feb8259c700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 0x7feb6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.023+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feb7408cc00 con 0x7feb840ff070 2024-02-15T22:49:06.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.024+0000 7feb8259c700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 0x7feb6c06eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb78005950 tx=0x7feb7800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:06.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.027+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7feb74092020 con 0x7feb840ff070 2024-02-15T22:49:06.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.220+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7feb8419aa90 con 0x7feb840ff070 2024-02-15T22:49:06.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.220+0000 7feb6bfff700 1 -- 172.21.15.138:0/2022293241 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7feb7405ad10 con 0x7feb840ff070 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 msgr2=0x7feb6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 0x7feb6c06eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb78005950 tx=0x7feb7800b410 comp rx=0 tx=0).stop 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 msgr2=0x7feb84194890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb7400bda0 tx=0x7feb7400bdd0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 shutdown_connections 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7feb6c06c680 0x7feb6c06eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb840ff070 0x7feb84194890 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 --2- 172.21.15.138:0/2022293241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb84100270 0x7feb84194dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 >> 172.21.15.138:0/2022293241 conn(0x7feb840fa600 msgr2=0x7feb841034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 shutdown_connections 2024-02-15T22:49:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:06.223+0000 7feb891b4700 1 -- 172.21.15.138:0/2022293241 wait complete. 2024-02-15T22:49:06.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T22:49:07.149 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:07.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:07 smithi138 ceph-mon[29229]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-15T22:49:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:07 smithi170 ceph-mon[35248]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-15T22:49:08.847 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:08 smithi138 ceph-mon[29229]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-15T22:49:08.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- 172.21.15.138:0/743027996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440ff330 msgr2=0x7f8f440ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:08.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 --2- 172.21.15.138:0/743027996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440ff330 0x7f8f440ff7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009910 tx=0x7f8f2c009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:08.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- 172.21.15.138:0/743027996 shutdown_connections 2024-02-15T22:49:08.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 --2- 172.21.15.138:0/743027996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f440ff330 0x7f8f440ff7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 --2- 172.21.15.138:0/743027996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f441006d0 0x7f8f44100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- 172.21.15.138:0/743027996 >> 172.21.15.138:0/743027996 conn(0x7f8f440f9dd0 msgr2=0x7f8f440fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- 172.21.15.138:0/743027996 shutdown_connections 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- 172.21.15.138:0/743027996 wait complete. 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 Processor -- start 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.860+0000 7f8f48997700 1 -- start start 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f48997700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f440ff330 0x7f8f440fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f48997700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f48997700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4419adf0 con 0x7f8f441006d0 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f48997700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4419af30 con 0x7f8f440ff330 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53516/0 (socket says 172.21.15.138:53516) 2024-02-15T22:49:08.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 -- 172.21.15.138:0/60714970 learned_addr learned my addr 172.21.15.138:0/60714970 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f4259c700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f440ff330 0x7f8f440fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 -- 172.21.15.138:0/60714970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f440ff330 msgr2=0x7f8f440fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f440ff330 0x7f8f440fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 -- 172.21.15.138:0/60714970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0095f0 con 0x7f8f441006d0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3bfff700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006010 tx=0x7f8f2c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.861+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c01d070 con 0x7f8f441006d0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.862+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4419b1b0 con 0x7f8f441006d0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.862+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8f2c00f460 con 0x7f8f441006d0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.862+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c021640 con 0x7f8f441006d0 2024-02-15T22:49:08.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.862+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4419b720 con 0x7f8f441006d0 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.862+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44107cc0 con 0x7f8f441006d0 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.863+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f8f2c004b70 con 0x7f8f441006d0 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.863+0000 7f8f3b7fe700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 0x7f8f3006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.863+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8f2c08ccf0 con 0x7f8f441006d0 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.864+0000 7f8f4259c700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 0x7f8f3006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:08.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.864+0000 7f8f4259c700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 0x7f8f3006eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:08.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:08.868+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8f2c05ae00 con 0x7f8f441006d0 2024-02-15T22:49:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:08 smithi170 ceph-mon[35248]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-15T22:49:09.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.056+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f8f44107ee0 con 0x7f8f441006d0 2024-02-15T22:49:09.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.057+0000 7f8f3b7fe700 1 -- 172.21.15.138:0/60714970 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8f2c0260e0 con 0x7f8f441006d0 2024-02-15T22:49:09.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 msgr2=0x7f8f3006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 0x7f8f3006eb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 msgr2=0x7f8f4419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006010 tx=0x7f8f2c00be20 comp rx=0 tx=0).stop 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 shutdown_connections 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f8f3006c680 0x7f8f3006eb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f440ff330 0x7f8f440fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 --2- 172.21.15.138:0/60714970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f441006d0 0x7f8f4419a820 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 >> 172.21.15.138:0/60714970 conn(0x7f8f440f9dd0 msgr2=0x7f8f44103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 shutdown_connections 2024-02-15T22:49:09.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:09.059+0000 7f8f48997700 1 -- 172.21.15.138:0/60714970 wait complete. 2024-02-15T22:49:09.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T22:49:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:11.368 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:11 smithi138 ceph-mon[29229]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:11 smithi170 ceph-mon[35248]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:11.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1067306998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 msgr2=0x7fb2f80ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1067306998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f80ff460 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009910 tx=0x7fb2e8009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1067306998 shutdown_connections 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1067306998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f81006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1067306998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f80ff460 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1067306998 >> 172.21.15.138:0/1067306998 conn(0x7fb2f80fa600 msgr2=0x7fb2f80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1067306998 shutdown_connections 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.758+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1067306998 wait complete. 2024-02-15T22:49:11.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 Processor -- start 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 -- start start 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f8195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8196580 con 0x7fb2f80ff050 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2fdcfb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f81966c0 con 0x7fb2f8100250 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.759+0000 7fb2f77fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53540/0 (socket says 172.21.15.138:53540) 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 -- 172.21.15.138:0/1799564935 learned_addr learned my addr 172.21.15.138:0/1799564935 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:11.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f6ffd700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f8195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 -- 172.21.15.138:0/1799564935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 msgr2=0x7fb2f8195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f8195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 -- 172.21.15.138:0/1799564935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80095f0 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f6ffd700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f8195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f77fe700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bda0 tx=0x7fb2e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e801d070 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f819b110 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb2e8004c50 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e800f690 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.760+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f819b680 con 0x7fb2f80ff050 2024-02-15T22:49:11.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.761+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f8107c20 con 0x7fb2f80ff050 2024-02-15T22:49:11.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.762+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fb2e80229b0 con 0x7fb2f80ff050 2024-02-15T22:49:11.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.762+0000 7fb2f4ff9700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 0x7fb2e006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:11.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.762+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb2e808d010 con 0x7fb2f80ff050 2024-02-15T22:49:11.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.762+0000 7fb2f6ffd700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 0x7fb2e006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:11.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.762+0000 7fb2f6ffd700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 0x7fb2e006eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007900 tx=0x7fb2ec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:11.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.766+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb2e805b1d0 con 0x7fb2f80ff050 2024-02-15T22:49:11.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.956+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb2f8107e10 con 0x7fb2f80ff050 2024-02-15T22:49:11.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.957+0000 7fb2f4ff9700 1 -- 172.21.15.138:0/1799564935 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb2e805ad60 con 0x7fb2f80ff050 2024-02-15T22:49:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 msgr2=0x7fb2e006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 0x7fb2e006eb30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec007900 tx=0x7fb2ec008040 comp rx=0 tx=0).stop 2024-02-15T22:49:11.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 msgr2=0x7fb2f8195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bda0 tx=0x7fb2e800be80 comp rx=0 tx=0).stop 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 shutdown_connections 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fb2e006c680 0x7fb2e006eb30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f80ff050 0x7fb2f8195a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 --2- 172.21.15.138:0/1799564935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2f8100250 0x7fb2f8195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 >> 172.21.15.138:0/1799564935 conn(0x7fb2f80fa600 msgr2=0x7fb2f8068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 shutdown_connections 2024-02-15T22:49:11.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:11.959+0000 7fb2fdcfb700 1 -- 172.21.15.138:0/1799564935 wait complete. 2024-02-15T22:49:12.805 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-15T22:49:13.014 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:13.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:13 smithi138 ceph-mon[29229]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:13.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:13 smithi170 ceph-mon[35248]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:14.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 -- 172.21.15.138:0/4039503591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 msgr2=0x7f186c1005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 --2- 172.21.15.138:0/4039503591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c1005a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1868009910 tx=0x7f1868009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 -- 172.21.15.138:0/4039503591 shutdown_connections 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 --2- 172.21.15.138:0/4039503591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 0x7f186c1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 --2- 172.21.15.138:0/4039503591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c1005a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 -- 172.21.15.138:0/4039503591 >> 172.21.15.138:0/4039503591 conn(0x7f186c0fb740 msgr2=0x7f186c0fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 -- 172.21.15.138:0/4039503591 shutdown_connections 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.838+0000 7f1873d88700 1 -- 172.21.15.138:0/4039503591 wait complete. 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 Processor -- start 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 -- start start 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 0x7f186c195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:14.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1964f0 con 0x7f186c100190 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1873d88700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c196630 con 0x7f186c101390 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:41472/0 (socket says 172.21.15.138:41472) 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 -- 172.21.15.138:0/2792588306 learned_addr learned my addr 172.21.15.138:0/2792588306 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871323700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 0x7f186c195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 -- 172.21.15.138:0/2792588306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 msgr2=0x7f186c195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 0x7f186c195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 -- 172.21.15.138:0/2792588306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680095f0 con 0x7f186c100190 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.839+0000 7f1871b24700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f186800bda0 tx=0x7f186800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.840+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186801d070 con 0x7f186c100190 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.840+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f186800f460 con 0x7f186c100190 2024-02-15T22:49:14.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.840+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c19b080 con 0x7f186c100190 2024-02-15T22:49:14.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.840+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1868021620 con 0x7f186c100190 2024-02-15T22:49:14.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.840+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c19b570 con 0x7f186c100190 2024-02-15T22:49:14.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.841+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c108ce0 con 0x7f186c100190 2024-02-15T22:49:14.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.841+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f1868003a60 con 0x7f186c100190 2024-02-15T22:49:14.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.841+0000 7f1862ffd700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 0x7f185806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:14.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.841+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f186808c730 con 0x7f186c100190 2024-02-15T22:49:14.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.841+0000 7f1871323700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 0x7f185806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:14.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.842+0000 7f1871323700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 0x7f185806e920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f185c005950 tx=0x7f185c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:14.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:14.846+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f186805a960 con 0x7f186c100190 2024-02-15T22:49:15.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:15.053+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f186c105d90 con 0x7f185806c470 2024-02-15T22:49:15.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:15 smithi138 ceph-mon[29229]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:15.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:15 smithi170 ceph-mon[35248]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-15T22:49:16.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:16 smithi138 ceph-mon[29229]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:16 smithi170 ceph-mon[35248]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:17.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:17 smithi138 ceph-mon[29229]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-15T22:49:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:17 smithi170 ceph-mon[35248]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-15T22:49:18.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:18 smithi138 ceph-mon[29229]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-02-15T22:49:19.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:18 smithi170 ceph-mon[35248]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-02-15T22:49:19.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:20.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:21.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:20 smithi170 ceph-mon[35248]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-15T22:49:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:20 smithi138 ceph-mon[29229]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-15T22:49:23.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:23 smithi138 ceph-mon[29229]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:23.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:23 smithi170 ceph-mon[35248]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:25.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:25 smithi138 ceph-mon[29229]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:25.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:25 smithi170 ceph-mon[35248]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:27.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:27 smithi138 ceph-mon[29229]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:27 smithi170 ceph-mon[35248]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:28.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:28 smithi138 ceph-mon[29229]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:49:29.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:28 smithi170 ceph-mon[35248]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:49:31.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:31 smithi138 ceph-mon[29229]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:31.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:31 smithi170 ceph-mon[35248]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:33.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:33 smithi138 ceph-mon[29229]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:33.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:33 smithi170 ceph-mon[35248]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:49:34.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:34.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:35.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:35 smithi138 ceph-mon[29229]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:35.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:35 smithi170 ceph-mon[35248]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:49:37.439 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:37 smithi170 ceph-mon[35248]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:37.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:37 smithi138 ceph-mon[29229]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:49:38.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:38 smithi138 ceph-mon[29229]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:49:39.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:38 smithi170 ceph-mon[35248]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:49:41.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:41 smithi138 ceph-mon[29229]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-15T22:49:41.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:41 smithi170 ceph-mon[35248]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-15T22:49:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:43 smithi138 ceph-mon[29229]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-15T22:49:43.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:43 smithi170 ceph-mon[35248]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-15T22:49:45.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:45 smithi138 ceph-mon[29229]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:49:45.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:45 smithi170 ceph-mon[35248]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:49:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.919+0000 7f1862ffd700 1 -- 172.21.15.138:0/2792588306 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f186c105d90 con 0x7f185806c470 2024-02-15T22:49:45.922 INFO:teuthology.orchestra.run.smithi138.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 msgr2=0x7f185806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 0x7f185806e920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f185c005950 tx=0x7f185c00b410 comp rx=0 tx=0).stop 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 msgr2=0x7f186c195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f186800bda0 tx=0x7f186800bdd0 comp rx=0 tx=0).stop 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 shutdown_connections 2024-02-15T22:49:45.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f185806c470 0x7f185806e920 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f186c100190 0x7f186c195990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 --2- 172.21.15.138:0/2792588306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f186c101390 0x7f186c195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 >> 172.21.15.138:0/2792588306 conn(0x7f186c0fb740 msgr2=0x7f186c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 shutdown_connections 2024-02-15T22:49:45.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:45.921+0000 7f1873d88700 1 -- 172.21.15.138:0/2792588306 wait complete. 2024-02-15T22:49:46.731 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-15T22:49:46.960 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:49:46.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:46 smithi138 ceph-mon[29229]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:46.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:46.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:46 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:46.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:46 smithi138 ceph-mon[29229]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-15T22:49:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:46 smithi170 ceph-mon[35248]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:46 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:46 smithi170 ceph-mon[35248]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-15T22:49:48.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:48.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:48.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:47 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:48.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:47 smithi138 ceph-mon[29229]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:48.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:49:48.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:49:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:47 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:47 smithi170 ceph-mon[35248]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:49:49.223 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:48 smithi138 ceph-mon[29229]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:49:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:48 smithi170 ceph-mon[35248]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T22:49:50.149 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:50.149 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-15T22:49:50.149 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:50.150 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:49:50.150 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:50.150 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:50.150 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: Upgrade: Need to upgrade myself (mgr.smithi138.jqscxs) 2024-02-15T22:49:50.150 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:50 smithi138 ceph-mon[29229]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi170 2024-02-15T22:49:50.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1783767975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 msgr2=0x7f4d181058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1783767975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d181058e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009910 tx=0x7f4d0c009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1783767975 shutdown_connections 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1783767975 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d181058e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1783767975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 0x7f4d18102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1783767975 >> 172.21.15.138:0/1783767975 conn(0x7f4d180fa5e0 msgr2=0x7f4d180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1783767975 shutdown_connections 2024-02-15T22:49:50.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.160+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1783767975 wait complete. 2024-02-15T22:49:50.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.161+0000 7f4d1cd06700 1 Processor -- start 2024-02-15T22:49:50.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.161+0000 7f4d1cd06700 1 -- start start 2024-02-15T22:49:50.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d1cd06700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 0x7f4d18100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d1cd06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d1cd06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18199580 con 0x7f4d18103500 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d1cd06700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d181996c0 con 0x7f4d18100be0 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53200/0 (socket says 172.21.15.138:53200) 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 -- 172.21.15.138:0/1916806255 learned_addr learned my addr 172.21.15.138:0/1916806255 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d1659c700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 0x7f4d18100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 -- 172.21.15.138:0/1916806255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 msgr2=0x7f4d18100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 0x7f4d18100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 -- 172.21.15.138:0/1916806255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0095f0 con 0x7f4d18103500 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d15d9b700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c000c00 tx=0x7f4d0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.162+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d0c01d070 con 0x7f4d18103500 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.163+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c005dc0 con 0x7f4d18103500 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.163+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d0c0226a0 con 0x7f4d18103500 2024-02-15T22:49:50.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.163+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d180ff0d0 con 0x7f4d18103500 2024-02-15T22:49:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.163+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d180ff4d0 con 0x7f4d18103500 2024-02-15T22:49:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.164+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1818fb70 con 0x7f4d18103500 2024-02-15T22:49:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.165+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f4d0c0038f0 con 0x7f4d18103500 2024-02-15T22:49:50.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.165+0000 7f4d077fe700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 0x7f4d0006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.165+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4d0c08cd20 con 0x7f4d18103500 2024-02-15T22:49:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.166+0000 7f4d1659c700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 0x7f4d0006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.166+0000 7f4d1659c700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 0x7f4d0006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009c60 tx=0x7f4d08009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:50.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.170+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4d0c05aeb0 con 0x7f4d18103500 2024-02-15T22:49:50.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.446+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d1802cfa0 con 0x7f4d0006c680 2024-02-15T22:49:50.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.447+0000 7f4d077fe700 1 -- 172.21.15.138:0/1916806255 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4d1802cfa0 con 0x7f4d0006c680 2024-02-15T22:49:50.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 msgr2=0x7f4d0006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 0x7f4d0006eb30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009c60 tx=0x7f4d08009260 comp rx=0 tx=0).stop 2024-02-15T22:49:50.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 msgr2=0x7f4d180feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c000c00 tx=0x7f4d0c00f690 comp rx=0 tx=0).stop 2024-02-15T22:49:50.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 shutdown_connections 2024-02-15T22:49:50.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f4d0006c680 0x7f4d0006eb30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d18100be0 0x7f4d18100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 --2- 172.21.15.138:0/1916806255 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d18103500 0x7f4d180feb90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 >> 172.21.15.138:0/1916806255 conn(0x7f4d180fa5e0 msgr2=0x7f4d180fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:50.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 shutdown_connections 2024-02-15T22:49:50.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.450+0000 7f4d1cd06700 1 -- 172.21.15.138:0/1916806255 wait complete. 2024-02-15T22:49:50.463 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:49:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: Upgrade: Need to upgrade myself (mgr.smithi138.jqscxs) 2024-02-15T22:49:50.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:50 smithi170 ceph-mon[35248]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi170 2024-02-15T22:49:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.590+0000 7eff63b10700 1 -- 172.21.15.138:0/2416122365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 msgr2=0x7eff5c1058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.590+0000 7eff63b10700 1 --2- 172.21.15.138:0/2416122365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c1058e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009910 tx=0x7eff4c009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 -- 172.21.15.138:0/2416122365 shutdown_connections 2024-02-15T22:49:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 --2- 172.21.15.138:0/2416122365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c1058e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 --2- 172.21.15.138:0/2416122365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 0x7eff5c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 -- 172.21.15.138:0/2416122365 >> 172.21.15.138:0/2416122365 conn(0x7eff5c0fa5e0 msgr2=0x7eff5c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 -- 172.21.15.138:0/2416122365 shutdown_connections 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 -- 172.21.15.138:0/2416122365 wait complete. 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 Processor -- start 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.591+0000 7eff63b10700 1 -- start start 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff63b10700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 0x7eff5c195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff63b10700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff63b10700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c196490 con 0x7eff5c103500 2024-02-15T22:49:50.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff63b10700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c1965d0 con 0x7eff5c100be0 2024-02-15T22:49:50.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53218/0 (socket says 172.21.15.138:53218) 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 -- 172.21.15.138:0/112753774 learned_addr learned my addr 172.21.15.138:0/112753774 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff618ac700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 0x7eff5c195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 -- 172.21.15.138:0/112753774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 msgr2=0x7eff5c195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 0x7eff5c195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 -- 172.21.15.138:0/112753774 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0095f0 con 0x7eff5c103500 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff610ab700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00bd70 tx=0x7eff4c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.592+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4c01d070 con 0x7eff5c103500 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.593+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c19b020 con 0x7eff5c103500 2024-02-15T22:49:50.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.593+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c19b510 con 0x7eff5c103500 2024-02-15T22:49:50.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.593+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff4c005dc0 con 0x7eff5c103500 2024-02-15T22:49:50.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.593+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4c021410 con 0x7eff5c103500 2024-02-15T22:49:50.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.594+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c18fb70 con 0x7eff5c103500 2024-02-15T22:49:50.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.594+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7eff4c00f7d0 con 0x7eff5c103500 2024-02-15T22:49:50.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.595+0000 7eff52ffd700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 0x7eff4806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:50.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.595+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7eff4c08cb90 con 0x7eff5c103500 2024-02-15T22:49:50.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.595+0000 7eff618ac700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 0x7eff4806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:50.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.596+0000 7eff618ac700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 0x7eff4806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff58005950 tx=0x7eff5800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:50.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.599+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7eff4c05aca0 con 0x7eff5c103500 2024-02-15T22:49:50.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.876+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff5c061190 con 0x7eff4806c680 2024-02-15T22:49:50.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.878+0000 7eff52ffd700 1 -- 172.21.15.138:0/112753774 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7eff5c061190 con 0x7eff4806c680 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 msgr2=0x7eff4806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 0x7eff4806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7eff58005950 tx=0x7eff5800b410 comp rx=0 tx=0).stop 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 msgr2=0x7eff5c195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00bd70 tx=0x7eff4c00bda0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 shutdown_connections 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7eff4806c680 0x7eff4806eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff5c100be0 0x7eff5c195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 --2- 172.21.15.138:0/112753774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff5c103500 0x7eff5c195e70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 >> 172.21.15.138:0/112753774 conn(0x7eff5c0fa5e0 msgr2=0x7eff5c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:50.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 shutdown_connections 2024-02-15T22:49:50.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:50.881+0000 7eff63b10700 1 -- 172.21.15.138:0/112753774 wait complete. 2024-02-15T22:49:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 -- 172.21.15.138:0/4229431297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 msgr2=0x7f82ec101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 --2- 172.21.15.138:0/4229431297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec101840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009910 tx=0x7f82d8009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:51.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 -- 172.21.15.138:0/4229431297 shutdown_connections 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 --2- 172.21.15.138:0/4229431297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec101840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 --2- 172.21.15.138:0/4229431297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 -- 172.21.15.138:0/4229431297 >> 172.21.15.138:0/4229431297 conn(0x7f82ec0f9d80 msgr2=0x7f82ec0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 -- 172.21.15.138:0/4229431297 shutdown_connections 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.009+0000 7f82f313c700 1 -- 172.21.15.138:0/4229431297 wait complete. 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 Processor -- start 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 -- start start 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1964b0 con 0x7f82ec1013f0 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f313c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1965f0 con 0x7f82ec0fe410 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82ebfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.010+0000 7f82f0ed8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82f0ed8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:60642/0 (socket says 172.21.15.138:60642) 2024-02-15T22:49:51.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82f0ed8700 1 -- 172.21.15.138:0/3397759403 learned_addr learned my addr 172.21.15.138:0/3397759403 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:51.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82ebfff700 1 -- 172.21.15.138:0/3397759403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 msgr2=0x7f82ec195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82ebfff700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82ebfff700 1 -- 172.21.15.138:0/3397759403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80095f0 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82f0ed8700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82ebfff700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec195e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009910 tx=0x7f82d800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d801d070 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec19b040 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82d8005dc0 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.011+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d8021410 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.012+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec19b530 con 0x7f82ec1013f0 2024-02-15T22:49:51.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.013+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec108c90 con 0x7f82ec1013f0 2024-02-15T22:49:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.014+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f82d800f7d0 con 0x7f82ec1013f0 2024-02-15T22:49:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.014+0000 7f82e9ffb700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 0x7f82dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.014+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f82d808cb80 con 0x7f82ec1013f0 2024-02-15T22:49:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.014+0000 7f82f0ed8700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 0x7f82dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.015+0000 7f82f0ed8700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 0x7f82dc06eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f82e00105c0 tx=0x7f82e000b4a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:51.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.022+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f82d805ac90 con 0x7f82ec1013f0 2024-02-15T22:49:51.159 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:51 smithi138 ceph-mon[29229]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-15T22:49:51.160 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:51 smithi138 ceph-mon[29229]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:51.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.383+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82ec19bc30 con 0x7f82dc06c680 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.394+0000 7f82e9ffb700 1 -- 172.21.15.138:0/3397759403 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f82ec19bc30 con 0x7f82dc06c680 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (5m) 55s ago 6m 27.3M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (7m) 55s ago 7m 7470k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (6m) 60s ago 6m 7407k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (7m) 55s ago 7m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:49:51.396 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (6m) 60s ago 6m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (5m) 55s ago 6m 84.3M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (81s) 55s ago 80s 12.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (75s) 55s ago 74s 16.2M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (78s) 60s ago 77s 18.3M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (72s) 60s ago 72s 15.5M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:9283,8765,8443 running (8m) 55s ago 8m 488M - 18.2.0 dc2bc1663786 8807f70e9831 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (5m) 60s ago 5m 439M - 18.2.0 dc2bc1663786 47b88133c81f 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (8m) 55s ago 8m 50.6M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (5m) 60s ago 5m 38.0M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 55s ago 6m 14.1M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 60s ago 5m 16.1M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (5m) 55s ago 5m 48.4M 3946M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (4m) 55s ago 4m 48.6M 3946M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (4m) 55s ago 4m 49.2M 3946M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:49:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (3m) 60s ago 3m 49.0M 4970M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:49:51.398 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (3m) 60s ago 3m 45.9M 4970M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:49:51.398 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (2m) 60s ago 2m 43.4M 4970M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:49:51.398 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (5m) 55s ago 6m 62.5M - 2.43.0 a07b618ecd1d 52e833c326a0 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 msgr2=0x7f82dc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 0x7f82dc06eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f82e00105c0 tx=0x7f82e000b4a0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 msgr2=0x7f82ec195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec195e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009910 tx=0x7f82d800bd70 comp rx=0 tx=0).stop 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 shutdown_connections 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f82dc06c680 0x7f82dc06eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82ec0fe410 0x7f82ec195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 --2- 172.21.15.138:0/3397759403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82ec1013f0 0x7f82ec195e90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 >> 172.21.15.138:0/3397759403 conn(0x7f82ec0f9d80 msgr2=0x7f82ec104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 shutdown_connections 2024-02-15T22:49:51.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.396+0000 7f82f313c700 1 -- 172.21.15.138:0/3397759403 wait complete. 2024-02-15T22:49:51.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:51 smithi170 ceph-mon[35248]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-15T22:49:51.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:51 smithi170 ceph-mon[35248]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:51.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 -- 172.21.15.138:0/4119191553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 msgr2=0x7fddb8102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 --2- 172.21.15.138:0/4119191553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8102f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddac009910 tx=0x7fddac009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 -- 172.21.15.138:0/4119191553 shutdown_connections 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 --2- 172.21.15.138:0/4119191553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 0x7fddb81058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 --2- 172.21.15.138:0/4119191553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8102f90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.548+0000 7fddbf18f700 1 -- 172.21.15.138:0/4119191553 >> 172.21.15.138:0/4119191553 conn(0x7fddb80fa5d0 msgr2=0x7fddb80fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.549+0000 7fddbf18f700 1 -- 172.21.15.138:0/4119191553 shutdown_connections 2024-02-15T22:49:51.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.549+0000 7fddbf18f700 1 -- 172.21.15.138:0/4119191553 wait complete. 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.549+0000 7fddbf18f700 1 Processor -- start 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.549+0000 7fddbf18f700 1 -- start start 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbf18f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbf18f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 0x7fddb80feb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbf18f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80ff0a0 con 0x7fddb8100bb0 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbf18f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80ff1e0 con 0x7fddb81034d0 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53256/0 (socket says 172.21.15.138:53256) 2024-02-15T22:49:51.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 -- 172.21.15.138:0/640781274 learned_addr learned my addr 172.21.15.138:0/640781274 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddb7fff700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 0x7fddb80feb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 -- 172.21.15.138:0/640781274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 msgr2=0x7fddb80feb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 0x7fddb80feb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 -- 172.21.15.138:0/640781274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0095f0 con 0x7fddb8100bb0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddbcf2b700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddac006010 tx=0x7fddac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac01d070 con 0x7fddb8100bb0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.550+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fddac00f460 con 0x7fddb8100bb0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.551+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddac021640 con 0x7fddb8100bb0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.551+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80ff460 con 0x7fddb8100bb0 2024-02-15T22:49:51.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.551+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80ff900 con 0x7fddb8100bb0 2024-02-15T22:49:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.552+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb818fb40 con 0x7fddb8100bb0 2024-02-15T22:49:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.553+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fddac00fab0 con 0x7fddb8100bb0 2024-02-15T22:49:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.553+0000 7fddb5ffb700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 0x7fdda806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.554+0000 7fddb7fff700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 0x7fdda806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:51.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.554+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fddac08cbb0 con 0x7fddb8100bb0 2024-02-15T22:49:51.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.554+0000 7fddb7fff700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 0x7fdda806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005950 tx=0x7fdda400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:51.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.558+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fddac093080 con 0x7fddb8100bb0 2024-02-15T22:49:51.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.951+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddb802cc30 con 0x7fddb8100bb0 2024-02-15T22:49:51.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.951+0000 7fddb5ffb700 1 -- 172.21.15.138:0/640781274 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fddac05acc0 con 0x7fddb8100bb0 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:49:51.954 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:49:51.955 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-15T22:49:51.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:49:51.955 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.954+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 msgr2=0x7fdda806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.954+0000 7fddbf18f700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 0x7fdda806eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdda4005950 tx=0x7fdda400b410 comp rx=0 tx=0).stop 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.954+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 msgr2=0x7fddb8100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.954+0000 7fddbf18f700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddac006010 tx=0x7fddac00bd70 comp rx=0 tx=0).stop 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 shutdown_connections 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fdda806c680 0x7fdda806eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb8100bb0 0x7fddb8100510 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 --2- 172.21.15.138:0/640781274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb81034d0 0x7fddb80feb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 >> 172.21.15.138:0/640781274 conn(0x7fddb80fa5d0 msgr2=0x7fddb80fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 shutdown_connections 2024-02-15T22:49:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:51.955+0000 7fddbf18f700 1 -- 172.21.15.138:0/640781274 wait complete. 2024-02-15T22:49:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 -- 172.21.15.138:0/3994062860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba40fe410 msgr2=0x7f3ba40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/3994062860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba40fe410 0x7f3ba40fe820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009910 tx=0x7f3b98009c20 comp rx=0 tx=0).stop 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 -- 172.21.15.138:0/3994062860 shutdown_connections 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/3994062860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba41013f0 0x7f3ba4101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/3994062860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba40fe410 0x7f3ba40fe820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 -- 172.21.15.138:0/3994062860 >> 172.21.15.138:0/3994062860 conn(0x7f3ba40f9d80 msgr2=0x7f3ba40fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 -- 172.21.15.138:0/3994062860 shutdown_connections 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.078+0000 7f3baaf5a700 1 -- 172.21.15.138:0/3994062860 wait complete. 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 Processor -- start 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 -- start start 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40fe410 0x7f3ba4195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba41964e0 con 0x7f3ba41013f0 2024-02-15T22:49:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3baaf5a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4196620 con 0x7f3ba40fe410 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3ba3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3ba8cf6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40fe410 0x7f3ba4195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3ba3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53274/0 (socket says 172.21.15.138:53274) 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3ba3fff700 1 -- 172.21.15.138:0/2475347097 learned_addr learned my addr 172.21.15.138:0/2475347097 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.079+0000 7f3ba3fff700 1 -- 172.21.15.138:0/2475347097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40fe410 msgr2=0x7f3ba4195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:52.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba3fff700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40fe410 0x7f3ba4195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba3fff700 1 -- 172.21.15.138:0/2475347097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980095f0 con 0x7f3ba41013f0 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba3fff700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d900 tx=0x7f3b9000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b900041f0 con 0x7f3ba41013f0 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b90004ce0 con 0x7f3ba41013f0 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40ff240 con 0x7f3ba41013f0 2024-02-15T22:49:52.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9000b750 con 0x7f3ba41013f0 2024-02-15T22:49:52.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.080+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba40ff790 con 0x7f3ba41013f0 2024-02-15T22:49:52.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.081+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4108c90 con 0x7f3ba41013f0 2024-02-15T22:49:52.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.082+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f3b90004e50 con 0x7f3ba41013f0 2024-02-15T22:49:52.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.082+0000 7f3ba1ffb700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 0x7f3b9406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:49:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.083+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3b9008b840 con 0x7f3ba41013f0 2024-02-15T22:49:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.083+0000 7f3ba8cf6700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 0x7f3b9406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:49:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.083+0000 7f3ba8cf6700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 0x7f3b9406eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b98006010 tx=0x7f3b98005ec0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:49:52.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.090+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3b90059950 con 0x7f3ba41013f0 2024-02-15T22:49:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:52 smithi138 ceph-mon[29229]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:52 smithi138 ceph-mon[29229]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:52 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/640781274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.376+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba4105d40 con 0x7f3b9406c680 2024-02-15T22:49:52.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.378+0000 7f3ba1ffb700 1 -- 172.21.15.138:0/2475347097 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f3ba4105d40 con 0x7f3b9406c680 2024-02-15T22:49:52.380 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:49:52.380 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:49:52.380 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [], 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "0/2 daemons upgraded", 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi170", 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:49:52.381 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:49:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 msgr2=0x7f3b9406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 0x7f3b9406eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b98006010 tx=0x7f3b98005ec0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 msgr2=0x7f3ba4195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:49:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000d900 tx=0x7f3b9000dc10 comp rx=0 tx=0).stop 2024-02-15T22:49:52.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 shutdown_connections 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f3b9406c680 0x7f3b9406eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40fe410 0x7f3ba4195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 --2- 172.21.15.138:0/2475347097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ba41013f0 0x7f3ba4195ec0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 >> 172.21.15.138:0/2475347097 conn(0x7f3ba40f9d80 msgr2=0x7f3ba4104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 shutdown_connections 2024-02-15T22:49:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:49:52.381+0000 7f3baaf5a700 1 -- 172.21.15.138:0/2475347097 wait complete. 2024-02-15T22:49:52.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:52 smithi170 ceph-mon[35248]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:52.533 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:52 smithi170 ceph-mon[35248]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:52.533 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:52 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/640781274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:49:53.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:53 smithi138 ceph-mon[29229]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-15T22:49:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:53 smithi138 ceph-mon[29229]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:53 smithi170 ceph-mon[35248]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-15T22:49:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:53 smithi170 ceph-mon[35248]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:49:55.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:55 smithi138 ceph-mon[29229]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:49:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:55 smithi170 ceph-mon[35248]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T22:49:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:57 smithi138 ceph-mon[29229]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:49:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:57 smithi170 ceph-mon[35248]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:49:59.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:49:58 smithi170 ceph-mon[35248]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:49:59.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:49:58 smithi138 ceph-mon[29229]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:50:00.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:00 smithi138 ceph-mon[29229]: overall HEALTH_OK 2024-02-15T22:50:00.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:00 smithi170 ceph-mon[35248]: overall HEALTH_OK 2024-02-15T22:50:01.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:01 smithi138 ceph-mon[29229]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:50:01.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:01 smithi170 ceph-mon[35248]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:50:03.065 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:03 smithi170 ceph-mon[35248]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:03 smithi138 ceph-mon[29229]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:04.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:04 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:04 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:05 smithi170 ceph-mon[35248]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:50:05.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:05 smithi138 ceph-mon[29229]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:50:07.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:07 smithi138 ceph-mon[29229]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:07 smithi170 ceph-mon[35248]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:08 smithi170 ceph-mon[35248]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:50:09.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:08 smithi138 ceph-mon[29229]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:50:11.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:11 smithi138 ceph-mon[29229]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:11 smithi170 ceph-mon[35248]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:13 smithi170 ceph-mon[35248]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:13.472 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:13 smithi138 ceph-mon[29229]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:15 smithi170 ceph-mon[35248]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:50:15.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:15 smithi138 ceph-mon[29229]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:50:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:17 smithi170 ceph-mon[35248]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:17.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:17 smithi138 ceph-mon[29229]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:18.229 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to 'f78a58c0ffd401d1493058a1022c35f011d65275'. 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-02-15T22:50:18.231 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at f78a58c0ffd Merge PR #55601 into wip-batrick-testing-20240215.160715 2024-02-15T22:50:18.233 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-15T22:50:18.271 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T22:50:18.273 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T22:50:18.273 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: Upgrade: Updating mgr.smithi170.gczrzt 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: Deploying daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:50:19.001 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:18 smithi170 ceph-mon[35248]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:50:19.031 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T22:50:19.104 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T22:50:19.143 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T22:50:19.145 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T22:50:19.145 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T22:50:19.184 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T22:50:19.188 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T22:50:19.189 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-15T22:50:19.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: Upgrade: Updating mgr.smithi170.gczrzt 2024-02-15T22:50:19.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:50:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:50:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: Deploying daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:50:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:18 smithi138 ceph-mon[29229]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:50:19.245 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-15T22:50:19.247 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T22:50:19.247 DEBUG:teuthology.orchestra.run.smithi138:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f78a58c0ffd401d1493058a1022c35f011d65275 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-15T22:50:19.307 INFO:tasks.workunit.client.0.smithi138.stderr:+ mkdir -p fsstress 2024-02-15T22:50:19.308 INFO:tasks.workunit.client.0.smithi138.stderr:+ pushd fsstress 2024-02-15T22:50:19.309 INFO:tasks.workunit.client.0.smithi138.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:50:19.309 INFO:tasks.workunit.client.0.smithi138.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T22:50:19.820 INFO:tasks.workunit.client.0.smithi138.stderr:+ tar xzf ltp-full.tgz 2024-02-15T22:50:20.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:19 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:20.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:19 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:21.160 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:20 smithi170 ceph-mon[35248]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:21.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:20 smithi138 ceph-mon[29229]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 -- 172.21.15.138:0/790426314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140ff380 msgr2=0x7fa5140ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 --2- 172.21.15.138:0/790426314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140ff380 0x7fa5140ff7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa508009910 tx=0x7fa508009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 -- 172.21.15.138:0/790426314 shutdown_connections 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 --2- 172.21.15.138:0/790426314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140ff380 0x7fa5140ff7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 --2- 172.21.15.138:0/790426314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140fea30 0x7fa5140fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 -- 172.21.15.138:0/790426314 >> 172.21.15.138:0/790426314 conn(0x7fa5140fa5e0 msgr2=0x7fa5140fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 -- 172.21.15.138:0/790426314 shutdown_connections 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 -- 172.21.15.138:0/790426314 wait complete. 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.497+0000 7fa5197bf700 1 Processor -- start 2024-02-15T22:50:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5197bf700 1 -- start start 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5197bf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5197bf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140ff380 0x7fa514198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5197bf700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514198690 con 0x7fa5140fea30 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5197bf700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141987d0 con 0x7fa5140ff380 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40212/0 (socket says 172.21.15.138:40212) 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 -- 172.21.15.138:0/3202027815 learned_addr learned my addr 172.21.15.138:0/3202027815 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa5127fc700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140ff380 0x7fa514198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 -- 172.21.15.138:0/3202027815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140ff380 msgr2=0x7fa514198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140ff380 0x7fa514198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.498+0000 7fa512ffd700 1 -- 172.21.15.138:0/3202027815 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080095f0 con 0x7fa5140fea30 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa512ffd700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d8d0 tx=0x7fa50400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:22.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5040098a0 con 0x7fa5140fea30 2024-02-15T22:50:22.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa504010460 con 0x7fa5140fea30 2024-02-15T22:50:22.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50400f5f0 con 0x7fa5140fea30 2024-02-15T22:50:22.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51419d280 con 0x7fa5140fea30 2024-02-15T22:50:22.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.499+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51419d7d0 con 0x7fa5140fea30 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.500+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51410ae80 con 0x7fa5140fea30 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.500+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa504009a00 con 0x7fa5140fea30 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.501+0000 7fa4fbfff700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 0x7fa4fc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.501+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa50408b710 con 0x7fa5140fea30 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.501+0000 7fa5127fc700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 0x7fa4fc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.501+0000 7fa5127fc700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 0x7fa4fc06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa508006010 tx=0x7fa50800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:22.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.506+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa5040598a0 con 0x7fa5140fea30 2024-02-15T22:50:22.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.728+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa514108780 con 0x7fa4fc06c680 2024-02-15T22:50:22.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.729+0000 7fa4fbfff700 1 -- 172.21.15.138:0/3202027815 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fa514108780 con 0x7fa4fc06c680 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 msgr2=0x7fa4fc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 0x7fa4fc06eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa508006010 tx=0x7fa50800b540 comp rx=0 tx=0).stop 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 msgr2=0x7fa514197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d8d0 tx=0x7fa50400dbe0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 shutdown_connections 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa4fc06c680 0x7fa4fc06eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5140fea30 0x7fa514197b30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 --2- 172.21.15.138:0/3202027815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5140ff380 0x7fa514198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 >> 172.21.15.138:0/3202027815 conn(0x7fa5140fa5e0 msgr2=0x7fa514107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 shutdown_connections 2024-02-15T22:50:22.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.732+0000 7fa5197bf700 1 -- 172.21.15.138:0/3202027815 wait complete. 2024-02-15T22:50:22.747 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 -- 172.21.15.138:0/2428540931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 msgr2=0x7ff7b00ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 --2- 172.21.15.138:0/2428540931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b00ff460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009910 tx=0x7ff7a0009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 -- 172.21.15.138:0/2428540931 shutdown_connections 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 --2- 172.21.15.138:0/2428540931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 0x7ff7b01006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 --2- 172.21.15.138:0/2428540931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b00ff460 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 -- 172.21.15.138:0/2428540931 >> 172.21.15.138:0/2428540931 conn(0x7ff7b00fa5e0 msgr2=0x7ff7b00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 -- 172.21.15.138:0/2428540931 shutdown_connections 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.847+0000 7ff7b5821700 1 -- 172.21.15.138:0/2428540931 wait complete. 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 Processor -- start 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 -- start start 2024-02-15T22:50:22.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 0x7ff7b019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b019f060 con 0x7ff7b00ff050 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7b5821700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01a36f0 con 0x7ff7b0100250 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7aeffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7aeffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40232/0 (socket says 172.21.15.138:40232) 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7aeffd700 1 -- 172.21.15.138:0/163268320 learned_addr learned my addr 172.21.15.138:0/163268320 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.848+0000 7ff7a7fff700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 0x7ff7b019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7aeffd700 1 -- 172.21.15.138:0/163268320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 msgr2=0x7ff7b019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7aeffd700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 0x7ff7b019ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7aeffd700 1 -- 172.21.15.138:0/163268320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00095f0 con 0x7ff7b00ff050 2024-02-15T22:50:22.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7aeffd700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000bda0 tx=0x7ff7a000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a001d070 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff7a000f460 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0021640 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b01a3890 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.849+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b01a3d30 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.850+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b006cf20 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.851+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7ff7a000f5d0 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.851+0000 7ff7b481f700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 0x7ff79c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.852+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff7a008cba0 con 0x7ff7b00ff050 2024-02-15T22:50:22.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.852+0000 7ff7a7fff700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 0x7ff79c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:22.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.852+0000 7ff7a7fff700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 0x7ff79c06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0072ee0 tx=0x7ff79800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:22.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:22.856+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff7a00572a0 con 0x7ff7b00ff050 2024-02-15T22:50:23.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.126+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7b0061190 con 0x7ff79c06c680 2024-02-15T22:50:23.128 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:23 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:23.129 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:23 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:23.129 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:23 smithi138 ceph-mon[29229]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:23.129 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:23 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:23.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.127+0000 7ff7b481f700 1 -- 172.21.15.138:0/163268320 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7ff7b0061190 con 0x7ff79c06c680 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 msgr2=0x7ff79c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 0x7ff79c06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0072ee0 tx=0x7ff79800b410 comp rx=0 tx=0).stop 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 msgr2=0x7ff7b019e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000bda0 tx=0x7ff7a000bdd0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 shutdown_connections 2024-02-15T22:50:23.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7ff79c06c680 0x7ff79c06eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7b00ff050 0x7ff7b019e500 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 --2- 172.21.15.138:0/163268320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7b0100250 0x7ff7b019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 >> 172.21.15.138:0/163268320 conn(0x7ff7b00fa5e0 msgr2=0x7ff7b00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:23.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 shutdown_connections 2024-02-15T22:50:23.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.130+0000 7ff7b5821700 1 -- 172.21.15.138:0/163268320 wait complete. 2024-02-15T22:50:23.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.247+0000 7f44c67fc700 1 -- 172.21.15.138:0/2564226461 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b800baf0 con 0x7f44c80fe430 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2564226461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe430 msgr2=0x7f44c80fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2564226461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe430 0x7f44c80fe840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009910 tx=0x7f44b8009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2564226461 shutdown_connections 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2564226461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c81014b0 0x7f44c8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2564226461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe430 0x7f44c80fe840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2564226461 >> 172.21.15.138:0/2564226461 conn(0x7f44c80f9d80 msgr2=0x7f44c80fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:23.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2564226461 shutdown_connections 2024-02-15T22:50:23.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.248+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2564226461 wait complete. 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 Processor -- start 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 -- start start 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 0x7f44c8193790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81942f0 con 0x7f44c81014b0 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44cdbe2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8194430 con 0x7f44c80fe430 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.249+0000 7f44c6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c77fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 0x7f44c8193790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40256/0 (socket says 172.21.15.138:40256) 2024-02-15T22:50:23.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 -- 172.21.15.138:0/2577178445 learned_addr learned my addr 172.21.15.138:0/2577178445 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 -- 172.21.15.138:0/2577178445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 msgr2=0x7f44c8193790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 0x7f44c8193790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 -- 172.21.15.138:0/2577178445 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80095f0 con 0x7f44c81014b0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c77fe700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 0x7f44c8193790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c6ffd700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e920 tx=0x7f44bc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44bc00c9d0 con 0x7f44c81014b0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.250+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8198ee0 con 0x7f44c81014b0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.251+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44bc010430 con 0x7f44c81014b0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.251+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c8199400 con 0x7f44c81014b0 2024-02-15T22:50:23.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.251+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44bc0185f0 con 0x7f44c81014b0 2024-02-15T22:50:23.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.252+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c80ff700 con 0x7f44c81014b0 2024-02-15T22:50:23.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.253+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f44bc0105a0 con 0x7f44c81014b0 2024-02-15T22:50:23.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.254+0000 7f44c4ff9700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 0x7f44b0072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.254+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f44bc014070 con 0x7f44c81014b0 2024-02-15T22:50:23.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.254+0000 7f44c77fe700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 0x7f44b0072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.255+0000 7f44c77fe700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 0x7f44b0072f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b6f0 tx=0x7f44b8005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:23.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.258+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f44bc05a5e0 con 0x7f44c81014b0 2024-02-15T22:50:23.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:23 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:23.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:23 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:23.310 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:23 smithi170 ceph-mon[35248]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 168 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-15T22:50:23.311 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:23 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:23.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.476+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44c80fad40 con 0x7f44b0070a90 2024-02-15T22:50:23.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.488+0000 7f44c4ff9700 1 -- 172.21.15.138:0/2577178445 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3576 (secure 0 0 0) 0x7f44c80fad40 con 0x7f44b0070a90 2024-02-15T22:50:23.490 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:50:23.490 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (5m) 87s ago 7m 27.3M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (7m) 87s ago 7m 7470k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (6m) 92s ago 6m 7407k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (7m) 87s ago 7m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (6m) 92s ago 6m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (5m) 87s ago 7m 84.3M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (113s) 87s ago 112s 12.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (107s) 87s ago 106s 16.2M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (110s) 92s ago 110s 18.3M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (104s) 92s ago 104s 15.5M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:9283,8765,8443 running (8m) 87s ago 8m 488M - 18.2.0 dc2bc1663786 8807f70e9831 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 starting - - - - 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (9m) 87s ago 9m 50.6M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (6m) 92s ago 6m 38.0M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 87s ago 7m 14.1M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 92s ago 6m 16.1M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:50:23.491 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (5m) 87s ago 5m 48.4M 3946M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (5m) 87s ago 5m 48.6M 3946M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (4m) 87s ago 4m 49.2M 3946M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (4m) 92s ago 4m 49.0M 4970M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (3m) 92s ago 3m 45.9M 4970M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (3m) 92s ago 3m 43.4M 4970M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:50:23.492 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (5m) 87s ago 6m 62.5M - 2.43.0 a07b618ecd1d 52e833c326a0 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 msgr2=0x7f44b0072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 0x7f44b0072f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b6f0 tx=0x7f44b8005940 comp rx=0 tx=0).stop 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 msgr2=0x7f44c8193cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e920 tx=0x7f44bc00ec30 comp rx=0 tx=0).stop 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 shutdown_connections 2024-02-15T22:50:23.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f44b0070a90 0x7f44b0072f40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c80fe430 0x7f44c8193790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 --2- 172.21.15.138:0/2577178445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c81014b0 0x7f44c8193cd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 >> 172.21.15.138:0/2577178445 conn(0x7f44c80f9d80 msgr2=0x7f44c80fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:23.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 shutdown_connections 2024-02-15T22:50:23.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.491+0000 7f44cdbe2700 1 -- 172.21.15.138:0/2577178445 wait complete. 2024-02-15T22:50:23.542 INFO:tasks.workunit.client.1.smithi170.stderr:Updating files: 93% (11460/12222) Updating files: 94% (11489/12222) Updating files: 95% (11611/12222) Updating files: 96% (11734/12222) Updating files: 97% (11856/12222) Updating files: 98% (11978/12222) Updating files: 99% (12100/12222) Updating files: 100% (12222/12222) Updating files: 100% (12222/12222), done. 2024-02-15T22:50:23.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 -- 172.21.15.138:0/813013760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3980ff320 msgr2=0x7fa3980ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 --2- 172.21.15.138:0/813013760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3980ff320 0x7fa3980ff770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009910 tx=0x7fa38c009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 -- 172.21.15.138:0/813013760 shutdown_connections 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 --2- 172.21.15.138:0/813013760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3980ff320 0x7fa3980ff770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 --2- 172.21.15.138:0/813013760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3981005e0 0x7fa3981009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 -- 172.21.15.138:0/813013760 >> 172.21.15.138:0/813013760 conn(0x7fa3980f9d80 msgr2=0x7fa3980fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 -- 172.21.15.138:0/813013760 shutdown_connections 2024-02-15T22:50:23.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.610+0000 7fa39d294700 1 -- 172.21.15.138:0/813013760 wait complete. 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 Processor -- start 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 -- start start 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 0x7fa398195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3981964f0 con 0x7fa3981005e0 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.611+0000 7fa39d294700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398196630 con 0x7fa3980ff320 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54216/0 (socket says 172.21.15.138:54216) 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 -- 172.21.15.138:0/3925054432 learned_addr learned my addr 172.21.15.138:0/3925054432 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa396ffd700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 0x7fa398195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 -- 172.21.15.138:0/3925054432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 msgr2=0x7fa398195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 0x7fa398195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 -- 172.21.15.138:0/3925054432 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0095f0 con 0x7fa3981005e0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa396ffd700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 0x7fa398195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa3967fc700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa38c006010 tx=0x7fa38c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38c01d070 con 0x7fa3981005e0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39819b030 con 0x7fa3981005e0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.612+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa38c00f460 con 0x7fa3981005e0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.613+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38c021640 con 0x7fa3981005e0 2024-02-15T22:50:23.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.613+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39819b5a0 con 0x7fa3981005e0 2024-02-15T22:50:23.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.614+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa398107b90 con 0x7fa3981005e0 2024-02-15T22:50:23.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.615+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7fa38c00f5d0 con 0x7fa3981005e0 2024-02-15T22:50:23.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.615+0000 7fa37ffff700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 0x7fa38006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:23.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.615+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa38c08cc70 con 0x7fa3981005e0 2024-02-15T22:50:23.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.615+0000 7fa396ffd700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 0x7fa38006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:23.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.616+0000 7fa396ffd700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 0x7fa38006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa388005950 tx=0x7fa3880058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:23.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.622+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa38c05ad80 con 0x7fa3981005e0 2024-02-15T22:50:23.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.944+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa39819bbe0 con 0x7fa3981005e0 2024-02-15T22:50:23.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.944+0000 7fa37ffff700 1 -- 172.21.15.138:0/3925054432 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fa38c05a910 con 0x7fa3981005e0 2024-02-15T22:50:23.946 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-02-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 msgr2=0x7fa38006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 0x7fa38006eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa388005950 tx=0x7fa3880058e0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 msgr2=0x7fa398195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa38c006010 tx=0x7fa38c00be20 comp rx=0 tx=0).stop 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 shutdown_connections 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7fa38006c680 0x7fa38006eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3980ff320 0x7fa398195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 --2- 172.21.15.138:0/3925054432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa3981005e0 0x7fa398195ed0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:23.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 >> 172.21.15.138:0/3925054432 conn(0x7fa3980f9d80 msgr2=0x7fa3980fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:23.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 shutdown_connections 2024-02-15T22:50:23.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:23.947+0000 7fa39d294700 1 -- 172.21.15.138:0/3925054432 wait complete. 2024-02-15T22:50:24.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 -- 172.21.15.138:0/294922167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c100250 msgr2=0x7f595c1006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:24.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 --2- 172.21.15.138:0/294922167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c100250 0x7f595c1006a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5950009910 tx=0x7f5950009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:24.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 -- 172.21.15.138:0/294922167 shutdown_connections 2024-02-15T22:50:24.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 --2- 172.21.15.138:0/294922167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c100250 0x7f595c1006a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 --2- 172.21.15.138:0/294922167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c0ff050 0x7f595c0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.071+0000 7f59627e2700 1 -- 172.21.15.138:0/294922167 >> 172.21.15.138:0/294922167 conn(0x7f595c0fa5e0 msgr2=0x7f595c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:24.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.072+0000 7f59627e2700 1 -- 172.21.15.138:0/294922167 shutdown_connections 2024-02-15T22:50:24.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.072+0000 7f59627e2700 1 -- 172.21.15.138:0/294922167 wait complete. 2024-02-15T22:50:24.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.072+0000 7f59627e2700 1 Processor -- start 2024-02-15T22:50:24.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.072+0000 7f59627e2700 1 -- start start 2024-02-15T22:50:24.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f59627e2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:24.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f59627e2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c100250 0x7f595c195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:24.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f59627e2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1964e0 con 0x7f595c0ff050 2024-02-15T22:50:24.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f59627e2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c196620 con 0x7f595c100250 2024-02-15T22:50:24.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:24.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54224/0 (socket says 172.21.15.138:54224) 2024-02-15T22:50:24.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 -- 172.21.15.138:0/3665397793 learned_addr learned my addr 172.21.15.138:0/3665397793 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:24.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595b7fe700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c100250 0x7f595c195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:24.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 -- 172.21.15.138:0/3665397793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c100250 msgr2=0x7f595c195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c100250 0x7f595c195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 -- 172.21.15.138:0/3665397793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500095f0 con 0x7f595c0ff050 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f595bfff700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d900 tx=0x7f594c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.073+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594c0041f0 con 0x7f595c0ff050 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.074+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f594c004350 con 0x7f595c0ff050 2024-02-15T22:50:24.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.074+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c19b0d0 con 0x7f595c0ff050 2024-02-15T22:50:24.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.074+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f594c003d20 con 0x7f595c0ff050 2024-02-15T22:50:24.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.074+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c19b620 con 0x7f595c0ff050 2024-02-15T22:50:24.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.075+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c107ba0 con 0x7f595c0ff050 2024-02-15T22:50:24.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.075+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) v1 ==== 89916+0+0 (secure 0 0 0) 0x7f594c009730 con 0x7f595c0ff050 2024-02-15T22:50:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.076+0000 7f59597fa700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 0x7f594406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.076+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f594c08b7e0 con 0x7f595c0ff050 2024-02-15T22:50:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.076+0000 7f595b7fe700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 0x7f594406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.076+0000 7f595b7fe700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 0x7f594406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5950006010 tx=0x7f595000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr:Note: switching to 'f78a58c0ffd401d1493058a1022c35f011d65275'. 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.082 INFO:tasks.workunit.client.1.smithi170.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: git switch -c 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr:Or undo this operation with: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: git switch - 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr: 2024-02-15T22:50:24.083 INFO:tasks.workunit.client.1.smithi170.stderr:HEAD is now at f78a58c0ffd Merge PR #55601 into wip-batrick-testing-20240215.160715 2024-02-15T22:50:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.080+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f594c0598f0 con 0x7f595c0ff050 2024-02-15T22:50:24.085 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-15T22:50:24.175 INFO:tasks.workunit.client.1.smithi170.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T22:50:24.177 INFO:tasks.workunit.client.1.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T22:50:24.177 INFO:tasks.workunit.client.1.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T22:50:24.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:24 smithi138 ceph-mon[29229]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:24 smithi138 ceph-mon[29229]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:24 smithi138 ceph-mon[29229]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:24 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3925054432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:24 smithi170 ceph-mon[35248]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:24 smithi170 ceph-mon[35248]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:24 smithi170 ceph-mon[35248]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:24.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:24 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3925054432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:24.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.339+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 --> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f595c068ae0 con 0x7f594406c680 2024-02-15T22:50:24.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.340+0000 7f59597fa700 1 -- 172.21.15.138:0/3665397793 <== mgr.14217 v2:172.21.15.138:6800/499746587 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f595c068ae0 con 0x7f594406c680 2024-02-15T22:50:24.342 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:50:24.342 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:50:24.342 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [], 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "", 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mgr daemons", 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:50:24.343 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 msgr2=0x7f594406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 0x7f594406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5950006010 tx=0x7f595000b540 comp rx=0 tx=0).stop 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 msgr2=0x7f595c195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d900 tx=0x7f594c00dc10 comp rx=0 tx=0).stop 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 shutdown_connections 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:6800/499746587,v1:172.21.15.138:6801/499746587] conn(0x7f594406c680 0x7f594406eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f595c0ff050 0x7f595c195980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 --2- 172.21.15.138:0/3665397793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f595c100250 0x7f595c195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:24.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 >> 172.21.15.138:0/3665397793 conn(0x7f595c0fa5e0 msgr2=0x7f595c0683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:24.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 shutdown_connections 2024-02-15T22:50:24.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:24.343+0000 7f59627e2700 1 -- 172.21.15.138:0/3665397793 wait complete. 2024-02-15T22:50:25.437 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:25 smithi170 ceph-mon[35248]: pgmap v239: 65 pgs: 65 active+clean; 8.6 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 695 KiB/s wr, 6 op/s 2024-02-15T22:50:25.437 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:25 smithi170 ceph-mon[35248]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:25.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:25 smithi138 ceph-mon[29229]: pgmap v239: 65 pgs: 65 active+clean; 8.6 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 695 KiB/s wr, 6 op/s 2024-02-15T22:50:25.483 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:25 smithi138 ceph-mon[29229]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:25.995 INFO:tasks.workunit.client.1.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T22:50:26.060 INFO:tasks.workunit.client.1.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T22:50:26.103 INFO:tasks.workunit.client.1.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T22:50:26.106 INFO:tasks.workunit.client.1.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T22:50:26.106 INFO:tasks.workunit.client.1.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T22:50:26.146 INFO:tasks.workunit.client.1.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T22:50:26.150 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T22:50:26.150 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-15T22:50:26.166 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-15T22:50:26.167 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T22:50:26.168 DEBUG:teuthology.orchestra.run.smithi170:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f78a58c0ffd401d1493058a1022c35f011d65275 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-15T22:50:27.264 INFO:tasks.workunit.client.1.smithi170.stderr:+ mkdir -p fsstress 2024-02-15T22:50:27.266 INFO:tasks.workunit.client.1.smithi170.stderr:+ pushd fsstress 2024-02-15T22:50:27.267 INFO:tasks.workunit.client.1.smithi170.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:50:27.267 INFO:tasks.workunit.client.1.smithi170.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T22:50:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:27 smithi170 ceph-mon[35248]: pgmap v240: 65 pgs: 65 active+clean; 14 MiB data, 180 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 41 op/s 2024-02-15T22:50:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:27 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:27 smithi138 ceph-mon[29229]: pgmap v240: 65 pgs: 65 active+clean; 14 MiB data, 180 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 1.2 MiB/s wr, 41 op/s 2024-02-15T22:50:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:27 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:28.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:28 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:50:28.678 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:28 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:50:29.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:29 smithi170 ceph-mon[35248]: pgmap v241: 65 pgs: 65 active+clean; 44 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 352 op/s 2024-02-15T22:50:29.690 INFO:tasks.workunit.client.1.smithi170.stderr:+ tar xzf ltp-full.tgz 2024-02-15T22:50:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:29 smithi138 ceph-mon[29229]: pgmap v241: 65 pgs: 65 active+clean; 44 MiB data, 305 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 352 op/s 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:50:30.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:30 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:50:30.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:30 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:50:31.724 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:31 smithi138 ceph-mon[29229]: pgmap v242: 65 pgs: 65 active+clean; 49 MiB data, 339 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 427 op/s 2024-02-15T22:50:31.724 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:31 smithi138 ceph-mon[29229]: mgrmap e20: smithi138.jqscxs(active, since 6m), standbys: smithi170.gczrzt 2024-02-15T22:50:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:31 smithi170 ceph-mon[35248]: pgmap v242: 65 pgs: 65 active+clean; 49 MiB data, 339 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.3 MiB/s wr, 427 op/s 2024-02-15T22:50:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:31 smithi170 ceph-mon[35248]: mgrmap e20: smithi138.jqscxs(active, since 6m), standbys: smithi170.gczrzt 2024-02-15T22:50:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:33 smithi138 ceph-mon[29229]: pgmap v243: 65 pgs: 65 active+clean; 56 MiB data, 403 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 484 op/s 2024-02-15T22:50:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:33 smithi170 ceph-mon[35248]: pgmap v243: 65 pgs: 65 active+clean; 56 MiB data, 403 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 484 op/s 2024-02-15T22:50:34.606 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:34 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:34.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:34 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:35.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:35 smithi170 ceph-mon[35248]: pgmap v244: 65 pgs: 65 active+clean; 76 MiB data, 435 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-02-15T22:50:35.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:35 smithi138 ceph-mon[29229]: pgmap v244: 65 pgs: 65 active+clean; 76 MiB data, 435 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-02-15T22:50:37.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:37 smithi138 ceph-mon[29229]: pgmap v245: 65 pgs: 65 active+clean; 79 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 541 op/s 2024-02-15T22:50:37.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:37 smithi170 ceph-mon[35248]: pgmap v245: 65 pgs: 65 active+clean; 79 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.1 MiB/s wr, 541 op/s 2024-02-15T22:50:39.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:38 smithi170 ceph-mon[35248]: pgmap v246: 65 pgs: 65 active+clean; 89 MiB data, 505 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 550 op/s 2024-02-15T22:50:39.156 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:38 smithi138 ceph-mon[29229]: pgmap v246: 65 pgs: 65 active+clean; 89 MiB data, 505 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 550 op/s 2024-02-15T22:50:39.451 INFO:tasks.workunit.client.0.smithi138.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T22:50:39.451 INFO:tasks.workunit.client.0.smithi138.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:50:39.452 INFO:tasks.workunit.client.0.smithi138.stderr:+ make 2024-02-15T22:50:39.896 INFO:tasks.workunit.client.0.smithi138.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T22:50:40.199 INFO:tasks.workunit.client.0.smithi138.stderr:++ readlink -f fsstress 2024-02-15T22:50:40.200 INFO:tasks.workunit.client.0.smithi138.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T22:50:40.200 INFO:tasks.workunit.client.0.smithi138.stderr:+ popd 2024-02-15T22:50:40.200 INFO:tasks.workunit.client.0.smithi138.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:50:40.201 INFO:tasks.workunit.client.0.smithi138.stderr:+ popd 2024-02-15T22:50:40.201 INFO:tasks.workunit.client.0.smithi138.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-15T22:50:40.201 INFO:tasks.workunit.client.0.smithi138.stderr:++ mktemp -d -p . 2024-02-15T22:50:40.202 INFO:tasks.workunit.client.0.smithi138.stderr:+ T=./tmp.LaR1thRtLF 2024-02-15T22:50:40.202 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.LaR1thRtLF -l 1 -n 1000 -p 10 -v 2024-02-15T22:50:40.204 INFO:tasks.workunit.client.0.smithi138.stdout:seed = 1707970271 2024-02-15T22:50:40.208 INFO:tasks.workunit.client.0.smithi138.stdout:1/0: rename - no filename 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:1/1: truncate - no filename 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:1/2: write - no filename 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:1/3: dwrite - no filename 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:1/4: chown . 8009 1 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:1/5: truncate - no filename 2024-02-15T22:50:40.209 INFO:tasks.workunit.client.0.smithi138.stdout:0/0: creat f0 x:0 0 0 2024-02-15T22:50:40.210 INFO:tasks.workunit.client.0.smithi138.stdout:2/0: truncate - no filename 2024-02-15T22:50:40.211 INFO:tasks.workunit.client.0.smithi138.stdout:1/6: mknod c0 0 2024-02-15T22:50:40.211 INFO:tasks.workunit.client.0.smithi138.stdout:1/7: fdatasync - no filename 2024-02-15T22:50:40.211 INFO:tasks.workunit.client.0.smithi138.stdout:1/8: truncate - no filename 2024-02-15T22:50:40.211 INFO:tasks.workunit.client.0.smithi138.stdout:1/9: dwrite - no filename 2024-02-15T22:50:40.212 INFO:tasks.workunit.client.0.smithi138.stdout:0/1: mknod c1 0 2024-02-15T22:50:40.212 INFO:tasks.workunit.client.0.smithi138.stdout:0/2: readlink - no filename 2024-02-15T22:50:40.212 INFO:tasks.workunit.client.0.smithi138.stdout:0/3: truncate f0 169169 0 2024-02-15T22:50:40.214 INFO:tasks.workunit.client.0.smithi138.stdout:2/1: mkdir d0 0 2024-02-15T22:50:40.214 INFO:tasks.workunit.client.0.smithi138.stdout:2/2: dread - no filename 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/10: unlink c0 0 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/11: dread - no filename 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/12: dwrite - no filename 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/13: write - no filename 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/14: write - no filename 2024-02-15T22:50:40.216 INFO:tasks.workunit.client.0.smithi138.stdout:1/15: fdatasync - no filename 2024-02-15T22:50:40.217 INFO:tasks.workunit.client.0.smithi138.stdout:4/0: dwrite - no filename 2024-02-15T22:50:40.217 INFO:tasks.workunit.client.0.smithi138.stdout:4/1: dwrite - no filename 2024-02-15T22:50:40.217 INFO:tasks.workunit.client.0.smithi138.stdout:4/2: rmdir - no directory 2024-02-15T22:50:40.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/0: mknod c0 0 2024-02-15T22:50:40.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/1: write - no filename 2024-02-15T22:50:40.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/2: stat c0 0 2024-02-15T22:50:40.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/3: write - no filename 2024-02-15T22:50:40.219 INFO:tasks.workunit.client.0.smithi138.stdout:5/0: dwrite - no filename 2024-02-15T22:50:40.221 INFO:tasks.workunit.client.0.smithi138.stdout:4/3: creat f0 x:0 0 0 2024-02-15T22:50:40.223 INFO:tasks.workunit.client.0.smithi138.stdout:3/4: creat f1 x:0 0 0 2024-02-15T22:50:40.227 INFO:tasks.workunit.client.0.smithi138.stdout:5/1: mknod c0 0 2024-02-15T22:50:40.227 INFO:tasks.workunit.client.0.smithi138.stdout:5/2: dread - no filename 2024-02-15T22:50:40.227 INFO:tasks.workunit.client.0.smithi138.stdout:5/3: dwrite - no filename 2024-02-15T22:50:40.227 INFO:tasks.workunit.client.0.smithi138.stdout:6/0: link - no file 2024-02-15T22:50:40.227 INFO:tasks.workunit.client.0.smithi138.stdout:6/1: write - no filename 2024-02-15T22:50:40.229 INFO:tasks.workunit.client.0.smithi138.stdout:4/4: unlink f0 0 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/5: dwrite - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/6: chown . 0 1 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/7: rmdir - no directory 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/8: fdatasync - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/9: rmdir - no directory 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/10: chown . 0 1 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/11: rename - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/12: dwrite - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/13: write - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/14: write - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/15: fdatasync - no filename 2024-02-15T22:50:40.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/16: dread - no filename 2024-02-15T22:50:40.231 INFO:tasks.workunit.client.0.smithi138.stdout:5/4: unlink c0 0 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr fail", "who": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: osdmap e47: 6 total, 6 up, 6 in 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "mgr fail", "who": "smithi138.jqscxs"}]': finished 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: mgrmap e21: smithi170.gczrzt(active, starting, since 0.00800842s) 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:50:40.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: Manager daemon smithi170.gczrzt is now available 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/trash_purge_schedule"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/trash_purge_schedule"}]: dispatch 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: [15/Feb/2024:22:50:39] ENGINE Bus STARTING 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: Deploying cephadm binary to smithi170 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: Deploying cephadm binary to smithi138 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: [15/Feb/2024:22:50:39] ENGINE Serving on http://172.21.15.170:8765 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: [15/Feb/2024:22:50:39] ENGINE Serving on https://172.21.15.170:7150 2024-02-15T22:50:40.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:39 smithi138 ceph-mon[29229]: [15/Feb/2024:22:50:39] ENGINE Bus STARTED 2024-02-15T22:50:40.239 INFO:tasks.workunit.client.0.smithi138.stdout:6/2: creat f0 x:0 0 0 2024-02-15T22:50:40.239 INFO:tasks.workunit.client.0.smithi138.stdout:4/17: symlink l1 0 2024-02-15T22:50:40.239 INFO:tasks.workunit.client.0.smithi138.stdout:4/18: creat f2 x:0 0 0 2024-02-15T22:50:40.239 INFO:tasks.workunit.client.0.smithi138.stdout:4/19: chown l1 245953 1 2024-02-15T22:50:40.239 INFO:tasks.workunit.client.0.smithi138.stdout:5/5: mknod c1 0 2024-02-15T22:50:40.242 INFO:tasks.workunit.client.0.smithi138.stdout:7/0: mknod c0 0 2024-02-15T22:50:40.243 INFO:tasks.workunit.client.0.smithi138.stdout:7/1: dread - no filename 2024-02-15T22:50:40.243 INFO:tasks.workunit.client.0.smithi138.stdout:7/2: chown c0 54 1 2024-02-15T22:50:40.243 INFO:tasks.workunit.client.0.smithi138.stdout:7/3: chown c0 10653 1 2024-02-15T22:50:40.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/20: symlink l3 0 2024-02-15T22:50:40.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/21: read - f2 zero size 2024-02-15T22:50:40.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/22: read - f2 zero size 2024-02-15T22:50:40.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/23: stat f2 0 2024-02-15T22:50:40.248 INFO:tasks.workunit.client.0.smithi138.stdout:4/24: write f2 [771546,51712] 0 2024-02-15T22:50:40.251 INFO:tasks.workunit.client.0.smithi138.stdout:5/6: symlink l2 0 2024-02-15T22:50:40.251 INFO:tasks.workunit.client.0.smithi138.stdout:5/7: readlink l2 0 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/8: fdatasync - no filename 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/9: dread - no filename 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/10: write - no filename 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/11: chown l2 1929459 1 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:8/0: creat f0 x:0 0 0 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:8/1: creat f1 x:0 0 0 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:8/2: stat f1 0 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:8/3: dread - f0 zero size 2024-02-15T22:50:40.252 INFO:tasks.workunit.client.0.smithi138.stdout:9/0: getdents . 0 2024-02-15T22:50:40.257 INFO:tasks.workunit.client.0.smithi138.stdout:7/4: mkdir d1 0 2024-02-15T22:50:40.258 INFO:tasks.workunit.client.0.smithi138.stdout:0/4: dwrite f0 [0,4194304] 0 2024-02-15T22:50:40.260 INFO:tasks.workunit.client.0.smithi138.stdout:4/25: unlink f2 0 2024-02-15T22:50:40.260 INFO:tasks.workunit.client.0.smithi138.stdout:4/26: write - no filename 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr fail", "who": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: osdmap e47: 6 total, 6 up, 6 in 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.14217 172.21.15.138:0/3595379893' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "mgr fail", "who": "smithi138.jqscxs"}]': finished 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: mgrmap e21: smithi170.gczrzt(active, starting, since 0.00800842s) 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:50:40.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: Manager daemon smithi170.gczrzt is now available 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/trash_purge_schedule"}]: dispatch 2024-02-15T22:50:40.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi170.gczrzt/trash_purge_schedule"}]: dispatch 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: [15/Feb/2024:22:50:39] ENGINE Bus STARTING 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: Deploying cephadm binary to smithi170 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: Deploying cephadm binary to smithi138 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: [15/Feb/2024:22:50:39] ENGINE Serving on http://172.21.15.170:8765 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: [15/Feb/2024:22:50:39] ENGINE Serving on https://172.21.15.170:7150 2024-02-15T22:50:40.265 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:39 smithi170 ceph-mon[35248]: [15/Feb/2024:22:50:39] ENGINE Bus STARTED 2024-02-15T22:50:40.270 INFO:tasks.workunit.client.0.smithi138.stdout:9/1: mkdir d0 0 2024-02-15T22:50:40.270 INFO:tasks.workunit.client.0.smithi138.stdout:7/5: mkdir d1/d2 0 2024-02-15T22:50:40.270 INFO:tasks.workunit.client.0.smithi138.stdout:7/6: dwrite - no filename 2024-02-15T22:50:40.270 INFO:tasks.workunit.client.0.smithi138.stdout:9/2: readlink - no filename 2024-02-15T22:50:40.270 INFO:tasks.workunit.client.0.smithi138.stdout:7/7: rename d1 to d1/d2/d3 22 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:9/3: truncate - no filename 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:9/4: write - no filename 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/8: write - no filename 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/9: readlink - no filename 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/10: rename d1 to d1/d4 22 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/11: dread - no filename 2024-02-15T22:50:40.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/12: stat d1 0 2024-02-15T22:50:40.279 INFO:tasks.workunit.client.0.smithi138.stdout:4/27: symlink l4 0 2024-02-15T22:50:40.279 INFO:tasks.workunit.client.0.smithi138.stdout:4/28: write - no filename 2024-02-15T22:50:40.284 INFO:tasks.workunit.client.0.smithi138.stdout:9/5: mkdir d0/d1 0 2024-02-15T22:50:40.286 INFO:tasks.workunit.client.0.smithi138.stdout:7/13: creat d1/f5 x:0 0 0 2024-02-15T22:50:40.286 INFO:tasks.workunit.client.0.smithi138.stdout:7/14: dread - d1/f5 zero size 2024-02-15T22:50:40.286 INFO:tasks.workunit.client.0.smithi138.stdout:7/15: dread - d1/f5 zero size 2024-02-15T22:50:40.286 INFO:tasks.workunit.client.0.smithi138.stdout:7/16: stat c0 0 2024-02-15T22:50:40.289 INFO:tasks.workunit.client.0.smithi138.stdout:4/29: rename l3 to l5 0 2024-02-15T22:50:40.289 INFO:tasks.workunit.client.0.smithi138.stdout:4/30: creat f6 x:0 0 0 2024-02-15T22:50:40.289 INFO:tasks.workunit.client.0.smithi138.stdout:4/31: write f6 [443045,101198] 0 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/17: link d1/f5 d1/f6 0 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/18: chown c0 55900789 1 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/19: chown d1 1633 1 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/32: mknod c7 0 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/33: stat l4 0 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/34: chown l4 1751 1 2024-02-15T22:50:40.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/35: truncate f6 694375 0 2024-02-15T22:50:40.302 INFO:tasks.workunit.client.0.smithi138.stdout:7/20: link d1/f5 d1/f7 0 2024-02-15T22:50:40.726 INFO:tasks.workunit.client.0.smithi138.stdout:3/5: dwrite f1 [0,4194304] 0 2024-02-15T22:50:40.747 INFO:tasks.workunit.client.0.smithi138.stdout:6/3: dwrite f0 [0,4194304] 0 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/4: readlink - no filename 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/5: creat f1 x:0 0 0 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/6: rmdir - no directory 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/7: dread - f1 zero size 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/8: creat f2 x:0 0 0 2024-02-15T22:50:40.748 INFO:tasks.workunit.client.0.smithi138.stdout:6/9: read - f2 zero size 2024-02-15T22:50:41.094 INFO:tasks.workunit.client.0.smithi138.stdout:3/6: write f1 [404880,127745] 0 2024-02-15T22:50:41.285 INFO:tasks.workunit.client.0.smithi138.stdout:9/6: rename d0 to d0/d2 22 2024-02-15T22:50:41.309 INFO:tasks.workunit.client.0.smithi138.stdout:4/36: dread f6 [0,4194304] 0 2024-02-15T22:50:41.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/37: chown l1 4819 1 2024-02-15T22:50:41.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/38: chown l4 984 1 2024-02-15T22:50:41.320 INFO:tasks.workunit.client.0.smithi138.stdout:4/39: write f6 [405138,90486] 0 2024-02-15T22:50:41.397 INFO:tasks.workunit.client.0.smithi138.stdout:4/40: dwrite f6 [0,4194304] 0 2024-02-15T22:50:41.419 INFO:tasks.workunit.client.0.smithi138.stdout:4/41: dwrite f6 [0,4194304] 0 2024-02-15T22:50:41.430 INFO:tasks.workunit.client.0.smithi138.stdout:6/10: mknod c3 0 2024-02-15T22:50:41.431 INFO:tasks.workunit.client.0.smithi138.stdout:4/42: read f6 [2982800,12478] 0 2024-02-15T22:50:41.431 INFO:tasks.workunit.client.0.smithi138.stdout:4/43: creat f8 x:0 0 0 2024-02-15T22:50:41.452 INFO:tasks.workunit.client.0.smithi138.stdout:6/11: dwrite f0 [0,4194304] 0 2024-02-15T22:50:41.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:41 smithi138 ceph-mon[29229]: mgrmap e22: smithi170.gczrzt(active, since 1.01006s) 2024-02-15T22:50:41.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:41 smithi138 ceph-mon[29229]: pgmap v3: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:41.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:41 smithi170 ceph-mon[35248]: mgrmap e22: smithi170.gczrzt(active, since 1.01006s) 2024-02-15T22:50:41.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:41 smithi170 ceph-mon[35248]: pgmap v3: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/5: getdents . 0 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/6: chown c1 1 1 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/7: fsync f0 0 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/8: truncate f0 4951659 0 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/9: rmdir - no directory 2024-02-15T22:50:41.903 INFO:tasks.workunit.client.0.smithi138.stdout:0/10: chown c1 8543364 1 2024-02-15T22:50:41.911 INFO:tasks.workunit.client.0.smithi138.stdout:0/11: write f0 [200533,130770] 0 2024-02-15T22:50:41.931 INFO:tasks.workunit.client.0.smithi138.stdout:5/12: getdents . 0 2024-02-15T22:50:42.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:42 smithi138 ceph-mon[29229]: pgmap v4: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:42.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:42 smithi170 ceph-mon[35248]: pgmap v4: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:43.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:43 smithi138 ceph-mon[29229]: mgrmap e23: smithi170.gczrzt(active, since 3s) 2024-02-15T22:50:43.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:43 smithi170 ceph-mon[35248]: mgrmap e23: smithi170.gczrzt(active, since 3s) 2024-02-15T22:50:44.534 INFO:tasks.workunit.client.0.smithi138.stdout:9/7: creat d0/d1/f3 x:0 0 0 2024-02-15T22:50:44.686 INFO:tasks.workunit.client.0.smithi138.stdout:4/44: mkdir d9 0 2024-02-15T22:50:44.694 INFO:tasks.workunit.client.0.smithi138.stdout:6/12: rename c3 to c4 0 2024-02-15T22:50:44.712 INFO:tasks.workunit.client.0.smithi138.stdout:6/13: dwrite f1 [0,4194304] 0 2024-02-15T22:50:44.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:44 smithi138 ceph-mon[29229]: pgmap v5: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:45.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:44 smithi170 ceph-mon[35248]: pgmap v5: 65 pgs: 65 active+clean; 102 MiB data, 537 MiB used, 536 GiB / 536 GiB avail 2024-02-15T22:50:45.160 INFO:tasks.workunit.client.0.smithi138.stdout:0/12: link c1 c2 0 2024-02-15T22:50:45.162 INFO:tasks.workunit.client.0.smithi138.stdout:5/13: unlink l2 0 2024-02-15T22:50:45.162 INFO:tasks.workunit.client.0.smithi138.stdout:5/14: readlink - no filename 2024-02-15T22:50:45.162 INFO:tasks.workunit.client.0.smithi138.stdout:5/15: fsync - no filename 2024-02-15T22:50:45.163 INFO:tasks.workunit.client.0.smithi138.stdout:9/8: mkdir d0/d4 0 2024-02-15T22:50:45.168 INFO:tasks.workunit.client.0.smithi138.stdout:0/13: link c2 c3 0 2024-02-15T22:50:45.171 INFO:tasks.workunit.client.0.smithi138.stdout:9/9: rename d0/d1/f3 to d0/d4/f5 0 2024-02-15T22:50:45.171 INFO:tasks.workunit.client.0.smithi138.stdout:9/10: rename d0/d1 to d0/d1/d6 22 2024-02-15T22:50:45.171 INFO:tasks.workunit.client.0.smithi138.stdout:0/14: stat c3 0 2024-02-15T22:50:45.173 INFO:tasks.workunit.client.0.smithi138.stdout:5/16: mknod c3 0 2024-02-15T22:50:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:9/11: dwrite d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:0/15: dwrite f0 [0,4194304] 0 2024-02-15T22:50:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:9/12: symlink d0/d1/l7 0 2024-02-15T22:50:45.203 INFO:tasks.workunit.client.0.smithi138.stdout:0/16: read f0 [1824064,16953] 0 2024-02-15T22:50:45.203 INFO:tasks.workunit.client.0.smithi138.stdout:0/17: creat f4 x:0 0 0 2024-02-15T22:50:45.220 INFO:tasks.workunit.client.0.smithi138.stdout:0/18: dwrite f0 [0,4194304] 0 2024-02-15T22:50:45.236 INFO:tasks.workunit.client.0.smithi138.stdout:0/19: dwrite f0 [0,4194304] 0 2024-02-15T22:50:45.238 INFO:tasks.workunit.client.0.smithi138.stdout:0/20: mknod c5 0 2024-02-15T22:50:45.238 INFO:tasks.workunit.client.0.smithi138.stdout:0/21: rmdir - no directory 2024-02-15T22:50:45.238 INFO:tasks.workunit.client.0.smithi138.stdout:0/22: write f4 [1037184,83289] 0 2024-02-15T22:50:45.239 INFO:tasks.workunit.client.0.smithi138.stdout:0/23: mkdir d6 0 2024-02-15T22:50:45.241 INFO:tasks.workunit.client.0.smithi138.stdout:0/24: rename c5 to d6/c7 0 2024-02-15T22:50:45.246 INFO:tasks.workunit.client.0.smithi138.stdout:0/25: dread f4 [0,4194304] 0 2024-02-15T22:50:45.248 INFO:tasks.workunit.client.0.smithi138.stdout:0/26: creat d6/f8 x:0 0 0 2024-02-15T22:50:45.249 INFO:tasks.workunit.client.0.smithi138.stdout:0/27: symlink d6/l9 0 2024-02-15T22:50:45.249 INFO:tasks.workunit.client.0.smithi138.stdout:0/28: creat d6/fa x:0 0 0 2024-02-15T22:50:45.253 INFO:tasks.workunit.client.0.smithi138.stdout:0/29: unlink d6/fa 0 2024-02-15T22:50:45.255 INFO:tasks.workunit.client.0.smithi138.stdout:0/30: link f0 d6/fb 0 2024-02-15T22:50:45.257 INFO:tasks.workunit.client.0.smithi138.stdout:0/31: symlink d6/lc 0 2024-02-15T22:50:45.257 INFO:tasks.workunit.client.0.smithi138.stdout:0/32: fdatasync f0 0 2024-02-15T22:50:45.272 INFO:tasks.workunit.client.0.smithi138.stdout:0/33: dwrite d6/f8 [0,4194304] 0 2024-02-15T22:50:45.437 INFO:tasks.workunit.client.0.smithi138.stdout:6/14: rename c4 to c5 0 2024-02-15T22:50:45.447 INFO:tasks.workunit.client.0.smithi138.stdout:6/15: read f0 [3790682,40953] 0 2024-02-15T22:50:45.447 INFO:tasks.workunit.client.0.smithi138.stdout:6/16: creat f6 x:0 0 0 2024-02-15T22:50:45.453 INFO:tasks.workunit.client.0.smithi138.stdout:6/17: mknod c7 0 2024-02-15T22:50:45.497 INFO:tasks.workunit.client.0.smithi138.stdout:9/13: write d0/d4/f5 [5109081,90677] 0 2024-02-15T22:50:45.502 INFO:tasks.workunit.client.0.smithi138.stdout:6/18: write f1 [4164135,43414] 0 2024-02-15T22:50:45.520 INFO:tasks.workunit.client.0.smithi138.stdout:6/19: dwrite f2 [0,4194304] 0 2024-02-15T22:50:45.520 INFO:tasks.workunit.client.0.smithi138.stdout:6/20: creat f8 x:0 0 0 2024-02-15T22:50:45.522 INFO:tasks.workunit.client.0.smithi138.stdout:6/21: mknod c9 0 2024-02-15T22:50:45.523 INFO:tasks.workunit.client.0.smithi138.stdout:6/22: symlink la 0 2024-02-15T22:50:45.547 INFO:tasks.workunit.client.0.smithi138.stdout:6/23: dwrite f6 [0,4194304] 0 2024-02-15T22:50:45.636 INFO:tasks.workunit.client.0.smithi138.stdout:6/24: symlink lb 0 2024-02-15T22:50:45.642 INFO:tasks.workunit.client.0.smithi138.stdout:6/25: dread f1 [0,4194304] 0 2024-02-15T22:50:45.643 INFO:tasks.workunit.client.0.smithi138.stdout:6/26: write f0 [3183526,17726] 0 2024-02-15T22:50:45.646 INFO:tasks.workunit.client.0.smithi138.stdout:6/27: dread f1 [0,4194304] 0 2024-02-15T22:50:45.654 INFO:tasks.workunit.client.0.smithi138.stdout:6/28: dread f2 [0,4194304] 0 2024-02-15T22:50:45.654 INFO:tasks.workunit.client.0.smithi138.stdout:6/29: chown f0 1007569329 1 2024-02-15T22:50:45.655 INFO:tasks.workunit.client.0.smithi138.stdout:6/30: mkdir dc 0 2024-02-15T22:50:45.655 INFO:tasks.workunit.client.0.smithi138.stdout:6/31: fdatasync f1 0 2024-02-15T22:50:45.672 INFO:tasks.workunit.client.0.smithi138.stdout:6/32: dwrite f1 [0,4194304] 0 2024-02-15T22:50:45.690 INFO:tasks.workunit.client.0.smithi138.stdout:6/33: dwrite f8 [0,4194304] 0 2024-02-15T22:50:45.693 INFO:tasks.workunit.client.0.smithi138.stdout:6/34: creat dc/fd x:0 0 0 2024-02-15T22:50:45.693 INFO:tasks.workunit.client.0.smithi138.stdout:6/35: creat dc/fe x:0 0 0 2024-02-15T22:50:45.698 INFO:tasks.workunit.client.0.smithi138.stdout:6/36: rmdir dc 39 2024-02-15T22:50:45.699 INFO:tasks.workunit.client.0.smithi138.stdout:6/37: truncate f6 1078817 0 2024-02-15T22:50:45.707 INFO:tasks.workunit.client.0.smithi138.stdout:6/38: truncate f6 1034453 0 2024-02-15T22:50:45.711 INFO:tasks.workunit.client.0.smithi138.stdout:6/39: rename f6 to dc/ff 0 2024-02-15T22:50:45.711 INFO:tasks.workunit.client.0.smithi138.stdout:6/40: dread - dc/fd zero size 2024-02-15T22:50:45.727 INFO:tasks.workunit.client.0.smithi138.stdout:6/41: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:45.737 INFO:tasks.workunit.client.0.smithi138.stdout:6/42: dread f8 [0,4194304] 0 2024-02-15T22:50:45.737 INFO:tasks.workunit.client.0.smithi138.stdout:6/43: fsync dc/ff 0 2024-02-15T22:50:45.738 INFO:tasks.workunit.client.0.smithi138.stdout:6/44: unlink f8 0 2024-02-15T22:50:45.738 INFO:tasks.workunit.client.0.smithi138.stdout:6/45: stat la 0 2024-02-15T22:50:45.761 INFO:tasks.workunit.client.0.smithi138.stdout:6/46: dwrite f2 [4194304,4194304] 0 2024-02-15T22:50:45.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/47: rmdir dc 39 2024-02-15T22:50:45.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/48: readlink lb 0 2024-02-15T22:50:45.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/49: fsync dc/fe 0 2024-02-15T22:50:45.764 INFO:tasks.workunit.client.0.smithi138.stdout:6/50: rename lb to dc/l10 0 2024-02-15T22:50:45.764 INFO:tasks.workunit.client.0.smithi138.stdout:6/51: fdatasync f2 0 2024-02-15T22:50:45.764 INFO:tasks.workunit.client.0.smithi138.stdout:6/52: symlink dc/l11 0 2024-02-15T22:50:45.767 INFO:tasks.workunit.client.0.smithi138.stdout:6/53: unlink dc/fd 0 2024-02-15T22:50:45.767 INFO:tasks.workunit.client.0.smithi138.stdout:6/54: chown dc/l10 2854130 1 2024-02-15T22:50:45.768 INFO:tasks.workunit.client.0.smithi138.stdout:6/55: creat dc/f12 x:0 0 0 2024-02-15T22:50:45.768 INFO:tasks.workunit.client.0.smithi138.stdout:6/56: fdatasync dc/ff 0 2024-02-15T22:50:45.769 INFO:tasks.workunit.client.0.smithi138.stdout:6/57: readlink la 0 2024-02-15T22:50:45.770 INFO:tasks.workunit.client.0.smithi138.stdout:6/58: link dc/fe dc/f13 0 2024-02-15T22:50:45.770 INFO:tasks.workunit.client.0.smithi138.stdout:6/59: creat dc/f14 x:0 0 0 2024-02-15T22:50:45.770 INFO:tasks.workunit.client.0.smithi138.stdout:6/60: creat dc/f15 x:0 0 0 2024-02-15T22:50:45.773 INFO:tasks.workunit.client.0.smithi138.stdout:6/61: mknod dc/c16 0 2024-02-15T22:50:45.773 INFO:tasks.workunit.client.0.smithi138.stdout:6/62: chown c5 248 1 2024-02-15T22:50:47.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:46 smithi170 ceph-mon[35248]: pgmap v6: 65 pgs: 65 active+clean; 179 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 18 MiB/s wr, 1.62k op/s 2024-02-15T22:50:47.012 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:46 smithi138 ceph-mon[29229]: pgmap v6: 65 pgs: 65 active+clean; 179 MiB data, 828 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 18 MiB/s wr, 1.62k op/s 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:4/45: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:6/63: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:0/34: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:9/14: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:7/21: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:3/7: sync 2024-02-15T22:50:47.522 INFO:tasks.workunit.client.0.smithi138.stdout:8/4: sync 2024-02-15T22:50:47.523 INFO:tasks.workunit.client.0.smithi138.stdout:5/17: sync 2024-02-15T22:50:47.523 INFO:tasks.workunit.client.0.smithi138.stdout:1/16: sync 2024-02-15T22:50:47.523 INFO:tasks.workunit.client.0.smithi138.stdout:2/3: sync 2024-02-15T22:50:47.523 INFO:tasks.workunit.client.0.smithi138.stdout:2/4: getdents d0 0 2024-02-15T22:50:47.525 INFO:tasks.workunit.client.0.smithi138.stdout:4/46: link f8 d9/fa 0 2024-02-15T22:50:47.527 INFO:tasks.workunit.client.0.smithi138.stdout:6/64: mknod dc/c17 0 2024-02-15T22:50:47.529 INFO:tasks.workunit.client.0.smithi138.stdout:0/35: rename c1 to d6/cd 0 2024-02-15T22:50:47.532 INFO:tasks.workunit.client.0.smithi138.stdout:9/15: creat d0/f8 x:0 0 0 2024-02-15T22:50:47.534 INFO:tasks.workunit.client.0.smithi138.stdout:9/16: write d0/d4/f5 [4340115,63119] 0 2024-02-15T22:50:47.535 INFO:tasks.workunit.client.0.smithi138.stdout:3/8: unlink c0 0 2024-02-15T22:50:47.540 INFO:tasks.workunit.client.0.smithi138.stdout:8/5: dwrite f0 [0,4194304] 0 2024-02-15T22:50:47.541 INFO:tasks.workunit.client.0.smithi138.stdout:2/5: creat d0/f1 x:0 0 0 2024-02-15T22:50:47.543 INFO:tasks.workunit.client.0.smithi138.stdout:3/9: dread f1 [0,4194304] 0 2024-02-15T22:50:47.547 INFO:tasks.workunit.client.0.smithi138.stdout:4/47: unlink d9/fa 0 2024-02-15T22:50:47.548 INFO:tasks.workunit.client.0.smithi138.stdout:3/10: dread f1 [0,4194304] 0 2024-02-15T22:50:47.549 INFO:tasks.workunit.client.0.smithi138.stdout:6/65: mknod dc/c18 0 2024-02-15T22:50:47.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/22: rename d1/f7 to d1/d2/f8 0 2024-02-15T22:50:47.556 INFO:tasks.workunit.client.0.smithi138.stdout:5/18: getdents . 0 2024-02-15T22:50:47.558 INFO:tasks.workunit.client.0.smithi138.stdout:1/17: getdents . 0 2024-02-15T22:50:47.562 INFO:tasks.workunit.client.0.smithi138.stdout:2/6: link d0/f1 d0/f2 0 2024-02-15T22:50:47.563 INFO:tasks.workunit.client.0.smithi138.stdout:2/7: dread - d0/f2 zero size 2024-02-15T22:50:47.566 INFO:tasks.workunit.client.0.smithi138.stdout:3/11: symlink l2 0 2024-02-15T22:50:47.566 INFO:tasks.workunit.client.0.smithi138.stdout:3/12: fdatasync f1 0 2024-02-15T22:50:47.566 INFO:tasks.workunit.client.0.smithi138.stdout:3/13: stat f1 0 2024-02-15T22:50:47.568 INFO:tasks.workunit.client.0.smithi138.stdout:6/66: truncate f1 3036020 0 2024-02-15T22:50:47.570 INFO:tasks.workunit.client.0.smithi138.stdout:3/14: dread f1 [0,4194304] 0 2024-02-15T22:50:47.572 INFO:tasks.workunit.client.0.smithi138.stdout:7/23: rename d1/f6 to d1/f9 0 2024-02-15T22:50:47.572 INFO:tasks.workunit.client.0.smithi138.stdout:7/24: dread - d1/f9 zero size 2024-02-15T22:50:47.572 INFO:tasks.workunit.client.0.smithi138.stdout:7/25: dread - d1/f5 zero size 2024-02-15T22:50:47.573 INFO:tasks.workunit.client.0.smithi138.stdout:5/19: link c3 c4 0 2024-02-15T22:50:47.573 INFO:tasks.workunit.client.0.smithi138.stdout:5/20: dread - no filename 2024-02-15T22:50:47.573 INFO:tasks.workunit.client.0.smithi138.stdout:5/21: chown c4 584273544 1 2024-02-15T22:50:47.574 INFO:tasks.workunit.client.0.smithi138.stdout:1/18: mknod c1 0 2024-02-15T22:50:47.577 INFO:tasks.workunit.client.0.smithi138.stdout:2/8: mkdir d0/d3 0 2024-02-15T22:50:47.578 INFO:tasks.workunit.client.0.smithi138.stdout:6/67: mknod dc/c19 0 2024-02-15T22:50:47.578 INFO:tasks.workunit.client.0.smithi138.stdout:6/68: chown dc/c17 295 1 2024-02-15T22:50:47.578 INFO:tasks.workunit.client.0.smithi138.stdout:6/69: creat dc/f1a x:0 0 0 2024-02-15T22:50:47.580 INFO:tasks.workunit.client.0.smithi138.stdout:3/15: rename l2 to l3 0 2024-02-15T22:50:47.582 INFO:tasks.workunit.client.0.smithi138.stdout:7/26: symlink d1/d2/la 0 2024-02-15T22:50:47.585 INFO:tasks.workunit.client.0.smithi138.stdout:5/22: creat f5 x:0 0 0 2024-02-15T22:50:47.588 INFO:tasks.workunit.client.0.smithi138.stdout:1/19: unlink c1 0 2024-02-15T22:50:47.591 INFO:tasks.workunit.client.0.smithi138.stdout:7/27: mkdir d1/d2/db 0 2024-02-15T22:50:47.593 INFO:tasks.workunit.client.0.smithi138.stdout:5/23: chown c3 815175 1 2024-02-15T22:50:47.593 INFO:tasks.workunit.client.0.smithi138.stdout:5/24: write f5 [996365,86189] 0 2024-02-15T22:50:47.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/9: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:50:47.596 INFO:tasks.workunit.client.0.smithi138.stdout:1/20: creat f2 x:0 0 0 2024-02-15T22:50:47.596 INFO:tasks.workunit.client.0.smithi138.stdout:1/21: dread - f2 zero size 2024-02-15T22:50:47.596 INFO:tasks.workunit.client.0.smithi138.stdout:1/22: truncate f2 144622 0 2024-02-15T22:50:47.602 INFO:tasks.workunit.client.0.smithi138.stdout:5/25: rename c3 to c6 0 2024-02-15T22:50:47.604 INFO:tasks.workunit.client.0.smithi138.stdout:6/70: dwrite dc/ff [0,4194304] 0 2024-02-15T22:50:47.605 INFO:tasks.workunit.client.0.smithi138.stdout:6/71: truncate dc/f15 416633 0 2024-02-15T22:50:47.605 INFO:tasks.workunit.client.0.smithi138.stdout:1/23: rename f2 to f3 0 2024-02-15T22:50:47.605 INFO:tasks.workunit.client.0.smithi138.stdout:6/72: creat dc/f1b x:0 0 0 2024-02-15T22:50:47.605 INFO:tasks.workunit.client.0.smithi138.stdout:6/73: write dc/f12 [911994,88310] 0 2024-02-15T22:50:47.605 INFO:tasks.workunit.client.0.smithi138.stdout:5/26: creat f7 x:0 0 0 2024-02-15T22:50:47.609 INFO:tasks.workunit.client.0.smithi138.stdout:2/10: dread d0/f1 [0,4194304] 0 2024-02-15T22:50:47.613 INFO:tasks.workunit.client.0.smithi138.stdout:5/27: mknod c8 0 2024-02-15T22:50:47.614 INFO:tasks.workunit.client.0.smithi138.stdout:2/11: creat d0/d3/f4 x:0 0 0 2024-02-15T22:50:47.616 INFO:tasks.workunit.client.0.smithi138.stdout:4/48: rmdir d9 0 2024-02-15T22:50:47.616 INFO:tasks.workunit.client.0.smithi138.stdout:4/49: rmdir - no directory 2024-02-15T22:50:47.617 INFO:tasks.workunit.client.0.smithi138.stdout:4/50: symlink lb 0 2024-02-15T22:50:47.619 INFO:tasks.workunit.client.0.smithi138.stdout:8/6: truncate f0 325719 0 2024-02-15T22:50:47.619 INFO:tasks.workunit.client.0.smithi138.stdout:2/12: dread d0/f2 [0,4194304] 0 2024-02-15T22:50:47.620 INFO:tasks.workunit.client.0.smithi138.stdout:2/13: readlink - no filename 2024-02-15T22:50:47.623 INFO:tasks.workunit.client.0.smithi138.stdout:8/7: link f1 f2 0 2024-02-15T22:50:47.623 INFO:tasks.workunit.client.0.smithi138.stdout:8/8: write f2 [942576,74830] 0 2024-02-15T22:50:47.623 INFO:tasks.workunit.client.0.smithi138.stdout:1/24: dwrite f3 [0,4194304] 0 2024-02-15T22:50:47.633 INFO:tasks.workunit.client.0.smithi138.stdout:7/28: rmdir d1 39 2024-02-15T22:50:47.634 INFO:tasks.workunit.client.0.smithi138.stdout:7/29: dread - d1/f5 zero size 2024-02-15T22:50:47.634 INFO:tasks.workunit.client.0.smithi138.stdout:7/30: chown d1 8061 1 2024-02-15T22:50:47.634 INFO:tasks.workunit.client.0.smithi138.stdout:7/31: dread - d1/d2/f8 zero size 2024-02-15T22:50:47.636 INFO:tasks.workunit.client.0.smithi138.stdout:4/51: dwrite f6 [0,4194304] 0 2024-02-15T22:50:47.638 INFO:tasks.workunit.client.0.smithi138.stdout:4/52: mknod cc 0 2024-02-15T22:50:47.639 INFO:tasks.workunit.client.0.smithi138.stdout:4/53: readlink l4 0 2024-02-15T22:50:47.639 INFO:tasks.workunit.client.0.smithi138.stdout:4/54: chown l4 45 1 2024-02-15T22:50:47.639 INFO:tasks.workunit.client.0.smithi138.stdout:4/55: creat fd x:0 0 0 2024-02-15T22:50:47.641 INFO:tasks.workunit.client.0.smithi138.stdout:4/56: mknod ce 0 2024-02-15T22:50:47.643 INFO:tasks.workunit.client.0.smithi138.stdout:1/25: rename f3 to f4 0 2024-02-15T22:50:47.643 INFO:tasks.workunit.client.0.smithi138.stdout:1/26: readlink - no filename 2024-02-15T22:50:47.643 INFO:tasks.workunit.client.0.smithi138.stdout:1/27: chown f4 4 1 2024-02-15T22:50:47.643 INFO:tasks.workunit.client.0.smithi138.stdout:6/74: rmdir dc 39 2024-02-15T22:50:47.645 INFO:tasks.workunit.client.0.smithi138.stdout:4/57: rename c7 to cf 0 2024-02-15T22:50:47.646 INFO:tasks.workunit.client.0.smithi138.stdout:2/14: getdents d0/d3 0 2024-02-15T22:50:47.648 INFO:tasks.workunit.client.0.smithi138.stdout:6/75: creat dc/f1c x:0 0 0 2024-02-15T22:50:47.650 INFO:tasks.workunit.client.0.smithi138.stdout:1/28: mknod c5 0 2024-02-15T22:50:47.650 INFO:tasks.workunit.client.0.smithi138.stdout:7/32: dwrite d1/f9 [0,4194304] 0 2024-02-15T22:50:47.653 INFO:tasks.workunit.client.0.smithi138.stdout:2/15: mkdir d0/d3/d5 0 2024-02-15T22:50:47.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/76: rename dc/l10 to dc/l1d 0 2024-02-15T22:50:47.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/77: write f0 [2164566,10812] 0 2024-02-15T22:50:47.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/78: chown dc/c19 7751 1 2024-02-15T22:50:47.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/79: creat dc/f1e x:0 0 0 2024-02-15T22:50:47.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/80: read - dc/f1e zero size 2024-02-15T22:50:47.657 INFO:tasks.workunit.client.0.smithi138.stdout:4/58: dread f6 [0,4194304] 0 2024-02-15T22:50:47.658 INFO:tasks.workunit.client.0.smithi138.stdout:4/59: creat f10 x:0 0 0 2024-02-15T22:50:47.658 INFO:tasks.workunit.client.0.smithi138.stdout:4/60: chown lb 4768 1 2024-02-15T22:50:47.658 INFO:tasks.workunit.client.0.smithi138.stdout:4/61: write fd [530793,105470] 0 2024-02-15T22:50:47.661 INFO:tasks.workunit.client.0.smithi138.stdout:2/16: stat d0/d3/f4 0 2024-02-15T22:50:47.661 INFO:tasks.workunit.client.0.smithi138.stdout:2/17: chown d0/d3 236 1 2024-02-15T22:50:47.667 INFO:tasks.workunit.client.0.smithi138.stdout:1/29: read f4 [2001956,93361] 0 2024-02-15T22:50:47.667 INFO:tasks.workunit.client.0.smithi138.stdout:6/81: dread f1 [0,4194304] 0 2024-02-15T22:50:47.668 INFO:tasks.workunit.client.0.smithi138.stdout:4/62: link l4 l11 0 2024-02-15T22:50:47.675 INFO:tasks.workunit.client.0.smithi138.stdout:1/30: symlink l6 0 2024-02-15T22:50:47.676 INFO:tasks.workunit.client.0.smithi138.stdout:1/31: read f4 [3010949,47416] 0 2024-02-15T22:50:47.676 INFO:tasks.workunit.client.0.smithi138.stdout:1/32: write f4 [74341,87465] 0 2024-02-15T22:50:47.679 INFO:tasks.workunit.client.0.smithi138.stdout:7/33: dwrite d1/f5 [0,4194304] 0 2024-02-15T22:50:47.679 INFO:tasks.workunit.client.0.smithi138.stdout:7/34: rename d1 to d1/dc 22 2024-02-15T22:50:47.694 INFO:tasks.workunit.client.0.smithi138.stdout:8/9: truncate f1 244702 0 2024-02-15T22:50:47.695 INFO:tasks.workunit.client.0.smithi138.stdout:8/10: rename f1 to f3 0 2024-02-15T22:50:47.696 INFO:tasks.workunit.client.0.smithi138.stdout:4/63: dwrite f10 [0,4194304] 0 2024-02-15T22:50:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:8/11: dread f0 [0,4194304] 0 2024-02-15T22:50:47.698 INFO:tasks.workunit.client.0.smithi138.stdout:8/12: chown f2 57674 1 2024-02-15T22:50:47.699 INFO:tasks.workunit.client.0.smithi138.stdout:4/64: write f8 [214840,35435] 0 2024-02-15T22:50:47.699 INFO:tasks.workunit.client.0.smithi138.stdout:8/13: mknod c4 0 2024-02-15T22:50:47.701 INFO:tasks.workunit.client.0.smithi138.stdout:2/18: dwrite d0/d3/f4 [0,4194304] 0 2024-02-15T22:50:47.702 INFO:tasks.workunit.client.0.smithi138.stdout:6/82: dwrite dc/ff [0,4194304] 0 2024-02-15T22:50:47.702 INFO:tasks.workunit.client.0.smithi138.stdout:7/35: dwrite d1/f9 [0,4194304] 0 2024-02-15T22:50:47.702 INFO:tasks.workunit.client.0.smithi138.stdout:6/83: write dc/f1a [1037434,102506] 0 2024-02-15T22:50:47.703 INFO:tasks.workunit.client.0.smithi138.stdout:4/65: dread f8 [0,4194304] 0 2024-02-15T22:50:47.707 INFO:tasks.workunit.client.0.smithi138.stdout:2/19: truncate d0/f1 1777685 0 2024-02-15T22:50:47.708 INFO:tasks.workunit.client.0.smithi138.stdout:2/20: creat d0/f6 x:0 0 0 2024-02-15T22:50:47.709 INFO:tasks.workunit.client.0.smithi138.stdout:7/36: rmdir d1/d2 39 2024-02-15T22:50:47.710 INFO:tasks.workunit.client.0.smithi138.stdout:7/37: stat d1/d2/la 0 2024-02-15T22:50:47.712 INFO:tasks.workunit.client.0.smithi138.stdout:6/84: rename c9 to dc/c1f 0 2024-02-15T22:50:47.712 INFO:tasks.workunit.client.0.smithi138.stdout:8/14: getdents . 0 2024-02-15T22:50:47.712 INFO:tasks.workunit.client.0.smithi138.stdout:8/15: write f0 [1038196,29634] 0 2024-02-15T22:50:47.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/38: mknod d1/d2/db/cd 0 2024-02-15T22:50:47.719 INFO:tasks.workunit.client.0.smithi138.stdout:1/33: dwrite f4 [0,4194304] 0 2024-02-15T22:50:47.721 INFO:tasks.workunit.client.0.smithi138.stdout:8/16: creat f5 x:0 0 0 2024-02-15T22:50:47.723 INFO:tasks.workunit.client.0.smithi138.stdout:2/21: mknod d0/d3/c7 0 2024-02-15T22:50:47.723 INFO:tasks.workunit.client.0.smithi138.stdout:2/22: readlink - no filename 2024-02-15T22:50:47.724 INFO:tasks.workunit.client.0.smithi138.stdout:6/85: rename dc/c1f to dc/c20 0 2024-02-15T22:50:47.726 INFO:tasks.workunit.client.0.smithi138.stdout:1/34: creat f7 x:0 0 0 2024-02-15T22:50:47.726 INFO:tasks.workunit.client.0.smithi138.stdout:1/35: dread - f7 zero size 2024-02-15T22:50:47.726 INFO:tasks.workunit.client.0.smithi138.stdout:1/36: dread - f7 zero size 2024-02-15T22:50:47.729 INFO:tasks.workunit.client.0.smithi138.stdout:2/23: creat d0/d3/d5/f8 x:0 0 0 2024-02-15T22:50:47.731 INFO:tasks.workunit.client.0.smithi138.stdout:6/86: symlink dc/l21 0 2024-02-15T22:50:47.731 INFO:tasks.workunit.client.0.smithi138.stdout:6/87: chown f1 3581141 1 2024-02-15T22:50:47.736 INFO:tasks.workunit.client.0.smithi138.stdout:2/24: symlink d0/l9 0 2024-02-15T22:50:47.736 INFO:tasks.workunit.client.0.smithi138.stdout:2/25: read - d0/f6 zero size 2024-02-15T22:50:47.737 INFO:tasks.workunit.client.0.smithi138.stdout:6/88: mknod dc/c22 0 2024-02-15T22:50:47.739 INFO:tasks.workunit.client.0.smithi138.stdout:6/89: mkdir dc/d23 0 2024-02-15T22:50:47.739 INFO:tasks.workunit.client.0.smithi138.stdout:6/90: stat dc/f1b 0 2024-02-15T22:50:47.739 INFO:tasks.workunit.client.0.smithi138.stdout:6/91: readlink la 0 2024-02-15T22:50:47.748 INFO:tasks.workunit.client.0.smithi138.stdout:1/37: dwrite f4 [4194304,4194304] 0 2024-02-15T22:50:47.749 INFO:tasks.workunit.client.0.smithi138.stdout:8/17: dwrite f2 [0,4194304] 0 2024-02-15T22:50:47.756 INFO:tasks.workunit.client.0.smithi138.stdout:2/26: rename d0/d3/d5 to d0/da 0 2024-02-15T22:50:47.756 INFO:tasks.workunit.client.0.smithi138.stdout:7/39: truncate d1/f5 236798 0 2024-02-15T22:50:47.761 INFO:tasks.workunit.client.0.smithi138.stdout:1/38: write f4 [5846300,32047] 0 2024-02-15T22:50:47.761 INFO:tasks.workunit.client.0.smithi138.stdout:6/92: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:47.762 INFO:tasks.workunit.client.0.smithi138.stdout:7/40: fsync d1/f9 0 2024-02-15T22:50:47.762 INFO:tasks.workunit.client.0.smithi138.stdout:7/41: fsync d1/f9 0 2024-02-15T22:50:47.764 INFO:tasks.workunit.client.0.smithi138.stdout:1/39: creat f8 x:0 0 0 2024-02-15T22:50:47.766 INFO:tasks.workunit.client.0.smithi138.stdout:8/18: dread f0 [0,4194304] 0 2024-02-15T22:50:47.766 INFO:tasks.workunit.client.0.smithi138.stdout:7/42: creat d1/d2/db/fe x:0 0 0 2024-02-15T22:50:47.767 INFO:tasks.workunit.client.0.smithi138.stdout:7/43: unlink d1/f5 0 2024-02-15T22:50:47.767 INFO:tasks.workunit.client.0.smithi138.stdout:7/44: readlink d1/d2/la 0 2024-02-15T22:50:47.768 INFO:tasks.workunit.client.0.smithi138.stdout:1/40: rename f7 to f9 0 2024-02-15T22:50:47.770 INFO:tasks.workunit.client.0.smithi138.stdout:7/45: creat d1/d2/ff x:0 0 0 2024-02-15T22:50:47.771 INFO:tasks.workunit.client.0.smithi138.stdout:7/46: symlink d1/l10 0 2024-02-15T22:50:47.771 INFO:tasks.workunit.client.0.smithi138.stdout:7/47: creat d1/d2/f11 x:0 0 0 2024-02-15T22:50:47.773 INFO:tasks.workunit.client.0.smithi138.stdout:2/27: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:50:47.774 INFO:tasks.workunit.client.0.smithi138.stdout:7/48: write d1/f9 [738919,105205] 0 2024-02-15T22:50:47.774 INFO:tasks.workunit.client.0.smithi138.stdout:7/49: readlink d1/d2/la 0 2024-02-15T22:50:47.779 INFO:tasks.workunit.client.0.smithi138.stdout:7/50: creat d1/f12 x:0 0 0 2024-02-15T22:50:47.780 INFO:tasks.workunit.client.0.smithi138.stdout:2/28: mknod d0/d3/cb 0 2024-02-15T22:50:47.780 INFO:tasks.workunit.client.0.smithi138.stdout:2/29: chown d0/f6 3 1 2024-02-15T22:50:47.789 INFO:tasks.workunit.client.0.smithi138.stdout:6/93: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:47.791 INFO:tasks.workunit.client.0.smithi138.stdout:6/94: rmdir dc/d23 0 2024-02-15T22:50:47.792 INFO:tasks.workunit.client.0.smithi138.stdout:6/95: mkdir dc/d24 0 2024-02-15T22:50:47.792 INFO:tasks.workunit.client.0.smithi138.stdout:7/51: dread d1/d2/f8 [0,4194304] 0 2024-02-15T22:50:47.792 INFO:tasks.workunit.client.0.smithi138.stdout:6/96: mknod dc/c25 0 2024-02-15T22:50:47.793 INFO:tasks.workunit.client.0.smithi138.stdout:6/97: truncate dc/ff 4892387 0 2024-02-15T22:50:47.920 INFO:tasks.workunit.client.0.smithi138.stdout:7/52: rename d1/d2/la to d1/l13 0 2024-02-15T22:50:47.920 INFO:tasks.workunit.client.0.smithi138.stdout:7/53: write d1/d2/ff [851360,36483] 0 2024-02-15T22:50:47.921 INFO:tasks.workunit.client.0.smithi138.stdout:1/41: dwrite f4 [0,4194304] 0 2024-02-15T22:50:47.921 INFO:tasks.workunit.client.0.smithi138.stdout:1/42: dread - f8 zero size 2024-02-15T22:50:47.921 INFO:tasks.workunit.client.0.smithi138.stdout:1/43: dread - f9 zero size 2024-02-15T22:50:47.921 INFO:tasks.workunit.client.0.smithi138.stdout:6/98: creat dc/d24/f26 x:0 0 0 2024-02-15T22:50:47.921 INFO:tasks.workunit.client.0.smithi138.stdout:6/99: fsync dc/ff 0 2024-02-15T22:50:47.928 INFO:tasks.workunit.client.0.smithi138.stdout:2/30: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:50:47.962 INFO:tasks.workunit.client.0.smithi138.stdout:1/44: creat fa x:0 0 0 2024-02-15T22:50:47.968 INFO:tasks.workunit.client.0.smithi138.stdout:7/54: link d1/d2/db/fe d1/f14 0 2024-02-15T22:50:47.973 INFO:tasks.workunit.client.0.smithi138.stdout:6/100: rmdir dc/d24 39 2024-02-15T22:50:47.975 INFO:tasks.workunit.client.0.smithi138.stdout:7/55: write d1/d2/f11 [180823,71136] 0 2024-02-15T22:50:47.976 INFO:tasks.workunit.client.0.smithi138.stdout:2/31: symlink d0/d3/lc 0 2024-02-15T22:50:47.976 INFO:tasks.workunit.client.0.smithi138.stdout:2/32: fsync d0/da/f8 0 2024-02-15T22:50:47.976 INFO:tasks.workunit.client.0.smithi138.stdout:2/33: truncate d0/f6 936881 0 2024-02-15T22:50:47.978 INFO:tasks.workunit.client.0.smithi138.stdout:6/101: unlink dc/f12 0 2024-02-15T22:50:47.980 INFO:tasks.workunit.client.0.smithi138.stdout:1/45: dwrite f4 [4194304,4194304] 0 2024-02-15T22:50:47.980 INFO:tasks.workunit.client.0.smithi138.stdout:1/46: fsync f9 0 2024-02-15T22:50:47.980 INFO:tasks.workunit.client.0.smithi138.stdout:2/34: mkdir d0/dd 0 2024-02-15T22:50:47.981 INFO:tasks.workunit.client.0.smithi138.stdout:2/35: chown d0/f2 3598434 1 2024-02-15T22:50:47.981 INFO:tasks.workunit.client.0.smithi138.stdout:7/56: getdents d1 0 2024-02-15T22:50:47.981 INFO:tasks.workunit.client.0.smithi138.stdout:2/36: dread d0/f6 [0,4194304] 0 2024-02-15T22:50:47.983 INFO:tasks.workunit.client.0.smithi138.stdout:7/57: link c0 d1/c15 0 2024-02-15T22:50:47.985 INFO:tasks.workunit.client.0.smithi138.stdout:2/37: mknod d0/da/ce 0 2024-02-15T22:50:47.986 INFO:tasks.workunit.client.0.smithi138.stdout:6/102: dread dc/f13 [0,4194304] 0 2024-02-15T22:50:47.987 INFO:tasks.workunit.client.0.smithi138.stdout:1/47: mknod cb 0 2024-02-15T22:50:47.990 INFO:tasks.workunit.client.0.smithi138.stdout:2/38: mknod d0/dd/cf 0 2024-02-15T22:50:47.990 INFO:tasks.workunit.client.0.smithi138.stdout:6/103: truncate f2 3419775 0 2024-02-15T22:50:47.992 INFO:tasks.workunit.client.0.smithi138.stdout:1/48: unlink f9 0 2024-02-15T22:50:47.992 INFO:tasks.workunit.client.0.smithi138.stdout:7/58: dread - d1/d2/db/fe zero size 2024-02-15T22:50:47.994 INFO:tasks.workunit.client.0.smithi138.stdout:2/39: link d0/f6 d0/da/f10 0 2024-02-15T22:50:47.996 INFO:tasks.workunit.client.0.smithi138.stdout:6/104: link dc/f1e dc/d24/f27 0 2024-02-15T22:50:47.996 INFO:tasks.workunit.client.0.smithi138.stdout:6/105: chown dc/c25 11650 1 2024-02-15T22:50:48.001 INFO:tasks.workunit.client.0.smithi138.stdout:1/49: mknod cc 0 2024-02-15T22:50:48.003 INFO:tasks.workunit.client.0.smithi138.stdout:6/106: getdents dc 0 2024-02-15T22:50:48.005 INFO:tasks.workunit.client.0.smithi138.stdout:1/50: creat fd x:0 0 0 2024-02-15T22:50:48.013 INFO:tasks.workunit.client.0.smithi138.stdout:2/40: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:50:48.023 INFO:tasks.workunit.client.0.smithi138.stdout:2/41: write d0/f2 [3205459,77064] 0 2024-02-15T22:50:48.023 INFO:tasks.workunit.client.0.smithi138.stdout:6/107: dwrite dc/f14 [0,4194304] 0 2024-02-15T22:50:48.023 INFO:tasks.workunit.client.0.smithi138.stdout:7/59: dwrite d1/d2/ff [0,4194304] 0 2024-02-15T22:50:48.026 INFO:tasks.workunit.client.0.smithi138.stdout:7/60: chown d1/f12 53292117 1 2024-02-15T22:50:48.028 INFO:tasks.workunit.client.0.smithi138.stdout:7/61: readlink d1/l13 0 2024-02-15T22:50:48.035 INFO:tasks.workunit.client.0.smithi138.stdout:2/42: dread d0/f2 [0,4194304] 0 2024-02-15T22:50:48.035 INFO:tasks.workunit.client.0.smithi138.stdout:2/43: chown d0/f2 4073329 1 2024-02-15T22:50:48.035 INFO:tasks.workunit.client.0.smithi138.stdout:2/44: truncate d0/da/f10 1236140 0 2024-02-15T22:50:48.035 INFO:tasks.workunit.client.0.smithi138.stdout:2/45: truncate d0/f1 5007333 0 2024-02-15T22:50:48.044 INFO:tasks.workunit.client.0.smithi138.stdout:6/108: dwrite dc/f1b [0,4194304] 0 2024-02-15T22:50:48.044 INFO:tasks.workunit.client.0.smithi138.stdout:6/109: chown dc/f1c 27223 1 2024-02-15T22:50:48.044 INFO:tasks.workunit.client.0.smithi138.stdout:7/62: dwrite d1/d2/ff [0,4194304] 0 2024-02-15T22:50:48.045 INFO:tasks.workunit.client.0.smithi138.stdout:7/63: dread - d1/f12 zero size 2024-02-15T22:50:48.047 INFO:tasks.workunit.client.0.smithi138.stdout:7/64: dread d1/d2/f11 [0,4194304] 0 2024-02-15T22:50:48.061 INFO:tasks.workunit.client.0.smithi138.stdout:7/65: dwrite d1/f14 [0,4194304] 0 2024-02-15T22:50:48.061 INFO:tasks.workunit.client.0.smithi138.stdout:7/66: creat d1/d2/db/f16 x:0 0 0 2024-02-15T22:50:48.064 INFO:tasks.workunit.client.0.smithi138.stdout:7/67: rename d1/f9 to d1/d2/db/f17 0 2024-02-15T22:50:48.065 INFO:tasks.workunit.client.0.smithi138.stdout:7/68: stat d1/c15 0 2024-02-15T22:50:48.071 INFO:tasks.workunit.client.0.smithi138.stdout:7/69: write d1/d2/db/fe [211980,104126] 0 2024-02-15T22:50:48.072 INFO:tasks.workunit.client.0.smithi138.stdout:7/70: symlink d1/l18 0 2024-02-15T22:50:48.075 INFO:tasks.workunit.client.0.smithi138.stdout:7/71: creat d1/d2/db/f19 x:0 0 0 2024-02-15T22:50:48.075 INFO:tasks.workunit.client.0.smithi138.stdout:7/72: chown d1/d2/db 16143 1 2024-02-15T22:50:48.076 INFO:tasks.workunit.client.0.smithi138.stdout:7/73: unlink d1/f14 0 2024-02-15T22:50:48.076 INFO:tasks.workunit.client.0.smithi138.stdout:7/74: mknod d1/d2/db/c1a 0 2024-02-15T22:50:48.076 INFO:tasks.workunit.client.0.smithi138.stdout:7/75: symlink d1/d2/l1b 0 2024-02-15T22:50:48.076 INFO:tasks.workunit.client.0.smithi138.stdout:7/76: creat d1/d2/db/f1c x:0 0 0 2024-02-15T22:50:48.077 INFO:tasks.workunit.client.0.smithi138.stdout:7/77: unlink d1/d2/db/cd 0 2024-02-15T22:50:48.083 INFO:tasks.workunit.client.0.smithi138.stdout:7/78: getdents d1 0 2024-02-15T22:50:48.084 INFO:tasks.workunit.client.0.smithi138.stdout:7/79: creat d1/d2/f1d x:0 0 0 2024-02-15T22:50:48.084 INFO:tasks.workunit.client.0.smithi138.stdout:7/80: write d1/d2/f1d [180926,935] 0 2024-02-15T22:50:48.085 INFO:tasks.workunit.client.0.smithi138.stdout:7/81: symlink d1/d2/db/l1e 0 2024-02-15T22:50:48.087 INFO:tasks.workunit.client.0.smithi138.stdout:7/82: rmdir d1 39 2024-02-15T22:50:48.088 INFO:tasks.workunit.client.0.smithi138.stdout:7/83: dread d1/d2/f11 [0,4194304] 0 2024-02-15T22:50:48.089 INFO:tasks.workunit.client.0.smithi138.stdout:7/84: rename d1/l18 to d1/d2/l1f 0 2024-02-15T22:50:48.091 INFO:tasks.workunit.client.0.smithi138.stdout:7/85: dread d1/d2/db/f17 [0,4194304] 0 2024-02-15T22:50:48.104 INFO:tasks.workunit.client.0.smithi138.stdout:7/86: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:48.106 INFO:tasks.workunit.client.0.smithi138.stdout:7/87: rename d1/d2/f11 to d1/d2/db/f20 0 2024-02-15T22:50:48.119 INFO:tasks.workunit.client.0.smithi138.stdout:7/88: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:48.120 INFO:tasks.workunit.client.0.smithi138.stdout:7/89: symlink d1/l21 0 2024-02-15T22:50:48.121 INFO:tasks.workunit.client.0.smithi138.stdout:7/90: link d1/c15 d1/d2/db/c22 0 2024-02-15T22:50:48.121 INFO:tasks.workunit.client.0.smithi138.stdout:7/91: dread - d1/d2/db/f19 zero size 2024-02-15T22:50:48.121 INFO:tasks.workunit.client.0.smithi138.stdout:7/92: rename d1 to d1/d2/db/d23 22 2024-02-15T22:50:48.134 INFO:tasks.workunit.client.0.smithi138.stdout:7/93: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:48.135 INFO:tasks.workunit.client.0.smithi138.stdout:7/94: mknod d1/c24 0 2024-02-15T22:50:48.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/95: mkdir d1/d2/db/d25 0 2024-02-15T22:50:48.138 INFO:tasks.workunit.client.0.smithi138.stdout:7/96: unlink d1/d2/f8 0 2024-02-15T22:50:48.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/97: dread d1/d2/db/fe [0,4194304] 0 2024-02-15T22:50:48.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/98: write d1/d2/db/f19 [148495,15829] 0 2024-02-15T22:50:48.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/99: dread - d1/f12 zero size 2024-02-15T22:50:48.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/100: fsync d1/d2/db/f16 0 2024-02-15T22:50:48.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/101: write d1/d2/db/f16 [783934,31826] 0 2024-02-15T22:50:48.146 INFO:tasks.workunit.client.0.smithi138.stdout:7/102: mknod d1/c26 0 2024-02-15T22:50:48.146 INFO:tasks.workunit.client.0.smithi138.stdout:7/103: getdents d1/d2/db/d25 0 2024-02-15T22:50:48.146 INFO:tasks.workunit.client.0.smithi138.stdout:7/104: readlink d1/d2/l1f 0 2024-02-15T22:50:48.147 INFO:tasks.workunit.client.0.smithi138.stdout:7/105: unlink d1/d2/db/f19 0 2024-02-15T22:50:48.147 INFO:tasks.workunit.client.0.smithi138.stdout:7/106: creat d1/d2/db/f27 x:0 0 0 2024-02-15T22:50:48.147 INFO:tasks.workunit.client.0.smithi138.stdout:7/107: write d1/d2/db/f27 [959651,7620] 0 2024-02-15T22:50:48.148 INFO:tasks.workunit.client.0.smithi138.stdout:7/108: mkdir d1/d28 0 2024-02-15T22:50:48.151 INFO:tasks.workunit.client.0.smithi138.stdout:7/109: dread d1/d2/db/f16 [0,4194304] 0 2024-02-15T22:50:48.152 INFO:tasks.workunit.client.0.smithi138.stdout:7/110: unlink d1/c15 0 2024-02-15T22:50:48.165 INFO:tasks.workunit.client.0.smithi138.stdout:7/111: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:48.166 INFO:tasks.workunit.client.0.smithi138.stdout:7/112: mkdir d1/d2/d29 0 2024-02-15T22:50:48.166 INFO:tasks.workunit.client.0.smithi138.stdout:7/113: chown d1/d2/db/c1a 6 1 2024-02-15T22:50:48.167 INFO:tasks.workunit.client.0.smithi138.stdout:7/114: mkdir d1/d2/db/d2a 0 2024-02-15T22:50:48.168 INFO:tasks.workunit.client.0.smithi138.stdout:7/115: write d1/d2/db/f17 [559499,28600] 0 2024-02-15T22:50:48.169 INFO:tasks.workunit.client.0.smithi138.stdout:7/116: link c0 d1/d2/db/d25/c2b 0 2024-02-15T22:50:48.170 INFO:tasks.workunit.client.0.smithi138.stdout:7/117: symlink d1/d2/l2c 0 2024-02-15T22:50:48.182 INFO:tasks.workunit.client.0.smithi138.stdout:7/118: rmdir d1/d2/db 39 2024-02-15T22:50:48.184 INFO:tasks.workunit.client.0.smithi138.stdout:7/119: creat d1/d2/d29/f2d x:0 0 0 2024-02-15T22:50:48.184 INFO:tasks.workunit.client.0.smithi138.stdout:7/120: readlink d1/d2/l2c 0 2024-02-15T22:50:48.201 INFO:tasks.workunit.client.0.smithi138.stdout:7/121: dwrite d1/d2/db/f16 [0,4194304] 0 2024-02-15T22:50:48.209 INFO:tasks.workunit.client.0.smithi138.stdout:7/122: dread d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:48.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/123: dwrite d1/d2/db/fe [0,4194304] 0 2024-02-15T22:50:48.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/124: mknod d1/d28/c2e 0 2024-02-15T22:50:48.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/125: getdents d1/d2/db/d25 0 2024-02-15T22:50:48.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/126: dread - d1/f12 zero size 2024-02-15T22:50:48.233 INFO:tasks.workunit.client.0.smithi138.stdout:7/127: symlink d1/d2/db/d2a/l2f 0 2024-02-15T22:50:48.233 INFO:tasks.workunit.client.0.smithi138.stdout:7/128: write d1/d2/db/f27 [1378619,33962] 0 2024-02-15T22:50:48.247 INFO:tasks.workunit.client.0.smithi138.stdout:7/129: dwrite d1/d2/f1d [0,4194304] 0 2024-02-15T22:50:48.248 INFO:tasks.workunit.client.0.smithi138.stdout:7/130: creat d1/d2/f30 x:0 0 0 2024-02-15T22:50:48.262 INFO:tasks.workunit.client.0.smithi138.stdout:7/131: dwrite d1/d2/db/f20 [0,4194304] 0 2024-02-15T22:50:48.265 INFO:tasks.workunit.client.0.smithi138.stdout:7/132: unlink d1/d2/db/l1e 0 2024-02-15T22:50:48.269 INFO:tasks.workunit.client.0.smithi138.stdout:7/133: dread d1/d2/db/f17 [0,4194304] 0 2024-02-15T22:50:48.270 INFO:tasks.workunit.client.0.smithi138.stdout:7/134: getdents d1/d2/d29 0 2024-02-15T22:50:48.277 INFO:tasks.workunit.client.0.smithi138.stdout:7/135: write d1/d2/db/f20 [994371,128273] 0 2024-02-15T22:50:48.277 INFO:tasks.workunit.client.0.smithi138.stdout:7/136: chown d1/l21 4845115 1 2024-02-15T22:50:48.292 INFO:tasks.workunit.client.0.smithi138.stdout:7/137: dwrite d1/f12 [0,4194304] 0 2024-02-15T22:50:48.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/138: rename d1/d2/db/f27 to d1/d2/f31 0 2024-02-15T22:50:48.298 INFO:tasks.workunit.client.0.smithi138.stdout:7/139: write d1/d2/db/f1c [3572045,91402] 0 2024-02-15T22:50:48.298 INFO:tasks.workunit.client.0.smithi138.stdout:7/140: fsync d1/d2/f30 0 2024-02-15T22:50:48.298 INFO:tasks.workunit.client.0.smithi138.stdout:7/141: symlink d1/d2/d29/l32 0 2024-02-15T22:50:48.299 INFO:tasks.workunit.client.0.smithi138.stdout:7/142: mknod d1/d2/db/c33 0 2024-02-15T22:50:48.308 INFO:tasks.workunit.client.0.smithi138.stdout:7/143: read d1/d2/db/f16 [386013,52869] 0 2024-02-15T22:50:48.309 INFO:tasks.workunit.client.0.smithi138.stdout:7/144: rename d1/d2/db/f17 to d1/d2/db/d2a/f34 0 2024-02-15T22:50:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:7/145: symlink d1/d2/db/d25/l35 0 2024-02-15T22:50:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:7/146: chown d1/d2/d29 338310 1 2024-02-15T22:50:48.311 INFO:tasks.workunit.client.0.smithi138.stdout:7/147: creat d1/d2/db/d25/f36 x:0 0 0 2024-02-15T22:50:48.329 INFO:tasks.workunit.client.0.smithi138.stdout:7/148: dwrite d1/d2/f31 [0,4194304] 0 2024-02-15T22:50:48.331 INFO:tasks.workunit.client.0.smithi138.stdout:7/149: mknod d1/c37 0 2024-02-15T22:50:48.332 INFO:tasks.workunit.client.0.smithi138.stdout:7/150: creat d1/d2/db/f38 x:0 0 0 2024-02-15T22:50:48.333 INFO:tasks.workunit.client.0.smithi138.stdout:7/151: write d1/d2/db/f1c [3832817,37512] 0 2024-02-15T22:50:48.333 INFO:tasks.workunit.client.0.smithi138.stdout:7/152: symlink d1/d28/l39 0 2024-02-15T22:50:48.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/153: creat d1/d2/d29/f3a x:0 0 0 2024-02-15T22:50:48.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/154: chown d1/d2/db/d25 943 1 2024-02-15T22:50:48.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/155: chown d1/d2/db/d25/c2b 530 1 2024-02-15T22:50:48.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/156: symlink d1/d2/l3b 0 2024-02-15T22:50:48.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/157: readlink d1/l13 0 2024-02-15T22:50:48.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/158: readlink d1/d2/l1f 0 2024-02-15T22:50:48.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/159: stat d1/d2/db/f1c 0 2024-02-15T22:50:48.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/160: dread - d1/d2/d29/f3a zero size 2024-02-15T22:50:48.339 INFO:tasks.workunit.client.0.smithi138.stdout:7/161: mkdir d1/d2/db/d3c 0 2024-02-15T22:50:48.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/162: symlink d1/d2/db/d25/l3d 0 2024-02-15T22:50:48.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/163: write d1/d2/d29/f3a [1070,125320] 0 2024-02-15T22:50:48.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/164: write d1/d2/db/d2a/f34 [1852537,128593] 0 2024-02-15T22:50:48.342 INFO:tasks.workunit.client.0.smithi138.stdout:7/165: symlink d1/d2/db/d2a/l3e 0 2024-02-15T22:50:48.342 INFO:tasks.workunit.client.0.smithi138.stdout:7/166: chown d1/d2/db/d25/c2b 671 1 2024-02-15T22:50:48.342 INFO:tasks.workunit.client.0.smithi138.stdout:7/167: stat d1/d2/db/f16 0 2024-02-15T22:50:48.342 INFO:tasks.workunit.client.0.smithi138.stdout:7/168: write d1/d2/db/fe [4432095,115586] 0 2024-02-15T22:50:48.360 INFO:tasks.workunit.client.0.smithi138.stdout:7/169: dwrite d1/d2/f31 [4194304,4194304] 0 2024-02-15T22:50:48.360 INFO:tasks.workunit.client.0.smithi138.stdout:7/170: write d1/d2/db/f38 [605454,105266] 0 2024-02-15T22:50:48.362 INFO:tasks.workunit.client.0.smithi138.stdout:7/171: symlink d1/d2/d29/l3f 0 2024-02-15T22:50:48.373 INFO:tasks.workunit.client.0.smithi138.stdout:7/172: creat d1/f40 x:0 0 0 2024-02-15T22:50:48.382 INFO:tasks.workunit.client.0.smithi138.stdout:7/173: write d1/d2/f1d [3125743,15613] 0 2024-02-15T22:50:48.382 INFO:tasks.workunit.client.0.smithi138.stdout:7/174: stat d1/l21 0 2024-02-15T22:50:48.390 INFO:tasks.workunit.client.0.smithi138.stdout:7/175: dread d1/d2/f31 [0,4194304] 0 2024-02-15T22:50:48.390 INFO:tasks.workunit.client.0.smithi138.stdout:7/176: write d1/d2/f30 [703236,108768] 0 2024-02-15T22:50:48.392 INFO:tasks.workunit.client.0.smithi138.stdout:7/177: fsync d1/d2/db/f38 0 2024-02-15T22:50:48.401 INFO:tasks.workunit.client.0.smithi138.stdout:7/178: write d1/f12 [1642517,92037] 0 2024-02-15T22:50:48.418 INFO:tasks.workunit.client.0.smithi138.stdout:7/179: dwrite d1/d2/db/d25/f36 [0,4194304] 0 2024-02-15T22:50:48.418 INFO:tasks.workunit.client.0.smithi138.stdout:7/180: write d1/d2/f1d [3085338,117258] 0 2024-02-15T22:50:48.418 INFO:tasks.workunit.client.0.smithi138.stdout:7/181: write d1/f12 [3394439,61619] 0 2024-02-15T22:50:48.420 INFO:tasks.workunit.client.0.smithi138.stdout:7/182: rmdir d1/d2/db/d2a 39 2024-02-15T22:50:48.421 INFO:tasks.workunit.client.0.smithi138.stdout:7/183: fdatasync d1/d2/f1d 0 2024-02-15T22:50:48.422 INFO:tasks.workunit.client.0.smithi138.stdout:7/184: mkdir d1/d2/db/d25/d41 0 2024-02-15T22:50:48.422 INFO:tasks.workunit.client.0.smithi138.stdout:7/185: creat d1/f42 x:0 0 0 2024-02-15T22:50:48.423 INFO:tasks.workunit.client.0.smithi138.stdout:7/186: mkdir d1/d28/d43 0 2024-02-15T22:50:48.439 INFO:tasks.workunit.client.0.smithi138.stdout:7/187: dwrite d1/d2/f31 [8388608,4194304] 0 2024-02-15T22:50:48.439 INFO:tasks.workunit.client.0.smithi138.stdout:7/188: getdents d1/d28/d43 0 2024-02-15T22:50:48.439 INFO:tasks.workunit.client.0.smithi138.stdout:7/189: write d1/d2/ff [5044065,2983] 0 2024-02-15T22:50:48.440 INFO:tasks.workunit.client.0.smithi138.stdout:7/190: stat d1/d28/l39 0 2024-02-15T22:50:48.440 INFO:tasks.workunit.client.0.smithi138.stdout:7/191: getdents d1/d2/db 0 2024-02-15T22:50:48.460 INFO:tasks.workunit.client.0.smithi138.stdout:7/192: dwrite d1/d2/f31 [4194304,4194304] 0 2024-02-15T22:50:48.460 INFO:tasks.workunit.client.0.smithi138.stdout:7/193: dread - d1/f40 zero size 2024-02-15T22:50:48.475 INFO:tasks.workunit.client.0.smithi138.stdout:7/194: dwrite d1/d2/d29/f3a [0,4194304] 0 2024-02-15T22:50:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:7/195: read d1/d2/db/d2a/f34 [1817530,130850] 0 2024-02-15T22:50:48.477 INFO:tasks.workunit.client.0.smithi138.stdout:7/196: readlink d1/l13 0 2024-02-15T22:50:48.478 INFO:tasks.workunit.client.0.smithi138.stdout:7/197: creat d1/d2/f44 x:0 0 0 2024-02-15T22:50:48.479 INFO:tasks.workunit.client.0.smithi138.stdout:7/198: dread d1/d2/db/fe [4194304,4194304] 0 2024-02-15T22:50:48.480 INFO:tasks.workunit.client.0.smithi138.stdout:7/199: creat d1/d2/db/d3c/f45 x:0 0 0 2024-02-15T22:50:48.480 INFO:tasks.workunit.client.0.smithi138.stdout:7/200: write d1/d2/db/f1c [1547178,101367] 0 2024-02-15T22:50:48.481 INFO:tasks.workunit.client.0.smithi138.stdout:7/201: creat d1/d2/db/d25/d41/f46 x:0 0 0 2024-02-15T22:50:48.481 INFO:tasks.workunit.client.0.smithi138.stdout:7/202: mknod d1/c47 0 2024-02-15T22:50:48.495 INFO:tasks.workunit.client.0.smithi138.stdout:7/203: dwrite d1/d2/ff [0,4194304] 0 2024-02-15T22:50:48.503 INFO:tasks.workunit.client.0.smithi138.stdout:7/204: write d1/d2/d29/f3a [769697,23755] 0 2024-02-15T22:50:48.505 INFO:tasks.workunit.client.0.smithi138.stdout:7/205: rmdir d1/d28/d43 0 2024-02-15T22:50:48.505 INFO:tasks.workunit.client.0.smithi138.stdout:7/206: chown d1/d2/db/d25/c2b 67440 1 2024-02-15T22:50:48.505 INFO:tasks.workunit.client.0.smithi138.stdout:7/207: creat d1/d2/db/d25/d41/f48 x:0 0 0 2024-02-15T22:50:48.521 INFO:tasks.workunit.client.0.smithi138.stdout:7/208: dwrite d1/d2/f44 [0,4194304] 0 2024-02-15T22:50:48.537 INFO:tasks.workunit.client.0.smithi138.stdout:7/209: dwrite d1/d2/db/d25/f36 [4194304,4194304] 0 2024-02-15T22:50:48.537 INFO:tasks.workunit.client.0.smithi138.stdout:7/210: dread - d1/d2/db/d3c/f45 zero size 2024-02-15T22:50:48.538 INFO:tasks.workunit.client.0.smithi138.stdout:7/211: truncate d1/d2/f1d 4226068 0 2024-02-15T22:50:48.538 INFO:tasks.workunit.client.0.smithi138.stdout:7/212: write d1/f42 [878930,113252] 0 2024-02-15T22:50:48.538 INFO:tasks.workunit.client.0.smithi138.stdout:7/213: chown d1/l10 485 1 2024-02-15T22:50:48.538 INFO:tasks.workunit.client.0.smithi138.stdout:7/214: read d1/d2/f1d [282930,34500] 0 2024-02-15T22:50:48.539 INFO:tasks.workunit.client.0.smithi138.stdout:7/215: creat d1/d2/db/f49 x:0 0 0 2024-02-15T22:50:48.539 INFO:tasks.workunit.client.0.smithi138.stdout:7/216: creat d1/d2/db/d3c/f4a x:0 0 0 2024-02-15T22:50:48.540 INFO:tasks.workunit.client.0.smithi138.stdout:7/217: symlink d1/d2/db/d25/l4b 0 2024-02-15T22:50:48.542 INFO:tasks.workunit.client.0.smithi138.stdout:7/218: link c0 d1/d2/db/d25/d41/c4c 0 2024-02-15T22:50:48.542 INFO:tasks.workunit.client.0.smithi138.stdout:7/219: write d1/d2/db/f38 [653773,10273] 0 2024-02-15T22:50:48.549 INFO:tasks.workunit.client.0.smithi138.stdout:7/220: write d1/d2/ff [3154248,21599] 0 2024-02-15T22:50:48.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/221: mkdir d1/d2/db/d3c/d4d 0 2024-02-15T22:50:48.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/222: readlink d1/d2/l3b 0 2024-02-15T22:50:48.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/223: chown d1/f42 4836 1 2024-02-15T22:50:48.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/224: stat d1/d2/l1f 0 2024-02-15T22:50:48.564 INFO:tasks.workunit.client.0.smithi138.stdout:7/225: dwrite d1/d2/db/f49 [0,4194304] 0 2024-02-15T22:50:48.567 INFO:tasks.workunit.client.0.smithi138.stdout:7/226: rename d1/d2/db/c33 to d1/d2/d29/c4e 0 2024-02-15T22:50:48.568 INFO:tasks.workunit.client.0.smithi138.stdout:7/227: creat d1/d2/db/d3c/d4d/f4f x:0 0 0 2024-02-15T22:50:48.569 INFO:tasks.workunit.client.0.smithi138.stdout:7/228: mknod d1/d2/db/d3c/d4d/c50 0 2024-02-15T22:50:48.569 INFO:tasks.workunit.client.0.smithi138.stdout:7/229: getdents d1/d2/db/d2a 0 2024-02-15T22:50:48.584 INFO:tasks.workunit.client.0.smithi138.stdout:7/230: dwrite d1/d2/db/f1c [4194304,4194304] 0 2024-02-15T22:50:48.587 INFO:tasks.workunit.client.0.smithi138.stdout:7/231: rename d1/d2/db/c22 to d1/d28/c51 0 2024-02-15T22:50:48.587 INFO:tasks.workunit.client.0.smithi138.stdout:7/232: truncate d1/d2/db/d3c/f45 950095 0 2024-02-15T22:50:48.587 INFO:tasks.workunit.client.0.smithi138.stdout:7/233: creat d1/d2/db/d3c/d4d/f52 x:0 0 0 2024-02-15T22:50:48.587 INFO:tasks.workunit.client.0.smithi138.stdout:7/234: chown d1/d2/d29/f3a 3012 1 2024-02-15T22:50:48.591 INFO:tasks.workunit.client.0.smithi138.stdout:7/235: getdents d1/d2/db/d25/d41 0 2024-02-15T22:50:48.593 INFO:tasks.workunit.client.0.smithi138.stdout:7/236: mknod d1/d2/c53 0 2024-02-15T22:50:48.593 INFO:tasks.workunit.client.0.smithi138.stdout:7/237: symlink d1/d2/db/d3c/l54 0 2024-02-15T22:50:48.603 INFO:tasks.workunit.client.0.smithi138.stdout:7/238: read d1/d2/f44 [3743144,72043] 0 2024-02-15T22:50:48.604 INFO:tasks.workunit.client.0.smithi138.stdout:7/239: unlink d1/d2/db/d3c/d4d/f4f 0 2024-02-15T22:50:48.605 INFO:tasks.workunit.client.0.smithi138.stdout:7/240: mknod d1/d2/db/d25/d41/c55 0 2024-02-15T22:50:48.610 INFO:tasks.workunit.client.0.smithi138.stdout:7/241: dread d1/d2/ff [0,4194304] 0 2024-02-15T22:50:48.623 INFO:tasks.workunit.client.0.smithi138.stdout:7/242: dwrite d1/d2/db/f49 [0,4194304] 0 2024-02-15T22:50:48.641 INFO:tasks.workunit.client.0.smithi138.stdout:7/243: dwrite d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:48.641 INFO:tasks.workunit.client.0.smithi138.stdout:7/244: creat d1/d2/db/d3c/f56 x:0 0 0 2024-02-15T22:50:48.641 INFO:tasks.workunit.client.0.smithi138.stdout:7/245: fsync d1/d2/db/d3c/f45 0 2024-02-15T22:50:48.644 INFO:tasks.workunit.client.0.smithi138.stdout:7/246: truncate d1/d2/db/f20 3209837 0 2024-02-15T22:50:48.645 INFO:tasks.workunit.client.0.smithi138.stdout:7/247: rmdir d1/d2/db/d2a 39 2024-02-15T22:50:48.661 INFO:tasks.workunit.client.0.smithi138.stdout:7/248: dwrite d1/d2/db/f38 [0,4194304] 0 2024-02-15T22:50:48.673 INFO:tasks.workunit.client.0.smithi138.stdout:7/249: dwrite d1/f42 [0,4194304] 0 2024-02-15T22:50:48.675 INFO:tasks.workunit.client.0.smithi138.stdout:7/250: mknod d1/d2/db/d3c/d4d/c57 0 2024-02-15T22:50:48.678 INFO:tasks.workunit.client.0.smithi138.stdout:7/251: dread d1/d2/f30 [0,4194304] 0 2024-02-15T22:50:48.684 INFO:tasks.workunit.client.0.smithi138.stdout:7/252: write d1/d2/db/f49 [309857,45996] 0 2024-02-15T22:50:48.687 INFO:tasks.workunit.client.0.smithi138.stdout:7/253: mkdir d1/d28/d58 0 2024-02-15T22:50:48.688 INFO:tasks.workunit.client.0.smithi138.stdout:7/254: mknod d1/d28/d58/c59 0 2024-02-15T22:50:48.691 INFO:tasks.workunit.client.0.smithi138.stdout:7/255: read d1/d2/db/d3c/d4d/f52 [3964951,64168] 0 2024-02-15T22:50:48.692 INFO:tasks.workunit.client.0.smithi138.stdout:7/256: mkdir d1/d5a 0 2024-02-15T22:50:48.693 INFO:tasks.workunit.client.0.smithi138.stdout:7/257: rmdir d1/d2/db/d25/d41 39 2024-02-15T22:50:48.699 INFO:tasks.workunit.client.0.smithi138.stdout:7/258: dread d1/d2/db/f16 [0,4194304] 0 2024-02-15T22:50:48.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/259: dwrite d1/d2/d29/f3a [0,4194304] 0 2024-02-15T22:50:48.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/260: mkdir d1/d2/db/d3c/d4d/d5b 0 2024-02-15T22:50:48.717 INFO:tasks.workunit.client.0.smithi138.stdout:7/261: rename d1/d2 to d1/d2/db/d2a/d5c 22 2024-02-15T22:50:48.717 INFO:tasks.workunit.client.0.smithi138.stdout:7/262: symlink d1/d2/db/d3c/d4d/d5b/l5d 0 2024-02-15T22:50:48.720 INFO:tasks.workunit.client.0.smithi138.stdout:7/263: dread d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:48.721 INFO:tasks.workunit.client.0.smithi138.stdout:7/264: mknod d1/d2/db/d25/d41/c5e 0 2024-02-15T22:50:48.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/36: sync 2024-02-15T22:50:48.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/37: creat d6/fe x:0 0 0 2024-02-15T22:50:48.725 INFO:tasks.workunit.client.0.smithi138.stdout:7/265: dread d1/d2/ff [0,4194304] 0 2024-02-15T22:50:48.726 INFO:tasks.workunit.client.0.smithi138.stdout:0/38: symlink d6/lf 0 2024-02-15T22:50:48.726 INFO:tasks.workunit.client.0.smithi138.stdout:0/39: stat d6/fe 0 2024-02-15T22:50:48.727 INFO:tasks.workunit.client.0.smithi138.stdout:7/266: rmdir d1/d28/d58 39 2024-02-15T22:50:48.728 INFO:tasks.workunit.client.0.smithi138.stdout:0/40: truncate f4 1107939 0 2024-02-15T22:50:48.732 INFO:tasks.workunit.client.0.smithi138.stdout:7/267: dread d1/d2/f44 [0,4194304] 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/66: sync 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:3/16: sync 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:9/17: sync 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/28: sync 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/29: fdatasync f7 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/67: fdatasync f10 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/68: chown f10 510803 1 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/69: readlink l5 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:3/17: creat f4 x:0 0 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:3/18: truncate f4 539393 0 2024-02-15T22:50:48.766 INFO:tasks.workunit.client.0.smithi138.stdout:9/18: write d0/f8 [590894,117299] 0 2024-02-15T22:50:48.769 INFO:tasks.workunit.client.0.smithi138.stdout:3/19: mkdir d5 0 2024-02-15T22:50:48.769 INFO:tasks.workunit.client.0.smithi138.stdout:3/20: read f1 [339636,86092] 0 2024-02-15T22:50:48.769 INFO:tasks.workunit.client.0.smithi138.stdout:3/21: getdents d5 0 2024-02-15T22:50:48.769 INFO:tasks.workunit.client.0.smithi138.stdout:3/22: read f1 [4127674,2537] 0 2024-02-15T22:50:48.770 INFO:tasks.workunit.client.0.smithi138.stdout:0/41: dwrite f4 [0,4194304] 0 2024-02-15T22:50:48.770 INFO:tasks.workunit.client.0.smithi138.stdout:0/42: truncate d6/fe 895996 0 2024-02-15T22:50:48.770 INFO:tasks.workunit.client.0.smithi138.stdout:9/19: mkdir d0/d4/d9 0 2024-02-15T22:50:48.771 INFO:tasks.workunit.client.0.smithi138.stdout:5/30: rename f7 to f9 0 2024-02-15T22:50:48.771 INFO:tasks.workunit.client.0.smithi138.stdout:5/31: truncate f9 612934 0 2024-02-15T22:50:48.772 INFO:tasks.workunit.client.0.smithi138.stdout:4/70: getdents . 0 2024-02-15T22:50:48.773 INFO:tasks.workunit.client.0.smithi138.stdout:3/23: mkdir d5/d6 0 2024-02-15T22:50:48.773 INFO:tasks.workunit.client.0.smithi138.stdout:3/24: fdatasync f4 0 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/32: dread f5 [0,4194304] 0 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/33: rmdir - no directory 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/34: fdatasync f9 0 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/35: chown f9 915481 1 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/36: truncate f9 1236014 0 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/37: write f9 [1990664,73324] 0 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/38: chown c8 22873 1 2024-02-15T22:50:48.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/39: chown c6 1 1 2024-02-15T22:50:48.775 INFO:tasks.workunit.client.0.smithi138.stdout:3/25: dread f4 [0,4194304] 0 2024-02-15T22:50:48.775 INFO:tasks.workunit.client.0.smithi138.stdout:3/26: fdatasync f4 0 2024-02-15T22:50:48.775 INFO:tasks.workunit.client.0.smithi138.stdout:3/27: fsync f4 0 2024-02-15T22:50:48.775 INFO:tasks.workunit.client.0.smithi138.stdout:0/43: truncate d6/f8 2323315 0 2024-02-15T22:50:48.777 INFO:tasks.workunit.client.0.smithi138.stdout:9/20: unlink d0/d1/l7 0 2024-02-15T22:50:48.779 INFO:tasks.workunit.client.0.smithi138.stdout:0/44: unlink c3 0 2024-02-15T22:50:48.781 INFO:tasks.workunit.client.0.smithi138.stdout:4/71: dread f10 [0,4194304] 0 2024-02-15T22:50:48.781 INFO:tasks.workunit.client.0.smithi138.stdout:4/72: rmdir - no directory 2024-02-15T22:50:48.783 INFO:tasks.workunit.client.0.smithi138.stdout:3/28: dread f1 [0,4194304] 0 2024-02-15T22:50:48.783 INFO:tasks.workunit.client.0.smithi138.stdout:3/29: write f1 [1227079,12223] 0 2024-02-15T22:50:48.783 INFO:tasks.workunit.client.0.smithi138.stdout:9/21: mknod d0/ca 0 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/30: chown l3 60 1 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/31: stat f4 0 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/32: truncate f4 1151296 0 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/33: write f1 [3491382,23286] 0 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/34: chown d5 6 1 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/35: getdents d5/d6 0 2024-02-15T22:50:48.784 INFO:tasks.workunit.client.0.smithi138.stdout:4/73: link cc c12 0 2024-02-15T22:50:48.785 INFO:tasks.workunit.client.0.smithi138.stdout:9/22: symlink d0/d4/lb 0 2024-02-15T22:50:48.787 INFO:tasks.workunit.client.0.smithi138.stdout:3/36: rename l3 to d5/l7 0 2024-02-15T22:50:48.787 INFO:tasks.workunit.client.0.smithi138.stdout:3/37: chown d5/d6 4661362 1 2024-02-15T22:50:48.788 INFO:tasks.workunit.client.0.smithi138.stdout:3/38: chown d5/d6 3865 1 2024-02-15T22:50:48.788 INFO:tasks.workunit.client.0.smithi138.stdout:9/23: dread d0/f8 [0,4194304] 0 2024-02-15T22:50:48.788 INFO:tasks.workunit.client.0.smithi138.stdout:9/24: creat d0/d1/fc x:0 0 0 2024-02-15T22:50:48.789 INFO:tasks.workunit.client.0.smithi138.stdout:4/74: truncate f10 2356369 0 2024-02-15T22:50:48.790 INFO:tasks.workunit.client.0.smithi138.stdout:3/39: mknod d5/d6/c8 0 2024-02-15T22:50:48.792 INFO:tasks.workunit.client.0.smithi138.stdout:4/75: symlink l13 0 2024-02-15T22:50:48.797 INFO:tasks.workunit.client.0.smithi138.stdout:0/45: dwrite f0 [4194304,4194304] 0 2024-02-15T22:50:48.797 INFO:tasks.workunit.client.0.smithi138.stdout:0/46: mkdir d6/d10 0 2024-02-15T22:50:48.798 INFO:tasks.workunit.client.0.smithi138.stdout:0/47: getdents d6/d10 0 2024-02-15T22:50:48.798 INFO:tasks.workunit.client.0.smithi138.stdout:0/48: creat d6/d10/f11 x:0 0 0 2024-02-15T22:50:48.814 INFO:tasks.workunit.client.0.smithi138.stdout:0/49: dwrite d6/fe [0,4194304] 0 2024-02-15T22:50:48.849 INFO:tasks.workunit.client.0.smithi138.stdout:3/40: getdents d5/d6 0 2024-02-15T22:50:48.851 INFO:tasks.workunit.client.0.smithi138.stdout:9/25: rmdir d0/d1 39 2024-02-15T22:50:48.853 INFO:tasks.workunit.client.0.smithi138.stdout:9/26: unlink d0/d4/lb 0 2024-02-15T22:50:48.853 INFO:tasks.workunit.client.0.smithi138.stdout:9/27: dread - d0/d1/fc zero size 2024-02-15T22:50:48.853 INFO:tasks.workunit.client.0.smithi138.stdout:9/28: dread - d0/d1/fc zero size 2024-02-15T22:50:48.853 INFO:tasks.workunit.client.0.smithi138.stdout:9/29: write d0/d1/fc [996568,121728] 0 2024-02-15T22:50:48.853 INFO:tasks.workunit.client.0.smithi138.stdout:4/76: dread f10 [0,4194304] 0 2024-02-15T22:50:48.854 INFO:tasks.workunit.client.0.smithi138.stdout:9/30: creat d0/d4/fd x:0 0 0 2024-02-15T22:50:48.855 INFO:tasks.workunit.client.0.smithi138.stdout:4/77: creat f14 x:0 0 0 2024-02-15T22:50:48.858 INFO:tasks.workunit.client.0.smithi138.stdout:6/110: sync 2024-02-15T22:50:48.858 INFO:tasks.workunit.client.0.smithi138.stdout:8/19: sync 2024-02-15T22:50:48.858 INFO:tasks.workunit.client.0.smithi138.stdout:2/46: sync 2024-02-15T22:50:48.858 INFO:tasks.workunit.client.0.smithi138.stdout:1/51: sync 2024-02-15T22:50:48.859 INFO:tasks.workunit.client.0.smithi138.stdout:1/52: write fd [848236,54770] 0 2024-02-15T22:50:48.861 INFO:tasks.workunit.client.0.smithi138.stdout:2/47: rename d0/d3/lc to d0/l11 0 2024-02-15T22:50:48.862 INFO:tasks.workunit.client.0.smithi138.stdout:4/78: dread f6 [0,4194304] 0 2024-02-15T22:50:48.862 INFO:tasks.workunit.client.0.smithi138.stdout:6/111: mknod dc/d24/c28 0 2024-02-15T22:50:48.863 INFO:tasks.workunit.client.0.smithi138.stdout:6/112: readlink dc/l21 0 2024-02-15T22:50:48.863 INFO:tasks.workunit.client.0.smithi138.stdout:9/31: dread d0/f8 [0,4194304] 0 2024-02-15T22:50:48.863 INFO:tasks.workunit.client.0.smithi138.stdout:9/32: readlink - no filename 2024-02-15T22:50:48.863 INFO:tasks.workunit.client.0.smithi138.stdout:1/53: creat fe x:0 0 0 2024-02-15T22:50:48.863 INFO:tasks.workunit.client.0.smithi138.stdout:1/54: chown cc 9671 1 2024-02-15T22:50:48.864 INFO:tasks.workunit.client.0.smithi138.stdout:2/48: creat d0/d3/f12 x:0 0 0 2024-02-15T22:50:48.865 INFO:tasks.workunit.client.0.smithi138.stdout:4/79: rename ce to c15 0 2024-02-15T22:50:48.867 INFO:tasks.workunit.client.0.smithi138.stdout:8/20: dread f2 [0,4194304] 0 2024-02-15T22:50:48.867 INFO:tasks.workunit.client.0.smithi138.stdout:8/21: stat f5 0 2024-02-15T22:50:48.867 INFO:tasks.workunit.client.0.smithi138.stdout:6/113: link dc/d24/c28 dc/c29 0 2024-02-15T22:50:48.869 INFO:tasks.workunit.client.0.smithi138.stdout:9/33: mkdir d0/de 0 2024-02-15T22:50:48.871 INFO:tasks.workunit.client.0.smithi138.stdout:3/41: dwrite f1 [0,4194304] 0 2024-02-15T22:50:48.872 INFO:tasks.workunit.client.0.smithi138.stdout:8/22: truncate f2 3374553 0 2024-02-15T22:50:48.873 INFO:tasks.workunit.client.0.smithi138.stdout:4/80: dread f6 [0,4194304] 0 2024-02-15T22:50:48.874 INFO:tasks.workunit.client.0.smithi138.stdout:6/114: creat dc/f2a x:0 0 0 2024-02-15T22:50:48.874 INFO:tasks.workunit.client.0.smithi138.stdout:4/81: dread f8 [0,4194304] 0 2024-02-15T22:50:48.876 INFO:tasks.workunit.client.0.smithi138.stdout:1/55: mkdir df 0 2024-02-15T22:50:48.878 INFO:tasks.workunit.client.0.smithi138.stdout:3/42: creat d5/d6/f9 x:0 0 0 2024-02-15T22:50:48.879 INFO:tasks.workunit.client.0.smithi138.stdout:9/34: dread d0/d1/fc [0,4194304] 0 2024-02-15T22:50:48.880 INFO:tasks.workunit.client.0.smithi138.stdout:8/23: creat f6 x:0 0 0 2024-02-15T22:50:48.882 INFO:tasks.workunit.client.0.smithi138.stdout:6/115: unlink dc/l11 0 2024-02-15T22:50:48.885 INFO:tasks.workunit.client.0.smithi138.stdout:6/116: symlink dc/l2b 0 2024-02-15T22:50:48.886 INFO:tasks.workunit.client.0.smithi138.stdout:8/24: symlink l7 0 2024-02-15T22:50:48.892 INFO:tasks.workunit.client.0.smithi138.stdout:6/117: unlink dc/f1b 0 2024-02-15T22:50:48.892 INFO:tasks.workunit.client.0.smithi138.stdout:6/118: stat dc/c17 0 2024-02-15T22:50:48.892 INFO:tasks.workunit.client.0.smithi138.stdout:3/43: read f1 [3221010,16562] 0 2024-02-15T22:50:48.892 INFO:tasks.workunit.client.0.smithi138.stdout:3/44: write d5/d6/f9 [703664,38273] 0 2024-02-15T22:50:48.894 INFO:tasks.workunit.client.0.smithi138.stdout:3/45: rename d5/d6/f9 to d5/d6/fa 0 2024-02-15T22:50:48.894 INFO:tasks.workunit.client.0.smithi138.stdout:9/35: write d0/d4/f5 [3907425,6156] 0 2024-02-15T22:50:48.894 INFO:tasks.workunit.client.0.smithi138.stdout:4/82: dwrite f10 [0,4194304] 0 2024-02-15T22:50:48.894 INFO:tasks.workunit.client.0.smithi138.stdout:2/49: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:50:48.894 INFO:tasks.workunit.client.0.smithi138.stdout:4/83: creat f16 x:0 0 0 2024-02-15T22:50:48.895 INFO:tasks.workunit.client.0.smithi138.stdout:2/50: dread d0/f6 [0,4194304] 0 2024-02-15T22:50:48.897 INFO:tasks.workunit.client.0.smithi138.stdout:3/46: getdents d5 0 2024-02-15T22:50:48.898 INFO:tasks.workunit.client.0.smithi138.stdout:9/36: mkdir d0/df 0 2024-02-15T22:50:48.900 INFO:tasks.workunit.client.0.smithi138.stdout:2/51: rename d0/d3/f4 to d0/da/f13 0 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:9/37: rename d0 to d0/d4/d9/d10 22 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:9/38: readlink - no filename 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:9/39: fdatasync d0/d1/fc 0 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:9/40: fdatasync d0/f8 0 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:3/47: fdatasync d5/d6/fa 0 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:2/52: write d0/d3/f12 [368845,110600] 0 2024-02-15T22:50:48.901 INFO:tasks.workunit.client.0.smithi138.stdout:2/53: creat d0/f14 x:0 0 0 2024-02-15T22:50:48.904 INFO:tasks.workunit.client.0.smithi138.stdout:4/84: write f6 [756697,87996] 0 2024-02-15T22:50:48.907 INFO:tasks.workunit.client.0.smithi138.stdout:2/54: mkdir d0/dd/d15 0 2024-02-15T22:50:48.907 INFO:tasks.workunit.client.0.smithi138.stdout:2/55: chown d0/dd 1918629 1 2024-02-15T22:50:48.915 INFO:tasks.workunit.client.0.smithi138.stdout:3/48: rename d5/d6 to d5/db 0 2024-02-15T22:50:48.917 INFO:tasks.workunit.client.0.smithi138.stdout:3/49: dread f4 [0,4194304] 0 2024-02-15T22:50:48.919 INFO:tasks.workunit.client.0.smithi138.stdout:6/119: dwrite f0 [0,4194304] 0 2024-02-15T22:50:48.919 INFO:tasks.workunit.client.0.smithi138.stdout:6/120: dread - dc/d24/f27 zero size 2024-02-15T22:50:48.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/50: mkdir d5/db/dc 0 2024-02-15T22:50:48.921 INFO:tasks.workunit.client.0.smithi138.stdout:3/51: write d5/db/fa [129404,101951] 0 2024-02-15T22:50:48.921 INFO:tasks.workunit.client.0.smithi138.stdout:3/52: stat d5/db/dc 0 2024-02-15T22:50:48.921 INFO:tasks.workunit.client.0.smithi138.stdout:3/53: stat d5/db/dc 0 2024-02-15T22:50:48.921 INFO:tasks.workunit.client.0.smithi138.stdout:6/121: creat dc/d24/f2c x:0 0 0 2024-02-15T22:50:48.922 INFO:tasks.workunit.client.0.smithi138.stdout:3/54: mknod d5/cd 0 2024-02-15T22:50:48.923 INFO:tasks.workunit.client.0.smithi138.stdout:6/122: write dc/f1a [583323,75094] 0 2024-02-15T22:50:48.936 INFO:tasks.workunit.client.0.smithi138.stdout:9/41: dwrite d0/f8 [0,4194304] 0 2024-02-15T22:50:48.938 INFO:tasks.workunit.client.0.smithi138.stdout:2/56: dwrite d0/f1 [4194304,4194304] 0 2024-02-15T22:50:48.938 INFO:tasks.workunit.client.0.smithi138.stdout:2/57: fdatasync d0/f1 0 2024-02-15T22:50:48.938 INFO:tasks.workunit.client.0.smithi138.stdout:1/56: dwrite fd [0,4194304] 0 2024-02-15T22:50:48.939 INFO:tasks.workunit.client.0.smithi138.stdout:2/58: dread d0/da/f10 [0,4194304] 0 2024-02-15T22:50:48.939 INFO:tasks.workunit.client.0.smithi138.stdout:2/59: chown d0/f2 2069690 1 2024-02-15T22:50:48.941 INFO:tasks.workunit.client.0.smithi138.stdout:4/85: dwrite f8 [0,4194304] 0 2024-02-15T22:50:48.943 INFO:tasks.workunit.client.0.smithi138.stdout:1/57: mknod df/c10 0 2024-02-15T22:50:48.949 INFO:tasks.workunit.client.0.smithi138.stdout:9/42: dread d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:48.952 INFO:tasks.workunit.client.0.smithi138.stdout:4/86: mkdir d17 0 2024-02-15T22:50:48.955 INFO:tasks.workunit.client.0.smithi138.stdout:1/58: read f4 [226438,113478] 0 2024-02-15T22:50:48.957 INFO:tasks.workunit.client.0.smithi138.stdout:6/123: truncate f0 1600917 0 2024-02-15T22:50:48.960 INFO:tasks.workunit.client.0.smithi138.stdout:3/55: dwrite d5/db/fa [0,4194304] 0 2024-02-15T22:50:48.960 INFO:tasks.workunit.client.0.smithi138.stdout:1/59: creat df/f11 x:0 0 0 2024-02-15T22:50:48.961 INFO:tasks.workunit.client.0.smithi138.stdout:1/60: creat df/f12 x:0 0 0 2024-02-15T22:50:48.962 INFO:tasks.workunit.client.0.smithi138.stdout:6/124: mknod dc/d24/c2d 0 2024-02-15T22:50:48.966 INFO:tasks.workunit.client.0.smithi138.stdout:1/61: rename l6 to df/l13 0 2024-02-15T22:50:48.968 INFO:tasks.workunit.client.0.smithi138.stdout:6/125: getdents dc 0 2024-02-15T22:50:48.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/60: truncate d0/da/f8 1379713 0 2024-02-15T22:50:48.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/61: chown d0/f1 48520 1 2024-02-15T22:50:48.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/62: mknod d0/dd/d15/c16 0 2024-02-15T22:50:48.972 INFO:tasks.workunit.client.0.smithi138.stdout:2/63: rename d0/dd/cf to d0/c17 0 2024-02-15T22:50:48.973 INFO:tasks.workunit.client.0.smithi138.stdout:4/87: dwrite fd [0,4194304] 0 2024-02-15T22:50:48.974 INFO:tasks.workunit.client.0.smithi138.stdout:9/43: dwrite d0/d1/fc [0,4194304] 0 2024-02-15T22:50:48.975 INFO:tasks.workunit.client.0.smithi138.stdout:1/62: dread fd [0,4194304] 0 2024-02-15T22:50:48.983 INFO:tasks.workunit.client.0.smithi138.stdout:3/56: dwrite f4 [0,4194304] 0 2024-02-15T22:50:48.991 INFO:tasks.workunit.client.0.smithi138.stdout:3/57: dread f1 [0,4194304] 0 2024-02-15T22:50:48.993 INFO:tasks.workunit.client.0.smithi138.stdout:2/64: dwrite d0/f14 [0,4194304] 0 2024-02-15T22:50:48.993 INFO:tasks.workunit.client.0.smithi138.stdout:2/65: chown d0/dd 16839 1 2024-02-15T22:50:48.995 INFO:tasks.workunit.client.0.smithi138.stdout:9/44: dwrite d0/d1/fc [0,4194304] 0 2024-02-15T22:50:48.999 INFO:tasks.workunit.client.0.smithi138.stdout:3/58: dread f4 [0,4194304] 0 2024-02-15T22:50:49.006 INFO:tasks.workunit.client.0.smithi138.stdout:4/88: creat d17/f18 x:0 0 0 2024-02-15T22:50:49.006 INFO:tasks.workunit.client.0.smithi138.stdout:3/59: dread d5/db/fa [0,4194304] 0 2024-02-15T22:50:49.006 INFO:tasks.workunit.client.0.smithi138.stdout:4/89: creat d17/f19 x:0 0 0 2024-02-15T22:50:49.010 INFO:tasks.workunit.client.0.smithi138.stdout:1/63: link f8 df/f14 0 2024-02-15T22:50:49.014 INFO:tasks.workunit.client.0.smithi138.stdout:4/90: dread f8 [0,4194304] 0 2024-02-15T22:50:49.017 INFO:tasks.workunit.client.0.smithi138.stdout:2/66: rename d0/f14 to d0/dd/f18 0 2024-02-15T22:50:49.019 INFO:tasks.workunit.client.0.smithi138.stdout:9/45: mkdir d0/df/d11 0 2024-02-15T22:50:49.020 INFO:tasks.workunit.client.0.smithi138.stdout:3/60: link d5/db/c8 d5/ce 0 2024-02-15T22:50:49.022 INFO:tasks.workunit.client.0.smithi138.stdout:1/64: link f8 df/f15 0 2024-02-15T22:50:49.023 INFO:tasks.workunit.client.0.smithi138.stdout:1/65: chown fa 3925 1 2024-02-15T22:50:49.023 INFO:tasks.workunit.client.0.smithi138.stdout:1/66: dread - df/f15 zero size 2024-02-15T22:50:49.023 INFO:tasks.workunit.client.0.smithi138.stdout:1/67: creat df/f16 x:0 0 0 2024-02-15T22:50:49.023 INFO:tasks.workunit.client.0.smithi138.stdout:4/91: stat cc 0 2024-02-15T22:50:49.028 INFO:tasks.workunit.client.0.smithi138.stdout:4/92: mkdir d17/d1a 0 2024-02-15T22:50:49.028 INFO:tasks.workunit.client.0.smithi138.stdout:4/93: readlink l5 0 2024-02-15T22:50:49.028 INFO:tasks.workunit.client.0.smithi138.stdout:4/94: fdatasync d17/f18 0 2024-02-15T22:50:49.028 INFO:tasks.workunit.client.0.smithi138.stdout:4/95: chown d17/d1a 43 1 2024-02-15T22:50:49.028 INFO:tasks.workunit.client.0.smithi138.stdout:3/61: truncate d5/db/fa 2206472 0 2024-02-15T22:50:49.030 INFO:tasks.workunit.client.0.smithi138.stdout:3/62: rename d5/ce to d5/cf 0 2024-02-15T22:50:49.031 INFO:tasks.workunit.client.0.smithi138.stdout:3/63: creat d5/db/f10 x:0 0 0 2024-02-15T22:50:49.034 INFO:tasks.workunit.client.0.smithi138.stdout:4/96: dread f6 [0,4194304] 0 2024-02-15T22:50:49.034 INFO:tasks.workunit.client.0.smithi138.stdout:4/97: write f6 [2446680,45415] 0 2024-02-15T22:50:49.036 INFO:tasks.workunit.client.0.smithi138.stdout:4/98: unlink l4 0 2024-02-15T22:50:49.041 INFO:tasks.workunit.client.0.smithi138.stdout:1/68: dwrite df/f15 [0,4194304] 0 2024-02-15T22:50:49.049 INFO:tasks.workunit.client.0.smithi138.stdout:1/69: dread df/f15 [0,4194304] 0 2024-02-15T22:50:49.049 INFO:tasks.workunit.client.0.smithi138.stdout:1/70: chown df/f12 954488471 1 2024-02-15T22:50:49.050 INFO:tasks.workunit.client.0.smithi138.stdout:3/64: dwrite f4 [0,4194304] 0 2024-02-15T22:50:49.050 INFO:tasks.workunit.client.0.smithi138.stdout:3/65: write d5/db/f10 [943131,287] 0 2024-02-15T22:50:49.051 INFO:tasks.workunit.client.0.smithi138.stdout:1/71: link c5 df/c17 0 2024-02-15T22:50:49.053 INFO:tasks.workunit.client.0.smithi138.stdout:3/66: mkdir d5/db/dc/d11 0 2024-02-15T22:50:49.053 INFO:tasks.workunit.client.0.smithi138.stdout:3/67: chown d5/db/fa 298107 1 2024-02-15T22:50:49.054 INFO:tasks.workunit.client.0.smithi138.stdout:1/72: write f8 [1030882,23520] 0 2024-02-15T22:50:49.055 INFO:tasks.workunit.client.0.smithi138.stdout:4/99: dwrite d17/f19 [0,4194304] 0 2024-02-15T22:50:49.058 INFO:tasks.workunit.client.0.smithi138.stdout:3/68: rename d5/db/dc/d11 to d5/d12 0 2024-02-15T22:50:49.060 INFO:tasks.workunit.client.0.smithi138.stdout:1/73: mknod df/c18 0 2024-02-15T22:50:49.065 INFO:tasks.workunit.client.0.smithi138.stdout:4/100: chown c12 95268586 1 2024-02-15T22:50:49.067 INFO:tasks.workunit.client.0.smithi138.stdout:3/69: truncate d5/db/fa 99527 0 2024-02-15T22:50:49.069 INFO:tasks.workunit.client.0.smithi138.stdout:3/70: read d5/db/f10 [734280,32025] 0 2024-02-15T22:50:49.069 INFO:tasks.workunit.client.0.smithi138.stdout:4/101: unlink f14 0 2024-02-15T22:50:49.071 INFO:tasks.workunit.client.0.smithi138.stdout:3/71: write d5/db/fa [927842,95256] 0 2024-02-15T22:50:49.072 INFO:tasks.workunit.client.0.smithi138.stdout:3/72: creat d5/db/dc/f13 x:0 0 0 2024-02-15T22:50:49.072 INFO:tasks.workunit.client.0.smithi138.stdout:3/73: creat d5/db/f14 x:0 0 0 2024-02-15T22:50:49.073 INFO:tasks.workunit.client.0.smithi138.stdout:3/74: write d5/db/dc/f13 [495551,15344] 0 2024-02-15T22:50:49.073 INFO:tasks.workunit.client.0.smithi138.stdout:3/75: getdents d5/d12 0 2024-02-15T22:50:49.073 INFO:tasks.workunit.client.0.smithi138.stdout:3/76: chown f4 0 1 2024-02-15T22:50:49.075 INFO:tasks.workunit.client.0.smithi138.stdout:3/77: rename d5/cf to d5/c15 0 2024-02-15T22:50:49.075 INFO:tasks.workunit.client.0.smithi138.stdout:4/102: dread f8 [0,4194304] 0 2024-02-15T22:50:49.078 INFO:tasks.workunit.client.0.smithi138.stdout:4/103: link fd d17/d1a/f1b 0 2024-02-15T22:50:49.079 INFO:tasks.workunit.client.0.smithi138.stdout:1/74: dwrite fa [0,4194304] 0 2024-02-15T22:50:49.085 INFO:tasks.workunit.client.0.smithi138.stdout:1/75: rename fd to df/f19 0 2024-02-15T22:50:49.114 INFO:tasks.workunit.client.0.smithi138.stdout:3/78: rename d5/db to d5/d16 0 2024-02-15T22:50:49.115 INFO:tasks.workunit.client.0.smithi138.stdout:3/79: write f1 [695442,118765] 0 2024-02-15T22:50:49.121 INFO:tasks.workunit.client.0.smithi138.stdout:4/104: dwrite fd [0,4194304] 0 2024-02-15T22:50:49.122 INFO:tasks.workunit.client.0.smithi138.stdout:1/76: dwrite df/f16 [0,4194304] 0 2024-02-15T22:50:49.125 INFO:tasks.workunit.client.0.smithi138.stdout:3/80: getdents d5 0 2024-02-15T22:50:49.129 INFO:tasks.workunit.client.0.smithi138.stdout:3/81: rename d5/cd to d5/c17 0 2024-02-15T22:50:49.131 INFO:tasks.workunit.client.0.smithi138.stdout:3/82: mkdir d5/d18 0 2024-02-15T22:50:49.131 INFO:tasks.workunit.client.0.smithi138.stdout:4/105: dread d17/d1a/f1b [0,4194304] 0 2024-02-15T22:50:49.135 INFO:tasks.workunit.client.0.smithi138.stdout:3/83: fsync f1 0 2024-02-15T22:50:49.136 INFO:tasks.workunit.client.0.smithi138.stdout:3/84: readlink d5/l7 0 2024-02-15T22:50:49.137 INFO:tasks.workunit.client.0.smithi138.stdout:3/85: symlink d5/l19 0 2024-02-15T22:50:49.137 INFO:tasks.workunit.client.0.smithi138.stdout:3/86: write f1 [5096421,120761] 0 2024-02-15T22:50:49.137 INFO:tasks.workunit.client.0.smithi138.stdout:3/87: write d5/d16/dc/f13 [786393,84681] 0 2024-02-15T22:50:49.139 INFO:tasks.workunit.client.0.smithi138.stdout:3/88: rename f4 to d5/d16/dc/f1a 0 2024-02-15T22:50:49.141 INFO:tasks.workunit.client.0.smithi138.stdout:3/89: rename d5/d16/f14 to d5/d12/f1b 0 2024-02-15T22:50:49.141 INFO:tasks.workunit.client.0.smithi138.stdout:3/90: dread - d5/d12/f1b zero size 2024-02-15T22:50:49.141 INFO:tasks.workunit.client.0.smithi138.stdout:3/91: fdatasync d5/d16/dc/f1a 0 2024-02-15T22:50:49.142 INFO:tasks.workunit.client.0.smithi138.stdout:3/92: mknod d5/c1c 0 2024-02-15T22:50:49.143 INFO:tasks.workunit.client.0.smithi138.stdout:3/93: creat d5/d12/f1d x:0 0 0 2024-02-15T22:50:49.144 INFO:tasks.workunit.client.0.smithi138.stdout:1/77: dwrite df/f14 [0,4194304] 0 2024-02-15T22:50:49.144 INFO:tasks.workunit.client.0.smithi138.stdout:1/78: creat df/f1a x:0 0 0 2024-02-15T22:50:49.145 INFO:tasks.workunit.client.0.smithi138.stdout:3/94: creat d5/d16/f1e x:0 0 0 2024-02-15T22:50:49.147 INFO:tasks.workunit.client.0.smithi138.stdout:1/79: mkdir df/d1b 0 2024-02-15T22:50:49.147 INFO:tasks.workunit.client.0.smithi138.stdout:3/95: creat d5/d18/f1f x:0 0 0 2024-02-15T22:50:49.148 INFO:tasks.workunit.client.0.smithi138.stdout:3/96: write d5/d12/f1d [579566,12334] 0 2024-02-15T22:50:49.149 INFO:tasks.workunit.client.0.smithi138.stdout:1/80: mknod df/c1c 0 2024-02-15T22:50:49.150 INFO:tasks.workunit.client.0.smithi138.stdout:4/106: dwrite d17/f19 [0,4194304] 0 2024-02-15T22:50:49.151 INFO:tasks.workunit.client.0.smithi138.stdout:1/81: mkdir df/d1b/d1d 0 2024-02-15T22:50:49.152 INFO:tasks.workunit.client.0.smithi138.stdout:4/107: chown f16 13 1 2024-02-15T22:50:49.152 INFO:tasks.workunit.client.0.smithi138.stdout:4/108: creat d17/f1c x:0 0 0 2024-02-15T22:50:49.154 INFO:tasks.workunit.client.0.smithi138.stdout:1/82: symlink df/d1b/l1e 0 2024-02-15T22:50:49.154 INFO:tasks.workunit.client.0.smithi138.stdout:5/40: sync 2024-02-15T22:50:49.154 INFO:tasks.workunit.client.0.smithi138.stdout:7/268: sync 2024-02-15T22:50:49.156 INFO:tasks.workunit.client.0.smithi138.stdout:5/41: dread f5 [0,4194304] 0 2024-02-15T22:50:49.163 INFO:tasks.workunit.client.0.smithi138.stdout:7/269: write d1/d2/db/fe [3446276,87663] 0 2024-02-15T22:50:49.186 INFO:tasks.workunit.client.0.smithi138.stdout:7/270: dwrite d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:49.187 INFO:tasks.workunit.client.0.smithi138.stdout:7/271: fsync d1/d2/f44 0 2024-02-15T22:50:49.187 INFO:tasks.workunit.client.0.smithi138.stdout:7/272: truncate d1/d2/db/d3c/d4d/f52 4920328 0 2024-02-15T22:50:49.187 INFO:tasks.workunit.client.0.smithi138.stdout:4/109: dwrite d17/f18 [0,4194304] 0 2024-02-15T22:50:49.187 INFO:tasks.workunit.client.0.smithi138.stdout:1/83: dwrite df/f12 [0,4194304] 0 2024-02-15T22:50:49.187 INFO:tasks.workunit.client.0.smithi138.stdout:5/42: dwrite f5 [0,4194304] 0 2024-02-15T22:50:49.189 INFO:tasks.workunit.client.0.smithi138.stdout:4/110: mknod d17/c1d 0 2024-02-15T22:50:49.190 INFO:tasks.workunit.client.0.smithi138.stdout:5/43: dread f9 [0,4194304] 0 2024-02-15T22:50:49.192 INFO:tasks.workunit.client.0.smithi138.stdout:1/84: getdents df/d1b 0 2024-02-15T22:50:49.192 INFO:tasks.workunit.client.0.smithi138.stdout:1/85: dread - df/f11 zero size 2024-02-15T22:50:49.194 INFO:tasks.workunit.client.0.smithi138.stdout:4/111: mkdir d17/d1e 0 2024-02-15T22:50:49.195 INFO:tasks.workunit.client.0.smithi138.stdout:4/112: readlink l13 0 2024-02-15T22:50:49.197 INFO:tasks.workunit.client.0.smithi138.stdout:5/44: symlink la 0 2024-02-15T22:50:49.197 INFO:tasks.workunit.client.0.smithi138.stdout:5/45: fdatasync f9 0 2024-02-15T22:50:49.198 INFO:tasks.workunit.client.0.smithi138.stdout:4/113: creat d17/d1e/f1f x:0 0 0 2024-02-15T22:50:49.198 INFO:tasks.workunit.client.0.smithi138.stdout:5/46: creat fb x:0 0 0 2024-02-15T22:50:49.201 INFO:tasks.workunit.client.0.smithi138.stdout:1/86: dread f8 [0,4194304] 0 2024-02-15T22:50:49.202 INFO:tasks.workunit.client.0.smithi138.stdout:7/273: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:49.204 INFO:tasks.workunit.client.0.smithi138.stdout:7/274: rename d1/d2/db/d25/l35 to d1/d2/db/d3c/d4d/d5b/l5f 0 2024-02-15T22:50:49.205 INFO:tasks.workunit.client.0.smithi138.stdout:7/275: write d1/d2/db/fe [1066744,43913] 0 2024-02-15T22:50:49.205 INFO:tasks.workunit.client.0.smithi138.stdout:7/276: write d1/d2/db/d3c/f56 [709817,105207] 0 2024-02-15T22:50:49.211 INFO:tasks.workunit.client.0.smithi138.stdout:7/277: getdents d1/d2/db/d3c/d4d/d5b 0 2024-02-15T22:50:49.211 INFO:tasks.workunit.client.0.smithi138.stdout:7/278: chown d1/d2/f30 24 1 2024-02-15T22:50:49.211 INFO:tasks.workunit.client.0.smithi138.stdout:7/279: fdatasync d1/d2/db/f49 0 2024-02-15T22:50:49.211 INFO:tasks.workunit.client.0.smithi138.stdout:7/280: write d1/d2/d29/f2d [794692,61827] 0 2024-02-15T22:50:49.211 INFO:tasks.workunit.client.0.smithi138.stdout:7/281: fsync d1/d2/db/f16 0 2024-02-15T22:50:49.213 INFO:tasks.workunit.client.0.smithi138.stdout:5/47: read f9 [681026,36071] 0 2024-02-15T22:50:49.215 INFO:tasks.workunit.client.0.smithi138.stdout:4/114: dwrite d17/f19 [0,4194304] 0 2024-02-15T22:50:49.216 INFO:tasks.workunit.client.0.smithi138.stdout:4/115: getdents d17/d1a 0 2024-02-15T22:50:49.218 INFO:tasks.workunit.client.0.smithi138.stdout:4/116: rename d17/c1d to d17/d1a/c20 0 2024-02-15T22:50:49.223 INFO:tasks.workunit.client.0.smithi138.stdout:4/117: truncate d17/f19 1455887 0 2024-02-15T22:50:49.226 INFO:tasks.workunit.client.0.smithi138.stdout:4/118: rename c15 to d17/d1a/c21 0 2024-02-15T22:50:49.226 INFO:tasks.workunit.client.0.smithi138.stdout:4/119: creat d17/d1e/f22 x:0 0 0 2024-02-15T22:50:49.231 INFO:tasks.workunit.client.0.smithi138.stdout:1/87: dwrite df/f19 [0,4194304] 0 2024-02-15T22:50:49.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/48: dwrite f9 [0,4194304] 0 2024-02-15T22:50:49.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: pgmap v7: 65 pgs: 65 active+clean; 188 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 1.38k op/s 2024-02-15T22:50:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: Standby manager daemon smithi138.jqscxs started 2024-02-15T22:50:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/crt"}]: dispatch 2024-02-15T22:50:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:50:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/key"}]: dispatch 2024-02-15T22:50:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:48 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:50:49.234 INFO:tasks.workunit.client.0.smithi138.stdout:1/88: truncate f8 723349 0 2024-02-15T22:50:49.234 INFO:tasks.workunit.client.0.smithi138.stdout:1/89: chown df/l13 39 1 2024-02-15T22:50:49.235 INFO:tasks.workunit.client.0.smithi138.stdout:5/49: creat fc x:0 0 0 2024-02-15T22:50:49.235 INFO:tasks.workunit.client.0.smithi138.stdout:5/50: write fc [152107,118820] 0 2024-02-15T22:50:49.236 INFO:tasks.workunit.client.0.smithi138.stdout:7/282: dread d1/d2/db/d3c/f56 [0,4194304] 0 2024-02-15T22:50:49.239 INFO:tasks.workunit.client.0.smithi138.stdout:1/90: creat df/d1b/f1f x:0 0 0 2024-02-15T22:50:49.239 INFO:tasks.workunit.client.0.smithi138.stdout:1/91: readlink df/d1b/l1e 0 2024-02-15T22:50:49.239 INFO:tasks.workunit.client.0.smithi138.stdout:1/92: write df/d1b/f1f [769488,101416] 0 2024-02-15T22:50:49.240 INFO:tasks.workunit.client.0.smithi138.stdout:7/283: symlink d1/d2/db/d2a/l60 0 2024-02-15T22:50:49.245 INFO:tasks.workunit.client.0.smithi138.stdout:4/120: dwrite f6 [0,4194304] 0 2024-02-15T22:50:49.247 INFO:tasks.workunit.client.0.smithi138.stdout:7/284: dread d1/d2/d29/f2d [0,4194304] 0 2024-02-15T22:50:49.247 INFO:tasks.workunit.client.0.smithi138.stdout:7/285: creat d1/d2/db/d3c/f61 x:0 0 0 2024-02-15T22:50:49.251 INFO:tasks.workunit.client.0.smithi138.stdout:1/93: rename df/f1a to df/d1b/d1d/f20 0 2024-02-15T22:50:49.253 INFO:tasks.workunit.client.0.smithi138.stdout:4/121: write d17/f18 [3212491,94727] 0 2024-02-15T22:50:49.259 INFO:tasks.workunit.client.0.smithi138.stdout:7/286: creat d1/d2/db/d3c/d4d/d5b/f62 x:0 0 0 2024-02-15T22:50:49.260 INFO:tasks.workunit.client.0.smithi138.stdout:1/94: mkdir df/d1b/d21 0 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: pgmap v7: 65 pgs: 65 active+clean; 188 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 1.38k op/s 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: Standby manager daemon smithi138.jqscxs started 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/crt"}]: dispatch 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/key"}]: dispatch 2024-02-15T22:50:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:48 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2382657686' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:50:49.261 INFO:tasks.workunit.client.0.smithi138.stdout:4/122: creat d17/d1a/f23 x:0 0 0 2024-02-15T22:50:49.263 INFO:tasks.workunit.client.0.smithi138.stdout:7/287: mkdir d1/d2/db/d3c/d4d/d63 0 2024-02-15T22:50:49.265 INFO:tasks.workunit.client.0.smithi138.stdout:4/123: unlink d17/f1c 0 2024-02-15T22:50:49.265 INFO:tasks.workunit.client.0.smithi138.stdout:4/124: dread - f16 zero size 2024-02-15T22:50:49.270 INFO:tasks.workunit.client.0.smithi138.stdout:4/125: dread fd [0,4194304] 0 2024-02-15T22:50:49.271 INFO:tasks.workunit.client.0.smithi138.stdout:4/126: stat d17/d1a 0 2024-02-15T22:50:49.271 INFO:tasks.workunit.client.0.smithi138.stdout:4/127: chown f10 66487657 1 2024-02-15T22:50:49.271 INFO:tasks.workunit.client.0.smithi138.stdout:4/128: dread - f16 zero size 2024-02-15T22:50:49.273 INFO:tasks.workunit.client.0.smithi138.stdout:4/129: link lb d17/l24 0 2024-02-15T22:50:49.274 INFO:tasks.workunit.client.0.smithi138.stdout:7/288: getdents d1/d2/db/d3c/d4d/d5b 0 2024-02-15T22:50:49.274 INFO:tasks.workunit.client.0.smithi138.stdout:7/289: write d1/d2/db/d25/d41/f48 [985238,125044] 0 2024-02-15T22:50:49.274 INFO:tasks.workunit.client.0.smithi138.stdout:7/290: read - d1/f40 zero size 2024-02-15T22:50:49.275 INFO:tasks.workunit.client.0.smithi138.stdout:1/95: dwrite f4 [0,4194304] 0 2024-02-15T22:50:49.276 INFO:tasks.workunit.client.0.smithi138.stdout:4/130: unlink l11 0 2024-02-15T22:50:49.277 INFO:tasks.workunit.client.0.smithi138.stdout:7/291: mkdir d1/d2/db/d2a/d64 0 2024-02-15T22:50:49.277 INFO:tasks.workunit.client.0.smithi138.stdout:7/292: creat d1/d2/db/d3c/d4d/f65 x:0 0 0 2024-02-15T22:50:49.278 INFO:tasks.workunit.client.0.smithi138.stdout:1/96: mknod df/d1b/c22 0 2024-02-15T22:50:49.279 INFO:tasks.workunit.client.0.smithi138.stdout:4/131: unlink d17/l24 0 2024-02-15T22:50:49.281 INFO:tasks.workunit.client.0.smithi138.stdout:7/293: rename d1/d2/l1f to d1/d2/d29/l66 0 2024-02-15T22:50:49.282 INFO:tasks.workunit.client.0.smithi138.stdout:1/97: symlink df/d1b/d21/l23 0 2024-02-15T22:50:49.283 INFO:tasks.workunit.client.0.smithi138.stdout:4/132: unlink f16 0 2024-02-15T22:50:49.284 INFO:tasks.workunit.client.0.smithi138.stdout:7/294: creat d1/d2/db/d2a/d64/f67 x:0 0 0 2024-02-15T22:50:49.285 INFO:tasks.workunit.client.0.smithi138.stdout:7/295: symlink d1/d2/db/d3c/d4d/l68 0 2024-02-15T22:50:49.290 INFO:tasks.workunit.client.0.smithi138.stdout:1/98: dread fa [0,4194304] 0 2024-02-15T22:50:49.290 INFO:tasks.workunit.client.0.smithi138.stdout:1/99: chown df/c1c 2971 1 2024-02-15T22:50:49.292 INFO:tasks.workunit.client.0.smithi138.stdout:4/133: dread f10 [0,4194304] 0 2024-02-15T22:50:49.300 INFO:tasks.workunit.client.0.smithi138.stdout:4/134: read f6 [2049897,33] 0 2024-02-15T22:50:49.300 INFO:tasks.workunit.client.0.smithi138.stdout:4/135: chown lb 113702 1 2024-02-15T22:50:49.300 INFO:tasks.workunit.client.0.smithi138.stdout:4/136: write d17/f18 [735537,36842] 0 2024-02-15T22:50:49.301 INFO:tasks.workunit.client.0.smithi138.stdout:4/137: readlink l1 0 2024-02-15T22:50:49.301 INFO:tasks.workunit.client.0.smithi138.stdout:4/138: chown f6 3493 1 2024-02-15T22:50:49.301 INFO:tasks.workunit.client.0.smithi138.stdout:4/139: fsync d17/f19 0 2024-02-15T22:50:49.302 INFO:tasks.workunit.client.0.smithi138.stdout:4/140: creat d17/d1a/f25 x:0 0 0 2024-02-15T22:50:49.302 INFO:tasks.workunit.client.0.smithi138.stdout:4/141: creat d17/f26 x:0 0 0 2024-02-15T22:50:49.302 INFO:tasks.workunit.client.0.smithi138.stdout:4/142: dread - d17/d1a/f23 zero size 2024-02-15T22:50:49.302 INFO:tasks.workunit.client.0.smithi138.stdout:4/143: chown f10 9 1 2024-02-15T22:50:49.302 INFO:tasks.workunit.client.0.smithi138.stdout:4/144: dread - d17/d1a/f23 zero size 2024-02-15T22:50:49.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/145: getdents d17 0 2024-02-15T22:50:49.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/146: truncate d17/d1a/f25 346439 0 2024-02-15T22:50:49.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/147: mknod d17/c27 0 2024-02-15T22:50:49.311 INFO:tasks.workunit.client.0.smithi138.stdout:4/148: write d17/d1e/f22 [654096,103427] 0 2024-02-15T22:50:49.327 INFO:tasks.workunit.client.0.smithi138.stdout:4/149: dwrite d17/d1a/f25 [0,4194304] 0 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:8/25: sync 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:0/50: sync 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:2/67: sync 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:0/51: truncate d6/f8 2324954 0 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:6/126: sync 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:6/127: chown dc/d24/c28 1357963 1 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:6/128: write dc/d24/f26 [361162,71287] 0 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:6/129: dread - dc/d24/f27 zero size 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:9/46: sync 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:9/47: truncate d0/d4/fd 281254 0 2024-02-15T22:50:49.328 INFO:tasks.workunit.client.0.smithi138.stdout:3/97: sync 2024-02-15T22:50:49.331 INFO:tasks.workunit.client.0.smithi138.stdout:6/130: symlink dc/l2e 0 2024-02-15T22:50:49.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/48: rename d0/d1/fc to d0/de/f12 0 2024-02-15T22:50:49.333 INFO:tasks.workunit.client.0.smithi138.stdout:9/49: write d0/d4/fd [1215057,1675] 0 2024-02-15T22:50:49.333 INFO:tasks.workunit.client.0.smithi138.stdout:9/50: truncate d0/f8 4706627 0 2024-02-15T22:50:49.336 INFO:tasks.workunit.client.0.smithi138.stdout:4/150: truncate d17/f19 34742 0 2024-02-15T22:50:49.336 INFO:tasks.workunit.client.0.smithi138.stdout:2/68: read d0/f1 [5195855,72472] 0 2024-02-15T22:50:49.336 INFO:tasks.workunit.client.0.smithi138.stdout:2/69: chown d0/f1 8 1 2024-02-15T22:50:49.338 INFO:tasks.workunit.client.0.smithi138.stdout:6/131: rename dc/d24/c2d to dc/d24/c2f 0 2024-02-15T22:50:49.340 INFO:tasks.workunit.client.0.smithi138.stdout:2/70: getdents d0/dd 0 2024-02-15T22:50:49.340 INFO:tasks.workunit.client.0.smithi138.stdout:6/132: mknod dc/d24/c30 0 2024-02-15T22:50:49.342 INFO:tasks.workunit.client.0.smithi138.stdout:4/151: rename d17/f26 to d17/d1e/f28 0 2024-02-15T22:50:49.342 INFO:tasks.workunit.client.0.smithi138.stdout:2/71: mkdir d0/da/d19 0 2024-02-15T22:50:49.343 INFO:tasks.workunit.client.0.smithi138.stdout:9/51: write d0/de/f12 [1746197,99963] 0 2024-02-15T22:50:49.345 INFO:tasks.workunit.client.0.smithi138.stdout:2/72: creat d0/da/f1a x:0 0 0 2024-02-15T22:50:49.345 INFO:tasks.workunit.client.0.smithi138.stdout:2/73: chown d0/d3/c7 656 1 2024-02-15T22:50:49.348 INFO:tasks.workunit.client.0.smithi138.stdout:2/74: creat d0/da/d19/f1b x:0 0 0 2024-02-15T22:50:49.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/152: rename d17/f19 to d17/f29 0 2024-02-15T22:50:49.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/153: stat d17/d1a/f25 0 2024-02-15T22:50:49.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/154: dread - d17/d1e/f28 zero size 2024-02-15T22:50:49.350 INFO:tasks.workunit.client.0.smithi138.stdout:2/75: rename d0/l11 to d0/dd/d15/l1c 0 2024-02-15T22:50:49.351 INFO:tasks.workunit.client.0.smithi138.stdout:4/155: mknod d17/c2a 0 2024-02-15T22:50:49.352 INFO:tasks.workunit.client.0.smithi138.stdout:4/156: truncate d17/f18 3920430 0 2024-02-15T22:50:49.354 INFO:tasks.workunit.client.0.smithi138.stdout:4/157: mkdir d17/d2b 0 2024-02-15T22:50:49.354 INFO:tasks.workunit.client.0.smithi138.stdout:4/158: fdatasync d17/d1a/f25 0 2024-02-15T22:50:49.354 INFO:tasks.workunit.client.0.smithi138.stdout:4/159: stat lb 0 2024-02-15T22:50:49.355 INFO:tasks.workunit.client.0.smithi138.stdout:9/52: dread d0/f8 [0,4194304] 0 2024-02-15T22:50:49.355 INFO:tasks.workunit.client.0.smithi138.stdout:4/160: creat d17/f2c x:0 0 0 2024-02-15T22:50:49.357 INFO:tasks.workunit.client.0.smithi138.stdout:3/98: dwrite d5/d12/f1b [0,4194304] 0 2024-02-15T22:50:49.358 INFO:tasks.workunit.client.0.smithi138.stdout:8/26: dwrite f0 [0,4194304] 0 2024-02-15T22:50:49.363 INFO:tasks.workunit.client.0.smithi138.stdout:4/161: dread f6 [0,4194304] 0 2024-02-15T22:50:49.363 INFO:tasks.workunit.client.0.smithi138.stdout:2/76: dread d0/da/f13 [0,4194304] 0 2024-02-15T22:50:49.363 INFO:tasks.workunit.client.0.smithi138.stdout:2/77: chown d0/da/d19/f1b 0 1 2024-02-15T22:50:49.363 INFO:tasks.workunit.client.0.smithi138.stdout:3/99: mknod d5/d16/dc/c20 0 2024-02-15T22:50:49.364 INFO:tasks.workunit.client.0.smithi138.stdout:8/27: dread f2 [0,4194304] 0 2024-02-15T22:50:49.364 INFO:tasks.workunit.client.0.smithi138.stdout:8/28: dread - f6 zero size 2024-02-15T22:50:49.365 INFO:tasks.workunit.client.0.smithi138.stdout:4/162: mkdir d17/d1e/d2d 0 2024-02-15T22:50:49.365 INFO:tasks.workunit.client.0.smithi138.stdout:4/163: fdatasync d17/f29 0 2024-02-15T22:50:49.366 INFO:tasks.workunit.client.0.smithi138.stdout:2/78: mknod d0/da/d19/c1d 0 2024-02-15T22:50:49.368 INFO:tasks.workunit.client.0.smithi138.stdout:3/100: mknod d5/d18/c21 0 2024-02-15T22:50:49.369 INFO:tasks.workunit.client.0.smithi138.stdout:6/133: truncate dc/d24/f26 298626 0 2024-02-15T22:50:49.369 INFO:tasks.workunit.client.0.smithi138.stdout:6/134: creat dc/d24/f31 x:0 0 0 2024-02-15T22:50:49.371 INFO:tasks.workunit.client.0.smithi138.stdout:4/164: creat d17/d1e/d2d/f2e x:0 0 0 2024-02-15T22:50:49.372 INFO:tasks.workunit.client.0.smithi138.stdout:6/135: dread f1 [0,4194304] 0 2024-02-15T22:50:49.372 INFO:tasks.workunit.client.0.smithi138.stdout:6/136: chown dc/f14 4411188 1 2024-02-15T22:50:49.374 INFO:tasks.workunit.client.0.smithi138.stdout:3/101: unlink d5/d18/c21 0 2024-02-15T22:50:49.374 INFO:tasks.workunit.client.0.smithi138.stdout:3/102: write d5/d16/f10 [1743702,28383] 0 2024-02-15T22:50:49.377 INFO:tasks.workunit.client.0.smithi138.stdout:9/53: dwrite d0/de/f12 [0,4194304] 0 2024-02-15T22:50:49.377 INFO:tasks.workunit.client.0.smithi138.stdout:9/54: getdents d0/d4/d9 0 2024-02-15T22:50:49.380 INFO:tasks.workunit.client.0.smithi138.stdout:6/137: symlink dc/d24/l32 0 2024-02-15T22:50:49.384 INFO:tasks.workunit.client.0.smithi138.stdout:9/55: dread d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:49.388 INFO:tasks.workunit.client.0.smithi138.stdout:4/165: rename d17/d1a/f1b to d17/d1e/f2f 0 2024-02-15T22:50:49.388 INFO:tasks.workunit.client.0.smithi138.stdout:4/166: fdatasync d17/d1e/f1f 0 2024-02-15T22:50:49.389 INFO:tasks.workunit.client.0.smithi138.stdout:9/56: dread d0/d4/f5 [4194304,4194304] 0 2024-02-15T22:50:49.390 INFO:tasks.workunit.client.0.smithi138.stdout:6/138: mknod dc/d24/c33 0 2024-02-15T22:50:49.391 INFO:tasks.workunit.client.0.smithi138.stdout:9/57: write d0/d4/fd [175805,61840] 0 2024-02-15T22:50:49.393 INFO:tasks.workunit.client.0.smithi138.stdout:3/103: rename d5/c15 to d5/c22 0 2024-02-15T22:50:49.395 INFO:tasks.workunit.client.0.smithi138.stdout:9/58: creat d0/df/d11/f13 x:0 0 0 2024-02-15T22:50:49.397 INFO:tasks.workunit.client.0.smithi138.stdout:9/59: mkdir d0/de/d14 0 2024-02-15T22:50:49.397 INFO:tasks.workunit.client.0.smithi138.stdout:8/29: dwrite f3 [0,4194304] 0 2024-02-15T22:50:49.398 INFO:tasks.workunit.client.0.smithi138.stdout:2/79: dwrite d0/da/f1a [0,4194304] 0 2024-02-15T22:50:49.398 INFO:tasks.workunit.client.0.smithi138.stdout:2/80: write d0/f1 [7634903,54946] 0 2024-02-15T22:50:49.400 INFO:tasks.workunit.client.0.smithi138.stdout:8/30: mknod c8 0 2024-02-15T22:50:49.400 INFO:tasks.workunit.client.0.smithi138.stdout:8/31: dread - f5 zero size 2024-02-15T22:50:49.403 INFO:tasks.workunit.client.0.smithi138.stdout:3/104: dread f1 [0,4194304] 0 2024-02-15T22:50:49.409 INFO:tasks.workunit.client.0.smithi138.stdout:2/81: unlink d0/da/f1a 0 2024-02-15T22:50:49.409 INFO:tasks.workunit.client.0.smithi138.stdout:2/82: write d0/f1 [2053128,12634] 0 2024-02-15T22:50:49.410 INFO:tasks.workunit.client.0.smithi138.stdout:2/83: mknod d0/dd/d15/c1e 0 2024-02-15T22:50:49.411 INFO:tasks.workunit.client.0.smithi138.stdout:3/105: dread d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:49.412 INFO:tasks.workunit.client.0.smithi138.stdout:8/32: mknod c9 0 2024-02-15T22:50:49.412 INFO:tasks.workunit.client.0.smithi138.stdout:8/33: fsync f3 0 2024-02-15T22:50:49.413 INFO:tasks.workunit.client.0.smithi138.stdout:2/84: rename d0/da/f10 to d0/dd/d15/f1f 0 2024-02-15T22:50:49.414 INFO:tasks.workunit.client.0.smithi138.stdout:3/106: rmdir d5 39 2024-02-15T22:50:49.415 INFO:tasks.workunit.client.0.smithi138.stdout:9/60: dwrite d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:49.415 INFO:tasks.workunit.client.0.smithi138.stdout:9/61: write d0/df/d11/f13 [301186,125264] 0 2024-02-15T22:50:49.417 INFO:tasks.workunit.client.0.smithi138.stdout:4/167: rmdir d17 39 2024-02-15T22:50:49.419 INFO:tasks.workunit.client.0.smithi138.stdout:2/85: unlink d0/da/d19/c1d 0 2024-02-15T22:50:49.421 INFO:tasks.workunit.client.0.smithi138.stdout:9/62: mknod d0/df/c15 0 2024-02-15T22:50:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/34: truncate f0 2324177 0 2024-02-15T22:50:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/35: rmdir - no directory 2024-02-15T22:50:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/36: readlink l7 0 2024-02-15T22:50:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/37: chown f2 1 1 2024-02-15T22:50:49.423 INFO:tasks.workunit.client.0.smithi138.stdout:3/107: write d5/d12/f1b [3715697,5823] 0 2024-02-15T22:50:49.425 INFO:tasks.workunit.client.0.smithi138.stdout:4/168: creat d17/d1e/d2d/f30 x:0 0 0 2024-02-15T22:50:49.426 INFO:tasks.workunit.client.0.smithi138.stdout:2/86: rename d0/d3 to d0/d3/d20 22 2024-02-15T22:50:49.426 INFO:tasks.workunit.client.0.smithi138.stdout:2/87: write d0/dd/d15/f1f [1561702,99110] 0 2024-02-15T22:50:49.429 INFO:tasks.workunit.client.0.smithi138.stdout:3/108: mkdir d5/d12/d23 0 2024-02-15T22:50:49.429 INFO:tasks.workunit.client.0.smithi138.stdout:4/169: dread d17/f29 [0,4194304] 0 2024-02-15T22:50:49.429 INFO:tasks.workunit.client.0.smithi138.stdout:4/170: fsync d17/f2c 0 2024-02-15T22:50:49.429 INFO:tasks.workunit.client.0.smithi138.stdout:4/171: stat l13 0 2024-02-15T22:50:49.429 INFO:tasks.workunit.client.0.smithi138.stdout:4/172: fdatasync d17/f18 0 2024-02-15T22:50:49.433 INFO:tasks.workunit.client.0.smithi138.stdout:3/109: rename f1 to d5/d18/f24 0 2024-02-15T22:50:49.434 INFO:tasks.workunit.client.0.smithi138.stdout:2/88: symlink d0/d3/l21 0 2024-02-15T22:50:49.434 INFO:tasks.workunit.client.0.smithi138.stdout:3/110: read d5/d16/dc/f13 [437606,30754] 0 2024-02-15T22:50:49.434 INFO:tasks.workunit.client.0.smithi138.stdout:4/173: write fd [2351570,77140] 0 2024-02-15T22:50:49.435 INFO:tasks.workunit.client.0.smithi138.stdout:4/174: truncate d17/d1e/d2d/f2e 342519 0 2024-02-15T22:50:49.436 INFO:tasks.workunit.client.0.smithi138.stdout:4/175: rmdir d17 39 2024-02-15T22:50:49.437 INFO:tasks.workunit.client.0.smithi138.stdout:3/111: rmdir d5/d16 39 2024-02-15T22:50:49.440 INFO:tasks.workunit.client.0.smithi138.stdout:8/38: dwrite f6 [0,4194304] 0 2024-02-15T22:50:49.440 INFO:tasks.workunit.client.0.smithi138.stdout:8/39: dread - f5 zero size 2024-02-15T22:50:49.440 INFO:tasks.workunit.client.0.smithi138.stdout:2/89: dread d0/f6 [0,4194304] 0 2024-02-15T22:50:49.440 INFO:tasks.workunit.client.0.smithi138.stdout:4/176: link d17/f2c d17/d1e/d2d/f31 0 2024-02-15T22:50:49.442 INFO:tasks.workunit.client.0.smithi138.stdout:3/112: rename d5/c17 to d5/d12/c25 0 2024-02-15T22:50:49.443 INFO:tasks.workunit.client.0.smithi138.stdout:3/113: getdents d5/d12/d23 0 2024-02-15T22:50:49.443 INFO:tasks.workunit.client.0.smithi138.stdout:3/114: chown d5/d16/fa 1 1 2024-02-15T22:50:49.448 INFO:tasks.workunit.client.0.smithi138.stdout:3/115: dread d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:49.448 INFO:tasks.workunit.client.0.smithi138.stdout:3/116: chown d5/d16/f1e 2937486 1 2024-02-15T22:50:49.448 INFO:tasks.workunit.client.0.smithi138.stdout:8/40: mknod ca 0 2024-02-15T22:50:49.448 INFO:tasks.workunit.client.0.smithi138.stdout:8/41: readlink l7 0 2024-02-15T22:50:49.451 INFO:tasks.workunit.client.0.smithi138.stdout:3/117: dread d5/d18/f24 [0,4194304] 0 2024-02-15T22:50:49.451 INFO:tasks.workunit.client.0.smithi138.stdout:2/90: rmdir d0/da 39 2024-02-15T22:50:49.451 INFO:tasks.workunit.client.0.smithi138.stdout:2/91: write d0/f2 [8420166,30495] 0 2024-02-15T22:50:49.453 INFO:tasks.workunit.client.0.smithi138.stdout:4/177: unlink l5 0 2024-02-15T22:50:49.453 INFO:tasks.workunit.client.0.smithi138.stdout:4/178: read - d17/f2c zero size 2024-02-15T22:50:49.453 INFO:tasks.workunit.client.0.smithi138.stdout:4/179: readlink l1 0 2024-02-15T22:50:49.454 INFO:tasks.workunit.client.0.smithi138.stdout:3/118: mkdir d5/d12/d26 0 2024-02-15T22:50:49.454 INFO:tasks.workunit.client.0.smithi138.stdout:3/119: fsync d5/d12/f1d 0 2024-02-15T22:50:49.455 INFO:tasks.workunit.client.0.smithi138.stdout:2/92: getdents d0/dd/d15 0 2024-02-15T22:50:49.455 INFO:tasks.workunit.client.0.smithi138.stdout:2/93: write d0/da/d19/f1b [660953,5284] 0 2024-02-15T22:50:49.456 INFO:tasks.workunit.client.0.smithi138.stdout:2/94: creat d0/f22 x:0 0 0 2024-02-15T22:50:49.456 INFO:tasks.workunit.client.0.smithi138.stdout:2/95: chown d0/d3/l21 20529194 1 2024-02-15T22:50:49.457 INFO:tasks.workunit.client.0.smithi138.stdout:4/180: symlink d17/d1e/l32 0 2024-02-15T22:50:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:2/96: dread d0/dd/d15/f1f [0,4194304] 0 2024-02-15T22:50:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:2/97: readlink d0/d3/l21 0 2024-02-15T22:50:49.459 INFO:tasks.workunit.client.0.smithi138.stdout:8/42: mkdir db 0 2024-02-15T22:50:49.463 INFO:tasks.workunit.client.0.smithi138.stdout:2/98: creat d0/da/f23 x:0 0 0 2024-02-15T22:50:49.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/43: creat db/fc x:0 0 0 2024-02-15T22:50:49.464 INFO:tasks.workunit.client.0.smithi138.stdout:4/181: mkdir d17/d33 0 2024-02-15T22:50:49.464 INFO:tasks.workunit.client.0.smithi138.stdout:4/182: chown d17/d1e/d2d 1619833 1 2024-02-15T22:50:49.464 INFO:tasks.workunit.client.0.smithi138.stdout:4/183: dread - d17/d1e/f1f zero size 2024-02-15T22:50:49.465 INFO:tasks.workunit.client.0.smithi138.stdout:2/99: symlink d0/da/l24 0 2024-02-15T22:50:49.466 INFO:tasks.workunit.client.0.smithi138.stdout:4/184: symlink d17/d33/l34 0 2024-02-15T22:50:49.467 INFO:tasks.workunit.client.0.smithi138.stdout:2/100: mknod d0/da/c25 0 2024-02-15T22:50:49.469 INFO:tasks.workunit.client.0.smithi138.stdout:2/101: mknod d0/dd/d15/c26 0 2024-02-15T22:50:49.469 INFO:tasks.workunit.client.0.smithi138.stdout:2/102: creat d0/da/f27 x:0 0 0 2024-02-15T22:50:49.469 INFO:tasks.workunit.client.0.smithi138.stdout:3/120: dwrite d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:49.474 INFO:tasks.workunit.client.0.smithi138.stdout:3/121: creat d5/f27 x:0 0 0 2024-02-15T22:50:49.474 INFO:tasks.workunit.client.0.smithi138.stdout:8/44: rmdir db 39 2024-02-15T22:50:49.475 INFO:tasks.workunit.client.0.smithi138.stdout:4/185: dread fd [0,4194304] 0 2024-02-15T22:50:49.475 INFO:tasks.workunit.client.0.smithi138.stdout:4/186: dread - d17/d1e/f1f zero size 2024-02-15T22:50:49.475 INFO:tasks.workunit.client.0.smithi138.stdout:2/103: mknod d0/d3/c28 0 2024-02-15T22:50:49.476 INFO:tasks.workunit.client.0.smithi138.stdout:3/122: creat d5/d12/d23/f28 x:0 0 0 2024-02-15T22:50:49.477 INFO:tasks.workunit.client.0.smithi138.stdout:8/45: mkdir db/dd 0 2024-02-15T22:50:49.480 INFO:tasks.workunit.client.0.smithi138.stdout:2/104: fsync d0/da/f27 0 2024-02-15T22:50:49.480 INFO:tasks.workunit.client.0.smithi138.stdout:8/46: mkdir db/dd/de 0 2024-02-15T22:50:49.482 INFO:tasks.workunit.client.0.smithi138.stdout:4/187: symlink d17/l35 0 2024-02-15T22:50:49.483 INFO:tasks.workunit.client.0.smithi138.stdout:2/105: mknod d0/c29 0 2024-02-15T22:50:49.484 INFO:tasks.workunit.client.0.smithi138.stdout:4/188: rmdir d17/d1e 39 2024-02-15T22:50:49.484 INFO:tasks.workunit.client.0.smithi138.stdout:4/189: fdatasync d17/d1e/f28 0 2024-02-15T22:50:49.486 INFO:tasks.workunit.client.0.smithi138.stdout:4/190: mkdir d17/d1e/d2d/d36 0 2024-02-15T22:50:49.487 INFO:tasks.workunit.client.0.smithi138.stdout:4/191: truncate d17/d1a/f25 2280547 0 2024-02-15T22:50:49.488 INFO:tasks.workunit.client.0.smithi138.stdout:4/192: truncate d17/d1e/d2d/f30 1045324 0 2024-02-15T22:50:49.490 INFO:tasks.workunit.client.0.smithi138.stdout:4/193: unlink d17/c27 0 2024-02-15T22:50:49.490 INFO:tasks.workunit.client.0.smithi138.stdout:4/194: mknod d17/d1e/c37 0 2024-02-15T22:50:49.492 INFO:tasks.workunit.client.0.smithi138.stdout:4/195: link d17/d1e/c37 d17/d1a/c38 0 2024-02-15T22:50:49.492 INFO:tasks.workunit.client.0.smithi138.stdout:4/196: fsync d17/d1a/f23 0 2024-02-15T22:50:49.492 INFO:tasks.workunit.client.0.smithi138.stdout:4/197: symlink d17/d1e/d2d/l39 0 2024-02-15T22:50:49.497 INFO:tasks.workunit.client.0.smithi138.stdout:3/123: dwrite d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:49.497 INFO:tasks.workunit.client.0.smithi138.stdout:3/124: truncate d5/d18/f1f 593644 0 2024-02-15T22:50:49.498 INFO:tasks.workunit.client.0.smithi138.stdout:8/47: dwrite f3 [0,4194304] 0 2024-02-15T22:50:49.538 INFO:tasks.workunit.client.0.smithi138.stdout:4/198: rename d17/d1a/c20 to d17/d1a/c3a 0 2024-02-15T22:50:49.540 INFO:tasks.workunit.client.0.smithi138.stdout:3/125: dwrite d5/d18/f24 [0,4194304] 0 2024-02-15T22:50:49.540 INFO:tasks.workunit.client.0.smithi138.stdout:3/126: dread - d5/d16/f1e zero size 2024-02-15T22:50:49.547 INFO:tasks.workunit.client.0.smithi138.stdout:8/48: creat db/ff x:0 0 0 2024-02-15T22:50:49.547 INFO:tasks.workunit.client.0.smithi138.stdout:4/199: symlink d17/d2b/l3b 0 2024-02-15T22:50:49.549 INFO:tasks.workunit.client.0.smithi138.stdout:8/49: link db/ff db/f10 0 2024-02-15T22:50:49.550 INFO:tasks.workunit.client.0.smithi138.stdout:4/200: symlink d17/d33/l3c 0 2024-02-15T22:50:49.550 INFO:tasks.workunit.client.0.smithi138.stdout:3/127: rmdir d5/d12/d23 39 2024-02-15T22:50:49.552 INFO:tasks.workunit.client.0.smithi138.stdout:3/128: write d5/d16/fa [658089,121631] 0 2024-02-15T22:50:49.552 INFO:tasks.workunit.client.0.smithi138.stdout:8/50: link f5 db/dd/f11 0 2024-02-15T22:50:49.552 INFO:tasks.workunit.client.0.smithi138.stdout:8/51: write db/dd/f11 [478531,32367] 0 2024-02-15T22:50:49.553 INFO:tasks.workunit.client.0.smithi138.stdout:3/129: mkdir d5/d12/d23/d29 0 2024-02-15T22:50:49.553 INFO:tasks.workunit.client.0.smithi138.stdout:3/130: write d5/d16/dc/f13 [915196,115007] 0 2024-02-15T22:50:49.554 INFO:tasks.workunit.client.0.smithi138.stdout:8/52: symlink db/dd/l12 0 2024-02-15T22:50:49.555 INFO:tasks.workunit.client.0.smithi138.stdout:8/53: chown db/fc 802483 1 2024-02-15T22:50:49.556 INFO:tasks.workunit.client.0.smithi138.stdout:3/131: rename d5/d16/f1e to d5/d12/f2a 0 2024-02-15T22:50:49.558 INFO:tasks.workunit.client.0.smithi138.stdout:3/132: rename d5/d16/c8 to d5/d12/d23/c2b 0 2024-02-15T22:50:49.559 INFO:tasks.workunit.client.0.smithi138.stdout:3/133: mkdir d5/d2c 0 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:8/54: write f6 [3397435,84421] 0 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:8/55: write f6 [1935953,104861] 0 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:8/56: chown f0 32 1 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:8/57: write db/f10 [967362,76391] 0 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:4/201: dwrite d17/d1e/f1f [0,4194304] 0 2024-02-15T22:50:49.565 INFO:tasks.workunit.client.0.smithi138.stdout:4/202: chown d17/d33/l34 122280 1 2024-02-15T22:50:49.566 INFO:tasks.workunit.client.0.smithi138.stdout:8/58: rename db/dd/de to db/dd/d13 0 2024-02-15T22:50:49.572 INFO:tasks.workunit.client.0.smithi138.stdout:4/203: dread f6 [0,4194304] 0 2024-02-15T22:50:49.572 INFO:tasks.workunit.client.0.smithi138.stdout:4/204: chown d17/c2a 61356439 1 2024-02-15T22:50:49.572 INFO:tasks.workunit.client.0.smithi138.stdout:3/134: rmdir d5/d12 39 2024-02-15T22:50:49.572 INFO:tasks.workunit.client.0.smithi138.stdout:3/135: write d5/d16/fa [1036363,62550] 0 2024-02-15T22:50:49.572 INFO:tasks.workunit.client.0.smithi138.stdout:8/59: dread db/dd/f11 [0,4194304] 0 2024-02-15T22:50:49.573 INFO:tasks.workunit.client.0.smithi138.stdout:4/205: rmdir d17/d33 39 2024-02-15T22:50:49.573 INFO:tasks.workunit.client.0.smithi138.stdout:4/206: truncate d17/f18 4554550 0 2024-02-15T22:50:49.574 INFO:tasks.workunit.client.0.smithi138.stdout:3/136: link d5/d18/f24 d5/d12/d26/f2d 0 2024-02-15T22:50:49.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/207: creat d17/d2b/f3d x:0 0 0 2024-02-15T22:50:49.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/208: chown d17/d1e/d2d/d36 8381590 1 2024-02-15T22:50:49.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/209: stat d17/d1e/f1f 0 2024-02-15T22:50:49.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/210: chown d17/f29 8106 1 2024-02-15T22:50:49.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/211: readlink l13 0 2024-02-15T22:50:49.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/137: getdents d5/d12/d23 0 2024-02-15T22:50:49.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/138: mkdir d5/d12/d26/d2e 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/60: dread f0 [0,4194304] 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/61: truncate f5 1151865 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/62: readlink l7 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/63: truncate f3 5177634 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/64: creat db/dd/f14 x:0 0 0 2024-02-15T22:50:49.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/65: truncate db/f10 1888097 0 2024-02-15T22:50:49.581 INFO:tasks.workunit.client.0.smithi138.stdout:8/66: mkdir db/d15 0 2024-02-15T22:50:49.581 INFO:tasks.workunit.client.0.smithi138.stdout:8/67: write db/fc [534410,33561] 0 2024-02-15T22:50:49.581 INFO:tasks.workunit.client.0.smithi138.stdout:5/51: sync 2024-02-15T22:50:49.581 INFO:tasks.workunit.client.0.smithi138.stdout:5/52: dread - fb zero size 2024-02-15T22:50:49.582 INFO:tasks.workunit.client.0.smithi138.stdout:5/53: fsync f9 0 2024-02-15T22:50:49.582 INFO:tasks.workunit.client.0.smithi138.stdout:8/68: mkdir db/dd/d13/d16 0 2024-02-15T22:50:49.583 INFO:tasks.workunit.client.0.smithi138.stdout:5/54: creat fd x:0 0 0 2024-02-15T22:50:49.584 INFO:tasks.workunit.client.0.smithi138.stdout:5/55: rmdir - no directory 2024-02-15T22:50:49.585 INFO:tasks.workunit.client.0.smithi138.stdout:3/139: dread d5/d12/d26/f2d [0,4194304] 0 2024-02-15T22:50:49.585 INFO:tasks.workunit.client.0.smithi138.stdout:3/140: write d5/f27 [351836,8577] 0 2024-02-15T22:50:49.585 INFO:tasks.workunit.client.0.smithi138.stdout:8/69: link db/dd/f11 db/d15/f17 0 2024-02-15T22:50:49.585 INFO:tasks.workunit.client.0.smithi138.stdout:8/70: truncate db/f10 2395570 0 2024-02-15T22:50:49.586 INFO:tasks.workunit.client.0.smithi138.stdout:8/71: symlink db/dd/d13/l18 0 2024-02-15T22:50:49.592 INFO:tasks.workunit.client.0.smithi138.stdout:3/141: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:49.593 INFO:tasks.workunit.client.0.smithi138.stdout:4/212: dwrite f10 [4194304,4194304] 0 2024-02-15T22:50:49.596 INFO:tasks.workunit.client.0.smithi138.stdout:3/142: write d5/d18/f24 [1647209,65809] 0 2024-02-15T22:50:49.597 INFO:tasks.workunit.client.0.smithi138.stdout:3/143: mkdir d5/d12/d26/d2f 0 2024-02-15T22:50:49.610 INFO:tasks.workunit.client.0.smithi138.stdout:5/56: dwrite fc [0,4194304] 0 2024-02-15T22:50:49.610 INFO:tasks.workunit.client.0.smithi138.stdout:5/57: chown fc 252292891 1 2024-02-15T22:50:49.610 INFO:tasks.workunit.client.0.smithi138.stdout:5/58: stat f5 0 2024-02-15T22:50:49.612 INFO:tasks.workunit.client.0.smithi138.stdout:8/72: dwrite db/ff [0,4194304] 0 2024-02-15T22:50:49.617 INFO:tasks.workunit.client.0.smithi138.stdout:8/73: mkdir db/dd/d13/d19 0 2024-02-15T22:50:49.623 INFO:tasks.workunit.client.0.smithi138.stdout:4/213: dwrite d17/d1e/d2d/f30 [0,4194304] 0 2024-02-15T22:50:49.631 INFO:tasks.workunit.client.0.smithi138.stdout:5/59: dwrite fb [0,4194304] 0 2024-02-15T22:50:49.632 INFO:tasks.workunit.client.0.smithi138.stdout:8/74: truncate db/ff 2381849 0 2024-02-15T22:50:49.635 INFO:tasks.workunit.client.0.smithi138.stdout:8/75: rename f2 to db/f1a 0 2024-02-15T22:50:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:5/60: rename la to le 0 2024-02-15T22:50:49.636 INFO:tasks.workunit.client.0.smithi138.stdout:5/61: fsync fc 0 2024-02-15T22:50:49.640 INFO:tasks.workunit.client.0.smithi138.stdout:4/214: dwrite f6 [0,4194304] 0 2024-02-15T22:50:49.641 INFO:tasks.workunit.client.0.smithi138.stdout:4/215: readlink d17/d33/l3c 0 2024-02-15T22:50:49.641 INFO:tasks.workunit.client.0.smithi138.stdout:4/216: chown d17/d1e/l32 1507 1 2024-02-15T22:50:49.641 INFO:tasks.workunit.client.0.smithi138.stdout:4/217: mkdir d17/d1e/d2d/d36/d3e 0 2024-02-15T22:50:49.643 INFO:tasks.workunit.client.0.smithi138.stdout:8/76: read db/f1a [413416,88575] 0 2024-02-15T22:50:49.643 INFO:tasks.workunit.client.0.smithi138.stdout:4/218: creat d17/d1e/f3f x:0 0 0 2024-02-15T22:50:49.644 INFO:tasks.workunit.client.0.smithi138.stdout:4/219: symlink d17/d1e/d2d/d36/l40 0 2024-02-15T22:50:49.645 INFO:tasks.workunit.client.0.smithi138.stdout:4/220: truncate d17/d1e/d2d/f30 1395349 0 2024-02-15T22:50:49.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/77: dread f3 [0,4194304] 0 2024-02-15T22:50:49.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/78: fdatasync f6 0 2024-02-15T22:50:49.647 INFO:tasks.workunit.client.0.smithi138.stdout:5/62: write fb [4186347,11736] 0 2024-02-15T22:50:49.647 INFO:tasks.workunit.client.0.smithi138.stdout:4/221: unlink l13 0 2024-02-15T22:50:49.648 INFO:tasks.workunit.client.0.smithi138.stdout:4/222: fdatasync d17/f18 0 2024-02-15T22:50:49.650 INFO:tasks.workunit.client.0.smithi138.stdout:5/63: mkdir df 0 2024-02-15T22:50:49.653 INFO:tasks.workunit.client.0.smithi138.stdout:5/64: symlink df/l10 0 2024-02-15T22:50:49.662 INFO:tasks.workunit.client.0.smithi138.stdout:8/79: dwrite db/f1a [0,4194304] 0 2024-02-15T22:50:49.662 INFO:tasks.workunit.client.0.smithi138.stdout:8/80: readlink db/dd/d13/l18 0 2024-02-15T22:50:49.662 INFO:tasks.workunit.client.0.smithi138.stdout:8/81: stat f6 0 2024-02-15T22:50:49.663 INFO:tasks.workunit.client.0.smithi138.stdout:8/82: mknod db/dd/c1b 0 2024-02-15T22:50:49.663 INFO:tasks.workunit.client.0.smithi138.stdout:8/83: write db/dd/f11 [1973175,72827] 0 2024-02-15T22:50:49.664 INFO:tasks.workunit.client.0.smithi138.stdout:8/84: write db/dd/f14 [310474,66633] 0 2024-02-15T22:50:49.732 INFO:tasks.workunit.client.0.smithi138.stdout:0/52: sync 2024-02-15T22:50:49.732 INFO:tasks.workunit.client.0.smithi138.stdout:1/100: sync 2024-02-15T22:50:49.732 INFO:tasks.workunit.client.0.smithi138.stdout:7/296: sync 2024-02-15T22:50:49.733 INFO:tasks.workunit.client.0.smithi138.stdout:7/297: rmdir d1/d2/db/d2a/d64 39 2024-02-15T22:50:49.733 INFO:tasks.workunit.client.0.smithi138.stdout:7/298: rename d1/d2 to d1/d2/db/d69 22 2024-02-15T22:50:49.733 INFO:tasks.workunit.client.0.smithi138.stdout:7/299: write d1/d2/db/d2a/f34 [2957242,61295] 0 2024-02-15T22:50:49.735 INFO:tasks.workunit.client.0.smithi138.stdout:7/300: rename d1/d28/d58 to d1/d2/db/d3c/d6a 0 2024-02-15T22:50:49.755 INFO:tasks.workunit.client.0.smithi138.stdout:7/301: dwrite d1/d2/db/f20 [0,4194304] 0 2024-02-15T22:50:49.755 INFO:tasks.workunit.client.0.smithi138.stdout:7/302: creat d1/f6b x:0 0 0 2024-02-15T22:50:49.755 INFO:tasks.workunit.client.0.smithi138.stdout:0/53: dwrite f0 [0,4194304] 0 2024-02-15T22:50:49.756 INFO:tasks.workunit.client.0.smithi138.stdout:7/303: rename d1/c26 to d1/d2/db/d3c/d4d/d5b/c6c 0 2024-02-15T22:50:49.760 INFO:tasks.workunit.client.0.smithi138.stdout:7/304: rename d1/d2/db/d25/d41/f48 to d1/d5a/f6d 0 2024-02-15T22:50:49.761 INFO:tasks.workunit.client.0.smithi138.stdout:0/54: getdents d6/d10 0 2024-02-15T22:50:49.763 INFO:tasks.workunit.client.0.smithi138.stdout:7/305: link d1/d2/d29/c4e d1/c6e 0 2024-02-15T22:50:49.764 INFO:tasks.workunit.client.0.smithi138.stdout:0/55: rename c2 to d6/c12 0 2024-02-15T22:50:49.765 INFO:tasks.workunit.client.0.smithi138.stdout:0/56: mkdir d6/d10/d13 0 2024-02-15T22:50:49.771 INFO:tasks.workunit.client.0.smithi138.stdout:7/306: write d1/d2/db/f20 [925642,91032] 0 2024-02-15T22:50:49.771 INFO:tasks.workunit.client.0.smithi138.stdout:0/57: dread d6/f8 [0,4194304] 0 2024-02-15T22:50:49.773 INFO:tasks.workunit.client.0.smithi138.stdout:0/58: creat d6/d10/f14 x:0 0 0 2024-02-15T22:50:49.790 INFO:tasks.workunit.client.0.smithi138.stdout:7/307: dwrite d1/d2/db/d25/f36 [4194304,4194304] 0 2024-02-15T22:50:49.792 INFO:tasks.workunit.client.0.smithi138.stdout:0/59: dwrite f4 [4194304,4194304] 0 2024-02-15T22:50:49.793 INFO:tasks.workunit.client.0.smithi138.stdout:0/60: creat d6/f15 x:0 0 0 2024-02-15T22:50:49.793 INFO:tasks.workunit.client.0.smithi138.stdout:0/61: chown d6/d10/f11 7486 1 2024-02-15T22:50:49.795 INFO:tasks.workunit.client.0.smithi138.stdout:0/62: creat d6/d10/d13/f16 x:0 0 0 2024-02-15T22:50:49.795 INFO:tasks.workunit.client.0.smithi138.stdout:0/63: truncate d6/d10/f14 721320 0 2024-02-15T22:50:49.795 INFO:tasks.workunit.client.0.smithi138.stdout:0/64: creat d6/d10/d13/f17 x:0 0 0 2024-02-15T22:50:49.798 INFO:tasks.workunit.client.0.smithi138.stdout:0/65: mkdir d6/d10/d18 0 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/66: dread d6/fe [0,4194304] 0 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/67: dread - d6/f15 zero size 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/68: chown d6/f15 2659375 1 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/69: fdatasync d6/d10/d13/f17 0 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/70: mknod d6/d10/d18/c19 0 2024-02-15T22:50:49.807 INFO:tasks.workunit.client.0.smithi138.stdout:0/71: mknod d6/d10/d18/c1a 0 2024-02-15T22:50:49.808 INFO:tasks.workunit.client.0.smithi138.stdout:0/72: mkdir d6/d10/d18/d1b 0 2024-02-15T22:50:49.808 INFO:tasks.workunit.client.0.smithi138.stdout:0/73: chown d6 62717334 1 2024-02-15T22:50:49.844 INFO:tasks.workunit.client.0.smithi138.stdout:9/63: sync 2024-02-15T22:50:49.845 INFO:tasks.workunit.client.0.smithi138.stdout:6/139: sync 2024-02-15T22:50:49.845 INFO:tasks.workunit.client.0.smithi138.stdout:9/64: chown d0/d4/d9 37453 1 2024-02-15T22:50:49.845 INFO:tasks.workunit.client.0.smithi138.stdout:0/74: mknod d6/d10/d18/c1c 0 2024-02-15T22:50:49.845 INFO:tasks.workunit.client.0.smithi138.stdout:6/140: getdents dc 0 2024-02-15T22:50:49.845 INFO:tasks.workunit.client.0.smithi138.stdout:6/141: chown dc/d24/l32 36793 1 2024-02-15T22:50:49.846 INFO:tasks.workunit.client.0.smithi138.stdout:6/142: fdatasync dc/f2a 0 2024-02-15T22:50:49.846 INFO:tasks.workunit.client.0.smithi138.stdout:9/65: truncate d0/d4/fd 700567 0 2024-02-15T22:50:49.853 INFO:tasks.workunit.client.0.smithi138.stdout:0/75: dread f0 [0,4194304] 0 2024-02-15T22:50:49.855 INFO:tasks.workunit.client.0.smithi138.stdout:0/76: rename d6/fe to d6/d10/d18/f1d 0 2024-02-15T22:50:49.856 INFO:tasks.workunit.client.0.smithi138.stdout:0/77: rename d6/d10/d13/f17 to d6/d10/d13/f1e 0 2024-02-15T22:50:49.856 INFO:tasks.workunit.client.0.smithi138.stdout:0/78: readlink d6/lc 0 2024-02-15T22:50:49.862 INFO:tasks.workunit.client.0.smithi138.stdout:9/66: dwrite d0/d4/f5 [4194304,4194304] 0 2024-02-15T22:50:49.863 INFO:tasks.workunit.client.0.smithi138.stdout:9/67: mknod d0/de/c16 0 2024-02-15T22:50:49.865 INFO:tasks.workunit.client.0.smithi138.stdout:9/68: rename d0/de/f12 to d0/df/d11/f17 0 2024-02-15T22:50:49.866 INFO:tasks.workunit.client.0.smithi138.stdout:0/79: dread f4 [0,4194304] 0 2024-02-15T22:50:49.872 INFO:tasks.workunit.client.0.smithi138.stdout:0/80: dread f0 [0,4194304] 0 2024-02-15T22:50:49.872 INFO:tasks.workunit.client.0.smithi138.stdout:0/81: dread - d6/d10/d13/f1e zero size 2024-02-15T22:50:49.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/82: mknod d6/d10/c1f 0 2024-02-15T22:50:49.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/83: read - d6/d10/d13/f16 zero size 2024-02-15T22:50:49.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/84: mknod d6/d10/d18/d1b/c20 0 2024-02-15T22:50:49.874 INFO:tasks.workunit.client.0.smithi138.stdout:0/85: chown d6/d10/d13/f16 5152253 1 2024-02-15T22:50:49.882 INFO:tasks.workunit.client.0.smithi138.stdout:9/69: dwrite d0/f8 [4194304,4194304] 0 2024-02-15T22:50:49.882 INFO:tasks.workunit.client.0.smithi138.stdout:9/70: chown d0/d4 2729 1 2024-02-15T22:50:49.883 INFO:tasks.workunit.client.0.smithi138.stdout:0/86: write f0 [5052200,57737] 0 2024-02-15T22:50:49.891 INFO:tasks.workunit.client.0.smithi138.stdout:9/71: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:49.904 INFO:tasks.workunit.client.0.smithi138.stdout:0/87: dwrite f0 [0,4194304] 0 2024-02-15T22:50:49.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/72: dwrite d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:49.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/73: fdatasync d0/d4/f5 0 2024-02-15T22:50:49.912 INFO:tasks.workunit.client.0.smithi138.stdout:9/74: rename d0/d4/d9 to d0/de/d14/d18 0 2024-02-15T22:50:49.912 INFO:tasks.workunit.client.0.smithi138.stdout:9/75: creat d0/f19 x:0 0 0 2024-02-15T22:50:49.912 INFO:tasks.workunit.client.0.smithi138.stdout:9/76: write d0/f19 [586138,67196] 0 2024-02-15T22:50:49.913 INFO:tasks.workunit.client.0.smithi138.stdout:9/77: symlink d0/d4/l1a 0 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:2/106: sync 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/144: sync 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/145: chown d5/d18/f24 494 1 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/146: creat d5/d18/f30 x:0 0 0 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/147: chown d5/d12/f1b 5439 1 2024-02-15T22:50:49.919 INFO:tasks.workunit.client.0.smithi138.stdout:2/107: chown d0/c29 93350 1 2024-02-15T22:50:49.920 INFO:tasks.workunit.client.0.smithi138.stdout:0/88: dwrite d6/f15 [0,4194304] 0 2024-02-15T22:50:49.920 INFO:tasks.workunit.client.0.smithi138.stdout:0/89: fsync d6/d10/f14 0 2024-02-15T22:50:49.920 INFO:tasks.workunit.client.0.smithi138.stdout:2/108: truncate d0/da/f13 173879 0 2024-02-15T22:50:49.922 INFO:tasks.workunit.client.0.smithi138.stdout:0/90: mknod d6/c21 0 2024-02-15T22:50:49.923 INFO:tasks.workunit.client.0.smithi138.stdout:2/109: creat d0/da/d19/f2a x:0 0 0 2024-02-15T22:50:49.924 INFO:tasks.workunit.client.0.smithi138.stdout:0/91: creat d6/d10/d18/d1b/f22 x:0 0 0 2024-02-15T22:50:49.926 INFO:tasks.workunit.client.0.smithi138.stdout:0/92: unlink d6/f8 0 2024-02-15T22:50:49.928 INFO:tasks.workunit.client.0.smithi138.stdout:9/78: dwrite d0/df/d11/f13 [0,4194304] 0 2024-02-15T22:50:49.928 INFO:tasks.workunit.client.0.smithi138.stdout:2/110: rename d0/d3/f12 to d0/d3/f2b 0 2024-02-15T22:50:49.930 INFO:tasks.workunit.client.0.smithi138.stdout:9/79: dread d0/d4/fd [0,4194304] 0 2024-02-15T22:50:49.930 INFO:tasks.workunit.client.0.smithi138.stdout:9/80: chown d0/d4/f5 8370655 1 2024-02-15T22:50:49.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/93: link d6/f15 d6/d10/d18/d1b/f23 0 2024-02-15T22:50:49.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/94: creat d6/f24 x:0 0 0 2024-02-15T22:50:49.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/95: fdatasync d6/f24 0 2024-02-15T22:50:49.936 INFO:tasks.workunit.client.0.smithi138.stdout:2/111: creat d0/dd/f2c x:0 0 0 2024-02-15T22:50:49.938 INFO:tasks.workunit.client.0.smithi138.stdout:9/81: dread d0/d4/f5 [4194304,4194304] 0 2024-02-15T22:50:49.940 INFO:tasks.workunit.client.0.smithi138.stdout:0/96: unlink d6/l9 0 2024-02-15T22:50:49.950 INFO:tasks.workunit.client.0.smithi138.stdout:0/97: dread d6/d10/d18/d1b/f23 [0,4194304] 0 2024-02-15T22:50:49.950 INFO:tasks.workunit.client.0.smithi138.stdout:9/82: write d0/df/d11/f13 [861490,15281] 0 2024-02-15T22:50:49.951 INFO:tasks.workunit.client.0.smithi138.stdout:9/83: creat d0/de/d14/f1b x:0 0 0 2024-02-15T22:50:49.956 INFO:tasks.workunit.client.0.smithi138.stdout:0/98: dread d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:50:49.956 INFO:tasks.workunit.client.0.smithi138.stdout:0/99: creat d6/d10/d13/f25 x:0 0 0 2024-02-15T22:50:49.958 INFO:tasks.workunit.client.0.smithi138.stdout:2/112: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:50:49.958 INFO:tasks.workunit.client.0.smithi138.stdout:2/113: dread - d0/f22 zero size 2024-02-15T22:50:49.961 INFO:tasks.workunit.client.0.smithi138.stdout:0/100: write d6/f15 [2396885,111671] 0 2024-02-15T22:50:49.970 INFO:tasks.workunit.client.0.smithi138.stdout:9/84: dwrite d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:49.974 INFO:tasks.workunit.client.0.smithi138.stdout:0/101: write d6/fb [382090,71830] 0 2024-02-15T22:50:49.974 INFO:tasks.workunit.client.0.smithi138.stdout:0/102: creat d6/d10/d18/d1b/f26 x:0 0 0 2024-02-15T22:50:49.974 INFO:tasks.workunit.client.0.smithi138.stdout:0/103: write d6/d10/d18/d1b/f22 [900463,44252] 0 2024-02-15T22:50:49.976 INFO:tasks.workunit.client.0.smithi138.stdout:0/104: symlink d6/l27 0 2024-02-15T22:50:49.978 INFO:tasks.workunit.client.0.smithi138.stdout:4/223: sync 2024-02-15T22:50:49.978 INFO:tasks.workunit.client.0.smithi138.stdout:5/65: sync 2024-02-15T22:50:49.980 INFO:tasks.workunit.client.0.smithi138.stdout:4/224: creat d17/d33/f41 x:0 0 0 2024-02-15T22:50:49.982 INFO:tasks.workunit.client.0.smithi138.stdout:4/225: getdents d17/d1e/d2d 0 2024-02-15T22:50:49.986 INFO:tasks.workunit.client.0.smithi138.stdout:4/226: dread d17/d1e/f22 [0,4194304] 0 2024-02-15T22:50:49.987 INFO:tasks.workunit.client.0.smithi138.stdout:4/227: creat d17/d1e/d2d/d36/f42 x:0 0 0 2024-02-15T22:50:49.989 INFO:tasks.workunit.client.0.smithi138.stdout:4/228: mknod d17/c43 0 2024-02-15T22:50:49.998 INFO:tasks.workunit.client.0.smithi138.stdout:0/105: dwrite d6/f24 [0,4194304] 0 2024-02-15T22:50:49.998 INFO:tasks.workunit.client.0.smithi138.stdout:0/106: chown d6/d10/d18/f1d 0 1 2024-02-15T22:50:50.000 INFO:tasks.workunit.client.0.smithi138.stdout:0/107: rename d6/c7 to d6/d10/d18/c28 0 2024-02-15T22:50:50.001 INFO:tasks.workunit.client.0.smithi138.stdout:0/108: mknod d6/c29 0 2024-02-15T22:50:50.001 INFO:tasks.workunit.client.0.smithi138.stdout:0/109: fsync d6/d10/d13/f16 0 2024-02-15T22:50:50.004 INFO:tasks.workunit.client.0.smithi138.stdout:9/85: dwrite d0/d4/fd [0,4194304] 0 2024-02-15T22:50:50.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/86: mkdir d0/df/d1c 0 2024-02-15T22:50:50.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/87: chown d0/d4 1236810012 1 2024-02-15T22:50:50.012 INFO:tasks.workunit.client.0.smithi138.stdout:5/66: dwrite fb [0,4194304] 0 2024-02-15T22:50:50.012 INFO:tasks.workunit.client.0.smithi138.stdout:5/67: write f9 [5060699,125739] 0 2024-02-15T22:50:50.013 INFO:tasks.workunit.client.0.smithi138.stdout:4/229: dwrite d17/d1e/d2d/d36/f42 [0,4194304] 0 2024-02-15T22:50:50.013 INFO:tasks.workunit.client.0.smithi138.stdout:4/230: dread - d17/d1e/d2d/f31 zero size 2024-02-15T22:50:50.015 INFO:tasks.workunit.client.0.smithi138.stdout:4/231: creat d17/f44 x:0 0 0 2024-02-15T22:50:50.015 INFO:tasks.workunit.client.0.smithi138.stdout:4/232: write d17/d1e/f2f [1563376,79382] 0 2024-02-15T22:50:50.016 INFO:tasks.workunit.client.0.smithi138.stdout:4/233: unlink d17/d1a/c38 0 2024-02-15T22:50:50.024 INFO:tasks.workunit.client.0.smithi138.stdout:0/110: dwrite d6/d10/d18/d1b/f23 [0,4194304] 0 2024-02-15T22:50:50.024 INFO:tasks.workunit.client.0.smithi138.stdout:9/88: dwrite d0/f8 [0,4194304] 0 2024-02-15T22:50:50.024 INFO:tasks.workunit.client.0.smithi138.stdout:9/89: chown d0/de 17376794 1 2024-02-15T22:50:50.025 INFO:tasks.workunit.client.0.smithi138.stdout:0/111: creat d6/d10/d18/f2a x:0 0 0 2024-02-15T22:50:50.025 INFO:tasks.workunit.client.0.smithi138.stdout:0/112: creat d6/d10/d13/f2b x:0 0 0 2024-02-15T22:50:50.025 INFO:tasks.workunit.client.0.smithi138.stdout:0/113: chown d6/d10/d13 439 1 2024-02-15T22:50:50.025 INFO:tasks.workunit.client.0.smithi138.stdout:0/114: creat d6/d10/d13/f2c x:0 0 0 2024-02-15T22:50:50.026 INFO:tasks.workunit.client.0.smithi138.stdout:0/115: truncate d6/d10/d13/f16 973694 0 2024-02-15T22:50:50.029 INFO:tasks.workunit.client.0.smithi138.stdout:0/116: unlink d6/d10/d18/d1b/c20 0 2024-02-15T22:50:50.029 INFO:tasks.workunit.client.0.smithi138.stdout:0/117: write d6/d10/f11 [628524,33157] 0 2024-02-15T22:50:50.050 INFO:tasks.workunit.client.0.smithi138.stdout:4/234: dwrite fd [4194304,4194304] 0 2024-02-15T22:50:50.050 INFO:tasks.workunit.client.0.smithi138.stdout:9/90: dwrite d0/de/d14/f1b [0,4194304] 0 2024-02-15T22:50:50.059 INFO:tasks.workunit.client.0.smithi138.stdout:9/91: dread d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:50.059 INFO:tasks.workunit.client.0.smithi138.stdout:9/92: chown d0/de/d14 3 1 2024-02-15T22:50:50.059 INFO:tasks.workunit.client.0.smithi138.stdout:4/235: dread f6 [0,4194304] 0 2024-02-15T22:50:50.059 INFO:tasks.workunit.client.0.smithi138.stdout:4/236: rename d17/d1e/d2d/d36/d3e to d17/d1e/d2d/d36/d3e/d45 22 2024-02-15T22:50:50.059 INFO:tasks.workunit.client.0.smithi138.stdout:4/237: dread - d17/d2b/f3d zero size 2024-02-15T22:50:50.060 INFO:tasks.workunit.client.0.smithi138.stdout:9/93: getdents d0/de 0 2024-02-15T22:50:50.061 INFO:tasks.workunit.client.0.smithi138.stdout:4/238: getdents d17/d2b 0 2024-02-15T22:50:50.063 INFO:tasks.workunit.client.0.smithi138.stdout:4/239: link d17/d1e/d2d/d36/l40 d17/d1e/d2d/l46 0 2024-02-15T22:50:50.064 INFO:tasks.workunit.client.0.smithi138.stdout:4/240: getdents d17/d1a 0 2024-02-15T22:50:50.066 INFO:tasks.workunit.client.0.smithi138.stdout:4/241: rename c12 to d17/d1e/d2d/c47 0 2024-02-15T22:50:50.068 INFO:tasks.workunit.client.0.smithi138.stdout:4/242: rename d17/d1a/c3a to d17/d33/c48 0 2024-02-15T22:50:50.068 INFO:tasks.workunit.client.0.smithi138.stdout:4/243: dread - d17/f44 zero size 2024-02-15T22:50:50.069 INFO:tasks.workunit.client.0.smithi138.stdout:8/85: sync 2024-02-15T22:50:50.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/86: link db/f1a db/dd/d13/f1c 0 2024-02-15T22:50:50.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/87: stat db/d15 0 2024-02-15T22:50:50.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/88: chown db/dd/d13/f1c 9914 1 2024-02-15T22:50:50.073 INFO:tasks.workunit.client.0.smithi138.stdout:4/244: write f6 [2329472,70981] 0 2024-02-15T22:50:50.073 INFO:tasks.workunit.client.0.smithi138.stdout:4/245: truncate d17/d1e/f3f 825054 0 2024-02-15T22:50:50.075 INFO:tasks.workunit.client.0.smithi138.stdout:8/89: read db/f10 [485790,118566] 0 2024-02-15T22:50:50.075 INFO:tasks.workunit.client.0.smithi138.stdout:8/90: creat db/dd/f1d x:0 0 0 2024-02-15T22:50:50.077 INFO:tasks.workunit.client.0.smithi138.stdout:8/91: link db/f10 db/dd/d13/f1e 0 2024-02-15T22:50:50.078 INFO:tasks.workunit.client.0.smithi138.stdout:8/92: fsync db/d15/f17 0 2024-02-15T22:50:50.079 INFO:tasks.workunit.client.0.smithi138.stdout:8/93: link c9 db/d15/c1f 0 2024-02-15T22:50:50.081 INFO:tasks.workunit.client.0.smithi138.stdout:8/94: link db/dd/c1b db/dd/d13/c20 0 2024-02-15T22:50:50.082 INFO:tasks.workunit.client.0.smithi138.stdout:8/95: link db/ff db/dd/d13/f21 0 2024-02-15T22:50:50.086 INFO:tasks.workunit.client.0.smithi138.stdout:8/96: write f0 [1548295,58004] 0 2024-02-15T22:50:50.086 INFO:tasks.workunit.client.0.smithi138.stdout:4/246: dwrite d17/d33/f41 [0,4194304] 0 2024-02-15T22:50:50.086 INFO:tasks.workunit.client.0.smithi138.stdout:4/247: dread - d17/f44 zero size 2024-02-15T22:50:50.086 INFO:tasks.workunit.client.0.smithi138.stdout:4/248: write d17/d1e/d2d/f30 [1473744,76126] 0 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/97: rename db/dd/d13/d16 to db/dd/d22 0 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/98: write db/dd/f11 [2283942,41803] 0 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/99: chown db/dd/f14 1381562049 1 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/100: readlink db/dd/d13/l18 0 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/101: chown db/dd 2 1 2024-02-15T22:50:50.088 INFO:tasks.workunit.client.0.smithi138.stdout:8/102: chown db 326 1 2024-02-15T22:50:50.089 INFO:tasks.workunit.client.0.smithi138.stdout:4/249: creat d17/f49 x:0 0 0 2024-02-15T22:50:50.089 INFO:tasks.workunit.client.0.smithi138.stdout:4/250: creat d17/d1e/d2d/d36/f4a x:0 0 0 2024-02-15T22:50:50.089 INFO:tasks.workunit.client.0.smithi138.stdout:4/251: dread - d17/d1a/f23 zero size 2024-02-15T22:50:50.089 INFO:tasks.workunit.client.0.smithi138.stdout:4/252: write d17/d2b/f3d [1034953,33360] 0 2024-02-15T22:50:50.090 INFO:tasks.workunit.client.0.smithi138.stdout:8/103: rename db/dd/d13/f1e to db/dd/d13/f23 0 2024-02-15T22:50:50.094 INFO:tasks.workunit.client.0.smithi138.stdout:8/104: mkdir db/dd/d13/d19/d24 0 2024-02-15T22:50:50.098 INFO:tasks.workunit.client.0.smithi138.stdout:8/105: link c4 db/dd/d22/c25 0 2024-02-15T22:50:50.103 INFO:tasks.workunit.client.0.smithi138.stdout:4/253: dwrite d17/f49 [0,4194304] 0 2024-02-15T22:50:50.103 INFO:tasks.workunit.client.0.smithi138.stdout:4/254: creat d17/d1e/f4b x:0 0 0 2024-02-15T22:50:50.106 INFO:tasks.workunit.client.0.smithi138.stdout:4/255: symlink d17/d1e/d2d/d36/l4c 0 2024-02-15T22:50:50.106 INFO:tasks.workunit.client.0.smithi138.stdout:4/256: creat d17/d1e/f4d x:0 0 0 2024-02-15T22:50:50.107 INFO:tasks.workunit.client.0.smithi138.stdout:8/106: dread f5 [0,4194304] 0 2024-02-15T22:50:50.109 INFO:tasks.workunit.client.0.smithi138.stdout:4/257: symlink d17/d1a/l4e 0 2024-02-15T22:50:50.109 INFO:tasks.workunit.client.0.smithi138.stdout:4/258: fdatasync d17/d1e/f28 0 2024-02-15T22:50:50.109 INFO:tasks.workunit.client.0.smithi138.stdout:4/259: fdatasync d17/d1e/f4d 0 2024-02-15T22:50:50.111 INFO:tasks.workunit.client.0.smithi138.stdout:4/260: creat d17/d2b/f4f x:0 0 0 2024-02-15T22:50:50.111 INFO:tasks.workunit.client.0.smithi138.stdout:4/261: readlink d17/l35 0 2024-02-15T22:50:50.120 INFO:tasks.workunit.client.0.smithi138.stdout:4/262: read d17/d33/f41 [2516825,8717] 0 2024-02-15T22:50:50.120 INFO:tasks.workunit.client.0.smithi138.stdout:4/263: stat d17/d1e/d2d/f30 0 2024-02-15T22:50:50.121 INFO:tasks.workunit.client.0.smithi138.stdout:4/264: write d17/d1e/f28 [438826,51043] 0 2024-02-15T22:50:50.122 INFO:tasks.workunit.client.0.smithi138.stdout:4/265: creat d17/d1a/f50 x:0 0 0 2024-02-15T22:50:50.131 INFO:tasks.workunit.client.0.smithi138.stdout:8/107: dwrite db/dd/f11 [0,4194304] 0 2024-02-15T22:50:50.131 INFO:tasks.workunit.client.0.smithi138.stdout:8/108: chown db 10 1 2024-02-15T22:50:50.133 INFO:tasks.workunit.client.0.smithi138.stdout:8/109: symlink db/dd/d13/l26 0 2024-02-15T22:50:50.138 INFO:tasks.workunit.client.0.smithi138.stdout:4/266: dwrite f8 [0,4194304] 0 2024-02-15T22:50:50.140 INFO:tasks.workunit.client.0.smithi138.stdout:4/267: symlink d17/d33/l51 0 2024-02-15T22:50:50.141 INFO:tasks.workunit.client.0.smithi138.stdout:4/268: mkdir d17/d1e/d2d/d52 0 2024-02-15T22:50:50.142 INFO:tasks.workunit.client.0.smithi138.stdout:4/269: symlink d17/d1e/d2d/d52/l53 0 2024-02-15T22:50:50.142 INFO:tasks.workunit.client.0.smithi138.stdout:4/270: write f6 [493094,113779] 0 2024-02-15T22:50:50.142 INFO:tasks.workunit.client.0.smithi138.stdout:4/271: read - d17/d1e/d2d/f31 zero size 2024-02-15T22:50:50.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/110: dwrite db/dd/d13/f23 [0,4194304] 0 2024-02-15T22:50:50.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/111: truncate db/dd/f1d 701325 0 2024-02-15T22:50:50.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/112: chown db/fc 169915 1 2024-02-15T22:50:50.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/113: chown l7 6438367 1 2024-02-15T22:50:50.151 INFO:tasks.workunit.client.0.smithi138.stdout:4/272: write fd [4740590,78827] 0 2024-02-15T22:50:50.152 INFO:tasks.workunit.client.0.smithi138.stdout:4/273: symlink d17/d1e/l54 0 2024-02-15T22:50:50.153 INFO:tasks.workunit.client.0.smithi138.stdout:4/274: link d17/d1a/f25 d17/d2b/f55 0 2024-02-15T22:50:50.154 INFO:tasks.workunit.client.0.smithi138.stdout:4/275: mkdir d17/d1e/d56 0 2024-02-15T22:50:50.154 INFO:tasks.workunit.client.0.smithi138.stdout:8/114: dread f6 [0,4194304] 0 2024-02-15T22:50:50.163 INFO:tasks.workunit.client.0.smithi138.stdout:4/276: dread f8 [0,4194304] 0 2024-02-15T22:50:50.163 INFO:tasks.workunit.client.0.smithi138.stdout:4/277: chown d17/f2c 12049923 1 2024-02-15T22:50:50.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/115: dwrite f6 [4194304,4194304] 0 2024-02-15T22:50:50.171 INFO:tasks.workunit.client.0.smithi138.stdout:4/278: truncate d17/d1e/f2f 2970099 0 2024-02-15T22:50:50.173 INFO:tasks.workunit.client.0.smithi138.stdout:4/279: rename d17/d1e/d2d/d52/l53 to d17/d33/l57 0 2024-02-15T22:50:50.176 INFO:tasks.workunit.client.0.smithi138.stdout:8/116: dread db/f1a [0,4194304] 0 2024-02-15T22:50:50.176 INFO:tasks.workunit.client.0.smithi138.stdout:8/117: rmdir db/dd/d22 39 2024-02-15T22:50:50.177 INFO:tasks.workunit.client.0.smithi138.stdout:8/118: symlink db/dd/l27 0 2024-02-15T22:50:50.177 INFO:tasks.workunit.client.0.smithi138.stdout:8/119: chown db/dd/l12 15 1 2024-02-15T22:50:50.181 INFO:tasks.workunit.client.0.smithi138.stdout:4/280: dread d17/d1e/f2f [0,4194304] 0 2024-02-15T22:50:50.196 INFO:tasks.workunit.client.0.smithi138.stdout:4/281: dwrite fd [0,4194304] 0 2024-02-15T22:50:50.196 INFO:tasks.workunit.client.0.smithi138.stdout:4/282: symlink d17/d1e/d2d/d36/d3e/l58 0 2024-02-15T22:50:50.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/283: dread d17/d1e/f2f [0,4194304] 0 2024-02-15T22:50:50.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/284: chown d17/f18 11 1 2024-02-15T22:50:50.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/285: dread - d17/d1e/f4b zero size 2024-02-15T22:50:50.204 INFO:tasks.workunit.client.0.smithi138.stdout:4/286: symlink d17/d2b/l59 0 2024-02-15T22:50:50.205 INFO:tasks.workunit.client.0.smithi138.stdout:4/287: rename d17/d1e/d2d/d36/l4c to d17/l5a 0 2024-02-15T22:50:50.206 INFO:tasks.workunit.client.0.smithi138.stdout:4/288: rename d17/d1e/l32 to d17/d1a/l5b 0 2024-02-15T22:50:50.207 INFO:tasks.workunit.client.0.smithi138.stdout:4/289: unlink d17/f2c 0 2024-02-15T22:50:50.208 INFO:tasks.workunit.client.0.smithi138.stdout:4/290: creat d17/d1e/d56/f5c x:0 0 0 2024-02-15T22:50:50.211 INFO:tasks.workunit.client.0.smithi138.stdout:4/291: creat d17/d1e/d2d/d52/f5d x:0 0 0 2024-02-15T22:50:50.211 INFO:tasks.workunit.client.0.smithi138.stdout:4/292: chown d17/d1a/f25 842 1 2024-02-15T22:50:50.228 INFO:tasks.workunit.client.0.smithi138.stdout:1/101: sync 2024-02-15T22:50:50.229 INFO:tasks.workunit.client.0.smithi138.stdout:4/293: dwrite d17/d1e/f28 [0,4194304] 0 2024-02-15T22:50:50.229 INFO:tasks.workunit.client.0.smithi138.stdout:4/294: readlink d17/d2b/l3b 0 2024-02-15T22:50:50.229 INFO:tasks.workunit.client.0.smithi138.stdout:1/102: mkdir df/d1b/d1d/d24 0 2024-02-15T22:50:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:49 smithi138 ceph-mon[29229]: mgrmap e24: smithi170.gczrzt(active, since 9s), standbys: smithi138.jqscxs 2024-02-15T22:50:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:49 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:50:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:49 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:49 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.235 INFO:tasks.workunit.client.0.smithi138.stdout:1/103: rmdir df/d1b 39 2024-02-15T22:50:50.235 INFO:tasks.workunit.client.0.smithi138.stdout:1/104: fsync df/f19 0 2024-02-15T22:50:50.235 INFO:tasks.workunit.client.0.smithi138.stdout:1/105: fdatasync f4 0 2024-02-15T22:50:50.241 INFO:tasks.workunit.client.0.smithi138.stdout:4/295: dwrite d17/d1e/f22 [0,4194304] 0 2024-02-15T22:50:50.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/296: dwrite d17/d2b/f4f [0,4194304] 0 2024-02-15T22:50:50.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/297: fdatasync f8 0 2024-02-15T22:50:50.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/298: fsync d17/f18 0 2024-02-15T22:50:50.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/299: dread - d17/d1a/f50 zero size 2024-02-15T22:50:50.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/300: write d17/d1e/f4d [1005842,32113] 0 2024-02-15T22:50:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:49 smithi170 ceph-mon[35248]: mgrmap e24: smithi170.gczrzt(active, since 9s), standbys: smithi138.jqscxs 2024-02-15T22:50:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:49 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:50:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:49 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:49 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.326 INFO:tasks.workunit.client.0.smithi138.stdout:1/106: rmdir df 39 2024-02-15T22:50:50.353 INFO:tasks.workunit.client.0.smithi138.stdout:4/301: dwrite d17/d1e/d2d/f30 [0,4194304] 0 2024-02-15T22:50:50.354 INFO:tasks.workunit.client.0.smithi138.stdout:4/302: symlink d17/d1a/l5e 0 2024-02-15T22:50:50.354 INFO:tasks.workunit.client.0.smithi138.stdout:4/303: creat d17/d33/f5f x:0 0 0 2024-02-15T22:50:50.357 INFO:tasks.workunit.client.0.smithi138.stdout:4/304: rmdir d17/d1e/d2d/d36 39 2024-02-15T22:50:50.359 INFO:tasks.workunit.client.0.smithi138.stdout:4/305: rmdir d17/d2b 39 2024-02-15T22:50:50.372 INFO:tasks.workunit.client.0.smithi138.stdout:4/306: dwrite fd [0,4194304] 0 2024-02-15T22:50:50.373 INFO:tasks.workunit.client.0.smithi138.stdout:4/307: symlink d17/d1a/l60 0 2024-02-15T22:50:50.375 INFO:tasks.workunit.client.0.smithi138.stdout:4/308: creat d17/d1e/d2d/f61 x:0 0 0 2024-02-15T22:50:50.377 INFO:tasks.workunit.client.0.smithi138.stdout:4/309: rename d17/d2b/l3b to d17/d1e/d2d/d52/l62 0 2024-02-15T22:50:50.378 INFO:tasks.workunit.client.0.smithi138.stdout:4/310: symlink d17/d2b/l63 0 2024-02-15T22:50:50.382 INFO:tasks.workunit.client.0.smithi138.stdout:4/311: rename d17/d33 to d17/d1e/d2d/d36/d3e/d64 0 2024-02-15T22:50:50.383 INFO:tasks.workunit.client.0.smithi138.stdout:7/308: sync 2024-02-15T22:50:50.384 INFO:tasks.workunit.client.0.smithi138.stdout:4/312: dread d17/d2b/f3d [0,4194304] 0 2024-02-15T22:50:50.384 INFO:tasks.workunit.client.0.smithi138.stdout:7/309: symlink d1/d2/db/d3c/d4d/d5b/l6f 0 2024-02-15T22:50:50.385 INFO:tasks.workunit.client.0.smithi138.stdout:4/313: creat d17/d1e/d2d/d36/d3e/d64/f65 x:0 0 0 2024-02-15T22:50:50.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/310: symlink d1/d2/db/d3c/d4d/l70 0 2024-02-15T22:50:50.386 INFO:tasks.workunit.client.0.smithi138.stdout:4/314: mknod d17/d1e/d2d/d36/d3e/c66 0 2024-02-15T22:50:50.395 INFO:tasks.workunit.client.0.smithi138.stdout:4/315: read d17/d1e/d2d/f30 [1193905,123724] 0 2024-02-15T22:50:50.395 INFO:tasks.workunit.client.0.smithi138.stdout:4/316: write d17/d1e/d2d/f30 [4364889,32135] 0 2024-02-15T22:50:50.395 INFO:tasks.workunit.client.0.smithi138.stdout:4/317: chown d17/d1a/l5b 31707508 1 2024-02-15T22:50:50.395 INFO:tasks.workunit.client.0.smithi138.stdout:4/318: write d17/d1e/d56/f5c [568935,113812] 0 2024-02-15T22:50:50.396 INFO:tasks.workunit.client.0.smithi138.stdout:4/319: mknod d17/d1e/d2d/d36/d3e/c67 0 2024-02-15T22:50:50.412 INFO:tasks.workunit.client.0.smithi138.stdout:4/320: dwrite d17/d1a/f25 [0,4194304] 0 2024-02-15T22:50:50.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/321: creat d17/d1e/d2d/d36/f68 x:0 0 0 2024-02-15T22:50:50.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/322: read - d17/d1e/d2d/d36/f4a zero size 2024-02-15T22:50:50.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/323: creat d17/d1e/d2d/d36/f69 x:0 0 0 2024-02-15T22:50:50.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/324: read d17/d1e/f3f [391260,24203] 0 2024-02-15T22:50:50.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/325: creat d17/f6a x:0 0 0 2024-02-15T22:50:50.421 INFO:tasks.workunit.client.0.smithi138.stdout:4/326: dread d17/d1e/d2d/f30 [0,4194304] 0 2024-02-15T22:50:50.423 INFO:tasks.workunit.client.0.smithi138.stdout:4/327: symlink d17/d1e/d2d/d36/d3e/d64/l6b 0 2024-02-15T22:50:50.425 INFO:tasks.workunit.client.0.smithi138.stdout:4/328: rename d17/d1a/l5e to d17/d1e/d2d/d36/d3e/l6c 0 2024-02-15T22:50:50.426 INFO:tasks.workunit.client.0.smithi138.stdout:4/329: write d17/d1e/d2d/f2e [227967,124957] 0 2024-02-15T22:50:50.426 INFO:tasks.workunit.client.0.smithi138.stdout:4/330: chown d17/d1e/d2d/d36/d3e/c67 3 1 2024-02-15T22:50:50.427 INFO:tasks.workunit.client.0.smithi138.stdout:4/331: mknod d17/d1e/d2d/d52/c6d 0 2024-02-15T22:50:50.429 INFO:tasks.workunit.client.0.smithi138.stdout:4/332: getdents d17/d1e/d2d 0 2024-02-15T22:50:50.445 INFO:tasks.workunit.client.0.smithi138.stdout:4/333: dwrite d17/d1e/f22 [0,4194304] 0 2024-02-15T22:50:50.445 INFO:tasks.workunit.client.0.smithi138.stdout:4/334: creat d17/d1e/d2d/d36/f6e x:0 0 0 2024-02-15T22:50:50.445 INFO:tasks.workunit.client.0.smithi138.stdout:4/335: creat d17/d1e/d2d/d36/f6f x:0 0 0 2024-02-15T22:50:50.447 INFO:tasks.workunit.client.0.smithi138.stdout:4/336: dread d17/d1e/f4d [0,4194304] 0 2024-02-15T22:50:50.448 INFO:tasks.workunit.client.0.smithi138.stdout:4/337: symlink d17/d1e/d2d/d36/l70 0 2024-02-15T22:50:50.455 INFO:tasks.workunit.client.0.smithi138.stdout:4/338: read d17/f49 [3367522,46038] 0 2024-02-15T22:50:50.460 INFO:tasks.workunit.client.0.smithi138.stdout:4/339: dread d17/f18 [0,4194304] 0 2024-02-15T22:50:50.461 INFO:tasks.workunit.client.0.smithi138.stdout:4/340: dread d17/d2b/f3d [0,4194304] 0 2024-02-15T22:50:50.462 INFO:tasks.workunit.client.0.smithi138.stdout:4/341: symlink d17/d1a/l71 0 2024-02-15T22:50:50.462 INFO:tasks.workunit.client.0.smithi138.stdout:4/342: chown d17/d1e/d2d/d36/d3e/c66 367865 1 2024-02-15T22:50:50.463 INFO:tasks.workunit.client.0.smithi138.stdout:4/343: rename d17/d1a/f25 to d17/d1e/d2d/d52/f72 0 2024-02-15T22:50:50.464 INFO:tasks.workunit.client.0.smithi138.stdout:4/344: truncate d17/d2b/f55 2511657 0 2024-02-15T22:50:50.476 INFO:tasks.workunit.client.0.smithi138.stdout:6/143: sync 2024-02-15T22:50:50.477 INFO:tasks.workunit.client.0.smithi138.stdout:6/144: mkdir dc/d24/d34 0 2024-02-15T22:50:50.477 INFO:tasks.workunit.client.0.smithi138.stdout:6/145: mknod dc/d24/c35 0 2024-02-15T22:50:50.479 INFO:tasks.workunit.client.0.smithi138.stdout:4/345: dwrite d17/d1e/d2d/d36/f6e [0,4194304] 0 2024-02-15T22:50:50.481 INFO:tasks.workunit.client.0.smithi138.stdout:4/346: rmdir d17/d1e/d2d 39 2024-02-15T22:50:50.489 INFO:tasks.workunit.client.0.smithi138.stdout:4/347: dread d17/d1e/f2f [0,4194304] 0 2024-02-15T22:50:50.490 INFO:tasks.workunit.client.0.smithi138.stdout:4/348: stat d17/d1e/d2d/d36/d3e/d64/f41 0 2024-02-15T22:50:50.492 INFO:tasks.workunit.client.0.smithi138.stdout:6/146: dwrite dc/f1a [0,4194304] 0 2024-02-15T22:50:50.492 INFO:tasks.workunit.client.0.smithi138.stdout:6/147: creat dc/d24/f36 x:0 0 0 2024-02-15T22:50:50.494 INFO:tasks.workunit.client.0.smithi138.stdout:6/148: link dc/d24/l32 dc/d24/l37 0 2024-02-15T22:50:50.495 INFO:tasks.workunit.client.0.smithi138.stdout:6/149: dread dc/d24/f26 [0,4194304] 0 2024-02-15T22:50:50.512 INFO:tasks.workunit.client.0.smithi138.stdout:6/150: dwrite dc/d24/f2c [0,4194304] 0 2024-02-15T22:50:50.513 INFO:tasks.workunit.client.0.smithi138.stdout:6/151: dread dc/d24/f26 [0,4194304] 0 2024-02-15T22:50:50.526 INFO:tasks.workunit.client.0.smithi138.stdout:6/152: dwrite dc/f1c [0,4194304] 0 2024-02-15T22:50:50.529 INFO:tasks.workunit.client.0.smithi138.stdout:6/153: unlink dc/c17 0 2024-02-15T22:50:50.529 INFO:tasks.workunit.client.0.smithi138.stdout:6/154: write dc/f2a [166317,49694] 0 2024-02-15T22:50:50.532 INFO:tasks.workunit.client.0.smithi138.stdout:6/155: write f1 [1515376,100032] 0 2024-02-15T22:50:50.532 INFO:tasks.workunit.client.0.smithi138.stdout:6/156: creat dc/d24/f38 x:0 0 0 2024-02-15T22:50:50.533 INFO:tasks.workunit.client.0.smithi138.stdout:6/157: creat dc/d24/f39 x:0 0 0 2024-02-15T22:50:50.534 INFO:tasks.workunit.client.0.smithi138.stdout:6/158: creat dc/f3a x:0 0 0 2024-02-15T22:50:50.535 INFO:tasks.workunit.client.0.smithi138.stdout:3/148: sync 2024-02-15T22:50:50.535 INFO:tasks.workunit.client.0.smithi138.stdout:2/114: sync 2024-02-15T22:50:50.535 INFO:tasks.workunit.client.0.smithi138.stdout:3/149: truncate d5/d12/d23/f28 802440 0 2024-02-15T22:50:50.537 INFO:tasks.workunit.client.0.smithi138.stdout:3/150: dread d5/d12/d26/f2d [4194304,4194304] 0 2024-02-15T22:50:50.537 INFO:tasks.workunit.client.0.smithi138.stdout:3/151: write d5/d18/f24 [416798,1868] 0 2024-02-15T22:50:50.539 INFO:tasks.workunit.client.0.smithi138.stdout:6/159: write dc/f13 [3563107,3396] 0 2024-02-15T22:50:50.539 INFO:tasks.workunit.client.0.smithi138.stdout:6/160: fdatasync dc/d24/f2c 0 2024-02-15T22:50:50.540 INFO:tasks.workunit.client.0.smithi138.stdout:6/161: truncate dc/f3a 768786 0 2024-02-15T22:50:50.549 INFO:tasks.workunit.client.0.smithi138.stdout:3/152: truncate d5/d12/d26/f2d 855892 0 2024-02-15T22:50:50.549 INFO:tasks.workunit.client.0.smithi138.stdout:3/153: write d5/d12/d23/f28 [824282,14017] 0 2024-02-15T22:50:50.549 INFO:tasks.workunit.client.0.smithi138.stdout:3/154: chown d5/d16/dc 11 1 2024-02-15T22:50:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:6/162: truncate f1 2410409 0 2024-02-15T22:50:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:2/115: dwrite d0/dd/f2c [0,4194304] 0 2024-02-15T22:50:50.550 INFO:tasks.workunit.client.0.smithi138.stdout:2/116: creat d0/da/d19/f2d x:0 0 0 2024-02-15T22:50:50.552 INFO:tasks.workunit.client.0.smithi138.stdout:3/155: link d5/l7 d5/d12/d23/l31 0 2024-02-15T22:50:50.552 INFO:tasks.workunit.client.0.smithi138.stdout:3/156: chown d5/d12/d23 71523 1 2024-02-15T22:50:50.553 INFO:tasks.workunit.client.0.smithi138.stdout:3/157: dread d5/d18/f1f [0,4194304] 0 2024-02-15T22:50:50.553 INFO:tasks.workunit.client.0.smithi138.stdout:6/163: truncate dc/f1a 3492072 0 2024-02-15T22:50:50.557 INFO:tasks.workunit.client.0.smithi138.stdout:3/158: mknod d5/d12/d26/d2e/c32 0 2024-02-15T22:50:50.558 INFO:tasks.workunit.client.0.smithi138.stdout:6/164: mkdir dc/d24/d34/d3b 0 2024-02-15T22:50:50.560 INFO:tasks.workunit.client.0.smithi138.stdout:3/159: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:50.562 INFO:tasks.workunit.client.0.smithi138.stdout:3/160: mknod d5/d18/c33 0 2024-02-15T22:50:50.568 INFO:tasks.workunit.client.0.smithi138.stdout:2/117: dwrite d0/f2 [4194304,4194304] 0 2024-02-15T22:50:50.568 INFO:tasks.workunit.client.0.smithi138.stdout:2/118: rename d0 to d0/dd/d2e 22 2024-02-15T22:50:50.570 INFO:tasks.workunit.client.0.smithi138.stdout:2/119: truncate d0/dd/f2c 1971676 0 2024-02-15T22:50:50.572 INFO:tasks.workunit.client.0.smithi138.stdout:2/120: mknod d0/dd/c2f 0 2024-02-15T22:50:50.574 INFO:tasks.workunit.client.0.smithi138.stdout:2/121: link d0/da/f27 d0/da/d19/f30 0 2024-02-15T22:50:50.582 INFO:tasks.workunit.client.0.smithi138.stdout:3/161: dwrite d5/d12/d23/f28 [0,4194304] 0 2024-02-15T22:50:50.582 INFO:tasks.workunit.client.0.smithi138.stdout:3/162: read d5/d12/f1b [1081146,16160] 0 2024-02-15T22:50:50.584 INFO:tasks.workunit.client.0.smithi138.stdout:3/163: symlink d5/l34 0 2024-02-15T22:50:50.584 INFO:tasks.workunit.client.0.smithi138.stdout:3/164: mkdir d5/d18/d35 0 2024-02-15T22:50:50.585 INFO:tasks.workunit.client.0.smithi138.stdout:3/165: read - d5/d12/f2a zero size 2024-02-15T22:50:50.585 INFO:tasks.workunit.client.0.smithi138.stdout:3/166: symlink d5/d18/l36 0 2024-02-15T22:50:50.585 INFO:tasks.workunit.client.0.smithi138.stdout:3/167: write d5/d18/f30 [14799,40822] 0 2024-02-15T22:50:50.586 INFO:tasks.workunit.client.0.smithi138.stdout:3/168: chown d5/d12/d23/f28 93 1 2024-02-15T22:50:50.587 INFO:tasks.workunit.client.0.smithi138.stdout:2/122: dwrite d0/da/d19/f30 [0,4194304] 0 2024-02-15T22:50:50.590 INFO:tasks.workunit.client.0.smithi138.stdout:2/123: symlink d0/dd/l31 0 2024-02-15T22:50:50.590 INFO:tasks.workunit.client.0.smithi138.stdout:3/169: write d5/d16/dc/f1a [625414,43237] 0 2024-02-15T22:50:50.591 INFO:tasks.workunit.client.0.smithi138.stdout:3/170: truncate d5/f27 1384190 0 2024-02-15T22:50:50.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/124: rename d0/f2 to d0/da/f32 0 2024-02-15T22:50:50.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/125: chown d0/dd/f2c 0 1 2024-02-15T22:50:50.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/126: fdatasync d0/da/f8 0 2024-02-15T22:50:50.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/127: creat d0/da/f33 x:0 0 0 2024-02-15T22:50:50.594 INFO:tasks.workunit.client.0.smithi138.stdout:2/128: stat d0 0 2024-02-15T22:50:50.595 INFO:tasks.workunit.client.0.smithi138.stdout:3/171: unlink d5/c22 0 2024-02-15T22:50:50.595 INFO:tasks.workunit.client.0.smithi138.stdout:3/172: read d5/d18/f30 [37767,103944] 0 2024-02-15T22:50:50.599 INFO:tasks.workunit.client.0.smithi138.stdout:3/173: link d5/d18/l36 d5/d18/d35/l37 0 2024-02-15T22:50:50.599 INFO:tasks.workunit.client.0.smithi138.stdout:3/174: write d5/d16/dc/f13 [783832,129737] 0 2024-02-15T22:50:50.599 INFO:tasks.workunit.client.0.smithi138.stdout:2/129: mknod d0/d3/c34 0 2024-02-15T22:50:50.601 INFO:tasks.workunit.client.0.smithi138.stdout:3/175: getdents d5/d12/d26 0 2024-02-15T22:50:50.602 INFO:tasks.workunit.client.0.smithi138.stdout:2/130: mknod d0/da/d19/c35 0 2024-02-15T22:50:50.610 INFO:tasks.workunit.client.0.smithi138.stdout:3/176: rmdir d5/d18 39 2024-02-15T22:50:50.613 INFO:tasks.workunit.client.0.smithi138.stdout:2/131: dread d0/da/d19/f30 [0,4194304] 0 2024-02-15T22:50:50.622 INFO:tasks.workunit.client.0.smithi138.stdout:2/132: dread d0/da/d19/f30 [0,4194304] 0 2024-02-15T22:50:50.623 INFO:tasks.workunit.client.0.smithi138.stdout:2/133: rename d0/da/f32 to d0/f36 0 2024-02-15T22:50:50.623 INFO:tasks.workunit.client.0.smithi138.stdout:2/134: write d0/f6 [1808589,56820] 0 2024-02-15T22:50:50.626 INFO:tasks.workunit.client.0.smithi138.stdout:3/177: dwrite d5/d12/f1b [0,4194304] 0 2024-02-15T22:50:50.628 INFO:tasks.workunit.client.0.smithi138.stdout:2/135: rmdir d0/da 39 2024-02-15T22:50:50.628 INFO:tasks.workunit.client.0.smithi138.stdout:2/136: truncate d0/da/d19/f1b 1293703 0 2024-02-15T22:50:50.628 INFO:tasks.workunit.client.0.smithi138.stdout:2/137: fsync d0/f1 0 2024-02-15T22:50:50.631 INFO:tasks.workunit.client.0.smithi138.stdout:3/178: unlink d5/d18/d35/l37 0 2024-02-15T22:50:50.632 INFO:tasks.workunit.client.0.smithi138.stdout:2/138: rename d0/da/f13 to d0/f37 0 2024-02-15T22:50:50.633 INFO:tasks.workunit.client.0.smithi138.stdout:3/179: symlink d5/d12/d26/l38 0 2024-02-15T22:50:50.635 INFO:tasks.workunit.client.0.smithi138.stdout:3/180: rename d5/f27 to d5/d12/d26/d2f/f39 0 2024-02-15T22:50:50.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/181: rename d5/d18/f1f to d5/d12/d26/d2e/f3a 0 2024-02-15T22:50:50.641 INFO:tasks.workunit.client.0.smithi138.stdout:9/94: sync 2024-02-15T22:50:50.641 INFO:tasks.workunit.client.0.smithi138.stdout:1/107: sync 2024-02-15T22:50:50.641 INFO:tasks.workunit.client.0.smithi138.stdout:7/311: sync 2024-02-15T22:50:50.641 INFO:tasks.workunit.client.0.smithi138.stdout:0/118: sync 2024-02-15T22:50:50.642 INFO:tasks.workunit.client.0.smithi138.stdout:2/139: write d0/f1 [3574353,19716] 0 2024-02-15T22:50:50.642 INFO:tasks.workunit.client.0.smithi138.stdout:2/140: write d0/da/d19/f2d [700536,28637] 0 2024-02-15T22:50:50.643 INFO:tasks.workunit.client.0.smithi138.stdout:1/108: read df/d1b/f1f [458711,5354] 0 2024-02-15T22:50:50.643 INFO:tasks.workunit.client.0.smithi138.stdout:8/120: sync 2024-02-15T22:50:50.643 INFO:tasks.workunit.client.0.smithi138.stdout:5/68: sync 2024-02-15T22:50:50.644 INFO:tasks.workunit.client.0.smithi138.stdout:5/69: chown fd 233240 1 2024-02-15T22:50:50.645 INFO:tasks.workunit.client.0.smithi138.stdout:7/312: symlink d1/d2/db/l71 0 2024-02-15T22:50:50.646 INFO:tasks.workunit.client.0.smithi138.stdout:9/95: rmdir d0/df/d1c 0 2024-02-15T22:50:50.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/121: unlink l7 0 2024-02-15T22:50:50.649 INFO:tasks.workunit.client.0.smithi138.stdout:5/70: creat df/f11 x:0 0 0 2024-02-15T22:50:50.652 INFO:tasks.workunit.client.0.smithi138.stdout:5/71: link df/l10 df/l12 0 2024-02-15T22:50:50.652 INFO:tasks.workunit.client.0.smithi138.stdout:5/72: creat df/f13 x:0 0 0 2024-02-15T22:50:50.652 INFO:tasks.workunit.client.0.smithi138.stdout:5/73: readlink df/l12 0 2024-02-15T22:50:50.656 INFO:tasks.workunit.client.0.smithi138.stdout:9/96: read d0/de/d14/f1b [1655235,94436] 0 2024-02-15T22:50:50.657 INFO:tasks.workunit.client.0.smithi138.stdout:2/141: dread d0/dd/d15/f1f [0,4194304] 0 2024-02-15T22:50:50.657 INFO:tasks.workunit.client.0.smithi138.stdout:9/97: truncate d0/df/d11/f13 2932551 0 2024-02-15T22:50:50.658 INFO:tasks.workunit.client.0.smithi138.stdout:2/142: mknod d0/dd/c38 0 2024-02-15T22:50:50.658 INFO:tasks.workunit.client.0.smithi138.stdout:2/143: readlink d0/d3/l21 0 2024-02-15T22:50:50.660 INFO:tasks.workunit.client.0.smithi138.stdout:2/144: link d0/dd/f2c d0/da/d19/f39 0 2024-02-15T22:50:50.660 INFO:tasks.workunit.client.0.smithi138.stdout:7/313: dread d1/f42 [0,4194304] 0 2024-02-15T22:50:50.661 INFO:tasks.workunit.client.0.smithi138.stdout:7/314: link d1/d2/c53 d1/d2/db/d2a/d64/c72 0 2024-02-15T22:50:50.663 INFO:tasks.workunit.client.0.smithi138.stdout:7/315: creat d1/d2/f73 x:0 0 0 2024-02-15T22:50:50.664 INFO:tasks.workunit.client.0.smithi138.stdout:7/316: mknod d1/c74 0 2024-02-15T22:50:50.664 INFO:tasks.workunit.client.0.smithi138.stdout:7/317: fsync d1/d2/db/f1c 0 2024-02-15T22:50:50.665 INFO:tasks.workunit.client.0.smithi138.stdout:7/318: getdents d1/d2/db/d3c 0 2024-02-15T22:50:50.666 INFO:tasks.workunit.client.0.smithi138.stdout:3/182: dwrite d5/d12/d23/f28 [0,4194304] 0 2024-02-15T22:50:50.667 INFO:tasks.workunit.client.0.smithi138.stdout:1/109: dwrite df/f11 [0,4194304] 0 2024-02-15T22:50:50.670 INFO:tasks.workunit.client.0.smithi138.stdout:3/183: mknod d5/d16/c3b 0 2024-02-15T22:50:50.671 INFO:tasks.workunit.client.0.smithi138.stdout:9/98: read d0/f8 [236004,109344] 0 2024-02-15T22:50:50.671 INFO:tasks.workunit.client.0.smithi138.stdout:9/99: creat d0/f1d x:0 0 0 2024-02-15T22:50:50.673 INFO:tasks.workunit.client.0.smithi138.stdout:1/110: mkdir df/d1b/d1d/d25 0 2024-02-15T22:50:50.673 INFO:tasks.workunit.client.0.smithi138.stdout:3/184: getdents d5/d12/d23 0 2024-02-15T22:50:50.673 INFO:tasks.workunit.client.0.smithi138.stdout:3/185: stat d5/d12/d26/d2f/f39 0 2024-02-15T22:50:50.676 INFO:tasks.workunit.client.0.smithi138.stdout:8/122: dwrite db/f1a [4194304,4194304] 0 2024-02-15T22:50:50.679 INFO:tasks.workunit.client.0.smithi138.stdout:5/74: dwrite f9 [0,4194304] 0 2024-02-15T22:50:50.679 INFO:tasks.workunit.client.0.smithi138.stdout:1/111: creat df/d1b/d1d/d24/f26 x:0 0 0 2024-02-15T22:50:50.680 INFO:tasks.workunit.client.0.smithi138.stdout:1/112: dread - df/d1b/d1d/f20 zero size 2024-02-15T22:50:50.681 INFO:tasks.workunit.client.0.smithi138.stdout:3/186: dread d5/d16/dc/f13 [0,4194304] 0 2024-02-15T22:50:50.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/75: mknod df/c14 0 2024-02-15T22:50:50.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/76: truncate fd 360141 0 2024-02-15T22:50:50.685 INFO:tasks.workunit.client.0.smithi138.stdout:1/113: write fa [2356771,120587] 0 2024-02-15T22:50:50.685 INFO:tasks.workunit.client.0.smithi138.stdout:1/114: write fe [661351,38883] 0 2024-02-15T22:50:50.686 INFO:tasks.workunit.client.0.smithi138.stdout:3/187: creat d5/d16/f3c x:0 0 0 2024-02-15T22:50:50.688 INFO:tasks.workunit.client.0.smithi138.stdout:3/188: symlink d5/d12/d23/d29/l3d 0 2024-02-15T22:50:50.690 INFO:tasks.workunit.client.0.smithi138.stdout:3/189: unlink d5/d12/d26/d2e/f3a 0 2024-02-15T22:50:50.690 INFO:tasks.workunit.client.0.smithi138.stdout:3/190: write d5/d18/f24 [293790,38091] 0 2024-02-15T22:50:50.695 INFO:tasks.workunit.client.0.smithi138.stdout:2/145: dwrite d0/f36 [8388608,4194304] 0 2024-02-15T22:50:50.695 INFO:tasks.workunit.client.0.smithi138.stdout:7/319: dwrite d1/d2/f30 [0,4194304] 0 2024-02-15T22:50:50.696 INFO:tasks.workunit.client.0.smithi138.stdout:9/100: dwrite d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:50.696 INFO:tasks.workunit.client.0.smithi138.stdout:1/115: dread df/f11 [0,4194304] 0 2024-02-15T22:50:50.696 INFO:tasks.workunit.client.0.smithi138.stdout:1/116: chown df/f11 427693550 1 2024-02-15T22:50:50.698 INFO:tasks.workunit.client.0.smithi138.stdout:3/191: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:50.698 INFO:tasks.workunit.client.0.smithi138.stdout:3/192: truncate d5/d16/fa 1204758 0 2024-02-15T22:50:50.698 INFO:tasks.workunit.client.0.smithi138.stdout:3/193: truncate d5/d16/f3c 281613 0 2024-02-15T22:50:50.699 INFO:tasks.workunit.client.0.smithi138.stdout:8/123: dwrite f0 [0,4194304] 0 2024-02-15T22:50:50.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/146: creat d0/da/f3a x:0 0 0 2024-02-15T22:50:50.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/147: write d0/da/f33 [232233,18824] 0 2024-02-15T22:50:50.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/148: stat d0 0 2024-02-15T22:50:50.704 INFO:tasks.workunit.client.0.smithi138.stdout:2/149: write d0/da/f3a [953923,26378] 0 2024-02-15T22:50:50.704 INFO:tasks.workunit.client.0.smithi138.stdout:1/117: dread fe [0,4194304] 0 2024-02-15T22:50:50.707 INFO:tasks.workunit.client.0.smithi138.stdout:7/320: creat d1/d2/db/d3c/f75 x:0 0 0 2024-02-15T22:50:50.710 INFO:tasks.workunit.client.0.smithi138.stdout:8/124: dread f5 [0,4194304] 0 2024-02-15T22:50:50.710 INFO:tasks.workunit.client.0.smithi138.stdout:2/150: dread d0/da/f27 [0,4194304] 0 2024-02-15T22:50:50.710 INFO:tasks.workunit.client.0.smithi138.stdout:8/125: creat db/f28 x:0 0 0 2024-02-15T22:50:50.710 INFO:tasks.workunit.client.0.smithi138.stdout:2/151: creat d0/f3b x:0 0 0 2024-02-15T22:50:50.711 INFO:tasks.workunit.client.0.smithi138.stdout:2/152: creat d0/dd/f3c x:0 0 0 2024-02-15T22:50:50.711 INFO:tasks.workunit.client.0.smithi138.stdout:2/153: stat d0/f37 0 2024-02-15T22:50:50.711 INFO:tasks.workunit.client.0.smithi138.stdout:2/154: chown d0/d3/c34 465 1 2024-02-15T22:50:50.711 INFO:tasks.workunit.client.0.smithi138.stdout:7/321: getdents d1/d5a 0 2024-02-15T22:50:50.714 INFO:tasks.workunit.client.0.smithi138.stdout:8/126: getdents db/dd/d13 0 2024-02-15T22:50:50.716 INFO:tasks.workunit.client.0.smithi138.stdout:3/194: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:50.717 INFO:tasks.workunit.client.0.smithi138.stdout:6/165: sync 2024-02-15T22:50:50.717 INFO:tasks.workunit.client.0.smithi138.stdout:6/166: write dc/f13 [4429818,42007] 0 2024-02-15T22:50:50.717 INFO:tasks.workunit.client.0.smithi138.stdout:4/349: sync 2024-02-15T22:50:50.718 INFO:tasks.workunit.client.0.smithi138.stdout:7/322: unlink d1/d2/db/d2a/l2f 0 2024-02-15T22:50:50.718 INFO:tasks.workunit.client.0.smithi138.stdout:7/323: chown d1/d2/f1d 665047 1 2024-02-15T22:50:50.718 INFO:tasks.workunit.client.0.smithi138.stdout:7/324: readlink d1/l13 0 2024-02-15T22:50:50.719 INFO:tasks.workunit.client.0.smithi138.stdout:2/155: symlink d0/d3/l3d 0 2024-02-15T22:50:50.721 INFO:tasks.workunit.client.0.smithi138.stdout:4/350: mknod d17/d1e/c73 0 2024-02-15T22:50:50.721 INFO:tasks.workunit.client.0.smithi138.stdout:4/351: creat d17/d1e/d2d/d52/f74 x:0 0 0 2024-02-15T22:50:50.722 INFO:tasks.workunit.client.0.smithi138.stdout:5/77: dwrite fd [0,4194304] 0 2024-02-15T22:50:50.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/195: dread d5/d16/fa [0,4194304] 0 2024-02-15T22:50:50.723 INFO:tasks.workunit.client.0.smithi138.stdout:2/156: creat d0/dd/d15/f3e x:0 0 0 2024-02-15T22:50:50.725 INFO:tasks.workunit.client.0.smithi138.stdout:4/352: mknod d17/d1e/c75 0 2024-02-15T22:50:50.727 INFO:tasks.workunit.client.0.smithi138.stdout:8/127: dread db/dd/d13/f21 [0,4194304] 0 2024-02-15T22:50:50.728 INFO:tasks.workunit.client.0.smithi138.stdout:1/118: dwrite df/d1b/d1d/d24/f26 [0,4194304] 0 2024-02-15T22:50:50.728 INFO:tasks.workunit.client.0.smithi138.stdout:1/119: write fe [800997,31446] 0 2024-02-15T22:50:50.729 INFO:tasks.workunit.client.0.smithi138.stdout:2/157: mkdir d0/da/d19/d3f 0 2024-02-15T22:50:50.729 INFO:tasks.workunit.client.0.smithi138.stdout:4/353: write d17/d1e/d2d/f31 [884504,94498] 0 2024-02-15T22:50:50.735 INFO:tasks.workunit.client.0.smithi138.stdout:1/120: creat df/d1b/f27 x:0 0 0 2024-02-15T22:50:50.736 INFO:tasks.workunit.client.0.smithi138.stdout:1/121: chown df/d1b/f27 139 1 2024-02-15T22:50:50.739 INFO:tasks.workunit.client.0.smithi138.stdout:9/101: dwrite d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:50.740 INFO:tasks.workunit.client.0.smithi138.stdout:9/102: creat d0/f1e x:0 0 0 2024-02-15T22:50:50.740 INFO:tasks.workunit.client.0.smithi138.stdout:9/103: creat d0/f1f x:0 0 0 2024-02-15T22:50:50.740 INFO:tasks.workunit.client.0.smithi138.stdout:9/104: readlink d0/d4/l1a 0 2024-02-15T22:50:50.740 INFO:tasks.workunit.client.0.smithi138.stdout:2/158: mknod d0/dd/c40 0 2024-02-15T22:50:50.740 INFO:tasks.workunit.client.0.smithi138.stdout:2/159: read - d0/dd/f3c zero size 2024-02-15T22:50:50.742 INFO:tasks.workunit.client.0.smithi138.stdout:4/354: unlink fd 0 2024-02-15T22:50:50.742 INFO:tasks.workunit.client.0.smithi138.stdout:4/355: chown d17/d1e/d2d/d36 43969 1 2024-02-15T22:50:50.742 INFO:tasks.workunit.client.0.smithi138.stdout:4/356: fdatasync f10 0 2024-02-15T22:50:50.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/122: creat df/d1b/d1d/f28 x:0 0 0 2024-02-15T22:50:50.743 INFO:tasks.workunit.client.0.smithi138.stdout:2/160: dread d0/f37 [0,4194304] 0 2024-02-15T22:50:50.749 INFO:tasks.workunit.client.0.smithi138.stdout:4/357: creat d17/d1e/d2d/d36/d3e/d64/f76 x:0 0 0 2024-02-15T22:50:50.753 INFO:tasks.workunit.client.0.smithi138.stdout:4/358: rename d17/d1e/d2d/d36/d3e/d64/f5f to d17/d2b/f77 0 2024-02-15T22:50:50.759 INFO:tasks.workunit.client.0.smithi138.stdout:4/359: dread d17/d1e/d2d/d52/f72 [0,4194304] 0 2024-02-15T22:50:50.764 INFO:tasks.workunit.client.0.smithi138.stdout:4/360: read f8 [1740999,90659] 0 2024-02-15T22:50:50.765 INFO:tasks.workunit.client.0.smithi138.stdout:4/361: mkdir d17/d2b/d78 0 2024-02-15T22:50:50.765 INFO:tasks.workunit.client.0.smithi138.stdout:4/362: getdents d17/d2b/d78 0 2024-02-15T22:50:50.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/363: readlink d17/d1e/d2d/d36/d3e/l58 0 2024-02-15T22:50:50.766 INFO:tasks.workunit.client.0.smithi138.stdout:4/364: write d17/d1e/f4d [1093937,15170] 0 2024-02-15T22:50:50.767 INFO:tasks.workunit.client.0.smithi138.stdout:4/365: mknod d17/d1a/c79 0 2024-02-15T22:50:50.767 INFO:tasks.workunit.client.0.smithi138.stdout:4/366: truncate d17/d1e/d2d/d36/f4a 182391 0 2024-02-15T22:50:50.768 INFO:tasks.workunit.client.0.smithi138.stdout:4/367: link d17/d1e/f3f d17/d1e/d56/f7a 0 2024-02-15T22:50:50.768 INFO:tasks.workunit.client.0.smithi138.stdout:4/368: dread - d17/d1e/d2d/f61 zero size 2024-02-15T22:50:50.768 INFO:tasks.workunit.client.0.smithi138.stdout:4/369: creat d17/f7b x:0 0 0 2024-02-15T22:50:50.769 INFO:tasks.workunit.client.0.smithi138.stdout:4/370: creat d17/d1e/d2d/f7c x:0 0 0 2024-02-15T22:50:50.770 INFO:tasks.workunit.client.0.smithi138.stdout:7/325: dwrite d1/d2/db/f49 [0,4194304] 0 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:7/326: creat d1/d2/db/d3c/d4d/d5b/f76 x:0 0 0 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/78: dwrite fd [0,4194304] 0 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/79: creat df/f15 x:0 0 0 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/80: dread - df/f15 zero size 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:5/81: creat df/f16 x:0 0 0 2024-02-15T22:50:50.774 INFO:tasks.workunit.client.0.smithi138.stdout:3/196: dwrite d5/d18/f30 [0,4194304] 0 2024-02-15T22:50:50.775 INFO:tasks.workunit.client.0.smithi138.stdout:9/105: dwrite d0/de/d14/f1b [0,4194304] 0 2024-02-15T22:50:50.775 INFO:tasks.workunit.client.0.smithi138.stdout:6/167: dwrite f0 [0,4194304] 0 2024-02-15T22:50:50.776 INFO:tasks.workunit.client.0.smithi138.stdout:8/128: dwrite db/f10 [0,4194304] 0 2024-02-15T22:50:50.777 INFO:tasks.workunit.client.0.smithi138.stdout:2/161: dwrite d0/dd/f18 [4194304,4194304] 0 2024-02-15T22:50:50.777 INFO:tasks.workunit.client.0.smithi138.stdout:2/162: chown d0/f37 8 1 2024-02-15T22:50:50.784 INFO:tasks.workunit.client.0.smithi138.stdout:3/197: mknod d5/d16/c3e 0 2024-02-15T22:50:50.786 INFO:tasks.workunit.client.0.smithi138.stdout:9/106: link d0/de/d14/f1b d0/f20 0 2024-02-15T22:50:50.787 INFO:tasks.workunit.client.0.smithi138.stdout:2/163: truncate d0/dd/d15/f1f 1362424 0 2024-02-15T22:50:50.788 INFO:tasks.workunit.client.0.smithi138.stdout:4/371: dwrite d17/d2b/f3d [0,4194304] 0 2024-02-15T22:50:50.789 INFO:tasks.workunit.client.0.smithi138.stdout:3/198: rename d5/l7 to d5/d12/d23/d29/l3f 0 2024-02-15T22:50:50.790 INFO:tasks.workunit.client.0.smithi138.stdout:8/129: dread db/fc [0,4194304] 0 2024-02-15T22:50:50.790 INFO:tasks.workunit.client.0.smithi138.stdout:8/130: chown db/dd/d13 112 1 2024-02-15T22:50:50.790 INFO:tasks.workunit.client.0.smithi138.stdout:8/131: creat db/f29 x:0 0 0 2024-02-15T22:50:50.791 INFO:tasks.workunit.client.0.smithi138.stdout:9/107: symlink d0/de/d14/l21 0 2024-02-15T22:50:50.793 INFO:tasks.workunit.client.0.smithi138.stdout:2/164: rename d0/da/ce to d0/dd/d15/c41 0 2024-02-15T22:50:50.794 INFO:tasks.workunit.client.0.smithi138.stdout:2/165: stat d0/d3/cb 0 2024-02-15T22:50:50.797 INFO:tasks.workunit.client.0.smithi138.stdout:8/132: mknod db/dd/d22/c2a 0 2024-02-15T22:50:50.799 INFO:tasks.workunit.client.0.smithi138.stdout:9/108: mkdir d0/de/d14/d22 0 2024-02-15T22:50:50.799 INFO:tasks.workunit.client.0.smithi138.stdout:1/123: rmdir df/d1b/d1d 39 2024-02-15T22:50:50.799 INFO:tasks.workunit.client.0.smithi138.stdout:1/124: dread - df/d1b/f27 zero size 2024-02-15T22:50:50.803 INFO:tasks.workunit.client.0.smithi138.stdout:9/109: truncate d0/df/d11/f13 2356353 0 2024-02-15T22:50:50.803 INFO:tasks.workunit.client.0.smithi138.stdout:9/110: stat d0/f8 0 2024-02-15T22:50:50.805 INFO:tasks.workunit.client.0.smithi138.stdout:2/166: dread d0/f36 [8388608,4194304] 0 2024-02-15T22:50:50.806 INFO:tasks.workunit.client.0.smithi138.stdout:2/167: write d0/da/d19/f2a [227271,846] 0 2024-02-15T22:50:50.806 INFO:tasks.workunit.client.0.smithi138.stdout:2/168: write d0/dd/d15/f3e [741353,121025] 0 2024-02-15T22:50:50.809 INFO:tasks.workunit.client.0.smithi138.stdout:6/168: dwrite dc/d24/f2c [0,4194304] 0 2024-02-15T22:50:50.809 INFO:tasks.workunit.client.0.smithi138.stdout:9/111: mkdir d0/df/d11/d23 0 2024-02-15T22:50:50.809 INFO:tasks.workunit.client.0.smithi138.stdout:8/133: dread f3 [0,4194304] 0 2024-02-15T22:50:50.813 INFO:tasks.workunit.client.0.smithi138.stdout:4/372: dwrite d17/d1e/d56/f7a [0,4194304] 0 2024-02-15T22:50:50.813 INFO:tasks.workunit.client.0.smithi138.stdout:6/169: rename dc/d24/c30 to dc/d24/c3c 0 2024-02-15T22:50:50.815 INFO:tasks.workunit.client.0.smithi138.stdout:9/112: mknod d0/de/c24 0 2024-02-15T22:50:50.820 INFO:tasks.workunit.client.0.smithi138.stdout:4/373: write d17/d1e/d2d/f61 [614640,129986] 0 2024-02-15T22:50:50.820 INFO:tasks.workunit.client.0.smithi138.stdout:7/327: dwrite d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:50.820 INFO:tasks.workunit.client.0.smithi138.stdout:7/328: readlink d1/d2/db/l71 0 2024-02-15T22:50:50.820 INFO:tasks.workunit.client.0.smithi138.stdout:7/329: write d1/d2/db/fe [2537614,122551] 0 2024-02-15T22:50:50.825 INFO:tasks.workunit.client.0.smithi138.stdout:1/125: dwrite df/f12 [0,4194304] 0 2024-02-15T22:50:50.828 INFO:tasks.workunit.client.0.smithi138.stdout:2/169: dwrite d0/f37 [0,4194304] 0 2024-02-15T22:50:50.829 INFO:tasks.workunit.client.0.smithi138.stdout:6/170: mknod dc/d24/d34/c3d 0 2024-02-15T22:50:50.830 INFO:tasks.workunit.client.0.smithi138.stdout:5/82: getdents df 0 2024-02-15T22:50:50.832 INFO:tasks.workunit.client.0.smithi138.stdout:3/199: getdents d5/d16 0 2024-02-15T22:50:50.836 INFO:tasks.workunit.client.0.smithi138.stdout:4/374: symlink d17/d1e/d2d/l7d 0 2024-02-15T22:50:50.842 INFO:tasks.workunit.client.0.smithi138.stdout:9/113: dwrite d0/f20 [4194304,4194304] 0 2024-02-15T22:50:50.842 INFO:tasks.workunit.client.0.smithi138.stdout:6/171: write dc/f1a [1537788,90204] 0 2024-02-15T22:50:50.842 INFO:tasks.workunit.client.0.smithi138.stdout:6/172: creat dc/f3e x:0 0 0 2024-02-15T22:50:50.846 INFO:tasks.workunit.client.0.smithi138.stdout:1/126: dwrite fa [0,4194304] 0 2024-02-15T22:50:50.846 INFO:tasks.workunit.client.0.smithi138.stdout:1/127: dread - df/d1b/f27 zero size 2024-02-15T22:50:50.846 INFO:tasks.workunit.client.0.smithi138.stdout:1/128: chown df 513 1 2024-02-15T22:50:50.849 INFO:tasks.workunit.client.0.smithi138.stdout:3/200: dwrite d5/d16/dc/f1a [4194304,4194304] 0 2024-02-15T22:50:50.858 INFO:tasks.workunit.client.0.smithi138.stdout:7/330: rename d1/d2/db/d25/l3d to d1/d2/db/d2a/l77 0 2024-02-15T22:50:50.858 INFO:tasks.workunit.client.0.smithi138.stdout:4/375: rename d17 to d17/d1e/d2d/d52/d7e 22 2024-02-15T22:50:50.859 INFO:tasks.workunit.client.0.smithi138.stdout:7/331: fsync d1/d2/f31 0 2024-02-15T22:50:50.861 INFO:tasks.workunit.client.0.smithi138.stdout:7/332: write d1/d5a/f6d [830500,64790] 0 2024-02-15T22:50:50.861 INFO:tasks.workunit.client.0.smithi138.stdout:7/333: chown d1/f42 64501 1 2024-02-15T22:50:50.861 INFO:tasks.workunit.client.0.smithi138.stdout:7/334: fdatasync d1/d2/db/f20 0 2024-02-15T22:50:50.861 INFO:tasks.workunit.client.0.smithi138.stdout:7/335: creat d1/d2/db/d3c/d4d/f78 x:0 0 0 2024-02-15T22:50:50.861 INFO:tasks.workunit.client.0.smithi138.stdout:5/83: unlink df/c14 0 2024-02-15T22:50:50.863 INFO:tasks.workunit.client.0.smithi138.stdout:9/114: mknod d0/d4/c25 0 2024-02-15T22:50:50.863 INFO:tasks.workunit.client.0.smithi138.stdout:9/115: write d0/f1e [699238,87061] 0 2024-02-15T22:50:50.865 INFO:tasks.workunit.client.0.smithi138.stdout:6/173: stat dc/d24/l32 0 2024-02-15T22:50:50.865 INFO:tasks.workunit.client.0.smithi138.stdout:6/174: fsync dc/d24/f27 0 2024-02-15T22:50:50.867 INFO:tasks.workunit.client.0.smithi138.stdout:3/201: mknod d5/d16/c40 0 2024-02-15T22:50:50.869 INFO:tasks.workunit.client.0.smithi138.stdout:2/170: unlink d0/dd/d15/f1f 0 2024-02-15T22:50:50.871 INFO:tasks.workunit.client.0.smithi138.stdout:7/336: mkdir d1/d79 0 2024-02-15T22:50:50.872 INFO:tasks.workunit.client.0.smithi138.stdout:7/337: write d1/d2/db/d3c/f61 [103056,27652] 0 2024-02-15T22:50:50.873 INFO:tasks.workunit.client.0.smithi138.stdout:9/116: symlink d0/d1/l26 0 2024-02-15T22:50:50.874 INFO:tasks.workunit.client.0.smithi138.stdout:6/175: symlink dc/d24/l3f 0 2024-02-15T22:50:50.876 INFO:tasks.workunit.client.0.smithi138.stdout:2/171: unlink d0/dd/f3c 0 2024-02-15T22:50:50.877 INFO:tasks.workunit.client.0.smithi138.stdout:7/338: symlink d1/l7a 0 2024-02-15T22:50:50.879 INFO:tasks.workunit.client.0.smithi138.stdout:3/202: symlink d5/l41 0 2024-02-15T22:50:50.880 INFO:tasks.workunit.client.0.smithi138.stdout:3/203: read - d5/d12/f2a zero size 2024-02-15T22:50:50.880 INFO:tasks.workunit.client.0.smithi138.stdout:3/204: stat d5/d16/f3c 0 2024-02-15T22:50:50.880 INFO:tasks.workunit.client.0.smithi138.stdout:0/119: sync 2024-02-15T22:50:50.880 INFO:tasks.workunit.client.0.smithi138.stdout:0/120: truncate d6/d10/d18/d1b/f22 1402454 0 2024-02-15T22:50:50.881 INFO:tasks.workunit.client.0.smithi138.stdout:0/121: symlink d6/d10/d18/l2d 0 2024-02-15T22:50:50.882 INFO:tasks.workunit.client.0.smithi138.stdout:9/117: dread d0/df/d11/f13 [0,4194304] 0 2024-02-15T22:50:50.882 INFO:tasks.workunit.client.0.smithi138.stdout:9/118: readlink d0/d4/l1a 0 2024-02-15T22:50:50.882 INFO:tasks.workunit.client.0.smithi138.stdout:9/119: chown d0 7078739 1 2024-02-15T22:50:50.883 INFO:tasks.workunit.client.0.smithi138.stdout:9/120: truncate d0/f1f 963724 0 2024-02-15T22:50:50.883 INFO:tasks.workunit.client.0.smithi138.stdout:9/121: fdatasync d0/d4/f5 0 2024-02-15T22:50:50.883 INFO:tasks.workunit.client.0.smithi138.stdout:5/84: getdents df 0 2024-02-15T22:50:50.885 INFO:tasks.workunit.client.0.smithi138.stdout:5/85: creat df/f17 x:0 0 0 2024-02-15T22:50:50.885 INFO:tasks.workunit.client.0.smithi138.stdout:5/86: read - df/f17 zero size 2024-02-15T22:50:50.887 INFO:tasks.workunit.client.0.smithi138.stdout:3/205: dread d5/d12/d23/f28 [0,4194304] 0 2024-02-15T22:50:50.887 INFO:tasks.workunit.client.0.smithi138.stdout:3/206: chown d5/l41 367487 1 2024-02-15T22:50:50.887 INFO:tasks.workunit.client.0.smithi138.stdout:5/87: mkdir df/d18 0 2024-02-15T22:50:50.888 INFO:tasks.workunit.client.0.smithi138.stdout:3/207: symlink d5/d12/d26/d2f/l42 0 2024-02-15T22:50:50.889 INFO:tasks.workunit.client.0.smithi138.stdout:5/88: creat df/f19 x:0 0 0 2024-02-15T22:50:50.891 INFO:tasks.workunit.client.0.smithi138.stdout:5/89: write df/f13 [144266,39095] 0 2024-02-15T22:50:50.891 INFO:tasks.workunit.client.0.smithi138.stdout:5/90: creat df/f1a x:0 0 0 2024-02-15T22:50:50.893 INFO:tasks.workunit.client.0.smithi138.stdout:6/176: dread dc/ff [0,4194304] 0 2024-02-15T22:50:50.893 INFO:tasks.workunit.client.0.smithi138.stdout:4/376: dwrite d17/d1a/f50 [0,4194304] 0 2024-02-15T22:50:50.893 INFO:tasks.workunit.client.0.smithi138.stdout:0/122: read d6/d10/f14 [512251,13273] 0 2024-02-15T22:50:50.893 INFO:tasks.workunit.client.0.smithi138.stdout:0/123: truncate d6/d10/d18/f1d 4986391 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:6/177: write dc/d24/f31 [817083,123151] 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:0/124: write d6/d10/f11 [952598,10697] 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:5/91: rename c4 to df/d18/c1b 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:5/92: dread - df/f19 zero size 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:5/93: write df/f1a [16359,122261] 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:5/94: truncate df/f1a 166963 0 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:5/95: chown fb 115255 1 2024-02-15T22:50:50.894 INFO:tasks.workunit.client.0.smithi138.stdout:6/178: dread dc/f3a [0,4194304] 0 2024-02-15T22:50:50.895 INFO:tasks.workunit.client.0.smithi138.stdout:6/179: creat dc/f40 x:0 0 0 2024-02-15T22:50:50.895 INFO:tasks.workunit.client.0.smithi138.stdout:3/208: getdents d5/d16 0 2024-02-15T22:50:50.899 INFO:tasks.workunit.client.0.smithi138.stdout:4/377: mknod d17/d2b/c7f 0 2024-02-15T22:50:50.900 INFO:tasks.workunit.client.0.smithi138.stdout:0/125: mknod d6/c2e 0 2024-02-15T22:50:50.902 INFO:tasks.workunit.client.0.smithi138.stdout:6/180: creat dc/d24/d34/d3b/f41 x:0 0 0 2024-02-15T22:50:50.902 INFO:tasks.workunit.client.0.smithi138.stdout:6/181: readlink dc/l2b 0 2024-02-15T22:50:50.902 INFO:tasks.workunit.client.0.smithi138.stdout:6/182: read - dc/d24/f39 zero size 2024-02-15T22:50:50.902 INFO:tasks.workunit.client.0.smithi138.stdout:3/209: mkdir d5/d16/dc/d43 0 2024-02-15T22:50:50.902 INFO:tasks.workunit.client.0.smithi138.stdout:3/210: chown d5/d18/f30 7960 1 2024-02-15T22:50:50.903 INFO:tasks.workunit.client.0.smithi138.stdout:6/183: write dc/d24/f31 [123426,118636] 0 2024-02-15T22:50:50.903 INFO:tasks.workunit.client.0.smithi138.stdout:6/184: chown dc/l1d 57786657 1 2024-02-15T22:50:50.903 INFO:tasks.workunit.client.0.smithi138.stdout:9/122: getdents d0/d1 0 2024-02-15T22:50:50.903 INFO:tasks.workunit.client.0.smithi138.stdout:9/123: fsync d0/f20 0 2024-02-15T22:50:50.904 INFO:tasks.workunit.client.0.smithi138.stdout:6/185: dread dc/f2a [0,4194304] 0 2024-02-15T22:50:50.904 INFO:tasks.workunit.client.0.smithi138.stdout:6/186: creat dc/d24/d34/d3b/f42 x:0 0 0 2024-02-15T22:50:50.905 INFO:tasks.workunit.client.0.smithi138.stdout:2/172: dwrite d0/da/d19/f1b [0,4194304] 0 2024-02-15T22:50:50.906 INFO:tasks.workunit.client.0.smithi138.stdout:3/211: symlink d5/d12/d23/l44 0 2024-02-15T22:50:50.908 INFO:tasks.workunit.client.0.smithi138.stdout:7/339: dwrite d1/d2/f73 [0,4194304] 0 2024-02-15T22:50:50.908 INFO:tasks.workunit.client.0.smithi138.stdout:7/340: creat d1/d2/db/f7b x:0 0 0 2024-02-15T22:50:50.908 INFO:tasks.workunit.client.0.smithi138.stdout:7/341: truncate d1/d2/db/d2a/d64/f67 904635 0 2024-02-15T22:50:50.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/124: rename d0/f1f to d0/f27 0 2024-02-15T22:50:50.910 INFO:tasks.workunit.client.0.smithi138.stdout:5/96: dwrite df/f19 [0,4194304] 0 2024-02-15T22:50:50.911 INFO:tasks.workunit.client.0.smithi138.stdout:6/187: mkdir dc/d24/d34/d3b/d43 0 2024-02-15T22:50:50.914 INFO:tasks.workunit.client.0.smithi138.stdout:3/212: symlink d5/d12/d26/d2f/l45 0 2024-02-15T22:50:50.917 INFO:tasks.workunit.client.0.smithi138.stdout:4/378: dwrite d17/d1e/d2d/f31 [0,4194304] 0 2024-02-15T22:50:50.918 INFO:tasks.workunit.client.0.smithi138.stdout:9/125: dread d0/de/d14/f1b [0,4194304] 0 2024-02-15T22:50:50.918 INFO:tasks.workunit.client.0.smithi138.stdout:7/342: mkdir d1/d28/d7c 0 2024-02-15T22:50:50.919 INFO:tasks.workunit.client.0.smithi138.stdout:0/126: getdents d6 0 2024-02-15T22:50:50.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/213: write d5/d12/d23/f28 [1738381,10855] 0 2024-02-15T22:50:50.923 INFO:tasks.workunit.client.0.smithi138.stdout:5/97: readlink df/l10 0 2024-02-15T22:50:50.924 INFO:tasks.workunit.client.0.smithi138.stdout:6/188: mknod dc/d24/c44 0 2024-02-15T22:50:50.924 INFO:tasks.workunit.client.0.smithi138.stdout:6/189: creat dc/d24/d34/d3b/f45 x:0 0 0 2024-02-15T22:50:50.926 INFO:tasks.workunit.client.0.smithi138.stdout:2/173: rename d0/l9 to d0/d3/l42 0 2024-02-15T22:50:50.926 INFO:tasks.workunit.client.0.smithi138.stdout:2/174: creat d0/dd/d15/f43 x:0 0 0 2024-02-15T22:50:50.930 INFO:tasks.workunit.client.0.smithi138.stdout:0/127: read d6/f24 [245380,63298] 0 2024-02-15T22:50:50.931 INFO:tasks.workunit.client.0.smithi138.stdout:4/379: creat d17/d2b/f80 x:0 0 0 2024-02-15T22:50:50.931 INFO:tasks.workunit.client.0.smithi138.stdout:4/380: truncate d17/d1e/d2d/d36/f68 235233 0 2024-02-15T22:50:50.931 INFO:tasks.workunit.client.0.smithi138.stdout:4/381: readlink d17/d2b/l63 0 2024-02-15T22:50:50.933 INFO:tasks.workunit.client.0.smithi138.stdout:9/126: mknod d0/d4/c28 0 2024-02-15T22:50:50.940 INFO:tasks.workunit.client.0.smithi138.stdout:6/190: getdents dc/d24/d34 0 2024-02-15T22:50:50.943 INFO:tasks.workunit.client.0.smithi138.stdout:5/98: symlink df/l1c 0 2024-02-15T22:50:50.946 INFO:tasks.workunit.client.0.smithi138.stdout:0/128: dread f4 [4194304,4194304] 0 2024-02-15T22:50:50.946 INFO:tasks.workunit.client.0.smithi138.stdout:5/99: link df/l10 df/l1d 0 2024-02-15T22:50:50.946 INFO:tasks.workunit.client.0.smithi138.stdout:5/100: truncate df/f17 666371 0 2024-02-15T22:50:50.947 INFO:tasks.workunit.client.0.smithi138.stdout:5/101: readlink df/l12 0 2024-02-15T22:50:50.948 INFO:tasks.workunit.client.0.smithi138.stdout:0/129: getdents d6/d10/d13 0 2024-02-15T22:50:50.950 INFO:tasks.workunit.client.0.smithi138.stdout:9/127: read d0/de/d14/f1b [4397621,114734] 0 2024-02-15T22:50:50.950 INFO:tasks.workunit.client.0.smithi138.stdout:9/128: write d0/df/d11/f13 [1684319,40696] 0 2024-02-15T22:50:50.950 INFO:tasks.workunit.client.0.smithi138.stdout:7/343: dwrite d1/d2/db/f1c [4194304,4194304] 0 2024-02-15T22:50:50.950 INFO:tasks.workunit.client.0.smithi138.stdout:7/344: chown d1/d2/db/d3c/d6a/c59 266413044 1 2024-02-15T22:50:50.951 INFO:tasks.workunit.client.0.smithi138.stdout:2/175: dwrite d0/dd/f2c [0,4194304] 0 2024-02-15T22:50:50.951 INFO:tasks.workunit.client.0.smithi138.stdout:2/176: write d0/d3/f2b [416750,89881] 0 2024-02-15T22:50:50.951 INFO:tasks.workunit.client.0.smithi138.stdout:7/345: symlink d1/d28/d7c/l7d 0 2024-02-15T22:50:50.960 INFO:tasks.workunit.client.0.smithi138.stdout:2/177: dread d0/da/f8 [0,4194304] 0 2024-02-15T22:50:50.961 INFO:tasks.workunit.client.0.smithi138.stdout:6/191: dwrite dc/f3a [0,4194304] 0 2024-02-15T22:50:50.961 INFO:tasks.workunit.client.0.smithi138.stdout:6/192: write dc/fe [2602459,93109] 0 2024-02-15T22:50:50.961 INFO:tasks.workunit.client.0.smithi138.stdout:0/130: dread d6/d10/d18/d1b/f23 [0,4194304] 0 2024-02-15T22:50:50.964 INFO:tasks.workunit.client.0.smithi138.stdout:0/131: link d6/d10/d18/c1c d6/d10/c2f 0 2024-02-15T22:50:50.964 INFO:tasks.workunit.client.0.smithi138.stdout:0/132: dread - d6/d10/d13/f25 zero size 2024-02-15T22:50:50.967 INFO:tasks.workunit.client.0.smithi138.stdout:5/102: dread df/f19 [0,4194304] 0 2024-02-15T22:50:50.967 INFO:tasks.workunit.client.0.smithi138.stdout:4/382: dread d17/d1e/f1f [0,4194304] 0 2024-02-15T22:50:50.968 INFO:tasks.workunit.client.0.smithi138.stdout:5/103: creat df/d18/f1e x:0 0 0 2024-02-15T22:50:50.970 INFO:tasks.workunit.client.0.smithi138.stdout:9/129: dwrite d0/d4/f5 [4194304,4194304] 0 2024-02-15T22:50:50.971 INFO:tasks.workunit.client.0.smithi138.stdout:5/104: dread df/f17 [0,4194304] 0 2024-02-15T22:50:50.974 INFO:tasks.workunit.client.0.smithi138.stdout:4/383: dread d17/d1e/d56/f5c [0,4194304] 0 2024-02-15T22:50:50.974 INFO:tasks.workunit.client.0.smithi138.stdout:4/384: write d17/f6a [15831,81066] 0 2024-02-15T22:50:50.975 INFO:tasks.workunit.client.0.smithi138.stdout:4/385: mknod d17/d1e/d56/c81 0 2024-02-15T22:50:50.978 INFO:tasks.workunit.client.0.smithi138.stdout:4/386: getdents d17/d1e/d2d/d52 0 2024-02-15T22:50:50.980 INFO:tasks.workunit.client.0.smithi138.stdout:4/387: symlink d17/d1e/d56/l82 0 2024-02-15T22:50:50.983 INFO:tasks.workunit.client.0.smithi138.stdout:2/178: dwrite d0/da/f23 [0,4194304] 0 2024-02-15T22:50:50.983 INFO:tasks.workunit.client.0.smithi138.stdout:2/179: fsync d0/f3b 0 2024-02-15T22:50:50.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:50 smithi138 ceph-mon[29229]: pgmap v8: 65 pgs: 65 active+clean; 188 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-02-15T22:50:50.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:50 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:50 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:50.991 INFO:tasks.workunit.client.0.smithi138.stdout:4/388: dread d17/d1e/d2d/d36/f6e [0,4194304] 0 2024-02-15T22:50:50.991 INFO:tasks.workunit.client.0.smithi138.stdout:7/346: dwrite d1/d5a/f6d [0,4194304] 0 2024-02-15T22:50:50.994 INFO:tasks.workunit.client.0.smithi138.stdout:4/389: mknod d17/c83 0 2024-02-15T22:50:50.995 INFO:tasks.workunit.client.0.smithi138.stdout:2/180: write d0/da/d19/f1b [2236460,60822] 0 2024-02-15T22:50:50.995 INFO:tasks.workunit.client.0.smithi138.stdout:0/133: dwrite d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:50:50.996 INFO:tasks.workunit.client.0.smithi138.stdout:9/130: dwrite d0/de/d14/f1b [0,4194304] 0 2024-02-15T22:50:50.997 INFO:tasks.workunit.client.0.smithi138.stdout:4/390: mkdir d17/d1e/d2d/d84 0 2024-02-15T22:50:51.001 INFO:tasks.workunit.client.0.smithi138.stdout:2/181: creat d0/d3/f44 x:0 0 0 2024-02-15T22:50:51.001 INFO:tasks.workunit.client.0.smithi138.stdout:9/131: dread d0/df/d11/f13 [0,4194304] 0 2024-02-15T22:50:51.002 INFO:tasks.workunit.client.0.smithi138.stdout:0/134: truncate f0 2501274 0 2024-02-15T22:50:51.003 INFO:tasks.workunit.client.0.smithi138.stdout:4/391: truncate d17/d2b/f4f 210127 0 2024-02-15T22:50:51.005 INFO:tasks.workunit.client.0.smithi138.stdout:9/132: symlink d0/df/d11/d23/l29 0 2024-02-15T22:50:51.005 INFO:tasks.workunit.client.0.smithi138.stdout:9/133: fdatasync d0/f8 0 2024-02-15T22:50:51.005 INFO:tasks.workunit.client.0.smithi138.stdout:9/134: creat d0/de/d14/f2a x:0 0 0 2024-02-15T22:50:51.005 INFO:tasks.workunit.client.0.smithi138.stdout:7/347: dwrite d1/d2/db/d3c/f4a [0,4194304] 0 2024-02-15T22:50:51.005 INFO:tasks.workunit.client.0.smithi138.stdout:4/392: fdatasync d17/d1e/f28 0 2024-02-15T22:50:51.011 INFO:tasks.workunit.client.0.smithi138.stdout:7/348: truncate d1/d2/db/f20 3082713 0 2024-02-15T22:50:51.015 INFO:tasks.workunit.client.0.smithi138.stdout:4/393: rename d17/f7b to d17/d1e/f85 0 2024-02-15T22:50:51.016 INFO:tasks.workunit.client.0.smithi138.stdout:4/394: dread - d17/d1e/f4b zero size 2024-02-15T22:50:51.016 INFO:tasks.workunit.client.0.smithi138.stdout:4/395: dread - d17/d1e/d2d/d36/f69 zero size 2024-02-15T22:50:51.016 INFO:tasks.workunit.client.0.smithi138.stdout:7/349: dread d1/d2/db/f16 [0,4194304] 0 2024-02-15T22:50:51.018 INFO:tasks.workunit.client.0.smithi138.stdout:9/135: dwrite d0/f19 [0,4194304] 0 2024-02-15T22:50:51.035 INFO:tasks.workunit.client.0.smithi138.stdout:9/136: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:51.035 INFO:tasks.workunit.client.0.smithi138.stdout:9/137: creat d0/d4/f2b x:0 0 0 2024-02-15T22:50:51.036 INFO:tasks.workunit.client.0.smithi138.stdout:9/138: creat d0/d4/f2c x:0 0 0 2024-02-15T22:50:51.036 INFO:tasks.workunit.client.0.smithi138.stdout:9/139: creat d0/f2d x:0 0 0 2024-02-15T22:50:51.040 INFO:tasks.workunit.client.0.smithi138.stdout:4/396: dwrite f10 [4194304,4194304] 0 2024-02-15T22:50:51.040 INFO:tasks.workunit.client.0.smithi138.stdout:4/397: read d17/f49 [1302011,32498] 0 2024-02-15T22:50:51.041 INFO:tasks.workunit.client.0.smithi138.stdout:9/140: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:51.041 INFO:tasks.workunit.client.0.smithi138.stdout:4/398: truncate d17/d1e/d56/f7a 582464 0 2024-02-15T22:50:51.041 INFO:tasks.workunit.client.0.smithi138.stdout:7/350: dwrite d1/f6b [0,4194304] 0 2024-02-15T22:50:51.041 INFO:tasks.workunit.client.0.smithi138.stdout:9/141: mkdir d0/d2e 0 2024-02-15T22:50:51.043 INFO:tasks.workunit.client.0.smithi138.stdout:4/399: symlink d17/d2b/l86 0 2024-02-15T22:50:51.043 INFO:tasks.workunit.client.0.smithi138.stdout:4/400: chown d17/d1e/d2d/d36/d3e/d64/l6b 127 1 2024-02-15T22:50:51.043 INFO:tasks.workunit.client.0.smithi138.stdout:7/351: stat d1/c6e 0 2024-02-15T22:50:51.045 INFO:tasks.workunit.client.0.smithi138.stdout:9/142: creat d0/df/d11/d23/f2f x:0 0 0 2024-02-15T22:50:51.047 INFO:tasks.workunit.client.0.smithi138.stdout:7/352: creat d1/d5a/f7e x:0 0 0 2024-02-15T22:50:51.047 INFO:tasks.workunit.client.0.smithi138.stdout:7/353: chown d1/c37 1440 1 2024-02-15T22:50:51.049 INFO:tasks.workunit.client.0.smithi138.stdout:7/354: unlink d1/d2/db/d2a/f34 0 2024-02-15T22:50:51.049 INFO:tasks.workunit.client.0.smithi138.stdout:7/355: chown d1/d2/db/d3c/d4d/d5b/f76 5 1 2024-02-15T22:50:51.050 INFO:tasks.workunit.client.0.smithi138.stdout:7/356: creat d1/d2/db/d3c/d6a/f7f x:0 0 0 2024-02-15T22:50:51.050 INFO:tasks.workunit.client.0.smithi138.stdout:7/357: stat d1/d2/ff 0 2024-02-15T22:50:51.051 INFO:tasks.workunit.client.0.smithi138.stdout:7/358: creat d1/d2/f80 x:0 0 0 2024-02-15T22:50:51.051 INFO:tasks.workunit.client.0.smithi138.stdout:7/359: fdatasync d1/d2/db/d3c/f61 0 2024-02-15T22:50:51.052 INFO:tasks.workunit.client.0.smithi138.stdout:7/360: mknod d1/d2/db/d3c/d6a/c81 0 2024-02-15T22:50:51.052 INFO:tasks.workunit.client.0.smithi138.stdout:7/361: fsync d1/d2/db/d3c/f75 0 2024-02-15T22:50:51.052 INFO:tasks.workunit.client.0.smithi138.stdout:7/362: creat d1/f82 x:0 0 0 2024-02-15T22:50:51.052 INFO:tasks.workunit.client.0.smithi138.stdout:7/363: chown d1/d2/db/d3c/d4d/d5b/f76 11 1 2024-02-15T22:50:51.053 INFO:tasks.workunit.client.0.smithi138.stdout:7/364: write d1/d5a/f7e [818266,37739] 0 2024-02-15T22:50:51.053 INFO:tasks.workunit.client.0.smithi138.stdout:7/365: fsync d1/d2/db/d2a/d64/f67 0 2024-02-15T22:50:51.053 INFO:tasks.workunit.client.0.smithi138.stdout:9/143: dread d0/f20 [4194304,4194304] 0 2024-02-15T22:50:51.054 INFO:tasks.workunit.client.0.smithi138.stdout:9/144: creat d0/de/d14/f30 x:0 0 0 2024-02-15T22:50:51.054 INFO:tasks.workunit.client.0.smithi138.stdout:7/366: truncate d1/d2/db/d3c/f56 381236 0 2024-02-15T22:50:51.054 INFO:tasks.workunit.client.0.smithi138.stdout:7/367: write d1/d2/db/d3c/d4d/f65 [506258,110920] 0 2024-02-15T22:50:51.055 INFO:tasks.workunit.client.0.smithi138.stdout:9/145: mknod d0/df/d11/c31 0 2024-02-15T22:50:51.056 INFO:tasks.workunit.client.0.smithi138.stdout:7/368: symlink d1/d2/db/d2a/d64/l83 0 2024-02-15T22:50:51.058 INFO:tasks.workunit.client.0.smithi138.stdout:9/146: rename d0/df/d11/d23/f2f to d0/df/d11/f32 0 2024-02-15T22:50:51.058 INFO:tasks.workunit.client.0.smithi138.stdout:7/369: unlink d1/d28/c51 0 2024-02-15T22:50:51.060 INFO:tasks.workunit.client.0.smithi138.stdout:9/147: mkdir d0/de/d33 0 2024-02-15T22:50:51.060 INFO:tasks.workunit.client.0.smithi138.stdout:9/148: truncate d0/f1d 103037 0 2024-02-15T22:50:51.060 INFO:tasks.workunit.client.0.smithi138.stdout:9/149: dread - d0/f2d zero size 2024-02-15T22:50:51.061 INFO:tasks.workunit.client.0.smithi138.stdout:9/150: stat d0/d2e 0 2024-02-15T22:50:51.061 INFO:tasks.workunit.client.0.smithi138.stdout:4/401: dwrite d17/d1e/d2d/d52/f72 [0,4194304] 0 2024-02-15T22:50:51.061 INFO:tasks.workunit.client.0.smithi138.stdout:4/402: creat d17/d1e/d2d/d36/d3e/d64/f87 x:0 0 0 2024-02-15T22:50:51.061 INFO:tasks.workunit.client.0.smithi138.stdout:7/370: unlink d1/d2/db/d25/d41/c5e 0 2024-02-15T22:50:51.072 INFO:tasks.workunit.client.0.smithi138.stdout:4/403: dwrite d17/d1e/d2d/f7c [0,4194304] 0 2024-02-15T22:50:51.072 INFO:tasks.workunit.client.0.smithi138.stdout:4/404: fsync d17/d1e/d2d/d36/f68 0 2024-02-15T22:50:51.074 INFO:tasks.workunit.client.0.smithi138.stdout:4/405: dread d17/d1e/d56/f7a [0,4194304] 0 2024-02-15T22:50:51.075 INFO:tasks.workunit.client.0.smithi138.stdout:4/406: creat d17/d1e/d2d/d36/d3e/f88 x:0 0 0 2024-02-15T22:50:51.077 INFO:tasks.workunit.client.0.smithi138.stdout:9/151: rmdir d0/df/d11 39 2024-02-15T22:50:51.078 INFO:tasks.workunit.client.0.smithi138.stdout:7/371: rename d1/d2/db/d2a to d1/d79/d84 0 2024-02-15T22:50:51.080 INFO:tasks.workunit.client.0.smithi138.stdout:7/372: link d1/d2/db/d3c/d4d/l68 d1/l85 0 2024-02-15T22:50:51.081 INFO:tasks.workunit.client.0.smithi138.stdout:7/373: mknod d1/d28/d7c/c86 0 2024-02-15T22:50:51.086 INFO:tasks.workunit.client.0.smithi138.stdout:4/407: dread d17/d1e/f22 [0,4194304] 0 2024-02-15T22:50:51.090 INFO:tasks.workunit.client.0.smithi138.stdout:4/408: dread d17/d1e/d2d/d36/f6e [0,4194304] 0 2024-02-15T22:50:51.093 INFO:tasks.workunit.client.0.smithi138.stdout:7/374: dread d1/d2/db/f16 [0,4194304] 0 2024-02-15T22:50:51.100 INFO:tasks.workunit.client.0.smithi138.stdout:4/409: write d17/d1a/f50 [3690927,2941] 0 2024-02-15T22:50:51.100 INFO:tasks.workunit.client.0.smithi138.stdout:9/152: dwrite d0/df/d11/f32 [0,4194304] 0 2024-02-15T22:50:51.103 INFO:tasks.workunit.client.0.smithi138.stdout:9/153: mkdir d0/de/d34 0 2024-02-15T22:50:51.103 INFO:tasks.workunit.client.0.smithi138.stdout:9/154: read - d0/de/d14/f30 zero size 2024-02-15T22:50:51.108 INFO:tasks.workunit.client.0.smithi138.stdout:4/410: rmdir d17/d1e/d2d 39 2024-02-15T22:50:51.108 INFO:tasks.workunit.client.0.smithi138.stdout:4/411: dread - d17/d2b/f77 zero size 2024-02-15T22:50:51.110 INFO:tasks.workunit.client.0.smithi138.stdout:7/375: dwrite d1/d2/db/fe [0,4194304] 0 2024-02-15T22:50:51.110 INFO:tasks.workunit.client.0.smithi138.stdout:7/376: write d1/d2/db/f16 [2880500,102919] 0 2024-02-15T22:50:51.110 INFO:tasks.workunit.client.0.smithi138.stdout:7/377: dread - d1/d2/f80 zero size 2024-02-15T22:50:51.110 INFO:tasks.workunit.client.0.smithi138.stdout:4/412: symlink d17/d2b/d78/l89 0 2024-02-15T22:50:51.111 INFO:tasks.workunit.client.0.smithi138.stdout:7/378: rmdir d1/d79/d84 39 2024-02-15T22:50:51.112 INFO:tasks.workunit.client.0.smithi138.stdout:9/155: write d0/d4/fd [941299,39208] 0 2024-02-15T22:50:51.113 INFO:tasks.workunit.client.0.smithi138.stdout:7/379: truncate d1/d2/f44 4054199 0 2024-02-15T22:50:51.113 INFO:tasks.workunit.client.0.smithi138.stdout:7/380: readlink d1/d79/d84/l60 0 2024-02-15T22:50:51.113 INFO:tasks.workunit.client.0.smithi138.stdout:7/381: chown d1/d2/db/d3c/d4d/f65 2 1 2024-02-15T22:50:51.114 INFO:tasks.workunit.client.0.smithi138.stdout:4/413: write d17/d1e/f4d [533989,123199] 0 2024-02-15T22:50:51.115 INFO:tasks.workunit.client.0.smithi138.stdout:9/156: unlink d0/f2d 0 2024-02-15T22:50:51.115 INFO:tasks.workunit.client.0.smithi138.stdout:9/157: stat d0/de/d14/d22 0 2024-02-15T22:50:51.117 INFO:tasks.workunit.client.0.smithi138.stdout:7/382: rename d1/d2/db/d3c/d4d/l68 to d1/d2/db/d3c/d4d/d63/l87 0 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:7/383: creat d1/d2/d29/f88 x:0 0 0 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:7/384: chown d1/d2/db/d3c/f4a 4081 1 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:7/385: fdatasync d1/d2/f30 0 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:7/386: read d1/d2/db/d3c/f56 [197443,1502] 0 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:4/414: truncate d17/d1e/d2d/f2e 1338826 0 2024-02-15T22:50:51.118 INFO:tasks.workunit.client.0.smithi138.stdout:4/415: write d17/d1e/d2d/d36/f68 [283683,114613] 0 2024-02-15T22:50:51.120 INFO:tasks.workunit.client.0.smithi138.stdout:9/158: mknod d0/de/d33/c35 0 2024-02-15T22:50:51.120 INFO:tasks.workunit.client.0.smithi138.stdout:9/159: fdatasync d0/f27 0 2024-02-15T22:50:51.122 INFO:tasks.workunit.client.0.smithi138.stdout:4/416: mknod d17/d2b/d78/c8a 0 2024-02-15T22:50:51.122 INFO:tasks.workunit.client.0.smithi138.stdout:4/417: readlink d17/d1e/d2d/d36/d3e/l58 0 2024-02-15T22:50:51.123 INFO:tasks.workunit.client.0.smithi138.stdout:9/160: creat d0/de/d33/f36 x:0 0 0 2024-02-15T22:50:51.123 INFO:tasks.workunit.client.0.smithi138.stdout:9/161: chown d0/df/d11/d23/l29 2 1 2024-02-15T22:50:51.123 INFO:tasks.workunit.client.0.smithi138.stdout:9/162: chown d0/de/d33/c35 12 1 2024-02-15T22:50:51.124 INFO:tasks.workunit.client.0.smithi138.stdout:9/163: truncate d0/d4/f2b 62784 0 2024-02-15T22:50:51.125 INFO:tasks.workunit.client.0.smithi138.stdout:4/418: unlink d17/d2b/l63 0 2024-02-15T22:50:51.126 INFO:tasks.workunit.client.0.smithi138.stdout:9/164: creat d0/de/f37 x:0 0 0 2024-02-15T22:50:51.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/387: dwrite d1/d5a/f6d [0,4194304] 0 2024-02-15T22:50:51.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/388: read d1/f12 [4179963,1101] 0 2024-02-15T22:50:51.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/389: creat d1/d2/db/d3c/d4d/d5b/f89 x:0 0 0 2024-02-15T22:50:51.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/390: stat d1/f42 0 2024-02-15T22:50:51.136 INFO:tasks.workunit.client.0.smithi138.stdout:7/391: readlink d1/d2/l2c 0 2024-02-15T22:50:51.153 INFO:tasks.workunit.client.0.smithi138.stdout:7/392: dwrite d1/d2/db/d3c/d4d/d5b/f76 [0,4194304] 0 2024-02-15T22:50:51.154 INFO:tasks.workunit.client.0.smithi138.stdout:7/393: readlink d1/d28/d7c/l7d 0 2024-02-15T22:50:51.167 INFO:tasks.workunit.client.0.smithi138.stdout:7/394: dwrite d1/d2/db/f20 [0,4194304] 0 2024-02-15T22:50:51.191 INFO:tasks.workunit.client.0.smithi138.stdout:7/395: dwrite d1/f6b [0,4194304] 0 2024-02-15T22:50:51.191 INFO:tasks.workunit.client.0.smithi138.stdout:7/396: fsync d1/d2/db/d25/d41/f46 0 2024-02-15T22:50:51.199 INFO:tasks.workunit.client.0.smithi138.stdout:7/397: write d1/d5a/f6d [992468,75928] 0 2024-02-15T22:50:51.200 INFO:tasks.workunit.client.0.smithi138.stdout:7/398: truncate d1/d2/db/d3c/f45 213163 0 2024-02-15T22:50:51.201 INFO:tasks.workunit.client.0.smithi138.stdout:7/399: symlink d1/d79/d84/d64/l8a 0 2024-02-15T22:50:51.204 INFO:tasks.workunit.client.0.smithi138.stdout:7/400: truncate d1/d2/db/f20 3592409 0 2024-02-15T22:50:51.205 INFO:tasks.workunit.client.0.smithi138.stdout:7/401: mknod d1/d79/d84/c8b 0 2024-02-15T22:50:51.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/402: mkdir d1/d79/d84/d8c 0 2024-02-15T22:50:51.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/403: chown d1/d2/db/d3c/d4d/d63 156 1 2024-02-15T22:50:51.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/404: chown d1/d2/db/d3c/l54 14 1 2024-02-15T22:50:51.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/405: creat d1/d2/f8d x:0 0 0 2024-02-15T22:50:51.209 INFO:tasks.workunit.client.0.smithi138.stdout:7/406: rename d1/d2/db/d3c/f61 to d1/d79/d84/f8e 0 2024-02-15T22:50:51.209 INFO:tasks.workunit.client.0.smithi138.stdout:7/407: truncate d1/d2/d29/f88 807995 0 2024-02-15T22:50:51.215 INFO:tasks.workunit.client.0.smithi138.stdout:7/408: dread d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:51.216 INFO:tasks.workunit.client.0.smithi138.stdout:7/409: stat d1/d2/db/d25 0 2024-02-15T22:50:51.216 INFO:tasks.workunit.client.0.smithi138.stdout:7/410: truncate d1/d79/d84/f8e 870442 0 2024-02-15T22:50:51.228 INFO:tasks.workunit.client.0.smithi138.stdout:7/411: dwrite d1/d2/db/d3c/d6a/f7f [0,4194304] 0 2024-02-15T22:50:51.230 INFO:tasks.workunit.client.0.smithi138.stdout:7/412: creat d1/d79/d84/d8c/f8f x:0 0 0 2024-02-15T22:50:51.230 INFO:tasks.workunit.client.0.smithi138.stdout:7/413: chown d1/d2/db/d3c/d4d/d5b/l5d 3997 1 2024-02-15T22:50:51.230 INFO:tasks.workunit.client.0.smithi138.stdout:7/414: fsync d1/d2/db/d3c/d4d/d5b/f62 0 2024-02-15T22:50:51.230 INFO:tasks.workunit.client.0.smithi138.stdout:7/415: mknod d1/d79/d84/c90 0 2024-02-15T22:50:51.230 INFO:tasks.workunit.client.0.smithi138.stdout:7/416: readlink d1/l21 0 2024-02-15T22:50:51.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/417: write d1/d2/db/d3c/d4d/d5b/f89 [28125,60195] 0 2024-02-15T22:50:51.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/418: mknod d1/d2/db/d3c/d6a/c91 0 2024-02-15T22:50:51.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/419: chown d1/d2/db/d25 99 1 2024-02-15T22:50:51.231 INFO:tasks.workunit.client.0.smithi138.stdout:7/420: fdatasync d1/d2/db/d3c/f45 0 2024-02-15T22:50:51.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/421: rename d1/d28/d7c/l7d to d1/d79/d84/d8c/l92 0 2024-02-15T22:50:51.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/422: fsync d1/d2/d29/f2d 0 2024-02-15T22:50:51.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/423: write d1/f40 [879361,28795] 0 2024-02-15T22:50:51.233 INFO:tasks.workunit.client.0.smithi138.stdout:7/424: unlink d1/l21 0 2024-02-15T22:50:51.233 INFO:tasks.workunit.client.0.smithi138.stdout:7/425: write d1/f12 [2132066,130595] 0 2024-02-15T22:50:51.251 INFO:tasks.workunit.client.0.smithi138.stdout:7/426: dwrite d1/d2/f31 [4194304,4194304] 0 2024-02-15T22:50:51.259 INFO:tasks.workunit.client.0.smithi138.stdout:7/427: rename d1/d2/db/f49 to d1/d2/f93 0 2024-02-15T22:50:51.260 INFO:tasks.workunit.client.0.smithi138.stdout:7/428: rename d1/d2/db/d3c/d4d/d5b/c6c to d1/d28/c94 0 2024-02-15T22:50:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:50 smithi170 ceph-mon[35248]: pgmap v8: 65 pgs: 65 active+clean; 188 MiB data, 882 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-02-15T22:50:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:50 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:50 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:51.269 INFO:tasks.workunit.client.0.smithi138.stdout:7/429: dread d1/d2/db/d25/f36 [4194304,4194304] 0 2024-02-15T22:50:51.270 INFO:tasks.workunit.client.0.smithi138.stdout:7/430: symlink d1/d2/db/d3c/d4d/l95 0 2024-02-15T22:50:51.271 INFO:tasks.workunit.client.0.smithi138.stdout:1/129: sync 2024-02-15T22:50:51.271 INFO:tasks.workunit.client.0.smithi138.stdout:8/134: sync 2024-02-15T22:50:51.271 INFO:tasks.workunit.client.0.smithi138.stdout:8/135: fsync db/dd/d13/f21 0 2024-02-15T22:50:51.271 INFO:tasks.workunit.client.0.smithi138.stdout:7/431: rename d1/d2/db/d3c/d4d/l95 to d1/d2/db/l96 0 2024-02-15T22:50:51.272 INFO:tasks.workunit.client.0.smithi138.stdout:1/130: mknod df/d1b/d1d/d24/c29 0 2024-02-15T22:50:51.272 INFO:tasks.workunit.client.0.smithi138.stdout:8/136: getdents db/dd/d22 0 2024-02-15T22:50:51.272 INFO:tasks.workunit.client.0.smithi138.stdout:8/137: chown db/dd/d13/d19 1 1 2024-02-15T22:50:51.273 INFO:tasks.workunit.client.0.smithi138.stdout:1/131: creat df/d1b/d1d/f2a x:0 0 0 2024-02-15T22:50:51.273 INFO:tasks.workunit.client.0.smithi138.stdout:8/138: getdents db/dd/d13/d19 0 2024-02-15T22:50:51.274 INFO:tasks.workunit.client.0.smithi138.stdout:1/132: mknod df/d1b/c2b 0 2024-02-15T22:50:51.275 INFO:tasks.workunit.client.0.smithi138.stdout:8/139: symlink db/dd/d13/d19/d24/l2b 0 2024-02-15T22:50:51.276 INFO:tasks.workunit.client.0.smithi138.stdout:1/133: mkdir df/d1b/d1d/d25/d2c 0 2024-02-15T22:50:51.276 INFO:tasks.workunit.client.0.smithi138.stdout:1/134: stat df/d1b/f1f 0 2024-02-15T22:50:51.276 INFO:tasks.workunit.client.0.smithi138.stdout:1/135: symlink df/d1b/d1d/d25/l2d 0 2024-02-15T22:50:51.277 INFO:tasks.workunit.client.0.smithi138.stdout:1/136: chown df/d1b/d1d 722 1 2024-02-15T22:50:51.285 INFO:tasks.workunit.client.0.smithi138.stdout:8/140: dread db/dd/d13/f21 [0,4194304] 0 2024-02-15T22:50:51.285 INFO:tasks.workunit.client.0.smithi138.stdout:8/141: fdatasync db/dd/f11 0 2024-02-15T22:50:51.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/142: link f5 db/dd/d13/d19/d24/f2c 0 2024-02-15T22:50:51.293 INFO:tasks.workunit.client.0.smithi138.stdout:1/137: dwrite df/d1b/f1f [0,4194304] 0 2024-02-15T22:50:51.300 INFO:tasks.workunit.client.0.smithi138.stdout:7/432: dwrite d1/d2/db/f16 [4194304,4194304] 0 2024-02-15T22:50:51.301 INFO:tasks.workunit.client.0.smithi138.stdout:8/143: dwrite f6 [4194304,4194304] 0 2024-02-15T22:50:51.301 INFO:tasks.workunit.client.0.smithi138.stdout:8/144: stat db/dd/d13/d19/d24/l2b 0 2024-02-15T22:50:51.304 INFO:tasks.workunit.client.0.smithi138.stdout:7/433: rmdir d1/d2/db/d3c/d4d/d5b 39 2024-02-15T22:50:51.305 INFO:tasks.workunit.client.0.smithi138.stdout:7/434: write d1/d2/db/d3c/d4d/f65 [302539,61978] 0 2024-02-15T22:50:51.311 INFO:tasks.workunit.client.0.smithi138.stdout:1/138: dwrite df/d1b/f1f [0,4194304] 0 2024-02-15T22:50:51.311 INFO:tasks.workunit.client.0.smithi138.stdout:8/145: write db/dd/d13/f1c [2519200,96918] 0 2024-02-15T22:50:51.311 INFO:tasks.workunit.client.0.smithi138.stdout:7/435: rename d1/d2/db/d3c/d6a to d1/d5a/d97 0 2024-02-15T22:50:51.313 INFO:tasks.workunit.client.0.smithi138.stdout:1/139: mkdir df/d1b/d1d/d25/d2e 0 2024-02-15T22:50:51.314 INFO:tasks.workunit.client.0.smithi138.stdout:8/146: mknod db/dd/c2d 0 2024-02-15T22:50:51.316 INFO:tasks.workunit.client.0.smithi138.stdout:7/436: link d1/d79/d84/c8b d1/d2/db/d3c/c98 0 2024-02-15T22:50:51.316 INFO:tasks.workunit.client.0.smithi138.stdout:8/147: rmdir db/dd/d22 39 2024-02-15T22:50:51.332 INFO:tasks.workunit.client.0.smithi138.stdout:7/437: dwrite d1/d2/db/d3c/d4d/f65 [0,4194304] 0 2024-02-15T22:50:51.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/438: dread d1/d2/ff [0,4194304] 0 2024-02-15T22:50:51.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/439: creat d1/d2/db/d25/f99 x:0 0 0 2024-02-15T22:50:51.342 INFO:tasks.workunit.client.0.smithi138.stdout:8/148: dwrite f5 [0,4194304] 0 2024-02-15T22:50:51.351 INFO:tasks.workunit.client.0.smithi138.stdout:7/440: dread d1/d2/f1d [0,4194304] 0 2024-02-15T22:50:51.353 INFO:tasks.workunit.client.0.smithi138.stdout:8/149: mknod db/dd/d13/d19/d24/c2e 0 2024-02-15T22:50:51.353 INFO:tasks.workunit.client.0.smithi138.stdout:8/150: read db/f1a [3235506,90001] 0 2024-02-15T22:50:51.353 INFO:tasks.workunit.client.0.smithi138.stdout:7/441: creat d1/d2/db/d3c/d4d/d5b/f9a x:0 0 0 2024-02-15T22:50:51.354 INFO:tasks.workunit.client.0.smithi138.stdout:8/151: creat db/dd/d22/f2f x:0 0 0 2024-02-15T22:50:51.355 INFO:tasks.workunit.client.0.smithi138.stdout:7/442: truncate d1/d2/db/f38 2233440 0 2024-02-15T22:50:51.355 INFO:tasks.workunit.client.0.smithi138.stdout:8/152: dread db/dd/f1d [0,4194304] 0 2024-02-15T22:50:51.355 INFO:tasks.workunit.client.0.smithi138.stdout:8/153: chown db/f28 4134939 1 2024-02-15T22:50:51.356 INFO:tasks.workunit.client.0.smithi138.stdout:8/154: fsync db/dd/f14 0 2024-02-15T22:50:51.368 INFO:tasks.workunit.client.0.smithi138.stdout:7/443: dwrite d1/d2/db/d3c/f4a [4194304,4194304] 0 2024-02-15T22:50:51.370 INFO:tasks.workunit.client.0.smithi138.stdout:7/444: link d1/d79/d84/l60 d1/l9b 0 2024-02-15T22:50:51.371 INFO:tasks.workunit.client.0.smithi138.stdout:7/445: symlink d1/d5a/d97/l9c 0 2024-02-15T22:50:51.371 INFO:tasks.workunit.client.0.smithi138.stdout:7/446: chown d1/d28/d7c/c86 351 1 2024-02-15T22:50:51.379 INFO:tasks.workunit.client.0.smithi138.stdout:7/447: write d1/d2/f73 [2897867,44882] 0 2024-02-15T22:50:51.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/448: write d1/d2/db/d3c/d4d/f52 [4030197,45090] 0 2024-02-15T22:50:51.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/449: write d1/d79/d84/d8c/f8f [94007,111325] 0 2024-02-15T22:50:51.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/450: chown d1/d2/db/d3c/d4d/c50 612174 1 2024-02-15T22:50:51.387 INFO:tasks.workunit.client.0.smithi138.stdout:7/451: link d1/d79/d84/d64/l83 d1/d79/l9d 0 2024-02-15T22:50:51.392 INFO:tasks.workunit.client.0.smithi138.stdout:7/452: link d1/d2/db/d25/d41/c55 d1/d2/db/d3c/c9e 0 2024-02-15T22:50:51.472 INFO:tasks.workunit.client.0.smithi138.stdout:7/453: dwrite d1/d5a/d97/f7f [0,4194304] 0 2024-02-15T22:50:51.473 INFO:tasks.workunit.client.0.smithi138.stdout:7/454: creat d1/d2/f9f x:0 0 0 2024-02-15T22:50:51.474 INFO:tasks.workunit.client.0.smithi138.stdout:7/455: mkdir d1/d79/d84/da0 0 2024-02-15T22:50:51.474 INFO:tasks.workunit.client.0.smithi138.stdout:7/456: write d1/d2/db/f16 [2003177,30202] 0 2024-02-15T22:50:51.476 INFO:tasks.workunit.client.0.smithi138.stdout:7/457: link d1/l10 d1/d28/la1 0 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:3/214: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:5/105: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:0/135: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/193: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:9/165: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/182: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:9/166: chown d0/df/d11/f13 253053 1 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:4/419: sync 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/194: creat dc/f46 x:0 0 0 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/195: chown dc/d24/d34/d3b/f45 50825091 1 2024-02-15T22:50:51.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/196: write dc/d24/d34/d3b/f42 [352708,49909] 0 2024-02-15T22:50:51.505 INFO:tasks.workunit.client.0.smithi138.stdout:3/215: symlink d5/d16/dc/l46 0 2024-02-15T22:50:51.505 INFO:tasks.workunit.client.0.smithi138.stdout:0/136: stat d6/c12 0 2024-02-15T22:50:51.505 INFO:tasks.workunit.client.0.smithi138.stdout:5/106: mknod df/d18/c1f 0 2024-02-15T22:50:51.505 INFO:tasks.workunit.client.0.smithi138.stdout:5/107: creat df/d18/f20 x:0 0 0 2024-02-15T22:50:51.508 INFO:tasks.workunit.client.0.smithi138.stdout:2/183: unlink d0/dd/d15/f3e 0 2024-02-15T22:50:51.510 INFO:tasks.workunit.client.0.smithi138.stdout:6/197: rmdir dc/d24/d34/d3b/d43 0 2024-02-15T22:50:51.510 INFO:tasks.workunit.client.0.smithi138.stdout:6/198: creat dc/d24/f47 x:0 0 0 2024-02-15T22:50:51.511 INFO:tasks.workunit.client.0.smithi138.stdout:3/216: mkdir d5/d16/dc/d43/d47 0 2024-02-15T22:50:51.512 INFO:tasks.workunit.client.0.smithi138.stdout:2/184: dread d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:51.512 INFO:tasks.workunit.client.0.smithi138.stdout:0/137: link f0 d6/d10/f30 0 2024-02-15T22:50:51.512 INFO:tasks.workunit.client.0.smithi138.stdout:0/138: creat d6/d10/f31 x:0 0 0 2024-02-15T22:50:51.514 INFO:tasks.workunit.client.0.smithi138.stdout:5/108: dread - df/f16 zero size 2024-02-15T22:50:51.515 INFO:tasks.workunit.client.0.smithi138.stdout:9/167: dwrite d0/de/f37 [0,4194304] 0 2024-02-15T22:50:51.516 INFO:tasks.workunit.client.0.smithi138.stdout:4/420: link d17/d2b/f4f d17/d1e/f8b 0 2024-02-15T22:50:51.518 INFO:tasks.workunit.client.0.smithi138.stdout:3/217: mknod d5/d18/c48 0 2024-02-15T22:50:51.518 INFO:tasks.workunit.client.0.smithi138.stdout:3/218: fsync d5/d12/f1d 0 2024-02-15T22:50:51.521 INFO:tasks.workunit.client.0.smithi138.stdout:0/139: link d6/d10/f11 d6/d10/d18/f32 0 2024-02-15T22:50:51.522 INFO:tasks.workunit.client.0.smithi138.stdout:5/109: mknod df/d18/c21 0 2024-02-15T22:50:51.522 INFO:tasks.workunit.client.0.smithi138.stdout:5/110: chown df/l10 172861935 1 2024-02-15T22:50:51.523 INFO:tasks.workunit.client.0.smithi138.stdout:6/199: dwrite dc/d24/f47 [0,4194304] 0 2024-02-15T22:50:51.524 INFO:tasks.workunit.client.0.smithi138.stdout:6/200: creat dc/f48 x:0 0 0 2024-02-15T22:50:51.524 INFO:tasks.workunit.client.0.smithi138.stdout:6/201: dread - dc/f1e zero size 2024-02-15T22:50:51.526 INFO:tasks.workunit.client.0.smithi138.stdout:9/168: symlink d0/de/l38 0 2024-02-15T22:50:51.526 INFO:tasks.workunit.client.0.smithi138.stdout:4/421: mkdir d17/d1e/d2d/d8c 0 2024-02-15T22:50:51.527 INFO:tasks.workunit.client.0.smithi138.stdout:4/422: fsync d17/d1e/d2d/d36/f68 0 2024-02-15T22:50:51.527 INFO:tasks.workunit.client.0.smithi138.stdout:4/423: write d17/d1e/d2d/d36/d3e/f88 [250894,39169] 0 2024-02-15T22:50:51.527 INFO:tasks.workunit.client.0.smithi138.stdout:4/424: dread - d17/d1e/f4b zero size 2024-02-15T22:50:51.528 INFO:tasks.workunit.client.0.smithi138.stdout:3/219: rename d5/d12/d26/d2f/l42 to d5/d18/l49 0 2024-02-15T22:50:51.528 INFO:tasks.workunit.client.0.smithi138.stdout:0/140: rename d6/d10 to d6/d10/d18/d1b/d33 22 2024-02-15T22:50:51.529 INFO:tasks.workunit.client.0.smithi138.stdout:2/185: mknod d0/d3/c45 0 2024-02-15T22:50:51.536 INFO:tasks.workunit.client.0.smithi138.stdout:9/169: creat d0/df/d11/d23/f39 x:0 0 0 2024-02-15T22:50:51.537 INFO:tasks.workunit.client.0.smithi138.stdout:4/425: creat d17/d1e/d2d/d52/f8d x:0 0 0 2024-02-15T22:50:51.537 INFO:tasks.workunit.client.0.smithi138.stdout:2/186: read d0/f37 [2411371,55151] 0 2024-02-15T22:50:51.538 INFO:tasks.workunit.client.0.smithi138.stdout:2/187: write d0/d3/f2b [991341,122730] 0 2024-02-15T22:50:51.538 INFO:tasks.workunit.client.0.smithi138.stdout:2/188: creat d0/da/f46 x:0 0 0 2024-02-15T22:50:51.540 INFO:tasks.workunit.client.0.smithi138.stdout:3/220: unlink d5/d16/dc/f13 0 2024-02-15T22:50:51.541 INFO:tasks.workunit.client.0.smithi138.stdout:5/111: mknod df/c22 0 2024-02-15T22:50:51.543 INFO:tasks.workunit.client.0.smithi138.stdout:4/426: creat d17/d1e/d2d/d8c/f8e x:0 0 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:9/170: write d0/f8 [6142814,79712] 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/202: rename dc/f48 to dc/d24/d34/f49 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:9/171: fdatasync d0/d4/fd 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/203: readlink dc/l2b 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/204: stat dc/f40 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/205: readlink dc/d24/l3f 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/206: write dc/f1e [798002,76272] 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/207: dread - dc/d24/f39 zero size 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:0/141: dwrite d6/d10/d13/f25 [0,4194304] 0 2024-02-15T22:50:51.546 INFO:tasks.workunit.client.0.smithi138.stdout:3/221: mkdir d5/d12/d23/d29/d4a 0 2024-02-15T22:50:51.549 INFO:tasks.workunit.client.0.smithi138.stdout:4/427: symlink d17/d1a/l8f 0 2024-02-15T22:50:51.550 INFO:tasks.workunit.client.0.smithi138.stdout:9/172: mknod d0/de/c3a 0 2024-02-15T22:50:51.555 INFO:tasks.workunit.client.0.smithi138.stdout:0/142: mkdir d6/d10/d34 0 2024-02-15T22:50:51.555 INFO:tasks.workunit.client.0.smithi138.stdout:0/143: truncate d6/d10/d13/f2c 859265 0 2024-02-15T22:50:51.556 INFO:tasks.workunit.client.0.smithi138.stdout:3/222: creat d5/d12/d26/d2f/f4b x:0 0 0 2024-02-15T22:50:51.556 INFO:tasks.workunit.client.0.smithi138.stdout:3/223: write d5/d12/f2a [983574,48288] 0 2024-02-15T22:50:51.557 INFO:tasks.workunit.client.0.smithi138.stdout:4/428: creat d17/f90 x:0 0 0 2024-02-15T22:50:51.557 INFO:tasks.workunit.client.0.smithi138.stdout:4/429: write d17/d1e/d2d/d36/f6e [4918963,122639] 0 2024-02-15T22:50:51.557 INFO:tasks.workunit.client.0.smithi138.stdout:4/430: write d17/d1e/d2d/d36/f68 [787902,21066] 0 2024-02-15T22:50:51.560 INFO:tasks.workunit.client.0.smithi138.stdout:4/431: dread d17/d1e/f8b [0,4194304] 0 2024-02-15T22:50:51.560 INFO:tasks.workunit.client.0.smithi138.stdout:5/112: rename df/d18/f1e to df/f23 0 2024-02-15T22:50:51.560 INFO:tasks.workunit.client.0.smithi138.stdout:5/113: write df/f13 [1169257,87273] 0 2024-02-15T22:50:51.561 INFO:tasks.workunit.client.0.smithi138.stdout:6/208: dwrite dc/d24/d34/f49 [0,4194304] 0 2024-02-15T22:50:51.562 INFO:tasks.workunit.client.0.smithi138.stdout:9/173: dread d0/df/d11/f32 [0,4194304] 0 2024-02-15T22:50:51.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/432: mknod d17/d2b/d78/c91 0 2024-02-15T22:50:51.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/433: write d17/d1e/d2d/d36/d3e/d64/f41 [4443506,61424] 0 2024-02-15T22:50:51.565 INFO:tasks.workunit.client.0.smithi138.stdout:3/224: rename d5/d12/d26/d2f/f4b to d5/d12/d23/f4c 0 2024-02-15T22:50:51.568 INFO:tasks.workunit.client.0.smithi138.stdout:3/225: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:51.569 INFO:tasks.workunit.client.0.smithi138.stdout:5/114: dread fb [0,4194304] 0 2024-02-15T22:50:51.569 INFO:tasks.workunit.client.0.smithi138.stdout:5/115: fdatasync df/f17 0 2024-02-15T22:50:51.570 INFO:tasks.workunit.client.0.smithi138.stdout:6/209: link dc/d24/d34/f49 dc/d24/d34/d3b/f4a 0 2024-02-15T22:50:51.570 INFO:tasks.workunit.client.0.smithi138.stdout:0/144: dwrite d6/d10/d13/f2c [0,4194304] 0 2024-02-15T22:50:51.571 INFO:tasks.workunit.client.0.smithi138.stdout:0/145: chown d6/d10/d13/f16 206416807 1 2024-02-15T22:50:51.571 INFO:tasks.workunit.client.0.smithi138.stdout:0/146: fdatasync d6/d10/d13/f2c 0 2024-02-15T22:50:51.571 INFO:tasks.workunit.client.0.smithi138.stdout:9/174: unlink d0/df/d11/c31 0 2024-02-15T22:50:51.571 INFO:tasks.workunit.client.0.smithi138.stdout:1/140: sync 2024-02-15T22:50:51.574 INFO:tasks.workunit.client.0.smithi138.stdout:3/226: rename d5/d2c to d5/d16/d4d 0 2024-02-15T22:50:51.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/210: mkdir dc/d4b 0 2024-02-15T22:50:51.578 INFO:tasks.workunit.client.0.smithi138.stdout:5/116: write fd [4003746,130534] 0 2024-02-15T22:50:51.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/141: creat df/d1b/d1d/d25/d2c/f2f x:0 0 0 2024-02-15T22:50:51.582 INFO:tasks.workunit.client.0.smithi138.stdout:0/147: rename d6/d10/d18/f2a to d6/d10/d34/f35 0 2024-02-15T22:50:51.583 INFO:tasks.workunit.client.0.smithi138.stdout:0/148: truncate d6/d10/f14 927268 0 2024-02-15T22:50:51.584 INFO:tasks.workunit.client.0.smithi138.stdout:3/227: unlink d5/d16/dc/l46 0 2024-02-15T22:50:51.584 INFO:tasks.workunit.client.0.smithi138.stdout:3/228: readlink d5/l41 0 2024-02-15T22:50:51.586 INFO:tasks.workunit.client.0.smithi138.stdout:3/229: dread d5/d16/f3c [0,4194304] 0 2024-02-15T22:50:51.588 INFO:tasks.workunit.client.0.smithi138.stdout:1/142: mknod df/d1b/c30 0 2024-02-15T22:50:51.591 INFO:tasks.workunit.client.0.smithi138.stdout:9/175: dwrite d0/f1d [0,4194304] 0 2024-02-15T22:50:51.591 INFO:tasks.workunit.client.0.smithi138.stdout:9/176: creat d0/d4/f3b x:0 0 0 2024-02-15T22:50:51.592 INFO:tasks.workunit.client.0.smithi138.stdout:0/149: link d6/d10/d13/f25 d6/d10/d18/d1b/f36 0 2024-02-15T22:50:51.594 INFO:tasks.workunit.client.0.smithi138.stdout:3/230: link d5/d16/c3b d5/d16/c4e 0 2024-02-15T22:50:51.594 INFO:tasks.workunit.client.0.smithi138.stdout:3/231: write d5/d12/d23/f28 [1771916,16778] 0 2024-02-15T22:50:51.594 INFO:tasks.workunit.client.0.smithi138.stdout:1/143: stat c5 0 2024-02-15T22:50:51.597 INFO:tasks.workunit.client.0.smithi138.stdout:9/177: symlink d0/df/d11/d23/l3c 0 2024-02-15T22:50:51.597 INFO:tasks.workunit.client.0.smithi138.stdout:0/150: mkdir d6/d10/d34/d37 0 2024-02-15T22:50:51.599 INFO:tasks.workunit.client.0.smithi138.stdout:4/434: dwrite d17/d1e/f3f [0,4194304] 0 2024-02-15T22:50:51.599 INFO:tasks.workunit.client.0.smithi138.stdout:3/232: mkdir d5/d12/d23/d29/d4f 0 2024-02-15T22:50:51.600 INFO:tasks.workunit.client.0.smithi138.stdout:0/151: truncate d6/d10/d18/d1b/f22 532335 0 2024-02-15T22:50:51.602 INFO:tasks.workunit.client.0.smithi138.stdout:3/233: getdents d5/d16/dc/d43 0 2024-02-15T22:50:51.604 INFO:tasks.workunit.client.0.smithi138.stdout:4/435: mknod d17/c92 0 2024-02-15T22:50:51.605 INFO:tasks.workunit.client.0.smithi138.stdout:5/117: dwrite df/f1a [0,4194304] 0 2024-02-15T22:50:51.605 INFO:tasks.workunit.client.0.smithi138.stdout:0/152: dread d6/d10/f30 [0,4194304] 0 2024-02-15T22:50:51.609 INFO:tasks.workunit.client.0.smithi138.stdout:4/436: rename d17/d1e/f85 to d17/d1e/d2d/d8c/f93 0 2024-02-15T22:50:51.610 INFO:tasks.workunit.client.0.smithi138.stdout:9/178: dread d0/de/f37 [0,4194304] 0 2024-02-15T22:50:51.617 INFO:tasks.workunit.client.0.smithi138.stdout:1/144: rmdir df/d1b 39 2024-02-15T22:50:51.618 INFO:tasks.workunit.client.0.smithi138.stdout:3/234: dwrite d5/d12/f2a [0,4194304] 0 2024-02-15T22:50:51.619 INFO:tasks.workunit.client.0.smithi138.stdout:9/179: rename d0/de/f37 to d0/de/d33/f3d 0 2024-02-15T22:50:51.619 INFO:tasks.workunit.client.0.smithi138.stdout:0/153: dread d6/d10/d13/f2c [0,4194304] 0 2024-02-15T22:50:51.619 INFO:tasks.workunit.client.0.smithi138.stdout:5/118: symlink df/l24 0 2024-02-15T22:50:51.620 INFO:tasks.workunit.client.0.smithi138.stdout:5/119: readlink df/l12 0 2024-02-15T22:50:51.621 INFO:tasks.workunit.client.0.smithi138.stdout:1/145: mknod df/d1b/d1d/c31 0 2024-02-15T22:50:51.624 INFO:tasks.workunit.client.0.smithi138.stdout:3/235: creat d5/d12/d23/f50 x:0 0 0 2024-02-15T22:50:51.624 INFO:tasks.workunit.client.0.smithi138.stdout:3/236: creat d5/d12/d23/f51 x:0 0 0 2024-02-15T22:50:51.624 INFO:tasks.workunit.client.0.smithi138.stdout:9/180: creat d0/de/d34/f3e x:0 0 0 2024-02-15T22:50:51.625 INFO:tasks.workunit.client.0.smithi138.stdout:0/154: symlink d6/d10/d13/l38 0 2024-02-15T22:50:51.626 INFO:tasks.workunit.client.0.smithi138.stdout:5/120: truncate df/f13 398045 0 2024-02-15T22:50:51.627 INFO:tasks.workunit.client.0.smithi138.stdout:5/121: readlink df/l1c 0 2024-02-15T22:50:51.628 INFO:tasks.workunit.client.0.smithi138.stdout:4/437: dwrite d17/d1e/d2d/d52/f74 [0,4194304] 0 2024-02-15T22:50:51.629 INFO:tasks.workunit.client.0.smithi138.stdout:3/237: creat d5/d12/d23/d29/d4a/f52 x:0 0 0 2024-02-15T22:50:51.631 INFO:tasks.workunit.client.0.smithi138.stdout:9/181: symlink d0/de/d14/d22/l3f 0 2024-02-15T22:50:51.631 INFO:tasks.workunit.client.0.smithi138.stdout:9/182: dread - d0/de/d34/f3e zero size 2024-02-15T22:50:51.631 INFO:tasks.workunit.client.0.smithi138.stdout:9/183: stat d0/de/d34 0 2024-02-15T22:50:51.631 INFO:tasks.workunit.client.0.smithi138.stdout:1/146: write df/f11 [1325955,33862] 0 2024-02-15T22:50:51.635 INFO:tasks.workunit.client.0.smithi138.stdout:4/438: truncate d17/d1e/d2d/f30 1035404 0 2024-02-15T22:50:51.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/238: link d5/d12/d26/d2f/f39 d5/d12/d23/d29/d4f/f53 0 2024-02-15T22:50:51.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/239: getdents d5/d16/d4d 0 2024-02-15T22:50:51.639 INFO:tasks.workunit.client.0.smithi138.stdout:1/147: rmdir df/d1b/d1d/d25 39 2024-02-15T22:50:51.640 INFO:tasks.workunit.client.0.smithi138.stdout:1/148: truncate df/d1b/f27 34999 0 2024-02-15T22:50:51.640 INFO:tasks.workunit.client.0.smithi138.stdout:1/149: chown df/l13 113 1 2024-02-15T22:50:51.641 INFO:tasks.workunit.client.0.smithi138.stdout:0/155: truncate d6/d10/f14 271673 0 2024-02-15T22:50:51.641 INFO:tasks.workunit.client.0.smithi138.stdout:0/156: chown d6/f15 3 1 2024-02-15T22:50:51.641 INFO:tasks.workunit.client.0.smithi138.stdout:0/157: stat d6/d10/d13/f16 0 2024-02-15T22:50:51.642 INFO:tasks.workunit.client.0.smithi138.stdout:3/240: symlink d5/d12/d23/d29/d4f/l54 0 2024-02-15T22:50:51.644 INFO:tasks.workunit.client.0.smithi138.stdout:5/122: dwrite df/f1a [0,4194304] 0 2024-02-15T22:50:51.644 INFO:tasks.workunit.client.0.smithi138.stdout:5/123: write df/f16 [291813,13254] 0 2024-02-15T22:50:51.646 INFO:tasks.workunit.client.0.smithi138.stdout:1/150: creat df/d1b/d21/f32 x:0 0 0 2024-02-15T22:50:51.647 INFO:tasks.workunit.client.0.smithi138.stdout:0/158: creat d6/f39 x:0 0 0 2024-02-15T22:50:51.647 INFO:tasks.workunit.client.0.smithi138.stdout:0/159: readlink d6/lc 0 2024-02-15T22:50:51.647 INFO:tasks.workunit.client.0.smithi138.stdout:0/160: truncate d6/d10/d18/d1b/f26 280522 0 2024-02-15T22:50:51.648 INFO:tasks.workunit.client.0.smithi138.stdout:4/439: dread d17/d1e/d56/f7a [0,4194304] 0 2024-02-15T22:50:51.653 INFO:tasks.workunit.client.0.smithi138.stdout:5/124: getdents df/d18 0 2024-02-15T22:50:51.653 INFO:tasks.workunit.client.0.smithi138.stdout:5/125: write fd [2087035,45464] 0 2024-02-15T22:50:51.654 INFO:tasks.workunit.client.0.smithi138.stdout:5/126: chown df/l24 11 1 2024-02-15T22:50:51.654 INFO:tasks.workunit.client.0.smithi138.stdout:9/184: rmdir d0/de/d14 39 2024-02-15T22:50:51.655 INFO:tasks.workunit.client.0.smithi138.stdout:3/241: dread d5/d12/f2a [0,4194304] 0 2024-02-15T22:50:51.656 INFO:tasks.workunit.client.0.smithi138.stdout:9/185: mknod d0/d4/c40 0 2024-02-15T22:50:51.657 INFO:tasks.workunit.client.0.smithi138.stdout:3/242: symlink d5/d12/d26/d2f/l55 0 2024-02-15T22:50:51.658 INFO:tasks.workunit.client.0.smithi138.stdout:1/151: dread df/f12 [0,4194304] 0 2024-02-15T22:50:51.660 INFO:tasks.workunit.client.0.smithi138.stdout:9/186: creat d0/de/d14/f41 x:0 0 0 2024-02-15T22:50:51.660 INFO:tasks.workunit.client.0.smithi138.stdout:9/187: creat d0/df/d11/d23/f42 x:0 0 0 2024-02-15T22:50:51.660 INFO:tasks.workunit.client.0.smithi138.stdout:9/188: stat d0/df/d11/d23/f42 0 2024-02-15T22:50:51.662 INFO:tasks.workunit.client.0.smithi138.stdout:0/161: dread d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:50:51.662 INFO:tasks.workunit.client.0.smithi138.stdout:0/162: stat d6 0 2024-02-15T22:50:51.665 INFO:tasks.workunit.client.0.smithi138.stdout:0/163: rename d6/d10/d18/d1b/f22 to d6/d10/d18/d1b/f3a 0 2024-02-15T22:50:51.668 INFO:tasks.workunit.client.0.smithi138.stdout:0/164: creat d6/d10/d34/f3b x:0 0 0 2024-02-15T22:50:51.671 INFO:tasks.workunit.client.0.smithi138.stdout:0/165: rmdir d6/d10/d34/d37 0 2024-02-15T22:50:51.673 INFO:tasks.workunit.client.0.smithi138.stdout:0/166: symlink d6/d10/l3c 0 2024-02-15T22:50:51.674 INFO:tasks.workunit.client.0.smithi138.stdout:3/243: dread d5/d12/f1b [0,4194304] 0 2024-02-15T22:50:51.675 INFO:tasks.workunit.client.0.smithi138.stdout:0/167: mkdir d6/d10/d13/d3d 0 2024-02-15T22:50:51.675 INFO:tasks.workunit.client.0.smithi138.stdout:1/152: dread df/d1b/d1d/d24/f26 [0,4194304] 0 2024-02-15T22:50:51.677 INFO:tasks.workunit.client.0.smithi138.stdout:3/244: mknod d5/d12/d23/c56 0 2024-02-15T22:50:51.679 INFO:tasks.workunit.client.0.smithi138.stdout:0/168: symlink d6/d10/d18/l3e 0 2024-02-15T22:50:51.679 INFO:tasks.workunit.client.0.smithi138.stdout:8/155: sync 2024-02-15T22:50:51.679 INFO:tasks.workunit.client.0.smithi138.stdout:8/156: creat db/dd/d22/f30 x:0 0 0 2024-02-15T22:50:51.679 INFO:tasks.workunit.client.0.smithi138.stdout:8/157: fsync db/dd/d13/d19/d24/f2c 0 2024-02-15T22:50:51.680 INFO:tasks.workunit.client.0.smithi138.stdout:1/153: truncate df/d1b/d1d/d24/f26 119270 0 2024-02-15T22:50:51.682 INFO:tasks.workunit.client.0.smithi138.stdout:3/245: mkdir d5/d16/dc/d43/d57 0 2024-02-15T22:50:51.685 INFO:tasks.workunit.client.0.smithi138.stdout:0/169: unlink d6/f15 0 2024-02-15T22:50:51.685 INFO:tasks.workunit.client.0.smithi138.stdout:4/440: dwrite d17/d1e/d2d/d8c/f8e [0,4194304] 0 2024-02-15T22:50:51.685 INFO:tasks.workunit.client.0.smithi138.stdout:9/189: dwrite d0/de/d14/f30 [0,4194304] 0 2024-02-15T22:50:51.686 INFO:tasks.workunit.client.0.smithi138.stdout:5/127: dwrite df/f19 [4194304,4194304] 0 2024-02-15T22:50:51.688 INFO:tasks.workunit.client.0.smithi138.stdout:8/158: creat db/dd/d13/f31 x:0 0 0 2024-02-15T22:50:51.690 INFO:tasks.workunit.client.0.smithi138.stdout:1/154: mkdir df/d1b/d33 0 2024-02-15T22:50:51.690 INFO:tasks.workunit.client.0.smithi138.stdout:1/155: chown df/d1b/d1d/d24/c29 68302006 1 2024-02-15T22:50:51.691 INFO:tasks.workunit.client.0.smithi138.stdout:0/170: rename d6/lc to d6/l3f 0 2024-02-15T22:50:51.695 INFO:tasks.workunit.client.0.smithi138.stdout:9/190: dread d0/d4/fd [0,4194304] 0 2024-02-15T22:50:51.695 INFO:tasks.workunit.client.0.smithi138.stdout:4/441: creat d17/d1e/d2d/d36/d3e/f94 x:0 0 0 2024-02-15T22:50:51.697 INFO:tasks.workunit.client.0.smithi138.stdout:3/246: dwrite d5/d18/f30 [0,4194304] 0 2024-02-15T22:50:51.703 INFO:tasks.workunit.client.0.smithi138.stdout:9/191: dread d0/de/d14/f1b [4194304,4194304] 0 2024-02-15T22:50:51.703 INFO:tasks.workunit.client.0.smithi138.stdout:9/192: creat d0/df/d11/d23/f43 x:0 0 0 2024-02-15T22:50:51.703 INFO:tasks.workunit.client.0.smithi138.stdout:9/193: dread - d0/df/d11/d23/f43 zero size 2024-02-15T22:50:51.707 INFO:tasks.workunit.client.0.smithi138.stdout:5/128: creat df/d18/f25 x:0 0 0 2024-02-15T22:50:51.707 INFO:tasks.workunit.client.0.smithi138.stdout:5/129: truncate df/f23 85480 0 2024-02-15T22:50:51.707 INFO:tasks.workunit.client.0.smithi138.stdout:5/130: fdatasync f9 0 2024-02-15T22:50:51.708 INFO:tasks.workunit.client.0.smithi138.stdout:8/159: mknod db/d15/c32 0 2024-02-15T22:50:51.709 INFO:tasks.workunit.client.0.smithi138.stdout:1/156: mknod df/d1b/c34 0 2024-02-15T22:50:51.711 INFO:tasks.workunit.client.0.smithi138.stdout:0/171: mkdir d6/d10/d40 0 2024-02-15T22:50:51.713 INFO:tasks.workunit.client.0.smithi138.stdout:4/442: symlink d17/d1e/d2d/d36/l95 0 2024-02-15T22:50:51.716 INFO:tasks.workunit.client.0.smithi138.stdout:3/247: rename d5/d12/d23/c56 to d5/d16/dc/d43/d57/c58 0 2024-02-15T22:50:51.716 INFO:tasks.workunit.client.0.smithi138.stdout:6/211: sync 2024-02-15T22:50:51.716 INFO:tasks.workunit.client.0.smithi138.stdout:2/189: sync 2024-02-15T22:50:51.716 INFO:tasks.workunit.client.0.smithi138.stdout:6/212: chown dc/f13 130466 1 2024-02-15T22:50:51.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/458: sync 2024-02-15T22:50:51.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/172: dread d6/d10/d18/d1b/f3a [0,4194304] 0 2024-02-15T22:50:51.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/173: stat d6/d10/f30 0 2024-02-15T22:50:51.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/174: fsync d6/d10/f11 0 2024-02-15T22:50:51.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/175: write d6/f39 [688640,26750] 0 2024-02-15T22:50:51.723 INFO:tasks.workunit.client.0.smithi138.stdout:9/194: rename d0/df/d11/d23/f39 to d0/de/d14/f44 0 2024-02-15T22:50:51.724 INFO:tasks.workunit.client.0.smithi138.stdout:9/195: fsync d0/df/d11/f32 0 2024-02-15T22:50:51.724 INFO:tasks.workunit.client.0.smithi138.stdout:9/196: dread - d0/d4/f2c zero size 2024-02-15T22:50:51.724 INFO:tasks.workunit.client.0.smithi138.stdout:3/248: mknod d5/d12/d23/d29/d4f/c59 0 2024-02-15T22:50:51.725 INFO:tasks.workunit.client.0.smithi138.stdout:2/190: symlink d0/dd/d15/l47 0 2024-02-15T22:50:51.726 INFO:tasks.workunit.client.0.smithi138.stdout:6/213: symlink dc/d4b/l4c 0 2024-02-15T22:50:51.726 INFO:tasks.workunit.client.0.smithi138.stdout:6/214: dread - dc/d24/d34/d3b/f45 zero size 2024-02-15T22:50:51.727 INFO:tasks.workunit.client.0.smithi138.stdout:7/459: link d1/d2/f9f d1/d79/d84/da0/fa2 0 2024-02-15T22:50:51.729 INFO:tasks.workunit.client.0.smithi138.stdout:8/160: dwrite db/dd/d22/f2f [0,4194304] 0 2024-02-15T22:50:51.730 INFO:tasks.workunit.client.0.smithi138.stdout:5/131: link df/d18/c1b df/c26 0 2024-02-15T22:50:51.730 INFO:tasks.workunit.client.0.smithi138.stdout:3/249: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:51.731 INFO:tasks.workunit.client.0.smithi138.stdout:4/443: getdents d17/d1a 0 2024-02-15T22:50:51.731 INFO:tasks.workunit.client.0.smithi138.stdout:4/444: write d17/d1e/d2d/f7c [4721215,86492] 0 2024-02-15T22:50:51.733 INFO:tasks.workunit.client.0.smithi138.stdout:8/161: write db/f10 [3609805,129233] 0 2024-02-15T22:50:51.734 INFO:tasks.workunit.client.0.smithi138.stdout:1/157: dwrite f8 [0,4194304] 0 2024-02-15T22:50:51.736 INFO:tasks.workunit.client.0.smithi138.stdout:9/197: mknod d0/de/d34/c45 0 2024-02-15T22:50:51.738 INFO:tasks.workunit.client.0.smithi138.stdout:6/215: write f0 [1073961,71977] 0 2024-02-15T22:50:51.738 INFO:tasks.workunit.client.0.smithi138.stdout:6/216: truncate dc/d24/d34/d3b/f45 437447 0 2024-02-15T22:50:51.739 INFO:tasks.workunit.client.0.smithi138.stdout:6/217: write dc/f46 [187857,13473] 0 2024-02-15T22:50:51.740 INFO:tasks.workunit.client.0.smithi138.stdout:4/445: rename d17/d2b/f4f to d17/d1e/d2d/d36/f96 0 2024-02-15T22:50:51.741 INFO:tasks.workunit.client.0.smithi138.stdout:8/162: symlink db/dd/d13/d19/d24/l33 0 2024-02-15T22:50:51.742 INFO:tasks.workunit.client.0.smithi138.stdout:8/163: readlink db/dd/l12 0 2024-02-15T22:50:51.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/158: creat df/d1b/d1d/f35 x:0 0 0 2024-02-15T22:50:51.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/159: dread - df/d1b/d1d/f35 zero size 2024-02-15T22:50:51.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/160: chown df/d1b/d1d/d24/f26 3 1 2024-02-15T22:50:51.744 INFO:tasks.workunit.client.0.smithi138.stdout:9/198: unlink d0/df/d11/f13 0 2024-02-15T22:50:51.744 INFO:tasks.workunit.client.0.smithi138.stdout:2/191: getdents d0/da 0 2024-02-15T22:50:51.746 INFO:tasks.workunit.client.0.smithi138.stdout:6/218: mknod dc/c4d 0 2024-02-15T22:50:51.746 INFO:tasks.workunit.client.0.smithi138.stdout:4/446: dread d17/d1e/f3f [0,4194304] 0 2024-02-15T22:50:51.747 INFO:tasks.workunit.client.0.smithi138.stdout:2/192: dread d0/da/f8 [0,4194304] 0 2024-02-15T22:50:51.748 INFO:tasks.workunit.client.0.smithi138.stdout:1/161: mknod df/d1b/d33/c36 0 2024-02-15T22:50:51.748 INFO:tasks.workunit.client.0.smithi138.stdout:1/162: readlink df/l13 0 2024-02-15T22:50:51.748 INFO:tasks.workunit.client.0.smithi138.stdout:1/163: stat df/f16 0 2024-02-15T22:50:51.749 INFO:tasks.workunit.client.0.smithi138.stdout:9/199: mknod d0/df/d11/d23/c46 0 2024-02-15T22:50:51.750 INFO:tasks.workunit.client.0.smithi138.stdout:6/219: mknod dc/d24/c4e 0 2024-02-15T22:50:51.750 INFO:tasks.workunit.client.0.smithi138.stdout:6/220: read - dc/f3e zero size 2024-02-15T22:50:51.751 INFO:tasks.workunit.client.0.smithi138.stdout:4/447: mknod d17/d2b/d78/c97 0 2024-02-15T22:50:51.760 INFO:tasks.workunit.client.0.smithi138.stdout:3/250: dwrite d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:51.766 INFO:tasks.workunit.client.0.smithi138.stdout:7/460: dwrite d1/d2/db/d3c/f45 [0,4194304] 0 2024-02-15T22:50:51.766 INFO:tasks.workunit.client.0.smithi138.stdout:7/461: dread - d1/d79/d84/da0/fa2 zero size 2024-02-15T22:50:51.767 INFO:tasks.workunit.client.0.smithi138.stdout:9/200: dread d0/de/d33/f3d [0,4194304] 0 2024-02-15T22:50:51.767 INFO:tasks.workunit.client.0.smithi138.stdout:9/201: write d0/df/d11/d23/f43 [544254,25182] 0 2024-02-15T22:50:51.767 INFO:tasks.workunit.client.0.smithi138.stdout:7/462: dread d1/d79/d84/f8e [0,4194304] 0 2024-02-15T22:50:51.769 INFO:tasks.workunit.client.0.smithi138.stdout:7/463: getdents d1/d2 0 2024-02-15T22:50:51.774 INFO:tasks.workunit.client.0.smithi138.stdout:0/176: dwrite d6/d10/f11 [0,4194304] 0 2024-02-15T22:50:51.781 INFO:tasks.workunit.client.0.smithi138.stdout:9/202: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:51.782 INFO:tasks.workunit.client.0.smithi138.stdout:7/464: write d1/d2/d29/f2d [38965,27886] 0 2024-02-15T22:50:51.782 INFO:tasks.workunit.client.0.smithi138.stdout:7/465: readlink d1/d2/db/d3c/d4d/d5b/l5f 0 2024-02-15T22:50:51.782 INFO:tasks.workunit.client.0.smithi138.stdout:5/132: truncate df/f19 7519842 0 2024-02-15T22:50:51.785 INFO:tasks.workunit.client.0.smithi138.stdout:7/466: symlink d1/d2/db/d3c/d4d/la3 0 2024-02-15T22:50:51.797 INFO:tasks.workunit.client.0.smithi138.stdout:1/164: dwrite df/f14 [0,4194304] 0 2024-02-15T22:50:51.797 INFO:tasks.workunit.client.0.smithi138.stdout:1/165: truncate df/d1b/d1d/f2a 682182 0 2024-02-15T22:50:51.797 INFO:tasks.workunit.client.0.smithi138.stdout:1/166: chown df/d1b/l1e 0 1 2024-02-15T22:50:51.797 INFO:tasks.workunit.client.0.smithi138.stdout:1/167: chown df/d1b/d1d/d24/f26 81 1 2024-02-15T22:50:51.798 INFO:tasks.workunit.client.0.smithi138.stdout:6/221: dwrite dc/d24/f2c [0,4194304] 0 2024-02-15T22:50:51.799 INFO:tasks.workunit.client.0.smithi138.stdout:2/193: dwrite d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:51.799 INFO:tasks.workunit.client.0.smithi138.stdout:6/222: dread dc/f15 [0,4194304] 0 2024-02-15T22:50:51.802 INFO:tasks.workunit.client.0.smithi138.stdout:2/194: dread d0/da/d19/f2d [0,4194304] 0 2024-02-15T22:50:51.802 INFO:tasks.workunit.client.0.smithi138.stdout:2/195: getdents d0/da/d19/d3f 0 2024-02-15T22:50:51.802 INFO:tasks.workunit.client.0.smithi138.stdout:2/196: readlink d0/dd/d15/l1c 0 2024-02-15T22:50:51.802 INFO:tasks.workunit.client.0.smithi138.stdout:8/164: dwrite db/f10 [0,4194304] 0 2024-02-15T22:50:51.804 INFO:tasks.workunit.client.0.smithi138.stdout:9/203: write d0/f1d [2342600,63319] 0 2024-02-15T22:50:51.804 INFO:tasks.workunit.client.0.smithi138.stdout:4/448: dwrite d17/d1e/f3f [0,4194304] 0 2024-02-15T22:50:51.804 INFO:tasks.workunit.client.0.smithi138.stdout:0/177: dwrite d6/fb [0,4194304] 0 2024-02-15T22:50:51.808 INFO:tasks.workunit.client.0.smithi138.stdout:8/165: mkdir db/d34 0 2024-02-15T22:50:51.808 INFO:tasks.workunit.client.0.smithi138.stdout:8/166: chown db/dd/d22 2969 1 2024-02-15T22:50:51.810 INFO:tasks.workunit.client.0.smithi138.stdout:3/251: dwrite d5/d16/f10 [4194304,4194304] 0 2024-02-15T22:50:51.811 INFO:tasks.workunit.client.0.smithi138.stdout:4/449: creat d17/d1e/d2d/d36/f98 x:0 0 0 2024-02-15T22:50:51.812 INFO:tasks.workunit.client.0.smithi138.stdout:1/168: dread df/f11 [0,4194304] 0 2024-02-15T22:50:51.812 INFO:tasks.workunit.client.0.smithi138.stdout:2/197: link d0/da/l24 d0/d3/l48 0 2024-02-15T22:50:51.813 INFO:tasks.workunit.client.0.smithi138.stdout:2/198: read - d0/f3b zero size 2024-02-15T22:50:51.814 INFO:tasks.workunit.client.0.smithi138.stdout:4/450: stat d17/d1e/d2d/l46 0 2024-02-15T22:50:51.816 INFO:tasks.workunit.client.0.smithi138.stdout:9/204: dread d0/f19 [0,4194304] 0 2024-02-15T22:50:51.816 INFO:tasks.workunit.client.0.smithi138.stdout:9/205: creat d0/de/f47 x:0 0 0 2024-02-15T22:50:51.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/178: write d6/d10/d13/f2c [4069661,32455] 0 2024-02-15T22:50:51.818 INFO:tasks.workunit.client.0.smithi138.stdout:8/167: read f5 [370652,42697] 0 2024-02-15T22:50:51.819 INFO:tasks.workunit.client.0.smithi138.stdout:6/223: dwrite f2 [0,4194304] 0 2024-02-15T22:50:51.822 INFO:tasks.workunit.client.0.smithi138.stdout:3/252: write d5/d12/f2a [1782864,97749] 0 2024-02-15T22:50:51.822 INFO:tasks.workunit.client.0.smithi138.stdout:3/253: write d5/d12/d23/d29/d4f/f53 [1696662,91035] 0 2024-02-15T22:50:51.823 INFO:tasks.workunit.client.0.smithi138.stdout:0/179: creat d6/d10/d13/f41 x:0 0 0 2024-02-15T22:50:51.823 INFO:tasks.workunit.client.0.smithi138.stdout:1/169: write df/f15 [2716139,46601] 0 2024-02-15T22:50:51.825 INFO:tasks.workunit.client.0.smithi138.stdout:6/224: symlink dc/d24/d34/d3b/l4f 0 2024-02-15T22:50:51.826 INFO:tasks.workunit.client.0.smithi138.stdout:4/451: dread d17/d1e/f28 [0,4194304] 0 2024-02-15T22:50:51.828 INFO:tasks.workunit.client.0.smithi138.stdout:0/180: link f0 d6/f42 0 2024-02-15T22:50:51.829 INFO:tasks.workunit.client.0.smithi138.stdout:6/225: mknod dc/d24/d34/c50 0 2024-02-15T22:50:51.829 INFO:tasks.workunit.client.0.smithi138.stdout:6/226: creat dc/d24/f51 x:0 0 0 2024-02-15T22:50:51.832 INFO:tasks.workunit.client.0.smithi138.stdout:3/254: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:51.832 INFO:tasks.workunit.client.0.smithi138.stdout:8/168: dread db/dd/f1d [0,4194304] 0 2024-02-15T22:50:51.833 INFO:tasks.workunit.client.0.smithi138.stdout:5/133: write df/f19 [5437901,85890] 0 2024-02-15T22:50:51.833 INFO:tasks.workunit.client.0.smithi138.stdout:5/134: stat f9 0 2024-02-15T22:50:51.834 INFO:tasks.workunit.client.0.smithi138.stdout:0/181: dread d6/d10/d18/d1b/f26 [0,4194304] 0 2024-02-15T22:50:51.834 INFO:tasks.workunit.client.0.smithi138.stdout:8/169: dread db/dd/f1d [0,4194304] 0 2024-02-15T22:50:51.837 INFO:tasks.workunit.client.0.smithi138.stdout:3/255: unlink d5/d12/d26/d2f/f39 0 2024-02-15T22:50:51.838 INFO:tasks.workunit.client.0.smithi138.stdout:1/170: dread df/f19 [0,4194304] 0 2024-02-15T22:50:51.838 INFO:tasks.workunit.client.0.smithi138.stdout:5/135: creat df/f27 x:0 0 0 2024-02-15T22:50:51.840 INFO:tasks.workunit.client.0.smithi138.stdout:2/199: dwrite d0/f3b [0,4194304] 0 2024-02-15T22:50:51.841 INFO:tasks.workunit.client.0.smithi138.stdout:8/170: mknod db/dd/d22/c35 0 2024-02-15T22:50:51.843 INFO:tasks.workunit.client.0.smithi138.stdout:5/136: dread df/f16 [0,4194304] 0 2024-02-15T22:50:51.844 INFO:tasks.workunit.client.0.smithi138.stdout:0/182: read d6/d10/d13/f25 [62036,93589] 0 2024-02-15T22:50:51.844 INFO:tasks.workunit.client.0.smithi138.stdout:4/452: link cc d17/c99 0 2024-02-15T22:50:51.846 INFO:tasks.workunit.client.0.smithi138.stdout:1/171: mkdir df/d1b/d1d/d25/d2e/d37 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:0/183: dread d6/d10/d13/f25 [0,4194304] 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:0/184: chown d6/lf 109 1 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:2/200: truncate d0/f1 8989205 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:2/201: creat d0/dd/d15/f49 x:0 0 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/137: stat le 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/138: readlink df/l1d 0 2024-02-15T22:50:51.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/139: creat df/d18/f28 x:0 0 0 2024-02-15T22:50:51.850 INFO:tasks.workunit.client.0.smithi138.stdout:1/172: creat df/d1b/d1d/d24/f38 x:0 0 0 2024-02-15T22:50:51.850 INFO:tasks.workunit.client.0.smithi138.stdout:0/185: creat d6/d10/d40/f43 x:0 0 0 2024-02-15T22:50:51.850 INFO:tasks.workunit.client.0.smithi138.stdout:0/186: chown d6/l27 0 1 2024-02-15T22:50:51.851 INFO:tasks.workunit.client.0.smithi138.stdout:2/202: creat d0/da/d19/d3f/f4a x:0 0 0 2024-02-15T22:50:51.852 INFO:tasks.workunit.client.0.smithi138.stdout:1/173: rmdir df 39 2024-02-15T22:50:51.853 INFO:tasks.workunit.client.0.smithi138.stdout:1/174: getdents df/d1b/d1d/d25 0 2024-02-15T22:50:51.854 INFO:tasks.workunit.client.0.smithi138.stdout:1/175: creat df/d1b/d1d/d25/d2c/f39 x:0 0 0 2024-02-15T22:50:51.854 INFO:tasks.workunit.client.0.smithi138.stdout:1/176: fdatasync f4 0 2024-02-15T22:50:51.918 INFO:tasks.workunit.client.0.smithi138.stdout:9/206: dwrite d0/d4/fd [0,4194304] 0 2024-02-15T22:50:51.919 INFO:tasks.workunit.client.0.smithi138.stdout:9/207: fsync d0/df/d11/f17 0 2024-02-15T22:50:51.925 INFO:tasks.workunit.client.0.smithi138.stdout:6/227: dwrite dc/d24/d34/f49 [0,4194304] 0 2024-02-15T22:50:51.927 INFO:tasks.workunit.client.0.smithi138.stdout:5/140: write fc [3820410,124760] 0 2024-02-15T22:50:51.927 INFO:tasks.workunit.client.0.smithi138.stdout:5/141: write df/d18/f25 [722226,48289] 0 2024-02-15T22:50:51.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/187: dread d6/f42 [0,4194304] 0 2024-02-15T22:50:51.932 INFO:tasks.workunit.client.0.smithi138.stdout:9/208: dread d0/d4/f2b [0,4194304] 0 2024-02-15T22:50:51.936 INFO:tasks.workunit.client.0.smithi138.stdout:0/188: write d6/fb [3198829,11304] 0 2024-02-15T22:50:51.936 INFO:tasks.workunit.client.0.smithi138.stdout:0/189: readlink d6/l3f 0 2024-02-15T22:50:51.937 INFO:tasks.workunit.client.0.smithi138.stdout:3/256: dwrite d5/d12/d23/d29/d4a/f52 [0,4194304] 0 2024-02-15T22:50:51.937 INFO:tasks.workunit.client.0.smithi138.stdout:6/228: write dc/d24/d34/f49 [338775,37095] 0 2024-02-15T22:50:51.938 INFO:tasks.workunit.client.0.smithi138.stdout:8/171: dwrite f3 [4194304,4194304] 0 2024-02-15T22:50:51.938 INFO:tasks.workunit.client.0.smithi138.stdout:4/453: dwrite f10 [4194304,4194304] 0 2024-02-15T22:50:51.938 INFO:tasks.workunit.client.0.smithi138.stdout:4/454: write d17/d1e/d2d/d36/d3e/d64/f41 [4329909,115503] 0 2024-02-15T22:50:51.948 INFO:tasks.workunit.client.0.smithi138.stdout:9/209: mkdir d0/de/d48 0 2024-02-15T22:50:51.948 INFO:tasks.workunit.client.0.smithi138.stdout:9/210: read d0/f1d [469946,76762] 0 2024-02-15T22:50:51.952 INFO:tasks.workunit.client.0.smithi138.stdout:2/203: truncate d0/f3b 2284622 0 2024-02-15T22:50:51.953 INFO:tasks.workunit.client.0.smithi138.stdout:2/204: stat d0/dd/d15/f43 0 2024-02-15T22:50:51.953 INFO:tasks.workunit.client.0.smithi138.stdout:2/205: write d0/da/f46 [797962,34795] 0 2024-02-15T22:50:51.959 INFO:tasks.workunit.client.0.smithi138.stdout:0/190: dwrite d6/d10/d18/d1b/f26 [0,4194304] 0 2024-02-15T22:50:51.960 INFO:tasks.workunit.client.0.smithi138.stdout:8/172: dwrite db/f10 [0,4194304] 0 2024-02-15T22:50:51.964 INFO:tasks.workunit.client.0.smithi138.stdout:5/142: getdents df/d18 0 2024-02-15T22:50:51.964 INFO:tasks.workunit.client.0.smithi138.stdout:1/177: truncate df/f14 3060299 0 2024-02-15T22:50:51.971 INFO:tasks.workunit.client.0.smithi138.stdout:6/229: creat dc/d24/d34/f52 x:0 0 0 2024-02-15T22:50:51.974 INFO:tasks.workunit.client.0.smithi138.stdout:4/455: unlink d17/d1e/d2d/d36/f6f 0 2024-02-15T22:50:51.976 INFO:tasks.workunit.client.0.smithi138.stdout:9/211: link d0/f20 d0/de/d14/d18/f49 0 2024-02-15T22:50:51.978 INFO:tasks.workunit.client.0.smithi138.stdout:2/206: dwrite d0/f22 [0,4194304] 0 2024-02-15T22:50:51.980 INFO:tasks.workunit.client.0.smithi138.stdout:3/257: rmdir d5/d12/d26/d2e 39 2024-02-15T22:50:51.980 INFO:tasks.workunit.client.0.smithi138.stdout:0/191: dwrite d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:51.981 INFO:tasks.workunit.client.0.smithi138.stdout:0/192: fdatasync d6/d10/f11 0 2024-02-15T22:50:51.981 INFO:tasks.workunit.client.0.smithi138.stdout:0/193: write d6/d10/f31 [36552,28468] 0 2024-02-15T22:50:51.981 INFO:tasks.workunit.client.0.smithi138.stdout:0/194: fsync d6/d10/d18/d1b/f3a 0 2024-02-15T22:50:51.985 INFO:tasks.workunit.client.0.smithi138.stdout:8/173: creat db/d15/f36 x:0 0 0 2024-02-15T22:50:51.987 INFO:tasks.workunit.client.0.smithi138.stdout:5/143: rename df/f23 to df/d18/f29 0 2024-02-15T22:50:51.988 INFO:tasks.workunit.client.0.smithi138.stdout:1/178: mkdir df/d1b/d1d/d24/d3a 0 2024-02-15T22:50:51.989 INFO:tasks.workunit.client.0.smithi138.stdout:2/207: dread d0/da/f23 [0,4194304] 0 2024-02-15T22:50:51.989 INFO:tasks.workunit.client.0.smithi138.stdout:6/230: getdents dc/d4b 0 2024-02-15T22:50:51.989 INFO:tasks.workunit.client.0.smithi138.stdout:2/208: write d0/da/f46 [137293,49207] 0 2024-02-15T22:50:51.992 INFO:tasks.workunit.client.0.smithi138.stdout:9/212: symlink d0/de/d48/l4a 0 2024-02-15T22:50:51.992 INFO:tasks.workunit.client.0.smithi138.stdout:9/213: dread - d0/df/d11/d23/f42 zero size 2024-02-15T22:50:51.997 INFO:tasks.workunit.client.0.smithi138.stdout:6/231: dread f0 [0,4194304] 0 2024-02-15T22:50:51.998 INFO:tasks.workunit.client.0.smithi138.stdout:3/258: unlink d5/d18/f30 0 2024-02-15T22:50:52.008 INFO:tasks.workunit.client.0.smithi138.stdout:0/195: unlink d6/l27 0 2024-02-15T22:50:52.009 INFO:tasks.workunit.client.0.smithi138.stdout:0/196: write d6/d10/f14 [405605,31240] 0 2024-02-15T22:50:52.009 INFO:tasks.workunit.client.0.smithi138.stdout:0/197: dread - d6/d10/d40/f43 zero size 2024-02-15T22:50:52.009 INFO:tasks.workunit.client.0.smithi138.stdout:0/198: dread - d6/d10/d34/f3b zero size 2024-02-15T22:50:52.010 INFO:tasks.workunit.client.0.smithi138.stdout:8/174: rename db/dd/d13/d19/d24/l2b to db/dd/d13/d19/l37 0 2024-02-15T22:50:52.011 INFO:tasks.workunit.client.0.smithi138.stdout:6/232: read dc/d24/f2c [852060,96221] 0 2024-02-15T22:50:52.012 INFO:tasks.workunit.client.0.smithi138.stdout:6/233: read dc/d24/f26 [232911,78038] 0 2024-02-15T22:50:52.012 INFO:tasks.workunit.client.0.smithi138.stdout:6/234: chown dc/d24/f47 47362092 1 2024-02-15T22:50:52.013 INFO:tasks.workunit.client.0.smithi138.stdout:1/179: symlink df/d1b/d1d/d24/l3b 0 2024-02-15T22:50:52.014 INFO:tasks.workunit.client.0.smithi138.stdout:4/456: rmdir d17/d1e/d2d/d36/d3e 39 2024-02-15T22:50:52.014 INFO:tasks.workunit.client.0.smithi138.stdout:4/457: creat d17/d1e/d2d/d8c/f9a x:0 0 0 2024-02-15T22:50:52.016 INFO:tasks.workunit.client.0.smithi138.stdout:2/209: dwrite d0/da/f46 [0,4194304] 0 2024-02-15T22:50:52.016 INFO:tasks.workunit.client.0.smithi138.stdout:2/210: creat d0/dd/d15/f4b x:0 0 0 2024-02-15T22:50:52.016 INFO:tasks.workunit.client.0.smithi138.stdout:2/211: write d0/da/f8 [2322013,92750] 0 2024-02-15T22:50:52.017 INFO:tasks.workunit.client.0.smithi138.stdout:9/214: symlink d0/d1/l4b 0 2024-02-15T22:50:52.017 INFO:tasks.workunit.client.0.smithi138.stdout:9/215: dread - d0/de/d14/f2a zero size 2024-02-15T22:50:52.017 INFO:tasks.workunit.client.0.smithi138.stdout:9/216: dread - d0/de/d14/f2a zero size 2024-02-15T22:50:52.020 INFO:tasks.workunit.client.0.smithi138.stdout:8/175: link db/dd/d22/f30 db/f38 0 2024-02-15T22:50:52.020 INFO:tasks.workunit.client.0.smithi138.stdout:8/176: creat db/f39 x:0 0 0 2024-02-15T22:50:52.021 INFO:tasks.workunit.client.0.smithi138.stdout:5/144: symlink df/d18/l2a 0 2024-02-15T22:50:52.022 INFO:tasks.workunit.client.0.smithi138.stdout:5/145: write df/f13 [176714,28231] 0 2024-02-15T22:50:52.023 INFO:tasks.workunit.client.0.smithi138.stdout:6/235: unlink dc/f14 0 2024-02-15T22:50:52.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/180: link df/c1c df/c3c 0 2024-02-15T22:50:52.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/181: fsync df/f12 0 2024-02-15T22:50:52.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/182: chown df/l13 50328460 1 2024-02-15T22:50:52.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/183: dread - df/d1b/d1d/d24/f38 zero size 2024-02-15T22:50:52.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/184: write df/f15 [1810422,91364] 0 2024-02-15T22:50:52.028 INFO:tasks.workunit.client.0.smithi138.stdout:4/458: creat d17/d1a/f9b x:0 0 0 2024-02-15T22:50:52.032 INFO:tasks.workunit.client.0.smithi138.stdout:5/146: write f5 [2627801,61883] 0 2024-02-15T22:50:52.032 INFO:tasks.workunit.client.0.smithi138.stdout:5/147: fdatasync fc 0 2024-02-15T22:50:52.032 INFO:tasks.workunit.client.0.smithi138.stdout:3/259: dwrite d5/d12/d23/f51 [0,4194304] 0 2024-02-15T22:50:52.033 INFO:tasks.workunit.client.0.smithi138.stdout:2/212: mknod d0/da/d19/d3f/c4c 0 2024-02-15T22:50:52.036 INFO:tasks.workunit.client.0.smithi138.stdout:8/177: write db/f10 [959368,18186] 0 2024-02-15T22:50:52.038 INFO:tasks.workunit.client.0.smithi138.stdout:9/217: creat d0/d1/f4c x:0 0 0 2024-02-15T22:50:52.040 INFO:tasks.workunit.client.0.smithi138.stdout:0/199: getdents d6/d10/d13 0 2024-02-15T22:50:52.048 INFO:tasks.workunit.client.0.smithi138.stdout:1/185: creat df/d1b/f3d x:0 0 0 2024-02-15T22:50:52.049 INFO:tasks.workunit.client.0.smithi138.stdout:4/459: dwrite d17/d1e/d2d/d52/f5d [0,4194304] 0 2024-02-15T22:50:52.055 INFO:tasks.workunit.client.0.smithi138.stdout:3/260: mkdir d5/d12/d23/d29/d5a 0 2024-02-15T22:50:52.064 INFO:tasks.workunit.client.0.smithi138.stdout:2/213: dwrite d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:52.064 INFO:tasks.workunit.client.0.smithi138.stdout:1/186: rename df/f16 to df/d1b/d1d/d25/d2e/d37/f3e 0 2024-02-15T22:50:52.069 INFO:tasks.workunit.client.0.smithi138.stdout:5/148: mkdir df/d18/d2b 0 2024-02-15T22:50:52.070 INFO:tasks.workunit.client.0.smithi138.stdout:0/200: getdents d6/d10/d40 0 2024-02-15T22:50:52.072 INFO:tasks.workunit.client.0.smithi138.stdout:2/214: symlink d0/dd/d15/l4d 0 2024-02-15T22:50:52.073 INFO:tasks.workunit.client.0.smithi138.stdout:1/187: mkdir df/d1b/d1d/d25/d2c/d3f 0 2024-02-15T22:50:52.074 INFO:tasks.workunit.client.0.smithi138.stdout:1/188: stat df/f14 0 2024-02-15T22:50:52.075 INFO:tasks.workunit.client.0.smithi138.stdout:4/460: symlink d17/l9c 0 2024-02-15T22:50:52.077 INFO:tasks.workunit.client.0.smithi138.stdout:0/201: mknod d6/d10/d40/c44 0 2024-02-15T22:50:52.077 INFO:tasks.workunit.client.0.smithi138.stdout:7/467: sync 2024-02-15T22:50:52.077 INFO:tasks.workunit.client.0.smithi138.stdout:7/468: readlink d1/d2/d29/l32 0 2024-02-15T22:50:52.079 INFO:tasks.workunit.client.0.smithi138.stdout:8/178: dwrite db/f28 [0,4194304] 0 2024-02-15T22:50:52.079 INFO:tasks.workunit.client.0.smithi138.stdout:3/261: dwrite d5/d16/fa [0,4194304] 0 2024-02-15T22:50:52.079 INFO:tasks.workunit.client.0.smithi138.stdout:3/262: chown d5/d16/dc/d43 29 1 2024-02-15T22:50:52.079 INFO:tasks.workunit.client.0.smithi138.stdout:3/263: truncate d5/d12/f2a 4970150 0 2024-02-15T22:50:52.079 INFO:tasks.workunit.client.0.smithi138.stdout:3/264: chown d5/d12/d26/d2f/l45 31871998 1 2024-02-15T22:50:52.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/202: write d6/f39 [109908,118004] 0 2024-02-15T22:50:52.080 INFO:tasks.workunit.client.0.smithi138.stdout:1/189: creat df/d1b/d1d/d24/d3a/f40 x:0 0 0 2024-02-15T22:50:52.080 INFO:tasks.workunit.client.0.smithi138.stdout:9/218: dwrite d0/d4/f2c [0,4194304] 0 2024-02-15T22:50:52.080 INFO:tasks.workunit.client.0.smithi138.stdout:5/149: dread fd [0,4194304] 0 2024-02-15T22:50:52.080 INFO:tasks.workunit.client.0.smithi138.stdout:5/150: write fd [5147981,64548] 0 2024-02-15T22:50:52.081 INFO:tasks.workunit.client.0.smithi138.stdout:4/461: unlink cc 0 2024-02-15T22:50:52.084 INFO:tasks.workunit.client.0.smithi138.stdout:7/469: rename d1/d79/l9d to d1/d2/db/d25/d41/la4 0 2024-02-15T22:50:52.084 INFO:tasks.workunit.client.0.smithi138.stdout:7/470: write d1/d2/db/d25/f99 [731965,85953] 0 2024-02-15T22:50:52.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/265: write d5/d12/f1b [1354254,63089] 0 2024-02-15T22:50:52.090 INFO:tasks.workunit.client.0.smithi138.stdout:2/215: dwrite d0/da/d19/f2a [0,4194304] 0 2024-02-15T22:50:52.090 INFO:tasks.workunit.client.0.smithi138.stdout:2/216: dread - d0/da/d19/d3f/f4a zero size 2024-02-15T22:50:52.101 INFO:tasks.workunit.client.0.smithi138.stdout:9/219: symlink d0/df/d11/d23/l4d 0 2024-02-15T22:50:52.106 INFO:tasks.workunit.client.0.smithi138.stdout:7/471: rename d1/d2/db/f38 to d1/d79/d84/da0/fa5 0 2024-02-15T22:50:52.110 INFO:tasks.workunit.client.0.smithi138.stdout:8/179: dwrite db/dd/f14 [0,4194304] 0 2024-02-15T22:50:52.111 INFO:tasks.workunit.client.0.smithi138.stdout:9/220: write d0/de/d33/f3d [2081192,5923] 0 2024-02-15T22:50:52.114 INFO:tasks.workunit.client.0.smithi138.stdout:4/462: dwrite d17/d1e/d2d/d52/f8d [0,4194304] 0 2024-02-15T22:50:52.114 INFO:tasks.workunit.client.0.smithi138.stdout:2/217: dwrite d0/d3/f44 [0,4194304] 0 2024-02-15T22:50:52.114 INFO:tasks.workunit.client.0.smithi138.stdout:3/266: dwrite d5/d16/f10 [4194304,4194304] 0 2024-02-15T22:50:52.115 INFO:tasks.workunit.client.0.smithi138.stdout:2/218: creat d0/dd/f4e x:0 0 0 2024-02-15T22:50:52.115 INFO:tasks.workunit.client.0.smithi138.stdout:2/219: truncate d0/da/d19/f1b 5217566 0 2024-02-15T22:50:52.115 INFO:tasks.workunit.client.0.smithi138.stdout:7/472: rename d1/d79/d84/c8b to d1/d2/db/d3c/d4d/d5b/ca6 0 2024-02-15T22:50:52.116 INFO:tasks.workunit.client.0.smithi138.stdout:5/151: rmdir df 39 2024-02-15T22:50:52.122 INFO:tasks.workunit.client.0.smithi138.stdout:8/180: symlink db/dd/d13/d19/l3a 0 2024-02-15T22:50:52.124 INFO:tasks.workunit.client.0.smithi138.stdout:8/181: write db/f29 [796229,80108] 0 2024-02-15T22:50:52.124 INFO:tasks.workunit.client.0.smithi138.stdout:8/182: fsync f3 0 2024-02-15T22:50:52.125 INFO:tasks.workunit.client.0.smithi138.stdout:2/220: dread d0/da/f46 [0,4194304] 0 2024-02-15T22:50:52.125 INFO:tasks.workunit.client.0.smithi138.stdout:2/221: creat d0/dd/f4f x:0 0 0 2024-02-15T22:50:52.126 INFO:tasks.workunit.client.0.smithi138.stdout:4/463: stat d17/d1e/d2d/d36/d3e/d64/c48 0 2024-02-15T22:50:52.126 INFO:tasks.workunit.client.0.smithi138.stdout:0/203: rmdir d6 39 2024-02-15T22:50:52.132 INFO:tasks.workunit.client.0.smithi138.stdout:5/152: symlink df/d18/d2b/l2c 0 2024-02-15T22:50:52.135 INFO:tasks.workunit.client.0.smithi138.stdout:4/464: dread d17/f18 [0,4194304] 0 2024-02-15T22:50:52.136 INFO:tasks.workunit.client.0.smithi138.stdout:9/221: dwrite d0/f1d [4194304,4194304] 0 2024-02-15T22:50:52.136 INFO:tasks.workunit.client.0.smithi138.stdout:8/183: dread f3 [4194304,4194304] 0 2024-02-15T22:50:52.136 INFO:tasks.workunit.client.0.smithi138.stdout:3/267: dwrite d5/d12/f2a [0,4194304] 0 2024-02-15T22:50:52.136 INFO:tasks.workunit.client.0.smithi138.stdout:8/184: creat db/dd/d13/f3b x:0 0 0 2024-02-15T22:50:52.136 INFO:tasks.workunit.client.0.smithi138.stdout:8/185: dread - db/f38 zero size 2024-02-15T22:50:52.137 INFO:tasks.workunit.client.0.smithi138.stdout:2/222: creat d0/da/d19/f50 x:0 0 0 2024-02-15T22:50:52.138 INFO:tasks.workunit.client.0.smithi138.stdout:0/204: creat d6/d10/d13/f45 x:0 0 0 2024-02-15T22:50:52.138 INFO:tasks.workunit.client.0.smithi138.stdout:0/205: write d6/d10/f31 [34250,103019] 0 2024-02-15T22:50:52.146 INFO:tasks.workunit.client.0.smithi138.stdout:9/222: truncate d0/de/d14/f1b 3015128 0 2024-02-15T22:50:52.146 INFO:tasks.workunit.client.0.smithi138.stdout:9/223: write d0/de/d14/f41 [1042383,29305] 0 2024-02-15T22:50:52.149 INFO:tasks.workunit.client.0.smithi138.stdout:3/268: creat d5/d12/d26/d2e/f5b x:0 0 0 2024-02-15T22:50:52.149 INFO:tasks.workunit.client.0.smithi138.stdout:3/269: write d5/d12/d26/f2d [709765,82537] 0 2024-02-15T22:50:52.151 INFO:tasks.workunit.client.0.smithi138.stdout:2/223: rename d0/da/d19/f50 to d0/f51 0 2024-02-15T22:50:52.151 INFO:tasks.workunit.client.0.smithi138.stdout:2/224: chown d0/da/l24 249099 1 2024-02-15T22:50:52.152 INFO:tasks.workunit.client.0.smithi138.stdout:4/465: write d17/d1e/d2d/d52/f72 [350968,121173] 0 2024-02-15T22:50:52.153 INFO:tasks.workunit.client.0.smithi138.stdout:5/153: symlink df/d18/l2d 0 2024-02-15T22:50:52.154 INFO:tasks.workunit.client.0.smithi138.stdout:9/224: creat d0/df/f4e x:0 0 0 2024-02-15T22:50:52.155 INFO:tasks.workunit.client.0.smithi138.stdout:2/225: mkdir d0/d52 0 2024-02-15T22:50:52.155 INFO:tasks.workunit.client.0.smithi138.stdout:2/226: readlink d0/dd/d15/l47 0 2024-02-15T22:50:52.155 INFO:tasks.workunit.client.0.smithi138.stdout:2/227: dread - d0/dd/f4e zero size 2024-02-15T22:50:52.159 INFO:tasks.workunit.client.0.smithi138.stdout:2/228: mkdir d0/da/d19/d53 0 2024-02-15T22:50:52.159 INFO:tasks.workunit.client.0.smithi138.stdout:2/229: truncate d0/dd/d15/f49 311066 0 2024-02-15T22:50:52.159 INFO:tasks.workunit.client.0.smithi138.stdout:2/230: creat d0/da/d19/f54 x:0 0 0 2024-02-15T22:50:52.159 INFO:tasks.workunit.client.0.smithi138.stdout:2/231: creat d0/da/d19/f55 x:0 0 0 2024-02-15T22:50:52.160 INFO:tasks.workunit.client.0.smithi138.stdout:5/154: link df/f27 df/f2e 0 2024-02-15T22:50:52.163 INFO:tasks.workunit.client.0.smithi138.stdout:0/206: getdents d6/d10/d13 0 2024-02-15T22:50:52.168 INFO:tasks.workunit.client.0.smithi138.stdout:4/466: dread d17/d1e/d2d/d8c/f8e [0,4194304] 0 2024-02-15T22:50:52.168 INFO:tasks.workunit.client.0.smithi138.stdout:2/232: symlink d0/da/d19/l56 0 2024-02-15T22:50:52.169 INFO:tasks.workunit.client.0.smithi138.stdout:2/233: fdatasync d0/dd/f4f 0 2024-02-15T22:50:52.169 INFO:tasks.workunit.client.0.smithi138.stdout:2/234: truncate d0/f51 854520 0 2024-02-15T22:50:52.169 INFO:tasks.workunit.client.0.smithi138.stdout:2/235: truncate d0/f37 4588415 0 2024-02-15T22:50:52.169 INFO:tasks.workunit.client.0.smithi138.stdout:0/207: creat d6/d10/d18/d1b/f46 x:0 0 0 2024-02-15T22:50:52.179 INFO:tasks.workunit.client.0.smithi138.stdout:3/270: dwrite d5/d12/d23/f51 [0,4194304] 0 2024-02-15T22:50:52.179 INFO:tasks.workunit.client.0.smithi138.stdout:9/225: dwrite d0/de/d14/f44 [0,4194304] 0 2024-02-15T22:50:52.179 INFO:tasks.workunit.client.0.smithi138.stdout:3/271: write d5/d12/d23/f28 [4640382,70297] 0 2024-02-15T22:50:52.179 INFO:tasks.workunit.client.0.smithi138.stdout:5/155: dwrite df/f1a [0,4194304] 0 2024-02-15T22:50:52.179 INFO:tasks.workunit.client.0.smithi138.stdout:5/156: chown df/l1d 625018086 1 2024-02-15T22:50:52.234 INFO:tasks.workunit.client.0.smithi138.stdout:2/236: rename d0/f22 to d0/dd/d15/f57 0 2024-02-15T22:50:52.236 INFO:tasks.workunit.client.0.smithi138.stdout:0/208: link d6/d10/d18/c28 d6/d10/d18/c47 0 2024-02-15T22:50:52.236 INFO:tasks.workunit.client.0.smithi138.stdout:0/209: stat d6/d10/c1f 0 2024-02-15T22:50:52.238 INFO:tasks.workunit.client.0.smithi138.stdout:4/467: getdents d17/d1e/d2d/d36 0 2024-02-15T22:50:52.238 INFO:tasks.workunit.client.0.smithi138.stdout:4/468: fdatasync f10 0 2024-02-15T22:50:52.241 INFO:tasks.workunit.client.0.smithi138.stdout:0/210: write d6/d10/d13/f1e [1947397,11186] 0 2024-02-15T22:50:52.241 INFO:tasks.workunit.client.0.smithi138.stdout:0/211: write d6/d10/d34/f3b [942850,99001] 0 2024-02-15T22:50:52.243 INFO:tasks.workunit.client.0.smithi138.stdout:9/226: creat d0/f4f x:0 0 0 2024-02-15T22:50:52.244 INFO:tasks.workunit.client.0.smithi138.stdout:9/227: readlink d0/de/l38 0 2024-02-15T22:50:52.245 INFO:tasks.workunit.client.0.smithi138.stdout:3/272: stat d5/d12/d23/c2b 0 2024-02-15T22:50:52.247 INFO:tasks.workunit.client.0.smithi138.stdout:0/212: dread d6/d10/d34/f3b [0,4194304] 0 2024-02-15T22:50:52.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/228: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:52.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/229: write d0/de/d14/f41 [1141875,62482] 0 2024-02-15T22:50:52.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/230: creat d0/de/d34/f50 x:0 0 0 2024-02-15T22:50:52.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/231: stat d0/df/f4e 0 2024-02-15T22:50:52.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/157: symlink df/l2f 0 2024-02-15T22:50:52.263 INFO:tasks.workunit.client.0.smithi138.stdout:3/273: dwrite d5/d16/f3c [0,4194304] 0 2024-02-15T22:50:52.264 INFO:tasks.workunit.client.0.smithi138.stdout:9/232: rename d0/de/c24 to d0/de/d14/c51 0 2024-02-15T22:50:52.265 INFO:tasks.workunit.client.0.smithi138.stdout:0/213: symlink d6/d10/d40/l48 0 2024-02-15T22:50:52.271 INFO:tasks.workunit.client.0.smithi138.stdout:0/214: mknod d6/d10/d18/d1b/c49 0 2024-02-15T22:50:52.272 INFO:tasks.workunit.client.0.smithi138.stdout:0/215: write d6/d10/d13/f16 [889316,111326] 0 2024-02-15T22:50:52.272 INFO:tasks.workunit.client.0.smithi138.stdout:0/216: chown d6/d10/d13/l38 200593 1 2024-02-15T22:50:52.272 INFO:tasks.workunit.client.0.smithi138.stdout:5/158: getdents df 0 2024-02-15T22:50:52.273 INFO:tasks.workunit.client.0.smithi138.stdout:5/159: rmdir df 39 2024-02-15T22:50:52.274 INFO:tasks.workunit.client.0.smithi138.stdout:5/160: chown df/f16 1046731 1 2024-02-15T22:50:52.274 INFO:tasks.workunit.client.0.smithi138.stdout:5/161: rmdir df/d18 39 2024-02-15T22:50:52.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/233: dread d0/d4/fd [0,4194304] 0 2024-02-15T22:50:52.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/234: truncate d0/de/f47 1014327 0 2024-02-15T22:50:52.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/235: stat d0/d4 0 2024-02-15T22:50:52.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/162: getdents df/d18 0 2024-02-15T22:50:52.278 INFO:tasks.workunit.client.0.smithi138.stdout:6/236: sync 2024-02-15T22:50:52.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/237: mknod dc/d24/c53 0 2024-02-15T22:50:52.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/238: chown dc/c22 115 1 2024-02-15T22:50:52.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/239: getdents dc/d4b 0 2024-02-15T22:50:52.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/240: creat dc/d24/d34/f54 x:0 0 0 2024-02-15T22:50:52.281 INFO:tasks.workunit.client.0.smithi138.stdout:3/274: dwrite d5/d12/d26/f2d [0,4194304] 0 2024-02-15T22:50:52.281 INFO:tasks.workunit.client.0.smithi138.stdout:4/469: dwrite d17/f18 [0,4194304] 0 2024-02-15T22:50:52.282 INFO:tasks.workunit.client.0.smithi138.stdout:6/241: symlink dc/d24/d34/l55 0 2024-02-15T22:50:52.282 INFO:tasks.workunit.client.0.smithi138.stdout:6/242: creat dc/d24/f56 x:0 0 0 2024-02-15T22:50:52.287 INFO:tasks.workunit.client.0.smithi138.stdout:6/243: mknod dc/d24/d34/c57 0 2024-02-15T22:50:52.287 INFO:tasks.workunit.client.0.smithi138.stdout:6/244: write dc/f40 [613616,61018] 0 2024-02-15T22:50:52.287 INFO:tasks.workunit.client.0.smithi138.stdout:6/245: dread - dc/d24/d34/f54 zero size 2024-02-15T22:50:52.287 INFO:tasks.workunit.client.0.smithi138.stdout:6/246: write dc/d24/f2c [2379855,40195] 0 2024-02-15T22:50:52.289 INFO:tasks.workunit.client.0.smithi138.stdout:0/217: dwrite f4 [0,4194304] 0 2024-02-15T22:50:52.289 INFO:tasks.workunit.client.0.smithi138.stdout:3/275: rmdir d5/d16/dc 39 2024-02-15T22:50:52.289 INFO:tasks.workunit.client.0.smithi138.stdout:3/276: stat d5/d12/f2a 0 2024-02-15T22:50:52.290 INFO:tasks.workunit.client.0.smithi138.stdout:4/470: rmdir d17/d1e/d2d/d52 39 2024-02-15T22:50:52.291 INFO:tasks.workunit.client.0.smithi138.stdout:6/247: mknod dc/d4b/c58 0 2024-02-15T22:50:52.292 INFO:tasks.workunit.client.0.smithi138.stdout:0/218: symlink d6/d10/d13/l4a 0 2024-02-15T22:50:52.294 INFO:tasks.workunit.client.0.smithi138.stdout:3/277: rename d5/d12/d23/f28 to d5/d12/d26/f5c 0 2024-02-15T22:50:52.296 INFO:tasks.workunit.client.0.smithi138.stdout:4/471: unlink d17/d1e/d56/f7a 0 2024-02-15T22:50:52.297 INFO:tasks.workunit.client.0.smithi138.stdout:5/163: dwrite fc [0,4194304] 0 2024-02-15T22:50:52.300 INFO:tasks.workunit.client.0.smithi138.stdout:5/164: symlink df/d18/d2b/l30 0 2024-02-15T22:50:52.302 INFO:tasks.workunit.client.0.smithi138.stdout:3/278: dread d5/d12/d23/d29/d4a/f52 [0,4194304] 0 2024-02-15T22:50:52.302 INFO:tasks.workunit.client.0.smithi138.stdout:3/279: fdatasync d5/d12/d23/f51 0 2024-02-15T22:50:52.302 INFO:tasks.workunit.client.0.smithi138.stdout:3/280: fsync d5/d12/d26/d2e/f5b 0 2024-02-15T22:50:52.303 INFO:tasks.workunit.client.0.smithi138.stdout:5/165: link df/l1d df/d18/l31 0 2024-02-15T22:50:52.304 INFO:tasks.workunit.client.0.smithi138.stdout:4/472: link d17/c99 d17/c9d 0 2024-02-15T22:50:52.305 INFO:tasks.workunit.client.0.smithi138.stdout:5/166: rename df/f19 to df/f32 0 2024-02-15T22:50:52.307 INFO:tasks.workunit.client.0.smithi138.stdout:5/167: symlink df/d18/l33 0 2024-02-15T22:50:52.308 INFO:tasks.workunit.client.0.smithi138.stdout:0/219: dread d6/d10/d18/d1b/f36 [0,4194304] 0 2024-02-15T22:50:52.309 INFO:tasks.workunit.client.0.smithi138.stdout:4/473: rename d17/d1e/d2d/d8c/f93 to d17/d2b/f9e 0 2024-02-15T22:50:52.311 INFO:tasks.workunit.client.0.smithi138.stdout:3/281: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:52.311 INFO:tasks.workunit.client.0.smithi138.stdout:6/248: dwrite dc/f15 [0,4194304] 0 2024-02-15T22:50:52.313 INFO:tasks.workunit.client.0.smithi138.stdout:0/220: link d6/d10/d18/d1b/f23 d6/d10/d18/f4b 0 2024-02-15T22:50:52.316 INFO:tasks.workunit.client.0.smithi138.stdout:5/168: dread fd [0,4194304] 0 2024-02-15T22:50:52.317 INFO:tasks.workunit.client.0.smithi138.stdout:3/282: getdents d5/d18 0 2024-02-15T22:50:52.320 INFO:tasks.workunit.client.0.smithi138.stdout:0/221: link d6/d10/d18/c28 d6/d10/d13/c4c 0 2024-02-15T22:50:52.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/169: mknod df/c34 0 2024-02-15T22:50:52.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/170: chown c6 3095 1 2024-02-15T22:50:52.323 INFO:tasks.workunit.client.0.smithi138.stdout:3/283: mkdir d5/d16/dc/d43/d57/d5d 0 2024-02-15T22:50:52.324 INFO:tasks.workunit.client.0.smithi138.stdout:5/171: truncate df/f1a 599036 0 2024-02-15T22:50:52.327 INFO:tasks.workunit.client.0.smithi138.stdout:3/284: symlink d5/l5e 0 2024-02-15T22:50:52.327 INFO:tasks.workunit.client.0.smithi138.stdout:3/285: dread - d5/d12/d23/f4c zero size 2024-02-15T22:50:52.327 INFO:tasks.workunit.client.0.smithi138.stdout:3/286: chown d5/d18/l49 0 1 2024-02-15T22:50:52.328 INFO:tasks.workunit.client.0.smithi138.stdout:3/287: rmdir d5/d12/d23/d29/d4a 39 2024-02-15T22:50:52.329 INFO:tasks.workunit.client.0.smithi138.stdout:5/172: dread df/f13 [0,4194304] 0 2024-02-15T22:50:52.330 INFO:tasks.workunit.client.0.smithi138.stdout:3/288: mknod d5/d12/d26/c5f 0 2024-02-15T22:50:52.331 INFO:tasks.workunit.client.0.smithi138.stdout:4/474: dwrite d17/d1e/d2d/d52/f74 [0,4194304] 0 2024-02-15T22:50:52.332 INFO:tasks.workunit.client.0.smithi138.stdout:5/173: symlink df/l35 0 2024-02-15T22:50:52.334 INFO:tasks.workunit.client.0.smithi138.stdout:6/249: dwrite dc/f3e [0,4194304] 0 2024-02-15T22:50:52.336 INFO:tasks.workunit.client.0.smithi138.stdout:4/475: rename d17/d1e/d2d/d36/d3e/f94 to d17/d2b/f9f 0 2024-02-15T22:50:52.339 INFO:tasks.workunit.client.0.smithi138.stdout:3/289: truncate d5/d12/d23/d29/d4f/f53 656339 0 2024-02-15T22:50:52.339 INFO:tasks.workunit.client.0.smithi138.stdout:3/290: fsync d5/d16/f3c 0 2024-02-15T22:50:52.339 INFO:tasks.workunit.client.0.smithi138.stdout:0/222: dwrite d6/d10/f11 [0,4194304] 0 2024-02-15T22:50:52.341 INFO:tasks.workunit.client.0.smithi138.stdout:6/250: symlink dc/d24/d34/d3b/l59 0 2024-02-15T22:50:52.342 INFO:tasks.workunit.client.0.smithi138.stdout:3/291: mknod d5/d12/d23/d29/d5a/c60 0 2024-02-15T22:50:52.344 INFO:tasks.workunit.client.0.smithi138.stdout:5/174: dread f9 [0,4194304] 0 2024-02-15T22:50:52.344 INFO:tasks.workunit.client.0.smithi138.stdout:6/251: mknod dc/d24/c5a 0 2024-02-15T22:50:52.346 INFO:tasks.workunit.client.0.smithi138.stdout:0/223: dread d6/d10/f30 [0,4194304] 0 2024-02-15T22:50:52.347 INFO:tasks.workunit.client.0.smithi138.stdout:4/476: rename d17/d1e/d2d/d36/f42 to d17/d1e/fa0 0 2024-02-15T22:50:52.347 INFO:tasks.workunit.client.0.smithi138.stdout:4/477: chown d17/d1e/d2d/d36/d3e/d64/l57 6894280 1 2024-02-15T22:50:52.347 INFO:tasks.workunit.client.0.smithi138.stdout:4/478: chown d17/d1e/d2d/d36/d3e/f88 6546768 1 2024-02-15T22:50:52.348 INFO:tasks.workunit.client.0.smithi138.stdout:3/292: creat d5/f61 x:0 0 0 2024-02-15T22:50:52.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/479: creat d17/d1a/fa1 x:0 0 0 2024-02-15T22:50:52.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/480: creat d17/d1e/d2d/d8c/fa2 x:0 0 0 2024-02-15T22:50:52.349 INFO:tasks.workunit.client.0.smithi138.stdout:4/481: write d17/d1a/f23 [250877,102915] 0 2024-02-15T22:50:52.350 INFO:tasks.workunit.client.0.smithi138.stdout:4/482: truncate d17/d1e/d2d/d36/f98 472060 0 2024-02-15T22:50:52.351 INFO:tasks.workunit.client.0.smithi138.stdout:3/293: symlink d5/d12/d26/d2f/l62 0 2024-02-15T22:50:52.356 INFO:tasks.workunit.client.0.smithi138.stdout:6/252: read dc/f15 [674624,109783] 0 2024-02-15T22:50:52.356 INFO:tasks.workunit.client.0.smithi138.stdout:6/253: write dc/f46 [352028,83046] 0 2024-02-15T22:50:52.359 INFO:tasks.workunit.client.0.smithi138.stdout:6/254: getdents dc/d24 0 2024-02-15T22:50:52.368 INFO:tasks.workunit.client.0.smithi138.stdout:6/255: dread dc/f1a [0,4194304] 0 2024-02-15T22:50:52.368 INFO:tasks.workunit.client.0.smithi138.stdout:6/256: chown dc/f1e 3 1 2024-02-15T22:50:52.368 INFO:tasks.workunit.client.0.smithi138.stdout:6/257: fdatasync dc/d24/f56 0 2024-02-15T22:50:52.369 INFO:tasks.workunit.client.0.smithi138.stdout:6/258: symlink dc/d24/d34/d3b/l5b 0 2024-02-15T22:50:52.371 INFO:tasks.workunit.client.0.smithi138.stdout:6/259: dread dc/d24/d34/d3b/f42 [0,4194304] 0 2024-02-15T22:50:52.371 INFO:tasks.workunit.client.0.smithi138.stdout:6/260: creat dc/d24/d34/f5c x:0 0 0 2024-02-15T22:50:52.371 INFO:tasks.workunit.client.0.smithi138.stdout:6/261: fsync dc/f3e 0 2024-02-15T22:50:52.371 INFO:tasks.workunit.client.0.smithi138.stdout:6/262: read dc/fe [653142,123353] 0 2024-02-15T22:50:52.371 INFO:tasks.workunit.client.0.smithi138.stdout:6/263: creat dc/d24/d34/d3b/f5d x:0 0 0 2024-02-15T22:50:52.376 INFO:tasks.workunit.client.0.smithi138.stdout:6/264: getdents dc/d24/d34 0 2024-02-15T22:50:52.391 INFO:tasks.workunit.client.0.smithi138.stdout:6/265: dread dc/d24/d34/d3b/f45 [0,4194304] 0 2024-02-15T22:50:52.391 INFO:tasks.workunit.client.0.smithi138.stdout:5/175: dwrite df/f13 [0,4194304] 0 2024-02-15T22:50:52.392 INFO:tasks.workunit.client.0.smithi138.stdout:6/266: link dc/d24/f31 dc/d24/f5e 0 2024-02-15T22:50:52.392 INFO:tasks.workunit.client.0.smithi138.stdout:6/267: truncate dc/d24/d34/f52 613542 0 2024-02-15T22:50:52.392 INFO:tasks.workunit.client.0.smithi138.stdout:6/268: read dc/d24/d34/f49 [2285900,76502] 0 2024-02-15T22:50:52.394 INFO:tasks.workunit.client.0.smithi138.stdout:5/176: symlink df/d18/l36 0 2024-02-15T22:50:52.394 INFO:tasks.workunit.client.0.smithi138.stdout:5/177: chown df/l24 42925 1 2024-02-15T22:50:52.394 INFO:tasks.workunit.client.0.smithi138.stdout:5/178: write df/f32 [7123122,114864] 0 2024-02-15T22:50:52.395 INFO:tasks.workunit.client.0.smithi138.stdout:5/179: link df/f17 df/f37 0 2024-02-15T22:50:52.397 INFO:tasks.workunit.client.0.smithi138.stdout:5/180: unlink df/f32 0 2024-02-15T22:50:52.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/269: read dc/ff [174373,89318] 0 2024-02-15T22:50:52.400 INFO:tasks.workunit.client.0.smithi138.stdout:4/483: dwrite d17/d1e/d2d/f30 [0,4194304] 0 2024-02-15T22:50:52.401 INFO:tasks.workunit.client.0.smithi138.stdout:4/484: mkdir d17/d1e/d2d/d84/da3 0 2024-02-15T22:50:52.402 INFO:tasks.workunit.client.0.smithi138.stdout:4/485: creat d17/d2b/fa4 x:0 0 0 2024-02-15T22:50:52.403 INFO:tasks.workunit.client.0.smithi138.stdout:0/224: dwrite d6/d10/f31 [0,4194304] 0 2024-02-15T22:50:52.403 INFO:tasks.workunit.client.0.smithi138.stdout:5/181: dread fd [0,4194304] 0 2024-02-15T22:50:52.403 INFO:tasks.workunit.client.0.smithi138.stdout:4/486: creat d17/d1e/d2d/d36/d3e/d64/fa5 x:0 0 0 2024-02-15T22:50:52.406 INFO:tasks.workunit.client.0.smithi138.stdout:0/225: unlink d6/d10/d18/l2d 0 2024-02-15T22:50:52.407 INFO:tasks.workunit.client.0.smithi138.stdout:5/182: write fb [752274,38959] 0 2024-02-15T22:50:52.407 INFO:tasks.workunit.client.0.smithi138.stdout:4/487: mknod d17/d1a/ca6 0 2024-02-15T22:50:52.407 INFO:tasks.workunit.client.0.smithi138.stdout:4/488: chown d17/d2b/d78/l89 2130803 1 2024-02-15T22:50:52.408 INFO:tasks.workunit.client.0.smithi138.stdout:0/226: mknod d6/d10/d18/c4d 0 2024-02-15T22:50:52.409 INFO:tasks.workunit.client.0.smithi138.stdout:4/489: symlink d17/d1e/d2d/d84/da3/la7 0 2024-02-15T22:50:52.410 INFO:tasks.workunit.client.0.smithi138.stdout:0/227: creat d6/d10/f4e x:0 0 0 2024-02-15T22:50:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:0/228: dread - d6/d10/d13/f2b zero size 2024-02-15T22:50:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:0/229: read d6/f24 [4146448,26968] 0 2024-02-15T22:50:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:0/230: write d6/fb [3680662,115869] 0 2024-02-15T22:50:52.411 INFO:tasks.workunit.client.0.smithi138.stdout:4/490: unlink d17/d1e/d2d/l39 0 2024-02-15T22:50:52.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/491: rename d17/d1e/d2d/d36/d3e/d64/l3c to d17/d1e/la8 0 2024-02-15T22:50:52.414 INFO:tasks.workunit.client.0.smithi138.stdout:4/492: write d17/d2b/f77 [82878,119041] 0 2024-02-15T22:50:52.416 INFO:tasks.workunit.client.0.smithi138.stdout:4/493: mknod d17/d1e/d2d/d52/ca9 0 2024-02-15T22:50:52.416 INFO:tasks.workunit.client.0.smithi138.stdout:6/270: dwrite dc/d24/f38 [0,4194304] 0 2024-02-15T22:50:52.416 INFO:tasks.workunit.client.0.smithi138.stdout:6/271: read - dc/d24/d34/f54 zero size 2024-02-15T22:50:52.416 INFO:tasks.workunit.client.0.smithi138.stdout:6/272: read dc/d24/d34/d3b/f4a [1687764,121861] 0 2024-02-15T22:50:52.416 INFO:tasks.workunit.client.0.smithi138.stdout:4/494: mkdir d17/d1a/daa 0 2024-02-15T22:50:52.419 INFO:tasks.workunit.client.0.smithi138.stdout:6/273: symlink dc/l5f 0 2024-02-15T22:50:52.420 INFO:tasks.workunit.client.0.smithi138.stdout:4/495: symlink d17/d1e/d2d/d36/d3e/d64/lab 0 2024-02-15T22:50:52.421 INFO:tasks.workunit.client.0.smithi138.stdout:4/496: symlink d17/d1e/d2d/d36/lac 0 2024-02-15T22:50:52.422 INFO:tasks.workunit.client.0.smithi138.stdout:4/497: truncate d17/d1e/f2f 276665 0 2024-02-15T22:50:52.425 INFO:tasks.workunit.client.0.smithi138.stdout:4/498: rename d17/d1a/l71 to d17/lad 0 2024-02-15T22:50:52.454 INFO:tasks.workunit.client.0.smithi138.stdout:4/499: dwrite d17/f6a [0,4194304] 0 2024-02-15T22:50:52.459 INFO:tasks.workunit.client.0.smithi138.stdout:0/231: fsync d6/d10/f30 0 2024-02-15T22:50:52.459 INFO:tasks.workunit.client.0.smithi138.stdout:0/232: fdatasync d6/d10/d18/d1b/f23 0 2024-02-15T22:50:52.465 INFO:tasks.workunit.client.0.smithi138.stdout:5/183: dwrite df/f1a [0,4194304] 0 2024-02-15T22:50:52.465 INFO:tasks.workunit.client.0.smithi138.stdout:5/184: dread - df/f15 zero size 2024-02-15T22:50:52.466 INFO:tasks.workunit.client.0.smithi138.stdout:5/185: chown df/d18/f25 54826 1 2024-02-15T22:50:52.466 INFO:tasks.workunit.client.0.smithi138.stdout:5/186: chown df/d18/l36 0 1 2024-02-15T22:50:52.467 INFO:tasks.workunit.client.0.smithi138.stdout:5/187: read df/f37 [462559,7516] 0 2024-02-15T22:50:52.480 INFO:tasks.workunit.client.0.smithi138.stdout:6/274: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:52.482 INFO:tasks.workunit.client.0.smithi138.stdout:6/275: mknod dc/d4b/c60 0 2024-02-15T22:50:52.483 INFO:tasks.workunit.client.0.smithi138.stdout:6/276: mknod dc/d24/c61 0 2024-02-15T22:50:52.489 INFO:tasks.workunit.client.0.smithi138.stdout:6/277: dread dc/d24/f31 [0,4194304] 0 2024-02-15T22:50:52.491 INFO:tasks.workunit.client.0.smithi138.stdout:6/278: unlink dc/d24/d34/f54 0 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:4/500: dwrite d17/f6a [0,4194304] 0 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:4/501: write d17/d1e/f4d [1868550,54620] 0 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:0/233: dwrite d6/d10/f31 [0,4194304] 0 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:0/234: read - d6/d10/d34/f35 zero size 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:0/235: chown d6/d10/d18/f4b 6493 1 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:5/188: dwrite df/f1a [0,4194304] 0 2024-02-15T22:50:52.492 INFO:tasks.workunit.client.0.smithi138.stdout:6/279: mknod dc/d24/d34/c62 0 2024-02-15T22:50:52.505 INFO:tasks.workunit.client.0.smithi138.stdout:0/236: write d6/d10/f11 [1917783,122039] 0 2024-02-15T22:50:52.508 INFO:tasks.workunit.client.0.smithi138.stdout:0/237: symlink d6/d10/d13/l4f 0 2024-02-15T22:50:52.508 INFO:tasks.workunit.client.0.smithi138.stdout:0/238: chown d6/d10/d18/f1d 297 1 2024-02-15T22:50:52.509 INFO:tasks.workunit.client.0.smithi138.stdout:0/239: chown d6/lf 31 1 2024-02-15T22:50:52.509 INFO:tasks.workunit.client.0.smithi138.stdout:1/190: sync 2024-02-15T22:50:52.509 INFO:tasks.workunit.client.0.smithi138.stdout:7/473: sync 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:5/189: dread df/f13 [0,4194304] 0 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:5/190: chown df/d18/c21 167476416 1 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:5/191: truncate df/f2e 293394 0 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:5/192: readlink le 0 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:5/193: chown df/f16 0 1 2024-02-15T22:50:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:1/191: mkdir df/d41 0 2024-02-15T22:50:52.512 INFO:tasks.workunit.client.0.smithi138.stdout:6/280: dwrite dc/f3e [0,4194304] 0 2024-02-15T22:50:52.513 INFO:tasks.workunit.client.0.smithi138.stdout:5/194: truncate fb 3774273 0 2024-02-15T22:50:52.514 INFO:tasks.workunit.client.0.smithi138.stdout:1/192: creat df/d1b/d1d/d25/f42 x:0 0 0 2024-02-15T22:50:52.514 INFO:tasks.workunit.client.0.smithi138.stdout:1/193: dread - df/d1b/d1d/f35 zero size 2024-02-15T22:50:52.514 INFO:tasks.workunit.client.0.smithi138.stdout:1/194: write df/d1b/d1d/d25/d2c/f2f [357347,62524] 0 2024-02-15T22:50:52.516 INFO:tasks.workunit.client.0.smithi138.stdout:7/474: getdents d1/d5a 0 2024-02-15T22:50:52.516 INFO:tasks.workunit.client.0.smithi138.stdout:7/475: chown d1 0 1 2024-02-15T22:50:52.516 INFO:tasks.workunit.client.0.smithi138.stdout:7/476: creat d1/d79/d84/d8c/fa7 x:0 0 0 2024-02-15T22:50:52.517 INFO:tasks.workunit.client.0.smithi138.stdout:4/502: dwrite d17/d1e/fa0 [4194304,4194304] 0 2024-02-15T22:50:52.520 INFO:tasks.workunit.client.0.smithi138.stdout:6/281: dread dc/d24/f2c [0,4194304] 0 2024-02-15T22:50:52.520 INFO:tasks.workunit.client.0.smithi138.stdout:6/282: stat dc/c19 0 2024-02-15T22:50:52.520 INFO:tasks.workunit.client.0.smithi138.stdout:7/477: symlink d1/d2/db/d3c/la8 0 2024-02-15T22:50:52.523 INFO:tasks.workunit.client.0.smithi138.stdout:4/503: stat d17/c43 0 2024-02-15T22:50:52.523 INFO:tasks.workunit.client.0.smithi138.stdout:4/504: readlink d17/d1e/d2d/d36/lac 0 2024-02-15T22:50:52.528 INFO:tasks.workunit.client.0.smithi138.stdout:7/478: mknod d1/d79/d84/da0/ca9 0 2024-02-15T22:50:52.528 INFO:tasks.workunit.client.0.smithi138.stdout:7/479: creat d1/faa x:0 0 0 2024-02-15T22:50:52.530 INFO:tasks.workunit.client.0.smithi138.stdout:7/480: getdents d1/d2/db 0 2024-02-15T22:50:52.530 INFO:tasks.workunit.client.0.smithi138.stdout:7/481: readlink d1/d2/db/d3c/d4d/d5b/l5f 0 2024-02-15T22:50:52.531 INFO:tasks.workunit.client.0.smithi138.stdout:7/482: chown d1/c37 88013 1 2024-02-15T22:50:52.531 INFO:tasks.workunit.client.0.smithi138.stdout:7/483: fdatasync d1/d79/d84/d8c/f8f 0 2024-02-15T22:50:52.531 INFO:tasks.workunit.client.0.smithi138.stdout:7/484: chown d1/d2/db/d25/f99 0 1 2024-02-15T22:50:52.531 INFO:tasks.workunit.client.0.smithi138.stdout:7/485: mknod d1/d2/db/d25/d41/cab 0 2024-02-15T22:50:52.532 INFO:tasks.workunit.client.0.smithi138.stdout:7/486: mknod d1/d79/d84/d64/cac 0 2024-02-15T22:50:52.532 INFO:tasks.workunit.client.0.smithi138.stdout:7/487: write d1/d2/f73 [195887,21241] 0 2024-02-15T22:50:52.533 INFO:tasks.workunit.client.0.smithi138.stdout:7/488: symlink d1/d2/db/d3c/d4d/lad 0 2024-02-15T22:50:52.539 INFO:tasks.workunit.client.0.smithi138.stdout:6/283: dwrite dc/d24/f27 [0,4194304] 0 2024-02-15T22:50:52.542 INFO:tasks.workunit.client.0.smithi138.stdout:4/505: dread d17/f49 [0,4194304] 0 2024-02-15T22:50:52.542 INFO:tasks.workunit.client.0.smithi138.stdout:4/506: fsync d17/d1e/d2d/d36/f68 0 2024-02-15T22:50:52.542 INFO:tasks.workunit.client.0.smithi138.stdout:4/507: chown d17/d1e/d56/f5c 119924303 1 2024-02-15T22:50:52.545 INFO:tasks.workunit.client.0.smithi138.stdout:0/240: dwrite d6/d10/d18/d1b/f26 [0,4194304] 0 2024-02-15T22:50:52.545 INFO:tasks.workunit.client.0.smithi138.stdout:5/195: dwrite f9 [0,4194304] 0 2024-02-15T22:50:52.545 INFO:tasks.workunit.client.0.smithi138.stdout:1/195: dwrite df/d1b/d1d/f2a [0,4194304] 0 2024-02-15T22:50:52.545 INFO:tasks.workunit.client.0.smithi138.stdout:4/508: dread d17/d1e/d2d/d36/d3e/f88 [0,4194304] 0 2024-02-15T22:50:52.549 INFO:tasks.workunit.client.0.smithi138.stdout:5/196: symlink df/l38 0 2024-02-15T22:50:52.552 INFO:tasks.workunit.client.0.smithi138.stdout:7/489: dread d1/d2/f73 [0,4194304] 0 2024-02-15T22:50:52.556 INFO:tasks.workunit.client.0.smithi138.stdout:1/196: symlink df/d1b/d1d/d25/d2e/d37/l43 0 2024-02-15T22:50:52.556 INFO:tasks.workunit.client.0.smithi138.stdout:1/197: creat df/d1b/d1d/d24/d3a/f44 x:0 0 0 2024-02-15T22:50:52.557 INFO:tasks.workunit.client.0.smithi138.stdout:5/197: rename df/l2f to df/l39 0 2024-02-15T22:50:52.557 INFO:tasks.workunit.client.0.smithi138.stdout:5/198: write df/d18/f28 [622701,36267] 0 2024-02-15T22:50:52.557 INFO:tasks.workunit.client.0.smithi138.stdout:5/199: chown df/d18/d2b 23572 1 2024-02-15T22:50:52.558 INFO:tasks.workunit.client.0.smithi138.stdout:7/490: rename d1/d2/db/d3c/d4d/d5b/l6f to d1/d2/db/d25/d41/lae 0 2024-02-15T22:50:52.560 INFO:tasks.workunit.client.0.smithi138.stdout:1/198: creat df/d1b/d1d/d25/d2e/d37/f45 x:0 0 0 2024-02-15T22:50:52.560 INFO:tasks.workunit.client.0.smithi138.stdout:5/200: rmdir df/d18/d2b 39 2024-02-15T22:50:52.561 INFO:tasks.workunit.client.0.smithi138.stdout:7/491: symlink d1/d5a/laf 0 2024-02-15T22:50:52.561 INFO:tasks.workunit.client.0.smithi138.stdout:7/492: chown d1/d5a/d97/f7f 59111 1 2024-02-15T22:50:52.561 INFO:tasks.workunit.client.0.smithi138.stdout:7/493: dread - d1/faa zero size 2024-02-15T22:50:52.562 INFO:tasks.workunit.client.0.smithi138.stdout:1/199: symlink df/d1b/d1d/d25/d2e/d37/l46 0 2024-02-15T22:50:52.562 INFO:tasks.workunit.client.0.smithi138.stdout:1/200: write df/d1b/f3d [58492,769] 0 2024-02-15T22:50:52.562 INFO:tasks.workunit.client.0.smithi138.stdout:5/201: creat df/f3a x:0 0 0 2024-02-15T22:50:52.563 INFO:tasks.workunit.client.0.smithi138.stdout:5/202: write fb [4130546,20835] 0 2024-02-15T22:50:52.563 INFO:tasks.workunit.client.0.smithi138.stdout:7/494: creat d1/d2/db/fb0 x:0 0 0 2024-02-15T22:50:52.564 INFO:tasks.workunit.client.0.smithi138.stdout:1/201: link df/d1b/c34 df/d1b/d33/c47 0 2024-02-15T22:50:52.564 INFO:tasks.workunit.client.0.smithi138.stdout:1/202: rename df/d1b/d1d/d25 to df/d1b/d1d/d25/d48 22 2024-02-15T22:50:52.564 INFO:tasks.workunit.client.0.smithi138.stdout:1/203: readlink df/d1b/d1d/d25/l2d 0 2024-02-15T22:50:52.565 INFO:tasks.workunit.client.0.smithi138.stdout:1/204: write df/d1b/d1d/f28 [294893,56843] 0 2024-02-15T22:50:52.565 INFO:tasks.workunit.client.0.smithi138.stdout:7/495: symlink d1/d2/db/d3c/d4d/d5b/lb1 0 2024-02-15T22:50:52.565 INFO:tasks.workunit.client.0.smithi138.stdout:1/205: creat df/d41/f49 x:0 0 0 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/496: truncate d1/f42 983915 0 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/497: chown d1/d79/d84 10 1 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/498: dread - d1/d2/db/d3c/d4d/f78 zero size 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/499: chown d1/l13 3 1 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/500: creat d1/d2/db/fb2 x:0 0 0 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/501: write d1/d2/f1d [403403,130331] 0 2024-02-15T22:50:52.566 INFO:tasks.workunit.client.0.smithi138.stdout:7/502: write d1/d2/db/d25/f36 [9161210,120387] 0 2024-02-15T22:50:52.567 INFO:tasks.workunit.client.0.smithi138.stdout:1/206: symlink df/d1b/d1d/d25/d2e/d37/l4a 0 2024-02-15T22:50:52.567 INFO:tasks.workunit.client.0.smithi138.stdout:1/207: readlink df/d1b/d1d/d25/d2e/d37/l4a 0 2024-02-15T22:50:52.570 INFO:tasks.workunit.client.0.smithi138.stdout:0/241: dwrite d6/d10/d34/f3b [0,4194304] 0 2024-02-15T22:50:52.570 INFO:tasks.workunit.client.0.smithi138.stdout:0/242: truncate d6/d10/d13/f25 4398611 0 2024-02-15T22:50:52.570 INFO:tasks.workunit.client.0.smithi138.stdout:0/243: chown d6/d10/d13/f2b 462107 1 2024-02-15T22:50:52.570 INFO:tasks.workunit.client.0.smithi138.stdout:6/284: dwrite dc/d24/f2c [0,4194304] 0 2024-02-15T22:50:52.572 INFO:tasks.workunit.client.0.smithi138.stdout:0/244: link d6/d10/d40/c44 d6/c50 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/285: creat dc/d24/d34/f63 x:0 0 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/286: stat dc/f15 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/287: stat dc/ff 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/288: write dc/f15 [2493928,110153] 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/289: write dc/d24/d34/d3b/f42 [1426263,36291] 0 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:6/290: dread - dc/d24/d34/d3b/f41 zero size 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:2/237: sync 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:9/236: sync 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:8/186: sync 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:9/237: dread - d0/de/d34/f50 zero size 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:3/294: sync 2024-02-15T22:50:52.574 INFO:tasks.workunit.client.0.smithi138.stdout:2/238: creat d0/da/d19/d3f/f58 x:0 0 0 2024-02-15T22:50:52.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/291: rename dc/d24/f51 to dc/d24/d34/d3b/f64 0 2024-02-15T22:50:52.577 INFO:tasks.workunit.client.0.smithi138.stdout:9/238: mknod d0/de/d14/c52 0 2024-02-15T22:50:52.578 INFO:tasks.workunit.client.0.smithi138.stdout:8/187: symlink db/dd/d13/l3c 0 2024-02-15T22:50:52.578 INFO:tasks.workunit.client.0.smithi138.stdout:8/188: truncate db/dd/d22/f30 701984 0 2024-02-15T22:50:52.579 INFO:tasks.workunit.client.0.smithi138.stdout:8/189: read db/ff [321362,5304] 0 2024-02-15T22:50:52.579 INFO:tasks.workunit.client.0.smithi138.stdout:8/190: chown db/f1a 26468047 1 2024-02-15T22:50:52.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/208: dread f8 [0,4194304] 0 2024-02-15T22:50:52.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/209: chown f4 716427 1 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/210: stat df/d1b/d1d/d25/d2c/d3f 0 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/211: dread - df/d1b/d1d/d25/d2e/d37/f45 zero size 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/212: creat df/d1b/d1d/d25/d2e/d37/f4b x:0 0 0 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/213: readlink df/d1b/l1e 0 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/214: write df/d1b/d1d/d24/d3a/f40 [664223,43298] 0 2024-02-15T22:50:52.580 INFO:tasks.workunit.client.0.smithi138.stdout:4/509: dwrite d17/f6a [0,4194304] 0 2024-02-15T22:50:52.581 INFO:tasks.workunit.client.0.smithi138.stdout:9/239: rename d0/de/d33/f3d to d0/df/d11/d23/f53 0 2024-02-15T22:50:52.581 INFO:tasks.workunit.client.0.smithi138.stdout:9/240: fsync d0/f19 0 2024-02-15T22:50:52.581 INFO:tasks.workunit.client.0.smithi138.stdout:8/191: link db/dd/f11 db/f3d 0 2024-02-15T22:50:52.582 INFO:tasks.workunit.client.0.smithi138.stdout:2/239: getdents d0/dd 0 2024-02-15T22:50:52.584 INFO:tasks.workunit.client.0.smithi138.stdout:5/203: dread df/d18/f28 [0,4194304] 0 2024-02-15T22:50:52.586 INFO:tasks.workunit.client.0.smithi138.stdout:5/204: dread df/f2e [0,4194304] 0 2024-02-15T22:50:52.586 INFO:tasks.workunit.client.0.smithi138.stdout:1/215: link f8 df/d1b/f4c 0 2024-02-15T22:50:52.588 INFO:tasks.workunit.client.0.smithi138.stdout:9/241: mknod d0/de/c54 0 2024-02-15T22:50:52.591 INFO:tasks.workunit.client.0.smithi138.stdout:2/240: symlink d0/dd/d15/l59 0 2024-02-15T22:50:52.591 INFO:tasks.workunit.client.0.smithi138.stdout:4/510: write d17/d1e/f22 [614566,100376] 0 2024-02-15T22:50:52.592 INFO:tasks.workunit.client.0.smithi138.stdout:9/242: mkdir d0/d55 0 2024-02-15T22:50:52.593 INFO:tasks.workunit.client.0.smithi138.stdout:4/511: mkdir d17/d2b/dae 0 2024-02-15T22:50:52.594 INFO:tasks.workunit.client.0.smithi138.stdout:6/292: write dc/fe [79685,30508] 0 2024-02-15T22:50:52.594 INFO:tasks.workunit.client.0.smithi138.stdout:7/503: dwrite d1/d2/db/d3c/f75 [0,4194304] 0 2024-02-15T22:50:52.597 INFO:tasks.workunit.client.0.smithi138.stdout:4/512: getdents d17/d1e 0 2024-02-15T22:50:52.597 INFO:tasks.workunit.client.0.smithi138.stdout:4/513: readlink d17/d1e/d2d/d36/l95 0 2024-02-15T22:50:52.598 INFO:tasks.workunit.client.0.smithi138.stdout:3/295: dwrite d5/d12/d23/f50 [0,4194304] 0 2024-02-15T22:50:52.599 INFO:tasks.workunit.client.0.smithi138.stdout:3/296: read d5/d12/d23/d29/d4f/f53 [282864,18938] 0 2024-02-15T22:50:52.599 INFO:tasks.workunit.client.0.smithi138.stdout:3/297: readlink d5/d12/d26/l38 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/192: dread db/f28 [0,4194304] 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/193: readlink db/dd/l12 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/194: creat db/dd/f3e x:0 0 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:4/514: dread d17/d1e/d2d/f61 [0,4194304] 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/195: creat db/dd/d22/f3f x:0 0 0 2024-02-15T22:50:52.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/196: chown db/dd/d13/d19/d24/l33 7615 1 2024-02-15T22:50:52.602 INFO:tasks.workunit.client.0.smithi138.stdout:0/245: dwrite d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:50:52.608 INFO:tasks.workunit.client.0.smithi138.stdout:7/504: dread d1/d2/f93 [0,4194304] 0 2024-02-15T22:50:52.608 INFO:tasks.workunit.client.0.smithi138.stdout:7/505: truncate d1/d2/db/d3c/d4d/d5b/f62 501410 0 2024-02-15T22:50:52.609 INFO:tasks.workunit.client.0.smithi138.stdout:4/515: dread d17/d1e/f2f [0,4194304] 0 2024-02-15T22:50:52.609 INFO:tasks.workunit.client.0.smithi138.stdout:4/516: chown d17/d1e/d2d/d8c 67145445 1 2024-02-15T22:50:52.611 INFO:tasks.workunit.client.0.smithi138.stdout:3/298: getdents d5/d12/d23/d29/d4a 0 2024-02-15T22:50:52.612 INFO:tasks.workunit.client.0.smithi138.stdout:3/299: fdatasync d5/d18/f24 0 2024-02-15T22:50:52.612 INFO:tasks.workunit.client.0.smithi138.stdout:3/300: chown d5/d16/fa 119 1 2024-02-15T22:50:52.612 INFO:tasks.workunit.client.0.smithi138.stdout:3/301: fsync d5/d16/dc/f1a 0 2024-02-15T22:50:52.615 INFO:tasks.workunit.client.0.smithi138.stdout:8/197: creat db/dd/d13/d19/f40 x:0 0 0 2024-02-15T22:50:52.615 INFO:tasks.workunit.client.0.smithi138.stdout:8/198: read db/dd/d13/f1c [3776313,98583] 0 2024-02-15T22:50:52.618 INFO:tasks.workunit.client.0.smithi138.stdout:9/243: rmdir d0/df/d11/d23 39 2024-02-15T22:50:52.618 INFO:tasks.workunit.client.0.smithi138.stdout:9/244: creat d0/df/f56 x:0 0 0 2024-02-15T22:50:52.620 INFO:tasks.workunit.client.0.smithi138.stdout:5/205: dwrite fd [0,4194304] 0 2024-02-15T22:50:52.621 INFO:tasks.workunit.client.0.smithi138.stdout:7/506: read d1/d2/db/fe [2230473,65547] 0 2024-02-15T22:50:52.621 INFO:tasks.workunit.client.0.smithi138.stdout:2/241: dwrite d0/f36 [0,4194304] 0 2024-02-15T22:50:52.621 INFO:tasks.workunit.client.0.smithi138.stdout:7/507: write d1/d2/f44 [4004871,84211] 0 2024-02-15T22:50:52.621 INFO:tasks.workunit.client.0.smithi138.stdout:0/246: rmdir d6/d10/d34 39 2024-02-15T22:50:52.621 INFO:tasks.workunit.client.0.smithi138.stdout:0/247: chown d6/c2e 420291 1 2024-02-15T22:50:52.625 INFO:tasks.workunit.client.0.smithi138.stdout:4/517: rmdir d17/d2b/dae 0 2024-02-15T22:50:52.626 INFO:tasks.workunit.client.0.smithi138.stdout:3/302: truncate d5/d12/d23/d29/d4f/f53 220897 0 2024-02-15T22:50:52.626 INFO:tasks.workunit.client.0.smithi138.stdout:8/199: dread f0 [0,4194304] 0 2024-02-15T22:50:52.630 INFO:tasks.workunit.client.0.smithi138.stdout:9/245: mkdir d0/de/d33/d57 0 2024-02-15T22:50:52.630 INFO:tasks.workunit.client.0.smithi138.stdout:5/206: write f9 [3788559,24585] 0 2024-02-15T22:50:52.632 INFO:tasks.workunit.client.0.smithi138.stdout:2/242: read d0/d3/f2b [1581593,40542] 0 2024-02-15T22:50:52.633 INFO:tasks.workunit.client.0.smithi138.stdout:7/508: mknod d1/d79/d84/da0/cb3 0 2024-02-15T22:50:52.634 INFO:tasks.workunit.client.0.smithi138.stdout:0/248: symlink d6/d10/d34/l51 0 2024-02-15T22:50:52.634 INFO:tasks.workunit.client.0.smithi138.stdout:0/249: fdatasync d6/d10/d13/f16 0 2024-02-15T22:50:52.636 INFO:tasks.workunit.client.0.smithi138.stdout:4/518: mkdir d17/d1e/d2d/d36/d3e/daf 0 2024-02-15T22:50:52.638 INFO:tasks.workunit.client.0.smithi138.stdout:3/303: link d5/d16/c4e d5/d12/c63 0 2024-02-15T22:50:52.640 INFO:tasks.workunit.client.0.smithi138.stdout:9/246: rename d0/de/d34/f50 to d0/de/d14/f58 0 2024-02-15T22:50:52.642 INFO:tasks.workunit.client.0.smithi138.stdout:2/243: dread d0/da/d19/f1b [0,4194304] 0 2024-02-15T22:50:52.642 INFO:tasks.workunit.client.0.smithi138.stdout:2/244: truncate d0/da/d19/d3f/f58 74125 0 2024-02-15T22:50:52.642 INFO:tasks.workunit.client.0.smithi138.stdout:8/200: dwrite db/dd/f3e [0,4194304] 0 2024-02-15T22:50:52.642 INFO:tasks.workunit.client.0.smithi138.stdout:5/207: creat df/d18/d2b/f3b x:0 0 0 2024-02-15T22:50:52.643 INFO:tasks.workunit.client.0.smithi138.stdout:7/509: rmdir d1/d79 39 2024-02-15T22:50:52.643 INFO:tasks.workunit.client.0.smithi138.stdout:7/510: fdatasync d1/f12 0 2024-02-15T22:50:52.643 INFO:tasks.workunit.client.0.smithi138.stdout:5/208: dread df/d18/f29 [0,4194304] 0 2024-02-15T22:50:52.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/250: mkdir d6/d10/d52 0 2024-02-15T22:50:52.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/251: truncate d6/d10/d18/f4b 4533396 0 2024-02-15T22:50:52.645 INFO:tasks.workunit.client.0.smithi138.stdout:4/519: mknod d17/d1a/cb0 0 2024-02-15T22:50:52.646 INFO:tasks.workunit.client.0.smithi138.stdout:4/520: getdents d17/d1a/daa 0 2024-02-15T22:50:52.646 INFO:tasks.workunit.client.0.smithi138.stdout:4/521: write d17/d1e/d2d/d36/f4a [371965,81096] 0 2024-02-15T22:50:52.647 INFO:tasks.workunit.client.0.smithi138.stdout:9/247: mkdir d0/d55/d59 0 2024-02-15T22:50:52.647 INFO:tasks.workunit.client.0.smithi138.stdout:9/248: readlink d0/d1/l26 0 2024-02-15T22:50:52.647 INFO:tasks.workunit.client.0.smithi138.stdout:9/249: fsync d0/d4/fd 0 2024-02-15T22:50:52.647 INFO:tasks.workunit.client.0.smithi138.stdout:3/304: write d5/d16/fa [3903,18042] 0 2024-02-15T22:50:52.648 INFO:tasks.workunit.client.0.smithi138.stdout:2/245: mknod d0/da/c5a 0 2024-02-15T22:50:52.652 INFO:tasks.workunit.client.0.smithi138.stdout:7/511: rename d1/d2/db/d3c/d4d/d5b/ca6 to d1/d79/d84/da0/cb4 0 2024-02-15T22:50:52.653 INFO:tasks.workunit.client.0.smithi138.stdout:7/512: fdatasync d1/d2/f1d 0 2024-02-15T22:50:52.654 INFO:tasks.workunit.client.0.smithi138.stdout:5/209: symlink df/l3c 0 2024-02-15T22:50:52.657 INFO:tasks.workunit.client.0.smithi138.stdout:0/252: mknod d6/d10/d13/d3d/c53 0 2024-02-15T22:50:52.657 INFO:tasks.workunit.client.0.smithi138.stdout:0/253: fdatasync d6/d10/d18/f32 0 2024-02-15T22:50:52.657 INFO:tasks.workunit.client.0.smithi138.stdout:3/305: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:52.657 INFO:tasks.workunit.client.0.smithi138.stdout:3/306: readlink d5/d12/d26/d2f/l55 0 2024-02-15T22:50:52.657 INFO:tasks.workunit.client.0.smithi138.stdout:3/307: fdatasync d5/d16/dc/f1a 0 2024-02-15T22:50:52.658 INFO:tasks.workunit.client.0.smithi138.stdout:9/250: creat d0/de/d33/d57/f5a x:0 0 0 2024-02-15T22:50:52.660 INFO:tasks.workunit.client.0.smithi138.stdout:2/246: truncate d0/da/d19/f30 1464686 0 2024-02-15T22:50:52.661 INFO:tasks.workunit.client.0.smithi138.stdout:5/210: mknod df/d18/d2b/c3d 0 2024-02-15T22:50:52.663 INFO:tasks.workunit.client.0.smithi138.stdout:4/522: dwrite d17/d1e/f4b [0,4194304] 0 2024-02-15T22:50:52.664 INFO:tasks.workunit.client.0.smithi138.stdout:9/251: creat d0/d55/f5b x:0 0 0 2024-02-15T22:50:52.664 INFO:tasks.workunit.client.0.smithi138.stdout:9/252: write d0/df/d11/d23/f42 [255758,107919] 0 2024-02-15T22:50:52.664 INFO:tasks.workunit.client.0.smithi138.stdout:9/253: chown d0/d55/d59 63599521 1 2024-02-15T22:50:52.669 INFO:tasks.workunit.client.0.smithi138.stdout:7/513: dwrite d1/d2/db/d25/f99 [0,4194304] 0 2024-02-15T22:50:52.669 INFO:tasks.workunit.client.0.smithi138.stdout:7/514: chown d1/l7a 117019 1 2024-02-15T22:50:52.674 INFO:tasks.workunit.client.0.smithi138.stdout:0/254: symlink d6/d10/d40/l54 0 2024-02-15T22:50:52.674 INFO:tasks.workunit.client.0.smithi138.stdout:0/255: write d6/d10/d13/f16 [914363,76810] 0 2024-02-15T22:50:52.675 INFO:tasks.workunit.client.0.smithi138.stdout:3/308: truncate d5/d12/d23/d29/d4f/f53 949662 0 2024-02-15T22:50:52.683 INFO:tasks.workunit.client.0.smithi138.stdout:5/211: truncate f9 5052063 0 2024-02-15T22:50:52.684 INFO:tasks.workunit.client.0.smithi138.stdout:0/256: mknod d6/d10/d34/c55 0 2024-02-15T22:50:52.686 INFO:tasks.workunit.client.0.smithi138.stdout:4/523: mkdir d17/db1 0 2024-02-15T22:50:52.691 INFO:tasks.workunit.client.0.smithi138.stdout:9/254: rmdir d0 39 2024-02-15T22:50:52.692 INFO:tasks.workunit.client.0.smithi138.stdout:7/515: rmdir d1/d2/db/d25/d41 39 2024-02-15T22:50:52.694 INFO:tasks.workunit.client.0.smithi138.stdout:0/257: unlink d6/d10/d18/c47 0 2024-02-15T22:50:52.694 INFO:tasks.workunit.client.0.smithi138.stdout:0/258: stat d6/d10/d13/f45 0 2024-02-15T22:50:52.696 INFO:tasks.workunit.client.0.smithi138.stdout:3/309: rename d5/d12/d23/d29/l3d to d5/l64 0 2024-02-15T22:50:52.697 INFO:tasks.workunit.client.0.smithi138.stdout:4/524: creat d17/d1e/d2d/d84/fb2 x:0 0 0 2024-02-15T22:50:52.697 INFO:tasks.workunit.client.0.smithi138.stdout:4/525: fsync d17/d2b/fa4 0 2024-02-15T22:50:52.698 INFO:tasks.workunit.client.0.smithi138.stdout:5/212: dwrite df/f27 [0,4194304] 0 2024-02-15T22:50:52.698 INFO:tasks.workunit.client.0.smithi138.stdout:9/255: symlink d0/de/l5c 0 2024-02-15T22:50:52.700 INFO:tasks.workunit.client.0.smithi138.stdout:3/310: write d5/d12/f1d [3921780,97377] 0 2024-02-15T22:50:52.701 INFO:tasks.workunit.client.0.smithi138.stdout:0/259: symlink d6/d10/d52/l56 0 2024-02-15T22:50:52.701 INFO:tasks.workunit.client.0.smithi138.stdout:0/260: write d6/f24 [370512,3809] 0 2024-02-15T22:50:52.706 INFO:tasks.workunit.client.0.smithi138.stdout:9/256: rename d0/de/c54 to d0/d55/d59/c5d 0 2024-02-15T22:50:52.708 INFO:tasks.workunit.client.0.smithi138.stdout:3/311: creat d5/d16/dc/d43/f65 x:0 0 0 2024-02-15T22:50:52.708 INFO:tasks.workunit.client.0.smithi138.stdout:3/312: read d5/d12/f1d [189861,103289] 0 2024-02-15T22:50:52.710 INFO:tasks.workunit.client.0.smithi138.stdout:0/261: mkdir d6/d10/d18/d57 0 2024-02-15T22:50:52.712 INFO:tasks.workunit.client.0.smithi138.stdout:9/257: rmdir d0 39 2024-02-15T22:50:52.712 INFO:tasks.workunit.client.0.smithi138.stdout:9/258: stat d0/f19 0 2024-02-15T22:50:52.718 INFO:tasks.workunit.client.0.smithi138.stdout:5/213: dwrite df/d18/f28 [0,4194304] 0 2024-02-15T22:50:52.719 INFO:tasks.workunit.client.0.smithi138.stdout:5/214: dread - df/f11 zero size 2024-02-15T22:50:52.719 INFO:tasks.workunit.client.0.smithi138.stdout:5/215: truncate df/f13 5016957 0 2024-02-15T22:50:52.719 INFO:tasks.workunit.client.0.smithi138.stdout:5/216: fsync df/f37 0 2024-02-15T22:50:52.732 INFO:tasks.workunit.client.0.smithi138.stdout:0/262: dwrite f0 [0,4194304] 0 2024-02-15T22:50:52.737 INFO:tasks.workunit.client.0.smithi138.stdout:3/313: dwrite d5/d16/fa [0,4194304] 0 2024-02-15T22:50:52.739 INFO:tasks.workunit.client.0.smithi138.stdout:9/259: dwrite d0/de/d14/f44 [4194304,4194304] 0 2024-02-15T22:50:52.739 INFO:tasks.workunit.client.0.smithi138.stdout:3/314: creat d5/d16/dc/f66 x:0 0 0 2024-02-15T22:50:52.740 INFO:tasks.workunit.client.0.smithi138.stdout:3/315: getdents d5/d18/d35 0 2024-02-15T22:50:52.740 INFO:tasks.workunit.client.0.smithi138.stdout:3/316: truncate d5/f61 903877 0 2024-02-15T22:50:52.742 INFO:tasks.workunit.client.0.smithi138.stdout:3/317: getdents d5/d12/d26/d2e 0 2024-02-15T22:50:52.743 INFO:tasks.workunit.client.0.smithi138.stdout:3/318: mkdir d5/d16/dc/d43/d47/d67 0 2024-02-15T22:50:52.743 INFO:tasks.workunit.client.0.smithi138.stdout:3/319: fdatasync d5/d12/d23/f50 0 2024-02-15T22:50:52.744 INFO:tasks.workunit.client.0.smithi138.stdout:3/320: symlink d5/d16/dc/d43/d47/l68 0 2024-02-15T22:50:52.745 INFO:tasks.workunit.client.0.smithi138.stdout:3/321: mknod d5/d12/d26/d2e/c69 0 2024-02-15T22:50:52.746 INFO:tasks.workunit.client.0.smithi138.stdout:3/322: symlink d5/d12/d23/d29/d5a/l6a 0 2024-02-15T22:50:52.746 INFO:tasks.workunit.client.0.smithi138.stdout:9/260: dread d0/df/d11/f17 [0,4194304] 0 2024-02-15T22:50:52.748 INFO:tasks.workunit.client.0.smithi138.stdout:0/263: dwrite d6/d10/d18/f4b [0,4194304] 0 2024-02-15T22:50:52.748 INFO:tasks.workunit.client.0.smithi138.stdout:9/261: dread d0/f27 [0,4194304] 0 2024-02-15T22:50:52.749 INFO:tasks.workunit.client.0.smithi138.stdout:3/323: rename d5/d12/f2a to d5/d16/dc/d43/d47/d67/f6b 0 2024-02-15T22:50:52.749 INFO:tasks.workunit.client.0.smithi138.stdout:3/324: read d5/d12/f1b [79046,66129] 0 2024-02-15T22:50:52.758 INFO:tasks.workunit.client.0.smithi138.stdout:3/325: read d5/d16/dc/d43/d47/d67/f6b [2177676,105861] 0 2024-02-15T22:50:52.762 INFO:tasks.workunit.client.0.smithi138.stdout:3/326: rename d5/d12/d23/d29/d4f/l54 to d5/d12/d23/d29/d4a/l6c 0 2024-02-15T22:50:52.762 INFO:tasks.workunit.client.0.smithi138.stdout:3/327: creat d5/d16/dc/f6d x:0 0 0 2024-02-15T22:50:52.770 INFO:tasks.workunit.client.0.smithi138.stdout:3/328: write d5/d16/fa [244896,76442] 0 2024-02-15T22:50:52.774 INFO:tasks.workunit.client.0.smithi138.stdout:9/262: dwrite d0/de/d14/d18/f49 [0,4194304] 0 2024-02-15T22:50:52.774 INFO:tasks.workunit.client.0.smithi138.stdout:0/264: dwrite d6/d10/d13/f16 [0,4194304] 0 2024-02-15T22:50:52.776 INFO:tasks.workunit.client.0.smithi138.stdout:0/265: write d6/d10/d40/f43 [949788,98994] 0 2024-02-15T22:50:52.776 INFO:tasks.workunit.client.0.smithi138.stdout:0/266: write d6/d10/d13/f25 [4976955,102879] 0 2024-02-15T22:50:52.779 INFO:tasks.workunit.client.0.smithi138.stdout:9/263: rename d0/df/d11/d23/f53 to d0/d55/f5e 0 2024-02-15T22:50:52.780 INFO:tasks.workunit.client.0.smithi138.stdout:0/267: symlink d6/d10/d34/l58 0 2024-02-15T22:50:52.782 INFO:tasks.workunit.client.0.smithi138.stdout:9/264: creat d0/d55/d59/f5f x:0 0 0 2024-02-15T22:50:52.784 INFO:tasks.workunit.client.0.smithi138.stdout:0/268: mknod d6/d10/d18/d1b/c59 0 2024-02-15T22:50:52.785 INFO:tasks.workunit.client.0.smithi138.stdout:0/269: truncate d6/d10/d13/f1e 3622484 0 2024-02-15T22:50:52.787 INFO:tasks.workunit.client.0.smithi138.stdout:9/265: read d0/df/d11/f32 [3919945,13957] 0 2024-02-15T22:50:52.787 INFO:tasks.workunit.client.0.smithi138.stdout:9/266: stat d0/de/f47 0 2024-02-15T22:50:52.788 INFO:tasks.workunit.client.0.smithi138.stdout:0/270: link d6/d10/d18/d1b/f23 d6/d10/d34/f5a 0 2024-02-15T22:50:52.788 INFO:tasks.workunit.client.0.smithi138.stdout:0/271: chown f4 989372545 1 2024-02-15T22:50:52.789 INFO:tasks.workunit.client.0.smithi138.stdout:0/272: read d6/d10/f14 [365503,64913] 0 2024-02-15T22:50:52.789 INFO:tasks.workunit.client.0.smithi138.stdout:3/329: dwrite d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:52.790 INFO:tasks.workunit.client.0.smithi138.stdout:0/273: mknod d6/d10/d18/d57/c5b 0 2024-02-15T22:50:52.790 INFO:tasks.workunit.client.0.smithi138.stdout:3/330: symlink d5/d12/d26/l6e 0 2024-02-15T22:50:52.790 INFO:tasks.workunit.client.0.smithi138.stdout:3/331: fsync d5/d12/d26/f2d 0 2024-02-15T22:50:52.791 INFO:tasks.workunit.client.0.smithi138.stdout:3/332: chown d5/d12/c63 21505 1 2024-02-15T22:50:52.793 INFO:tasks.workunit.client.0.smithi138.stdout:0/274: creat d6/d10/d40/f5c x:0 0 0 2024-02-15T22:50:52.793 INFO:tasks.workunit.client.0.smithi138.stdout:0/275: truncate d6/d10/d34/f35 540441 0 2024-02-15T22:50:52.793 INFO:tasks.workunit.client.0.smithi138.stdout:0/276: write d6/d10/d40/f5c [129325,73033] 0 2024-02-15T22:50:52.795 INFO:tasks.workunit.client.0.smithi138.stdout:3/333: dread d5/d16/dc/d43/d47/d67/f6b [0,4194304] 0 2024-02-15T22:50:52.795 INFO:tasks.workunit.client.0.smithi138.stdout:3/334: chown d5/d16/dc/d43/d47 244 1 2024-02-15T22:50:52.795 INFO:tasks.workunit.client.0.smithi138.stdout:9/267: write d0/de/d14/f1b [361168,30413] 0 2024-02-15T22:50:52.796 INFO:tasks.workunit.client.0.smithi138.stdout:3/335: truncate d5/d12/d23/d29/d4a/f52 1069237 0 2024-02-15T22:50:52.798 INFO:tasks.workunit.client.0.smithi138.stdout:9/268: creat d0/df/d11/f60 x:0 0 0 2024-02-15T22:50:52.800 INFO:tasks.workunit.client.0.smithi138.stdout:9/269: link d0/de/d14/f41 d0/d55/f61 0 2024-02-15T22:50:52.801 INFO:tasks.workunit.client.0.smithi138.stdout:9/270: read d0/d4/f2b [40386,59541] 0 2024-02-15T22:50:52.803 INFO:tasks.workunit.client.0.smithi138.stdout:9/271: link d0/de/d14/d18/f49 d0/de/d14/d18/f62 0 2024-02-15T22:50:52.806 INFO:tasks.workunit.client.0.smithi138.stdout:3/336: dread d5/d12/d23/f51 [0,4194304] 0 2024-02-15T22:50:52.812 INFO:tasks.workunit.client.0.smithi138.stdout:0/277: dwrite d6/d10/d13/f45 [0,4194304] 0 2024-02-15T22:50:52.813 INFO:tasks.workunit.client.0.smithi138.stdout:9/272: dread d0/de/d14/d18/f49 [0,4194304] 0 2024-02-15T22:50:52.815 INFO:tasks.workunit.client.0.smithi138.stdout:0/278: symlink d6/d10/d34/l5d 0 2024-02-15T22:50:52.816 INFO:tasks.workunit.client.0.smithi138.stdout:3/337: write d5/d18/f24 [1054396,58566] 0 2024-02-15T22:50:52.816 INFO:tasks.workunit.client.0.smithi138.stdout:9/273: mkdir d0/de/d14/d63 0 2024-02-15T22:50:52.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/338: getdents d5/d12/d23/d29/d5a 0 2024-02-15T22:50:52.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/339: creat d5/d16/dc/f6f x:0 0 0 2024-02-15T22:50:52.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/340: write d5/d16/dc/f6d [762412,106418] 0 2024-02-15T22:50:52.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/341: fsync d5/d12/d23/f4c 0 2024-02-15T22:50:52.820 INFO:tasks.workunit.client.0.smithi138.stdout:9/274: mknod d0/df/d11/c64 0 2024-02-15T22:50:52.823 INFO:tasks.workunit.client.0.smithi138.stdout:3/342: creat d5/d12/d23/d29/d4f/f70 x:0 0 0 2024-02-15T22:50:52.824 INFO:tasks.workunit.client.0.smithi138.stdout:0/279: read d6/d10/d18/d1b/f26 [4067143,108876] 0 2024-02-15T22:50:52.824 INFO:tasks.workunit.client.0.smithi138.stdout:0/280: fsync d6/d10/d34/f5a 0 2024-02-15T22:50:52.826 INFO:tasks.workunit.client.0.smithi138.stdout:9/275: symlink d0/df/l65 0 2024-02-15T22:50:52.830 INFO:tasks.workunit.client.0.smithi138.stdout:9/276: dread d0/de/d14/d18/f62 [0,4194304] 0 2024-02-15T22:50:52.835 INFO:tasks.workunit.client.0.smithi138.stdout:3/343: rename d5/d16/dc/d43/f65 to d5/d16/dc/d43/d47/d67/f71 0 2024-02-15T22:50:52.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/281: creat d6/d10/d18/d57/f5e x:0 0 0 2024-02-15T22:50:52.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/282: chown d6/cd 0 1 2024-02-15T22:50:52.839 INFO:tasks.workunit.client.0.smithi138.stdout:9/277: write d0/de/d14/f44 [7154916,20596] 0 2024-02-15T22:50:52.839 INFO:tasks.workunit.client.0.smithi138.stdout:3/344: rmdir d5/d12/d23/d29/d4f 39 2024-02-15T22:50:52.840 INFO:tasks.workunit.client.0.smithi138.stdout:3/345: chown d5/d16/dc/d43 16 1 2024-02-15T22:50:52.843 INFO:tasks.workunit.client.0.smithi138.stdout:3/346: dread d5/d18/f24 [0,4194304] 0 2024-02-15T22:50:52.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/347: mknod d5/d18/c72 0 2024-02-15T22:50:52.846 INFO:tasks.workunit.client.0.smithi138.stdout:0/283: dread f4 [0,4194304] 0 2024-02-15T22:50:52.847 INFO:tasks.workunit.client.0.smithi138.stdout:0/284: rename d6/d10/d13/c4c to d6/c5f 0 2024-02-15T22:50:52.848 INFO:tasks.workunit.client.0.smithi138.stdout:0/285: truncate d6/d10/d18/d1b/f23 779325 0 2024-02-15T22:50:52.857 INFO:tasks.workunit.client.0.smithi138.stdout:9/278: dwrite d0/d4/fd [0,4194304] 0 2024-02-15T22:50:52.857 INFO:tasks.workunit.client.0.smithi138.stdout:9/279: readlink d0/d1/l4b 0 2024-02-15T22:50:52.859 INFO:tasks.workunit.client.0.smithi138.stdout:9/280: link d0/de/d14/f30 d0/de/d14/f66 0 2024-02-15T22:50:52.868 INFO:tasks.workunit.client.0.smithi138.stdout:0/286: dwrite d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:50:52.870 INFO:tasks.workunit.client.0.smithi138.stdout:0/287: creat d6/d10/d18/f60 x:0 0 0 2024-02-15T22:50:52.871 INFO:tasks.workunit.client.0.smithi138.stdout:0/288: mkdir d6/d10/d13/d3d/d61 0 2024-02-15T22:50:52.872 INFO:tasks.workunit.client.0.smithi138.stdout:0/289: mknod d6/d10/d18/c62 0 2024-02-15T22:50:52.872 INFO:tasks.workunit.client.0.smithi138.stdout:0/290: fdatasync d6/d10/d13/f2c 0 2024-02-15T22:50:52.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/291: rename d6/d10/d18/d1b/f46 to d6/d10/d18/d57/f63 0 2024-02-15T22:50:52.874 INFO:tasks.workunit.client.0.smithi138.stdout:9/281: dwrite d0/d55/f5e [4194304,4194304] 0 2024-02-15T22:50:52.874 INFO:tasks.workunit.client.0.smithi138.stdout:9/282: chown d0/d4 129 1 2024-02-15T22:50:52.877 INFO:tasks.workunit.client.0.smithi138.stdout:9/283: symlink d0/de/d34/l67 0 2024-02-15T22:50:52.882 INFO:tasks.workunit.client.0.smithi138.stdout:1/216: sync 2024-02-15T22:50:52.882 INFO:tasks.workunit.client.0.smithi138.stdout:6/293: sync 2024-02-15T22:50:52.882 INFO:tasks.workunit.client.0.smithi138.stdout:6/294: stat dc/c18 0 2024-02-15T22:50:52.883 INFO:tasks.workunit.client.0.smithi138.stdout:6/295: readlink la 0 2024-02-15T22:50:52.883 INFO:tasks.workunit.client.0.smithi138.stdout:6/296: write dc/f1a [2704355,99868] 0 2024-02-15T22:50:52.884 INFO:tasks.workunit.client.0.smithi138.stdout:1/217: rename df/d1b/d1d/d24/f26 to df/d1b/d1d/d24/f4d 0 2024-02-15T22:50:52.884 INFO:tasks.workunit.client.0.smithi138.stdout:1/218: fdatasync df/f19 0 2024-02-15T22:50:52.884 INFO:tasks.workunit.client.0.smithi138.stdout:6/297: symlink dc/d24/d34/d3b/l65 0 2024-02-15T22:50:52.884 INFO:tasks.workunit.client.0.smithi138.stdout:6/298: stat dc/f15 0 2024-02-15T22:50:52.885 INFO:tasks.workunit.client.0.smithi138.stdout:1/219: unlink df/f15 0 2024-02-15T22:50:52.924 INFO:tasks.workunit.client.0.smithi138.stdout:9/284: dwrite d0/df/d11/d23/f43 [0,4194304] 0 2024-02-15T22:50:52.927 INFO:tasks.workunit.client.0.smithi138.stdout:0/292: dwrite f0 [0,4194304] 0 2024-02-15T22:50:52.930 INFO:tasks.workunit.client.0.smithi138.stdout:9/285: rename d0/f1e to d0/de/d14/f68 0 2024-02-15T22:50:52.936 INFO:tasks.workunit.client.0.smithi138.stdout:0/293: dread d6/d10/d13/f2c [0,4194304] 0 2024-02-15T22:50:52.937 INFO:tasks.workunit.client.0.smithi138.stdout:0/294: mkdir d6/d10/d64 0 2024-02-15T22:50:52.939 INFO:tasks.workunit.client.0.smithi138.stdout:0/295: read d6/d10/d40/f43 [284716,4646] 0 2024-02-15T22:50:52.939 INFO:tasks.workunit.client.0.smithi138.stdout:0/296: fdatasync d6/d10/d18/f4b 0 2024-02-15T22:50:52.939 INFO:tasks.workunit.client.0.smithi138.stdout:0/297: creat d6/d10/d18/f65 x:0 0 0 2024-02-15T22:50:52.939 INFO:tasks.workunit.client.0.smithi138.stdout:0/298: dread - d6/d10/d18/f65 zero size 2024-02-15T22:50:52.943 INFO:tasks.workunit.client.0.smithi138.stdout:9/286: dread d0/df/d11/d23/f43 [0,4194304] 0 2024-02-15T22:50:52.943 INFO:tasks.workunit.client.0.smithi138.stdout:9/287: chown d0/de/d14/d22 682509 1 2024-02-15T22:50:52.943 INFO:tasks.workunit.client.0.smithi138.stdout:9/288: write d0/de/d33/d57/f5a [499899,33794] 0 2024-02-15T22:50:52.944 INFO:tasks.workunit.client.0.smithi138.stdout:9/289: getdents d0/d55/d59 0 2024-02-15T22:50:52.944 INFO:tasks.workunit.client.0.smithi138.stdout:9/290: write d0/f27 [1340887,48636] 0 2024-02-15T22:50:52.946 INFO:tasks.workunit.client.0.smithi138.stdout:6/299: dwrite f0 [0,4194304] 0 2024-02-15T22:50:52.946 INFO:tasks.workunit.client.0.smithi138.stdout:0/299: dread d6/d10/d13/f25 [4194304,4194304] 0 2024-02-15T22:50:52.946 INFO:tasks.workunit.client.0.smithi138.stdout:1/220: dwrite df/d1b/d1d/d24/d3a/f44 [0,4194304] 0 2024-02-15T22:50:52.946 INFO:tasks.workunit.client.0.smithi138.stdout:1/221: truncate df/d41/f49 211060 0 2024-02-15T22:50:52.950 INFO:tasks.workunit.client.0.smithi138.stdout:1/222: write df/f14 [2496489,86933] 0 2024-02-15T22:50:52.952 INFO:tasks.workunit.client.0.smithi138.stdout:1/223: dread df/d41/f49 [0,4194304] 0 2024-02-15T22:50:52.953 INFO:tasks.workunit.client.0.smithi138.stdout:1/224: read df/d41/f49 [63964,21097] 0 2024-02-15T22:50:52.954 INFO:tasks.workunit.client.0.smithi138.stdout:9/291: dread d0/d55/f5e [0,4194304] 0 2024-02-15T22:50:52.955 INFO:tasks.workunit.client.0.smithi138.stdout:1/225: creat df/d1b/d1d/d25/d2e/f4e x:0 0 0 2024-02-15T22:50:52.955 INFO:tasks.workunit.client.0.smithi138.stdout:1/226: write df/d1b/f3d [411853,105053] 0 2024-02-15T22:50:52.957 INFO:tasks.workunit.client.0.smithi138.stdout:9/292: mknod d0/c69 0 2024-02-15T22:50:52.958 INFO:tasks.workunit.client.0.smithi138.stdout:9/293: fdatasync d0/d4/fd 0 2024-02-15T22:50:52.958 INFO:tasks.workunit.client.0.smithi138.stdout:9/294: fsync d0/de/d34/f3e 0 2024-02-15T22:50:52.959 INFO:tasks.workunit.client.0.smithi138.stdout:9/295: mkdir d0/df/d11/d23/d6a 0 2024-02-15T22:50:52.960 INFO:tasks.workunit.client.0.smithi138.stdout:9/296: link d0/d4/c28 d0/df/d11/d23/d6a/c6b 0 2024-02-15T22:50:52.960 INFO:tasks.workunit.client.0.smithi138.stdout:9/297: write d0/df/d11/f32 [4132792,117929] 0 2024-02-15T22:50:52.960 INFO:tasks.workunit.client.0.smithi138.stdout:6/300: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:52.962 INFO:tasks.workunit.client.0.smithi138.stdout:9/298: mknod d0/df/c6c 0 2024-02-15T22:50:52.963 INFO:tasks.workunit.client.0.smithi138.stdout:6/301: mkdir dc/d24/d34/d3b/d66 0 2024-02-15T22:50:52.964 INFO:tasks.workunit.client.0.smithi138.stdout:9/299: mknod d0/de/d34/c6d 0 2024-02-15T22:50:52.964 INFO:tasks.workunit.client.0.smithi138.stdout:9/300: write d0/d4/f3b [844649,44632] 0 2024-02-15T22:50:52.965 INFO:tasks.workunit.client.0.smithi138.stdout:9/301: creat d0/d2e/f6e x:0 0 0 2024-02-15T22:50:52.979 INFO:tasks.workunit.client.0.smithi138.stdout:9/302: write d0/d55/f5e [6490814,16297] 0 2024-02-15T22:50:52.982 INFO:tasks.workunit.client.0.smithi138.stdout:6/302: dwrite dc/d24/d34/d3b/f41 [0,4194304] 0 2024-02-15T22:50:52.989 INFO:tasks.workunit.client.0.smithi138.stdout:9/303: dread d0/df/d11/f32 [0,4194304] 0 2024-02-15T22:50:52.992 INFO:tasks.workunit.client.0.smithi138.stdout:9/304: dread d0/f27 [0,4194304] 0 2024-02-15T22:50:52.992 INFO:tasks.workunit.client.0.smithi138.stdout:9/305: dread - d0/df/f4e zero size 2024-02-15T22:50:52.993 INFO:tasks.workunit.client.0.smithi138.stdout:9/306: rename d0/df/d11/d23/l3c to d0/de/d14/d63/l6f 0 2024-02-15T22:50:52.994 INFO:tasks.workunit.client.0.smithi138.stdout:9/307: dread - d0/df/f4e zero size 2024-02-15T22:50:52.995 INFO:tasks.workunit.client.0.smithi138.stdout:9/308: unlink d0/d4/l1a 0 2024-02-15T22:50:52.996 INFO:tasks.workunit.client.0.smithi138.stdout:9/309: mkdir d0/de/d48/d70 0 2024-02-15T22:50:53.004 INFO:tasks.workunit.client.0.smithi138.stdout:9/310: read d0/d4/f2c [3102681,29771] 0 2024-02-15T22:50:53.004 INFO:tasks.workunit.client.0.smithi138.stdout:9/311: truncate d0/df/f4e 655102 0 2024-02-15T22:50:53.004 INFO:tasks.workunit.client.0.smithi138.stdout:6/303: dwrite dc/f40 [0,4194304] 0 2024-02-15T22:50:53.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/312: mkdir d0/df/d11/d23/d71 0 2024-02-15T22:50:53.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/313: stat d0/de/d14/f66 0 2024-02-15T22:50:53.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/314: write d0/de/d14/f1b [43589,93339] 0 2024-02-15T22:50:53.008 INFO:tasks.workunit.client.0.smithi138.stdout:9/315: symlink d0/de/d14/l72 0 2024-02-15T22:50:53.008 INFO:tasks.workunit.client.0.smithi138.stdout:9/316: symlink d0/d4/l73 0 2024-02-15T22:50:53.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:52 smithi170 ceph-mon[35248]: pgmap v9: 65 pgs: 65 active+clean; 504 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 47 MiB/s rd, 63 MiB/s wr, 959 op/s 2024-02-15T22:50:53.019 INFO:tasks.workunit.client.0.smithi138.stdout:6/304: dwrite dc/d24/f38 [4194304,4194304] 0 2024-02-15T22:50:53.020 INFO:tasks.workunit.client.0.smithi138.stdout:6/305: fsync dc/d24/d34/d3b/f42 0 2024-02-15T22:50:53.027 INFO:tasks.workunit.client.0.smithi138.stdout:9/317: dwrite d0/de/d14/f44 [4194304,4194304] 0 2024-02-15T22:50:53.028 INFO:tasks.workunit.client.0.smithi138.stdout:9/318: mknod d0/de/d14/c74 0 2024-02-15T22:50:53.028 INFO:tasks.workunit.client.0.smithi138.stdout:9/319: creat d0/de/d34/f75 x:0 0 0 2024-02-15T22:50:53.040 INFO:tasks.workunit.client.0.smithi138.stdout:9/320: dwrite d0/de/f47 [0,4194304] 0 2024-02-15T22:50:53.043 INFO:tasks.workunit.client.0.smithi138.stdout:9/321: read d0/f19 [4173360,129204] 0 2024-02-15T22:50:53.071 INFO:tasks.workunit.client.0.smithi138.stdout:9/322: creat d0/de/d33/f76 x:0 0 0 2024-02-15T22:50:53.071 INFO:tasks.workunit.client.0.smithi138.stdout:9/323: creat d0/de/d33/f77 x:0 0 0 2024-02-15T22:50:53.071 INFO:tasks.workunit.client.0.smithi138.stdout:9/324: dread - d0/de/d33/f36 zero size 2024-02-15T22:50:53.071 INFO:tasks.workunit.client.0.smithi138.stdout:9/325: chown d0/d4/f3b 2650759 1 2024-02-15T22:50:53.073 INFO:tasks.workunit.client.0.smithi138.stdout:9/326: mknod d0/df/c78 0 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/327: truncate d0/d55/d59/f5f 469480 0 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/328: chown d0/d55/d59/c5d 48 1 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/329: symlink d0/de/d33/l79 0 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/330: chown d0/d2e/f6e 322441 1 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/331: stat d0/df/d11/c64 0 2024-02-15T22:50:53.074 INFO:tasks.workunit.client.0.smithi138.stdout:9/332: write d0/d4/f2c [1497910,117493] 0 2024-02-15T22:50:53.075 INFO:tasks.workunit.client.0.smithi138.stdout:9/333: stat d0/d2e 0 2024-02-15T22:50:53.079 INFO:tasks.workunit.client.0.smithi138.stdout:8/201: sync 2024-02-15T22:50:53.080 INFO:tasks.workunit.client.0.smithi138.stdout:9/334: dread d0/df/d11/f32 [0,4194304] 0 2024-02-15T22:50:53.080 INFO:tasks.workunit.client.0.smithi138.stdout:9/335: read - d0/de/d14/f58 zero size 2024-02-15T22:50:53.089 INFO:tasks.workunit.client.0.smithi138.stdout:8/202: write db/dd/f14 [1840714,7446] 0 2024-02-15T22:50:53.089 INFO:tasks.workunit.client.0.smithi138.stdout:8/203: chown db/d15/f17 122 1 2024-02-15T22:50:53.091 INFO:tasks.workunit.client.0.smithi138.stdout:8/204: rename ca to db/dd/c41 0 2024-02-15T22:50:53.091 INFO:tasks.workunit.client.0.smithi138.stdout:8/205: symlink db/dd/d13/d19/d24/l42 0 2024-02-15T22:50:53.091 INFO:tasks.workunit.client.0.smithi138.stdout:8/206: creat db/dd/d13/d19/f43 x:0 0 0 2024-02-15T22:50:53.095 INFO:tasks.workunit.client.0.smithi138.stdout:9/336: dwrite d0/de/d14/f68 [0,4194304] 0 2024-02-15T22:50:53.098 INFO:tasks.workunit.client.0.smithi138.stdout:8/207: dread f0 [0,4194304] 0 2024-02-15T22:50:53.099 INFO:tasks.workunit.client.0.smithi138.stdout:8/208: symlink db/dd/d13/l44 0 2024-02-15T22:50:53.099 INFO:tasks.workunit.client.0.smithi138.stdout:8/209: write db/f3d [3793665,91823] 0 2024-02-15T22:50:53.099 INFO:tasks.workunit.client.0.smithi138.stdout:8/210: stat db/dd/d13/f31 0 2024-02-15T22:50:53.100 INFO:tasks.workunit.client.0.smithi138.stdout:8/211: fsync db/dd/f14 0 2024-02-15T22:50:53.108 INFO:tasks.workunit.client.0.smithi138.stdout:8/212: dread db/f3d [0,4194304] 0 2024-02-15T22:50:53.108 INFO:tasks.workunit.client.0.smithi138.stdout:8/213: chown db/d15/c32 63122 1 2024-02-15T22:50:53.108 INFO:tasks.workunit.client.0.smithi138.stdout:8/214: chown db/d34 12772986 1 2024-02-15T22:50:53.109 INFO:tasks.workunit.client.0.smithi138.stdout:8/215: mkdir db/dd/d13/d19/d45 0 2024-02-15T22:50:53.122 INFO:tasks.workunit.client.0.smithi138.stdout:8/216: dwrite db/fc [0,4194304] 0 2024-02-15T22:50:53.122 INFO:tasks.workunit.client.0.smithi138.stdout:8/217: chown db/dd/d13/f3b 1058 1 2024-02-15T22:50:53.122 INFO:tasks.workunit.client.0.smithi138.stdout:8/218: truncate db/f28 4440447 0 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:2/247: sync 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:7/516: sync 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:2/248: chown d0/da/d19/d3f 1514580 1 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:2/249: readlink d0/dd/d15/l4d 0 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:8/219: creat db/d34/f46 x:0 0 0 2024-02-15T22:50:53.124 INFO:tasks.workunit.client.0.smithi138.stdout:7/517: mknod d1/d2/cb5 0 2024-02-15T22:50:53.126 INFO:tasks.workunit.client.0.smithi138.stdout:7/518: mknod d1/d2/d29/cb6 0 2024-02-15T22:50:53.133 INFO:tasks.workunit.client.0.smithi138.stdout:2/250: dread d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:53.134 INFO:tasks.workunit.client.0.smithi138.stdout:8/220: rmdir db/d34 39 2024-02-15T22:50:53.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/519: dwrite d1/d2/db/d3c/d4d/f78 [0,4194304] 0 2024-02-15T22:50:53.147 INFO:tasks.workunit.client.0.smithi138.stdout:2/251: dwrite d0/da/f23 [0,4194304] 0 2024-02-15T22:50:53.160 INFO:tasks.workunit.client.0.smithi138.stdout:2/252: dwrite d0/da/d19/f2d [0,4194304] 0 2024-02-15T22:50:53.167 INFO:tasks.workunit.client.0.smithi138.stdout:2/253: dread d0/da/f46 [0,4194304] 0 2024-02-15T22:50:53.167 INFO:tasks.workunit.client.0.smithi138.stdout:2/254: write d0/dd/f4e [888722,34293] 0 2024-02-15T22:50:53.169 INFO:tasks.workunit.client.0.smithi138.stdout:8/221: rmdir db/d15 39 2024-02-15T22:50:53.172 INFO:tasks.workunit.client.0.smithi138.stdout:7/520: rename d1/d2/d29/f88 to d1/d79/d84/da0/fb7 0 2024-02-15T22:50:53.172 INFO:tasks.workunit.client.0.smithi138.stdout:7/521: dread - d1/d2/f8d zero size 2024-02-15T22:50:53.172 INFO:tasks.workunit.client.0.smithi138.stdout:7/522: truncate d1/d2/f73 4707005 0 2024-02-15T22:50:53.175 INFO:tasks.workunit.client.0.smithi138.stdout:2/255: link d0/da/d19/f2a d0/d52/f5b 0 2024-02-15T22:50:53.178 INFO:tasks.workunit.client.0.smithi138.stdout:8/222: rename db/dd/d13/f23 to db/dd/f47 0 2024-02-15T22:50:53.178 INFO:tasks.workunit.client.0.smithi138.stdout:8/223: write db/dd/f1d [740816,41539] 0 2024-02-15T22:50:53.181 INFO:tasks.workunit.client.0.smithi138.stdout:2/256: creat d0/dd/f5c x:0 0 0 2024-02-15T22:50:53.181 INFO:tasks.workunit.client.0.smithi138.stdout:2/257: stat d0/d52 0 2024-02-15T22:50:53.182 INFO:tasks.workunit.client.0.smithi138.stdout:8/224: symlink db/l48 0 2024-02-15T22:50:53.182 INFO:tasks.workunit.client.0.smithi138.stdout:8/225: stat db/dd/d13/d19/f43 0 2024-02-15T22:50:53.182 INFO:tasks.workunit.client.0.smithi138.stdout:8/226: creat db/dd/d13/d19/f49 x:0 0 0 2024-02-15T22:50:53.182 INFO:tasks.workunit.client.0.smithi138.stdout:8/227: fdatasync db/f28 0 2024-02-15T22:50:53.183 INFO:tasks.workunit.client.0.smithi138.stdout:2/258: mkdir d0/da/d19/d53/d5d 0 2024-02-15T22:50:53.184 INFO:tasks.workunit.client.0.smithi138.stdout:2/259: rename d0/da/f46 to d0/d3/f5e 0 2024-02-15T22:50:53.185 INFO:tasks.workunit.client.0.smithi138.stdout:2/260: creat d0/d52/f5f x:0 0 0 2024-02-15T22:50:53.186 INFO:tasks.workunit.client.0.smithi138.stdout:2/261: symlink d0/dd/d15/l60 0 2024-02-15T22:50:53.187 INFO:tasks.workunit.client.0.smithi138.stdout:2/262: rename d0/dd/d15/l47 to d0/da/l61 0 2024-02-15T22:50:53.192 INFO:tasks.workunit.client.0.smithi138.stdout:2/263: mkdir d0/da/d62 0 2024-02-15T22:50:53.192 INFO:tasks.workunit.client.0.smithi138.stdout:8/228: dread db/dd/f11 [0,4194304] 0 2024-02-15T22:50:53.192 INFO:tasks.workunit.client.0.smithi138.stdout:8/229: creat db/dd/d13/d19/d24/f4a x:0 0 0 2024-02-15T22:50:53.195 INFO:tasks.workunit.client.0.smithi138.stdout:2/264: fsync d0/d3/f5e 0 2024-02-15T22:50:53.195 INFO:tasks.workunit.client.0.smithi138.stdout:2/265: write d0/da/f33 [839935,29098] 0 2024-02-15T22:50:53.196 INFO:tasks.workunit.client.0.smithi138.stdout:2/266: rename d0/d3/l48 to d0/l63 0 2024-02-15T22:50:53.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/230: rmdir db/dd/d13/d19 39 2024-02-15T22:50:53.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/231: chown db/dd/d13/d19/d24/f4a 196278 1 2024-02-15T22:50:53.199 INFO:tasks.workunit.client.0.smithi138.stdout:8/232: symlink db/dd/d13/l4b 0 2024-02-15T22:50:53.199 INFO:tasks.workunit.client.0.smithi138.stdout:8/233: creat db/dd/d13/f4c x:0 0 0 2024-02-15T22:50:53.199 INFO:tasks.workunit.client.0.smithi138.stdout:8/234: stat db/dd/d13/d19/f40 0 2024-02-15T22:50:53.200 INFO:tasks.workunit.client.0.smithi138.stdout:8/235: mkdir db/dd/d4d 0 2024-02-15T22:50:53.200 INFO:tasks.workunit.client.0.smithi138.stdout:8/236: creat db/dd/f4e x:0 0 0 2024-02-15T22:50:53.201 INFO:tasks.workunit.client.0.smithi138.stdout:8/237: mknod db/dd/d13/d19/d45/c4f 0 2024-02-15T22:50:53.201 INFO:tasks.workunit.client.0.smithi138.stdout:8/238: write db/fc [4464847,33308] 0 2024-02-15T22:50:53.202 INFO:tasks.workunit.client.0.smithi138.stdout:8/239: creat db/d34/f50 x:0 0 0 2024-02-15T22:50:53.202 INFO:tasks.workunit.client.0.smithi138.stdout:8/240: readlink db/dd/d13/d19/l3a 0 2024-02-15T22:50:53.203 INFO:tasks.workunit.client.0.smithi138.stdout:8/241: symlink db/dd/d13/d19/d45/l51 0 2024-02-15T22:50:53.203 INFO:tasks.workunit.client.0.smithi138.stdout:8/242: dread - db/d15/f36 zero size 2024-02-15T22:50:53.203 INFO:tasks.workunit.client.0.smithi138.stdout:8/243: fsync db/dd/d13/d19/d24/f4a 0 2024-02-15T22:50:53.210 INFO:tasks.workunit.client.0.smithi138.stdout:2/267: dwrite d0/da/d19/f55 [0,4194304] 0 2024-02-15T22:50:53.210 INFO:tasks.workunit.client.0.smithi138.stdout:2/268: chown d0/d3/l42 44056389 1 2024-02-15T22:50:53.210 INFO:tasks.workunit.client.0.smithi138.stdout:2/269: chown d0/d3/c45 1 1 2024-02-15T22:50:53.215 INFO:tasks.workunit.client.0.smithi138.stdout:8/244: rename db/d34 to db/dd/d13/d19/d52 0 2024-02-15T22:50:53.215 INFO:tasks.workunit.client.0.smithi138.stdout:8/245: write f6 [401979,109233] 0 2024-02-15T22:50:53.215 INFO:tasks.workunit.client.0.smithi138.stdout:8/246: write db/dd/d13/f4c [969084,79654] 0 2024-02-15T22:50:53.216 INFO:tasks.workunit.client.0.smithi138.stdout:4/526: sync 2024-02-15T22:50:53.216 INFO:tasks.workunit.client.0.smithi138.stdout:5/217: sync 2024-02-15T22:50:53.216 INFO:tasks.workunit.client.0.smithi138.stdout:4/527: write d17/d1e/d2d/f2e [1945953,77707] 0 2024-02-15T22:50:53.217 INFO:tasks.workunit.client.0.smithi138.stdout:2/270: write d0/f3b [887452,12790] 0 2024-02-15T22:50:53.217 INFO:tasks.workunit.client.0.smithi138.stdout:8/247: rename f6 to db/dd/d22/f53 0 2024-02-15T22:50:53.218 INFO:tasks.workunit.client.0.smithi138.stdout:5/218: mkdir df/d18/d3e 0 2024-02-15T22:50:53.220 INFO:tasks.workunit.client.0.smithi138.stdout:4/528: mknod d17/d1a/cb3 0 2024-02-15T22:50:53.221 INFO:tasks.workunit.client.0.smithi138.stdout:2/271: read d0/d3/f5e [3287754,36645] 0 2024-02-15T22:50:53.221 INFO:tasks.workunit.client.0.smithi138.stdout:2/272: write d0/da/d19/f1b [2759190,14582] 0 2024-02-15T22:50:53.223 INFO:tasks.workunit.client.0.smithi138.stdout:4/529: link d17/d1e/d2d/f31 d17/d1e/d2d/d36/d3e/fb4 0 2024-02-15T22:50:53.224 INFO:tasks.workunit.client.0.smithi138.stdout:2/273: link d0/da/l24 d0/da/d19/d53/l64 0 2024-02-15T22:50:53.225 INFO:tasks.workunit.client.0.smithi138.stdout:2/274: truncate d0/d52/f5f 785639 0 2024-02-15T22:50:53.230 INFO:tasks.workunit.client.0.smithi138.stdout:5/219: dread df/f27 [0,4194304] 0 2024-02-15T22:50:53.230 INFO:tasks.workunit.client.0.smithi138.stdout:5/220: chown df/f1a 2552 1 2024-02-15T22:50:53.233 INFO:tasks.workunit.client.0.smithi138.stdout:5/221: creat df/d18/d3e/f3f x:0 0 0 2024-02-15T22:50:53.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:52 smithi138 ceph-mon[29229]: pgmap v9: 65 pgs: 65 active+clean; 504 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 47 MiB/s rd, 63 MiB/s wr, 959 op/s 2024-02-15T22:50:53.246 INFO:tasks.workunit.client.0.smithi138.stdout:2/275: dwrite d0/dd/f18 [0,4194304] 0 2024-02-15T22:50:53.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/530: dwrite d17/d1e/d2d/f2e [0,4194304] 0 2024-02-15T22:50:53.247 INFO:tasks.workunit.client.0.smithi138.stdout:4/531: creat d17/d1e/d2d/d36/d3e/d64/fb5 x:0 0 0 2024-02-15T22:50:53.248 INFO:tasks.workunit.client.0.smithi138.stdout:4/532: read f6 [1976812,6119] 0 2024-02-15T22:50:53.248 INFO:tasks.workunit.client.0.smithi138.stdout:8/248: dwrite db/dd/d13/d19/d52/f46 [0,4194304] 0 2024-02-15T22:50:53.248 INFO:tasks.workunit.client.0.smithi138.stdout:2/276: truncate d0/d3/f44 4068766 0 2024-02-15T22:50:53.254 INFO:tasks.workunit.client.0.smithi138.stdout:8/249: symlink db/dd/d13/d19/d52/l54 0 2024-02-15T22:50:53.256 INFO:tasks.workunit.client.0.smithi138.stdout:2/277: mkdir d0/dd/d15/d65 0 2024-02-15T22:50:53.256 INFO:tasks.workunit.client.0.smithi138.stdout:2/278: write d0/d3/f5e [4045316,10505] 0 2024-02-15T22:50:53.257 INFO:tasks.workunit.client.0.smithi138.stdout:2/279: symlink d0/da/d62/l66 0 2024-02-15T22:50:53.259 INFO:tasks.workunit.client.0.smithi138.stdout:2/280: getdents d0/da/d19 0 2024-02-15T22:50:53.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/222: rmdir df 39 2024-02-15T22:50:53.261 INFO:tasks.workunit.client.0.smithi138.stdout:4/533: dwrite d17/d2b/fa4 [0,4194304] 0 2024-02-15T22:50:53.261 INFO:tasks.workunit.client.0.smithi138.stdout:4/534: dread - d17/d1e/d2d/d36/f69 zero size 2024-02-15T22:50:53.261 INFO:tasks.workunit.client.0.smithi138.stdout:4/535: stat d17/d1a/c21 0 2024-02-15T22:50:53.264 INFO:tasks.workunit.client.0.smithi138.stdout:2/281: dread d0/da/f33 [0,4194304] 0 2024-02-15T22:50:53.266 INFO:tasks.workunit.client.0.smithi138.stdout:2/282: link d0/d3/c45 d0/d52/c67 0 2024-02-15T22:50:53.270 INFO:tasks.workunit.client.0.smithi138.stdout:2/283: write d0/da/f8 [167200,130987] 0 2024-02-15T22:50:53.272 INFO:tasks.workunit.client.0.smithi138.stdout:5/223: dread df/f2e [0,4194304] 0 2024-02-15T22:50:53.272 INFO:tasks.workunit.client.0.smithi138.stdout:5/224: chown df/d18/d2b/l2c 29375413 1 2024-02-15T22:50:53.272 INFO:tasks.workunit.client.0.smithi138.stdout:5/225: fdatasync df/d18/d3e/f3f 0 2024-02-15T22:50:53.274 INFO:tasks.workunit.client.0.smithi138.stdout:2/284: rmdir d0/dd/d15 39 2024-02-15T22:50:53.280 INFO:tasks.workunit.client.0.smithi138.stdout:5/226: dread fc [0,4194304] 0 2024-02-15T22:50:53.281 INFO:tasks.workunit.client.0.smithi138.stdout:5/227: mknod df/d18/d2b/c40 0 2024-02-15T22:50:53.284 INFO:tasks.workunit.client.0.smithi138.stdout:8/250: dwrite db/f3d [0,4194304] 0 2024-02-15T22:50:53.284 INFO:tasks.workunit.client.0.smithi138.stdout:8/251: truncate db/f10 4274714 0 2024-02-15T22:50:53.285 INFO:tasks.workunit.client.0.smithi138.stdout:8/252: symlink db/dd/d13/d19/d45/l55 0 2024-02-15T22:50:53.285 INFO:tasks.workunit.client.0.smithi138.stdout:8/253: creat db/dd/d22/f56 x:0 0 0 2024-02-15T22:50:53.285 INFO:tasks.workunit.client.0.smithi138.stdout:8/254: fsync db/f29 0 2024-02-15T22:50:53.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/255: creat db/dd/d13/d19/d24/f57 x:0 0 0 2024-02-15T22:50:53.287 INFO:tasks.workunit.client.0.smithi138.stdout:8/256: getdents db/dd/d13/d19/d52 0 2024-02-15T22:50:53.287 INFO:tasks.workunit.client.0.smithi138.stdout:8/257: creat db/f58 x:0 0 0 2024-02-15T22:50:53.291 INFO:tasks.workunit.client.0.smithi138.stdout:2/285: dwrite d0/da/d19/f54 [0,4194304] 0 2024-02-15T22:50:53.296 INFO:tasks.workunit.client.0.smithi138.stdout:8/258: rmdir db/dd 39 2024-02-15T22:50:53.296 INFO:tasks.workunit.client.0.smithi138.stdout:8/259: write db/dd/d13/f4c [1140744,86975] 0 2024-02-15T22:50:53.296 INFO:tasks.workunit.client.0.smithi138.stdout:8/260: write db/f29 [1194919,99873] 0 2024-02-15T22:50:53.297 INFO:tasks.workunit.client.0.smithi138.stdout:5/228: dwrite df/f27 [0,4194304] 0 2024-02-15T22:50:53.298 INFO:tasks.workunit.client.0.smithi138.stdout:2/286: creat d0/da/d19/d53/f68 x:0 0 0 2024-02-15T22:50:53.299 INFO:tasks.workunit.client.0.smithi138.stdout:8/261: mknod db/dd/c59 0 2024-02-15T22:50:53.300 INFO:tasks.workunit.client.0.smithi138.stdout:5/229: chown c1 16 1 2024-02-15T22:50:53.301 INFO:tasks.workunit.client.0.smithi138.stdout:2/287: mknod d0/c69 0 2024-02-15T22:50:53.302 INFO:tasks.workunit.client.0.smithi138.stdout:8/262: rename db/dd/d22/f53 to db/dd/d4d/f5a 0 2024-02-15T22:50:53.303 INFO:tasks.workunit.client.0.smithi138.stdout:8/263: chown db/dd/f3e 602315 1 2024-02-15T22:50:53.303 INFO:tasks.workunit.client.0.smithi138.stdout:8/264: fdatasync db/dd/d22/f3f 0 2024-02-15T22:50:53.303 INFO:tasks.workunit.client.0.smithi138.stdout:1/227: sync 2024-02-15T22:50:53.303 INFO:tasks.workunit.client.0.smithi138.stdout:3/348: sync 2024-02-15T22:50:53.303 INFO:tasks.workunit.client.0.smithi138.stdout:0/300: sync 2024-02-15T22:50:53.305 INFO:tasks.workunit.client.0.smithi138.stdout:5/230: rename df/f1a to df/d18/d3e/f41 0 2024-02-15T22:50:53.305 INFO:tasks.workunit.client.0.smithi138.stdout:5/231: stat df/d18/d2b/l30 0 2024-02-15T22:50:53.307 INFO:tasks.workunit.client.0.smithi138.stdout:3/349: mkdir d5/d12/d26/d2f/d73 0 2024-02-15T22:50:53.308 INFO:tasks.workunit.client.0.smithi138.stdout:1/228: mkdir df/d1b/d21/d4f 0 2024-02-15T22:50:53.308 INFO:tasks.workunit.client.0.smithi138.stdout:1/229: readlink df/d1b/d1d/d25/d2e/d37/l43 0 2024-02-15T22:50:53.309 INFO:tasks.workunit.client.0.smithi138.stdout:0/301: creat d6/d10/d34/f66 x:0 0 0 2024-02-15T22:50:53.311 INFO:tasks.workunit.client.0.smithi138.stdout:3/350: link d5/d12/d23/d29/l3f d5/d16/dc/d43/d47/l74 0 2024-02-15T22:50:53.311 INFO:tasks.workunit.client.0.smithi138.stdout:3/351: chown d5/d16/dc/f1a 231 1 2024-02-15T22:50:53.311 INFO:tasks.workunit.client.0.smithi138.stdout:8/265: dread f5 [0,4194304] 0 2024-02-15T22:50:53.313 INFO:tasks.workunit.client.0.smithi138.stdout:1/230: symlink df/d1b/d1d/d24/d3a/l50 0 2024-02-15T22:50:53.315 INFO:tasks.workunit.client.0.smithi138.stdout:5/232: read fd [1731627,119318] 0 2024-02-15T22:50:53.315 INFO:tasks.workunit.client.0.smithi138.stdout:0/302: rename d6/d10/d18/c4d to d6/d10/d52/c67 0 2024-02-15T22:50:53.316 INFO:tasks.workunit.client.0.smithi138.stdout:3/352: truncate d5/d12/f1b 2219927 0 2024-02-15T22:50:53.316 INFO:tasks.workunit.client.0.smithi138.stdout:3/353: write d5/d16/fa [1086378,82688] 0 2024-02-15T22:50:53.316 INFO:tasks.workunit.client.0.smithi138.stdout:2/288: dwrite d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:53.317 INFO:tasks.workunit.client.0.smithi138.stdout:2/289: truncate d0/da/d19/f55 4457118 0 2024-02-15T22:50:53.317 INFO:tasks.workunit.client.0.smithi138.stdout:5/233: mknod df/d18/d3e/c42 0 2024-02-15T22:50:53.318 INFO:tasks.workunit.client.0.smithi138.stdout:1/231: rename df/d1b/c2b to df/d1b/d1d/d25/d2e/c51 0 2024-02-15T22:50:53.318 INFO:tasks.workunit.client.0.smithi138.stdout:1/232: write df/d1b/d1d/d25/f42 [682405,16931] 0 2024-02-15T22:50:53.320 INFO:tasks.workunit.client.0.smithi138.stdout:3/354: rmdir d5/d12/d26/d2f/d73 0 2024-02-15T22:50:53.320 INFO:tasks.workunit.client.0.smithi138.stdout:3/355: fdatasync d5/d16/dc/d43/d47/d67/f6b 0 2024-02-15T22:50:53.321 INFO:tasks.workunit.client.0.smithi138.stdout:2/290: symlink d0/d52/l6a 0 2024-02-15T22:50:53.321 INFO:tasks.workunit.client.0.smithi138.stdout:2/291: write d0/d52/f5f [1111975,101141] 0 2024-02-15T22:50:53.321 INFO:tasks.workunit.client.0.smithi138.stdout:2/292: truncate d0/dd/f5c 660449 0 2024-02-15T22:50:53.321 INFO:tasks.workunit.client.0.smithi138.stdout:2/293: write d0/d3/f2b [4784047,22061] 0 2024-02-15T22:50:53.321 INFO:tasks.workunit.client.0.smithi138.stdout:5/234: mknod df/c43 0 2024-02-15T22:50:53.322 INFO:tasks.workunit.client.0.smithi138.stdout:1/233: symlink df/d41/l52 0 2024-02-15T22:50:53.322 INFO:tasks.workunit.client.0.smithi138.stdout:1/234: stat df/c10 0 2024-02-15T22:50:53.325 INFO:tasks.workunit.client.0.smithi138.stdout:3/356: creat d5/d16/dc/d43/d47/f75 x:0 0 0 2024-02-15T22:50:53.325 INFO:tasks.workunit.client.0.smithi138.stdout:3/357: chown d5/d16/c3e 16574 1 2024-02-15T22:50:53.326 INFO:tasks.workunit.client.0.smithi138.stdout:8/266: dwrite db/dd/d13/f3b [0,4194304] 0 2024-02-15T22:50:53.327 INFO:tasks.workunit.client.0.smithi138.stdout:2/294: mknod d0/dd/d15/c6b 0 2024-02-15T22:50:53.328 INFO:tasks.workunit.client.0.smithi138.stdout:5/235: creat df/f44 x:0 0 0 2024-02-15T22:50:53.330 INFO:tasks.workunit.client.0.smithi138.stdout:3/358: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:53.330 INFO:tasks.workunit.client.0.smithi138.stdout:3/359: creat d5/d16/dc/f76 x:0 0 0 2024-02-15T22:50:53.330 INFO:tasks.workunit.client.0.smithi138.stdout:1/235: creat df/f53 x:0 0 0 2024-02-15T22:50:53.331 INFO:tasks.workunit.client.0.smithi138.stdout:1/236: creat df/d1b/d1d/d25/d2e/d37/f54 x:0 0 0 2024-02-15T22:50:53.333 INFO:tasks.workunit.client.0.smithi138.stdout:2/295: rename d0/dd/d15/f43 to d0/dd/d15/f6c 0 2024-02-15T22:50:53.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/236: dread fd [0,4194304] 0 2024-02-15T22:50:53.339 INFO:tasks.workunit.client.0.smithi138.stdout:8/267: write db/dd/d13/d19/d52/f46 [163041,72300] 0 2024-02-15T22:50:53.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/360: creat d5/d16/f77 x:0 0 0 2024-02-15T22:50:53.345 INFO:tasks.workunit.client.0.smithi138.stdout:1/237: creat df/d1b/d33/f55 x:0 0 0 2024-02-15T22:50:53.347 INFO:tasks.workunit.client.0.smithi138.stdout:2/296: rename d0/da/d62 to d0/da/d19/d53/d5d/d6d 0 2024-02-15T22:50:53.351 INFO:tasks.workunit.client.0.smithi138.stdout:8/268: creat db/dd/d13/d19/d52/f5b x:0 0 0 2024-02-15T22:50:53.354 INFO:tasks.workunit.client.0.smithi138.stdout:5/237: dwrite df/d18/f20 [0,4194304] 0 2024-02-15T22:50:53.354 INFO:tasks.workunit.client.0.smithi138.stdout:5/238: write df/f11 [876001,21697] 0 2024-02-15T22:50:53.355 INFO:tasks.workunit.client.0.smithi138.stdout:1/238: dread df/f12 [0,4194304] 0 2024-02-15T22:50:53.360 INFO:tasks.workunit.client.0.smithi138.stdout:3/361: fsync d5/d16/f77 0 2024-02-15T22:50:53.360 INFO:tasks.workunit.client.0.smithi138.stdout:3/362: dread - d5/d16/dc/d43/d47/f75 zero size 2024-02-15T22:50:53.360 INFO:tasks.workunit.client.0.smithi138.stdout:3/363: fsync d5/d12/d23/f4c 0 2024-02-15T22:50:53.365 INFO:tasks.workunit.client.0.smithi138.stdout:1/239: dread df/d1b/f1f [0,4194304] 0 2024-02-15T22:50:53.366 INFO:tasks.workunit.client.0.smithi138.stdout:2/297: rename d0/d3/c7 to d0/c6e 0 2024-02-15T22:50:53.369 INFO:tasks.workunit.client.0.smithi138.stdout:3/364: symlink d5/d16/dc/d43/l78 0 2024-02-15T22:50:53.369 INFO:tasks.workunit.client.0.smithi138.stdout:3/365: stat d5/d12/d23 0 2024-02-15T22:50:53.369 INFO:tasks.workunit.client.0.smithi138.stdout:1/240: truncate df/d1b/d1d/d24/d3a/f44 3201090 0 2024-02-15T22:50:53.370 INFO:tasks.workunit.client.0.smithi138.stdout:2/298: symlink d0/da/l6f 0 2024-02-15T22:50:53.372 INFO:tasks.workunit.client.0.smithi138.stdout:3/366: creat d5/d12/f79 x:0 0 0 2024-02-15T22:50:53.372 INFO:tasks.workunit.client.0.smithi138.stdout:3/367: write d5/d18/f24 [1566059,90225] 0 2024-02-15T22:50:53.372 INFO:tasks.workunit.client.0.smithi138.stdout:3/368: write d5/d16/f77 [239638,37702] 0 2024-02-15T22:50:53.373 INFO:tasks.workunit.client.0.smithi138.stdout:5/239: dwrite df/d18/f29 [0,4194304] 0 2024-02-15T22:50:53.373 INFO:tasks.workunit.client.0.smithi138.stdout:1/241: creat df/d1b/d1d/d25/d2c/d3f/f56 x:0 0 0 2024-02-15T22:50:53.382 INFO:tasks.workunit.client.0.smithi138.stdout:3/369: write d5/d12/d23/f51 [1187282,104586] 0 2024-02-15T22:50:53.382 INFO:tasks.workunit.client.0.smithi138.stdout:3/370: write d5/d16/dc/f66 [500957,104434] 0 2024-02-15T22:50:53.382 INFO:tasks.workunit.client.0.smithi138.stdout:2/299: dread d0/da/d19/f54 [0,4194304] 0 2024-02-15T22:50:53.382 INFO:tasks.workunit.client.0.smithi138.stdout:2/300: truncate d0/da/d19/f2d 5029450 0 2024-02-15T22:50:53.383 INFO:tasks.workunit.client.0.smithi138.stdout:5/240: symlink df/d18/l45 0 2024-02-15T22:50:53.385 INFO:tasks.workunit.client.0.smithi138.stdout:3/371: rename d5/d12/d23/d29/d5a/l6a to d5/d16/d4d/l7a 0 2024-02-15T22:50:53.387 INFO:tasks.workunit.client.0.smithi138.stdout:2/301: creat d0/d3/f70 x:0 0 0 2024-02-15T22:50:53.388 INFO:tasks.workunit.client.0.smithi138.stdout:5/241: stat df/l39 0 2024-02-15T22:50:53.391 INFO:tasks.workunit.client.0.smithi138.stdout:2/302: write d0/da/f27 [589855,33543] 0 2024-02-15T22:50:53.391 INFO:tasks.workunit.client.0.smithi138.stdout:1/242: dwrite fe [0,4194304] 0 2024-02-15T22:50:53.393 INFO:tasks.workunit.client.0.smithi138.stdout:2/303: creat d0/dd/d15/f71 x:0 0 0 2024-02-15T22:50:53.395 INFO:tasks.workunit.client.0.smithi138.stdout:2/304: dread d0/f51 [0,4194304] 0 2024-02-15T22:50:53.396 INFO:tasks.workunit.client.0.smithi138.stdout:1/243: truncate f4 7854030 0 2024-02-15T22:50:53.399 INFO:tasks.workunit.client.0.smithi138.stdout:2/305: mkdir d0/dd/d15/d72 0 2024-02-15T22:50:53.400 INFO:tasks.workunit.client.0.smithi138.stdout:2/306: readlink d0/dd/d15/l1c 0 2024-02-15T22:50:53.400 INFO:tasks.workunit.client.0.smithi138.stdout:1/244: symlink df/d1b/d1d/d25/l57 0 2024-02-15T22:50:53.403 INFO:tasks.workunit.client.0.smithi138.stdout:2/307: unlink d0/da/f23 0 2024-02-15T22:50:53.403 INFO:tasks.workunit.client.0.smithi138.stdout:3/372: dwrite d5/d16/dc/d43/d47/d67/f71 [0,4194304] 0 2024-02-15T22:50:53.403 INFO:tasks.workunit.client.0.smithi138.stdout:3/373: read - d5/d16/dc/f76 zero size 2024-02-15T22:50:53.403 INFO:tasks.workunit.client.0.smithi138.stdout:3/374: stat d5/l19 0 2024-02-15T22:50:53.404 INFO:tasks.workunit.client.0.smithi138.stdout:3/375: creat d5/d12/d26/d2f/f7b x:0 0 0 2024-02-15T22:50:53.404 INFO:tasks.workunit.client.0.smithi138.stdout:3/376: fdatasync d5/d16/dc/d43/d47/d67/f71 0 2024-02-15T22:50:53.405 INFO:tasks.workunit.client.0.smithi138.stdout:1/245: link df/d1b/d1d/d24/f4d df/d1b/d1d/d25/d2e/f58 0 2024-02-15T22:50:53.413 INFO:tasks.workunit.client.0.smithi138.stdout:2/308: dread d0/dd/f18 [4194304,4194304] 0 2024-02-15T22:50:53.417 INFO:tasks.workunit.client.0.smithi138.stdout:1/246: rmdir df/d1b/d1d/d25 39 2024-02-15T22:50:53.417 INFO:tasks.workunit.client.0.smithi138.stdout:1/247: read - df/d1b/d1d/d25/d2c/d3f/f56 zero size 2024-02-15T22:50:53.417 INFO:tasks.workunit.client.0.smithi138.stdout:1/248: write df/d1b/d1d/d25/d2e/d37/f4b [234410,10947] 0 2024-02-15T22:50:53.418 INFO:tasks.workunit.client.0.smithi138.stdout:1/249: dread df/d1b/f27 [0,4194304] 0 2024-02-15T22:50:53.418 INFO:tasks.workunit.client.0.smithi138.stdout:2/309: mkdir d0/da/d19/d73 0 2024-02-15T22:50:53.419 INFO:tasks.workunit.client.0.smithi138.stdout:1/250: mknod df/d1b/d1d/d25/d2e/d37/c59 0 2024-02-15T22:50:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:1/251: mknod df/d1b/d1d/c5a 0 2024-02-15T22:50:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:1/252: chown df/d1b/d1d/f28 887165 1 2024-02-15T22:50:53.420 INFO:tasks.workunit.client.0.smithi138.stdout:1/253: write f8 [1251290,12863] 0 2024-02-15T22:50:53.422 INFO:tasks.workunit.client.0.smithi138.stdout:2/310: getdents d0/dd/d15 0 2024-02-15T22:50:53.422 INFO:tasks.workunit.client.0.smithi138.stdout:6/306: sync 2024-02-15T22:50:53.422 INFO:tasks.workunit.client.0.smithi138.stdout:7/523: sync 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:6/307: stat dc/d24/d34/f5c 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:6/308: fsync dc/f3e 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/337: sync 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/338: write d0/df/d11/f32 [3914481,61941] 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/339: creat d0/de/d33/f7a x:0 0 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/340: fsync d0/de/d14/f2a 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/341: readlink d0/df/d11/d23/l4d 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/342: readlink d0/de/l38 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/343: readlink d0/de/d48/l4a 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:9/344: truncate d0/f4f 898963 0 2024-02-15T22:50:53.423 INFO:tasks.workunit.client.0.smithi138.stdout:3/377: dwrite d5/d16/dc/f6f [0,4194304] 0 2024-02-15T22:50:53.424 INFO:tasks.workunit.client.0.smithi138.stdout:7/524: write d1/d5a/f7e [174678,58644] 0 2024-02-15T22:50:53.424 INFO:tasks.workunit.client.0.smithi138.stdout:1/254: mkdir df/d1b/d1d/d25/d2e/d5b 0 2024-02-15T22:50:53.424 INFO:tasks.workunit.client.0.smithi138.stdout:1/255: readlink df/d1b/d1d/d24/d3a/l50 0 2024-02-15T22:50:53.425 INFO:tasks.workunit.client.0.smithi138.stdout:6/309: symlink dc/d24/l67 0 2024-02-15T22:50:53.425 INFO:tasks.workunit.client.0.smithi138.stdout:6/310: chown dc/d24/c53 2 1 2024-02-15T22:50:53.429 INFO:tasks.workunit.client.0.smithi138.stdout:3/378: rmdir d5/d12/d23/d29/d4f 39 2024-02-15T22:50:53.430 INFO:tasks.workunit.client.0.smithi138.stdout:3/379: dread - d5/d12/d23/d29/d4f/f70 zero size 2024-02-15T22:50:53.430 INFO:tasks.workunit.client.0.smithi138.stdout:7/525: getdents d1/d2/db/d25/d41 0 2024-02-15T22:50:53.430 INFO:tasks.workunit.client.0.smithi138.stdout:7/526: readlink d1/d79/d84/d64/l8a 0 2024-02-15T22:50:53.431 INFO:tasks.workunit.client.0.smithi138.stdout:1/256: mknod df/d1b/d1d/d25/c5c 0 2024-02-15T22:50:53.432 INFO:tasks.workunit.client.0.smithi138.stdout:6/311: mkdir dc/d24/d34/d3b/d68 0 2024-02-15T22:50:53.436 INFO:tasks.workunit.client.0.smithi138.stdout:9/345: rmdir d0/de/d34 39 2024-02-15T22:50:53.440 INFO:tasks.workunit.client.0.smithi138.stdout:1/257: write df/d1b/d1d/d25/d2e/d37/f3e [2454279,128259] 0 2024-02-15T22:50:53.441 INFO:tasks.workunit.client.0.smithi138.stdout:3/380: mknod d5/d16/c7c 0 2024-02-15T22:50:53.442 INFO:tasks.workunit.client.0.smithi138.stdout:7/527: getdents d1/d5a/d97 0 2024-02-15T22:50:53.444 INFO:tasks.workunit.client.0.smithi138.stdout:2/311: dwrite d0/da/d19/d53/f68 [0,4194304] 0 2024-02-15T22:50:53.444 INFO:tasks.workunit.client.0.smithi138.stdout:2/312: write d0/da/f27 [1101282,30604] 0 2024-02-15T22:50:53.444 INFO:tasks.workunit.client.0.smithi138.stdout:2/313: readlink d0/dd/d15/l59 0 2024-02-15T22:50:53.445 INFO:tasks.workunit.client.0.smithi138.stdout:6/312: unlink dc/d24/d34/d3b/f42 0 2024-02-15T22:50:53.446 INFO:tasks.workunit.client.0.smithi138.stdout:9/346: mkdir d0/df/d11/d23/d71/d7b 0 2024-02-15T22:50:53.449 INFO:tasks.workunit.client.0.smithi138.stdout:3/381: creat d5/d12/d23/d29/d4a/f7d x:0 0 0 2024-02-15T22:50:53.450 INFO:tasks.workunit.client.0.smithi138.stdout:7/528: rmdir d1/d79/d84/da0 39 2024-02-15T22:50:53.455 INFO:tasks.workunit.client.0.smithi138.stdout:9/347: dread d0/de/d14/f1b [0,4194304] 0 2024-02-15T22:50:53.455 INFO:tasks.workunit.client.0.smithi138.stdout:1/258: dwrite df/d1b/d33/f55 [0,4194304] 0 2024-02-15T22:50:53.455 INFO:tasks.workunit.client.0.smithi138.stdout:1/259: write df/d1b/d1d/d25/d2c/f2f [1361616,110319] 0 2024-02-15T22:50:53.455 INFO:tasks.workunit.client.0.smithi138.stdout:1/260: chown df/d1b/d1d/d25/d2e/d37/l46 29729898 1 2024-02-15T22:50:53.456 INFO:tasks.workunit.client.0.smithi138.stdout:6/313: unlink dc/d24/f36 0 2024-02-15T22:50:53.456 INFO:tasks.workunit.client.0.smithi138.stdout:6/314: fsync dc/d24/d34/d3b/f5d 0 2024-02-15T22:50:53.458 INFO:tasks.workunit.client.0.smithi138.stdout:7/529: link d1/d5a/f7e d1/d2/d29/fb8 0 2024-02-15T22:50:53.462 INFO:tasks.workunit.client.0.smithi138.stdout:9/348: truncate d0/de/d14/f66 2478956 0 2024-02-15T22:50:53.464 INFO:tasks.workunit.client.0.smithi138.stdout:1/261: symlink df/l5d 0 2024-02-15T22:50:53.464 INFO:tasks.workunit.client.0.smithi138.stdout:1/262: fsync df/f11 0 2024-02-15T22:50:53.464 INFO:tasks.workunit.client.0.smithi138.stdout:6/315: mknod dc/d24/c69 0 2024-02-15T22:50:53.466 INFO:tasks.workunit.client.0.smithi138.stdout:2/314: rename d0/d52 to d0/da/d19/d53/d5d/d74 0 2024-02-15T22:50:53.466 INFO:tasks.workunit.client.0.smithi138.stdout:2/315: readlink d0/d3/l42 0 2024-02-15T22:50:53.467 INFO:tasks.workunit.client.0.smithi138.stdout:9/349: symlink d0/de/d33/d57/l7c 0 2024-02-15T22:50:53.467 INFO:tasks.workunit.client.0.smithi138.stdout:9/350: truncate d0/d55/d59/f5f 969267 0 2024-02-15T22:50:53.467 INFO:tasks.workunit.client.0.smithi138.stdout:9/351: creat d0/de/d33/f7d x:0 0 0 2024-02-15T22:50:53.468 INFO:tasks.workunit.client.0.smithi138.stdout:1/263: mknod df/d41/c5e 0 2024-02-15T22:50:53.468 INFO:tasks.workunit.client.0.smithi138.stdout:1/264: readlink df/d1b/d1d/d25/l57 0 2024-02-15T22:50:53.468 INFO:tasks.workunit.client.0.smithi138.stdout:1/265: chown df/d1b/c22 0 1 2024-02-15T22:50:53.469 INFO:tasks.workunit.client.0.smithi138.stdout:6/316: truncate dc/f46 123231 0 2024-02-15T22:50:53.470 INFO:tasks.workunit.client.0.smithi138.stdout:2/316: symlink d0/dd/d15/d65/l75 0 2024-02-15T22:50:53.470 INFO:tasks.workunit.client.0.smithi138.stdout:2/317: fdatasync d0/da/d19/f54 0 2024-02-15T22:50:53.471 INFO:tasks.workunit.client.0.smithi138.stdout:3/382: dwrite d5/d16/dc/d43/d47/f75 [0,4194304] 0 2024-02-15T22:50:53.475 INFO:tasks.workunit.client.0.smithi138.stdout:9/352: creat d0/de/d14/d63/f7e x:0 0 0 2024-02-15T22:50:53.477 INFO:tasks.workunit.client.0.smithi138.stdout:6/317: rename dc/d24/f31 to dc/d24/d34/f6a 0 2024-02-15T22:50:53.481 INFO:tasks.workunit.client.0.smithi138.stdout:2/318: rename d0/f6 to d0/dd/d15/d65/f76 0 2024-02-15T22:50:53.483 INFO:tasks.workunit.client.0.smithi138.stdout:6/318: symlink dc/d24/l6b 0 2024-02-15T22:50:53.485 INFO:tasks.workunit.client.0.smithi138.stdout:2/319: mknod d0/da/d19/d53/d5d/d6d/c77 0 2024-02-15T22:50:53.486 INFO:tasks.workunit.client.0.smithi138.stdout:6/319: mkdir dc/d24/d6c 0 2024-02-15T22:50:53.486 INFO:tasks.workunit.client.0.smithi138.stdout:6/320: fsync dc/d24/d34/f49 0 2024-02-15T22:50:53.486 INFO:tasks.workunit.client.0.smithi138.stdout:6/321: stat dc/d24/c5a 0 2024-02-15T22:50:53.487 INFO:tasks.workunit.client.0.smithi138.stdout:9/353: dread d0/de/d14/f68 [0,4194304] 0 2024-02-15T22:50:53.488 INFO:tasks.workunit.client.0.smithi138.stdout:9/354: write d0/d55/f5e [8041733,33284] 0 2024-02-15T22:50:53.488 INFO:tasks.workunit.client.0.smithi138.stdout:2/320: unlink d0/dd/d15/f49 0 2024-02-15T22:50:53.488 INFO:tasks.workunit.client.0.smithi138.stdout:2/321: readlink d0/da/l24 0 2024-02-15T22:50:53.490 INFO:tasks.workunit.client.0.smithi138.stdout:7/530: dwrite d1/d79/d84/d8c/f8f [0,4194304] 0 2024-02-15T22:50:53.490 INFO:tasks.workunit.client.0.smithi138.stdout:6/322: link dc/d24/d34/c57 dc/d24/d34/c6d 0 2024-02-15T22:50:53.491 INFO:tasks.workunit.client.0.smithi138.stdout:6/323: getdents dc/d24/d34/d3b/d66 0 2024-02-15T22:50:53.491 INFO:tasks.workunit.client.0.smithi138.stdout:6/324: rename dc/d24/d6c to dc/d24/d6c/d6e 22 2024-02-15T22:50:53.492 INFO:tasks.workunit.client.0.smithi138.stdout:1/266: dwrite f8 [0,4194304] 0 2024-02-15T22:50:53.495 INFO:tasks.workunit.client.0.smithi138.stdout:7/531: mkdir d1/d2/db/db9 0 2024-02-15T22:50:53.496 INFO:tasks.workunit.client.0.smithi138.stdout:3/383: dwrite d5/d16/dc/f66 [0,4194304] 0 2024-02-15T22:50:53.497 INFO:tasks.workunit.client.0.smithi138.stdout:6/325: symlink dc/d24/l6f 0 2024-02-15T22:50:53.500 INFO:tasks.workunit.client.0.smithi138.stdout:1/267: symlink df/d1b/d1d/d25/d2c/d3f/l5f 0 2024-02-15T22:50:53.500 INFO:tasks.workunit.client.0.smithi138.stdout:1/268: stat df/d1b/d1d/c5a 0 2024-02-15T22:50:53.503 INFO:tasks.workunit.client.0.smithi138.stdout:7/532: creat d1/d2/db/d3c/d4d/d63/fba x:0 0 0 2024-02-15T22:50:53.503 INFO:tasks.workunit.client.0.smithi138.stdout:7/533: readlink d1/d2/d29/l66 0 2024-02-15T22:50:53.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/322: dwrite d0/dd/d15/d65/f76 [0,4194304] 0 2024-02-15T22:50:53.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/323: readlink d0/da/d19/l56 0 2024-02-15T22:50:53.506 INFO:tasks.workunit.client.0.smithi138.stdout:3/384: dread d5/d16/f10 [4194304,4194304] 0 2024-02-15T22:50:53.509 INFO:tasks.workunit.client.0.smithi138.stdout:6/326: creat dc/d4b/f70 x:0 0 0 2024-02-15T22:50:53.510 INFO:tasks.workunit.client.0.smithi138.stdout:6/327: dread - dc/d24/f39 zero size 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:2/324: dread d0/f1 [0,4194304] 0 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:2/325: fsync d0/dd/d15/f71 0 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:2/326: chown d0/da/d19/f55 6 1 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:7/534: unlink d1/d2/cb5 0 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:7/535: stat d1/d2/db/d3c/d4d/d5b/lb1 0 2024-02-15T22:50:53.514 INFO:tasks.workunit.client.0.smithi138.stdout:7/536: readlink d1/l85 0 2024-02-15T22:50:53.516 INFO:tasks.workunit.client.0.smithi138.stdout:6/328: symlink dc/d24/d34/l71 0 2024-02-15T22:50:53.521 INFO:tasks.workunit.client.0.smithi138.stdout:1/269: rmdir df 39 2024-02-15T22:50:53.521 INFO:tasks.workunit.client.0.smithi138.stdout:1/270: chown fa 0 1 2024-02-15T22:50:53.522 INFO:tasks.workunit.client.0.smithi138.stdout:4/536: sync 2024-02-15T22:50:53.523 INFO:tasks.workunit.client.0.smithi138.stdout:0/303: sync 2024-02-15T22:50:53.523 INFO:tasks.workunit.client.0.smithi138.stdout:2/327: rmdir d0/da/d19/d53 39 2024-02-15T22:50:53.523 INFO:tasks.workunit.client.0.smithi138.stdout:2/328: write d0/dd/f4e [1198378,98364] 0 2024-02-15T22:50:53.526 INFO:tasks.workunit.client.0.smithi138.stdout:4/537: creat d17/d1a/daa/fb6 x:0 0 0 2024-02-15T22:50:53.528 INFO:tasks.workunit.client.0.smithi138.stdout:2/329: link d0/d3/c34 d0/dd/c78 0 2024-02-15T22:50:53.537 INFO:tasks.workunit.client.0.smithi138.stdout:4/538: dread d17/d2b/fa4 [0,4194304] 0 2024-02-15T22:50:53.539 INFO:tasks.workunit.client.0.smithi138.stdout:4/539: link d17/d1e/f8b d17/d1a/fb7 0 2024-02-15T22:50:53.539 INFO:tasks.workunit.client.0.smithi138.stdout:4/540: fsync d17/f6a 0 2024-02-15T22:50:53.540 INFO:tasks.workunit.client.0.smithi138.stdout:4/541: mkdir d17/d1e/db8 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/542: read d17/d1e/f4d [400244,2337] 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/543: write d17/d1e/f1f [4460756,12522] 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/544: readlink l1 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/545: stat d17/d1e/d2d/d52/ca9 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/546: creat d17/d1a/daa/fb9 x:0 0 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/547: readlink d17/d1e/d56/l82 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/548: creat d17/d2b/fba x:0 0 0 2024-02-15T22:50:53.541 INFO:tasks.workunit.client.0.smithi138.stdout:2/330: dread d0/d3/f44 [0,4194304] 0 2024-02-15T22:50:53.543 INFO:tasks.workunit.client.0.smithi138.stdout:4/549: mknod d17/d1e/d2d/d8c/cbb 0 2024-02-15T22:50:53.543 INFO:tasks.workunit.client.0.smithi138.stdout:4/550: write d17/d1e/d2d/d52/f5d [4639256,32480] 0 2024-02-15T22:50:53.543 INFO:tasks.workunit.client.0.smithi138.stdout:1/271: dwrite df/d1b/d1d/d25/d2e/f58 [0,4194304] 0 2024-02-15T22:50:53.543 INFO:tasks.workunit.client.0.smithi138.stdout:6/329: dwrite f0 [0,4194304] 0 2024-02-15T22:50:53.543 INFO:tasks.workunit.client.0.smithi138.stdout:6/330: chown dc/d24/d34/d3b/f64 3031 1 2024-02-15T22:50:53.544 INFO:tasks.workunit.client.0.smithi138.stdout:1/272: mkdir df/d1b/d1d/d60 0 2024-02-15T22:50:53.548 INFO:tasks.workunit.client.0.smithi138.stdout:6/331: rmdir dc/d24/d34/d3b 39 2024-02-15T22:50:53.549 INFO:tasks.workunit.client.0.smithi138.stdout:6/332: symlink dc/d24/d34/d3b/d66/l72 0 2024-02-15T22:50:53.550 INFO:tasks.workunit.client.0.smithi138.stdout:4/551: getdents d17/d1a/daa 0 2024-02-15T22:50:53.551 INFO:tasks.workunit.client.0.smithi138.stdout:4/552: readlink d17/d1e/d56/l82 0 2024-02-15T22:50:53.552 INFO:tasks.workunit.client.0.smithi138.stdout:1/273: dread df/d1b/d1d/d25/d2e/f58 [0,4194304] 0 2024-02-15T22:50:53.553 INFO:tasks.workunit.client.0.smithi138.stdout:6/333: dread dc/d24/d34/f6a [0,4194304] 0 2024-02-15T22:50:53.554 INFO:tasks.workunit.client.0.smithi138.stdout:1/274: creat df/d1b/d1d/d25/f61 x:0 0 0 2024-02-15T22:50:53.554 INFO:tasks.workunit.client.0.smithi138.stdout:1/275: truncate df/d1b/d1d/d25/d2c/f2f 2447994 0 2024-02-15T22:50:53.554 INFO:tasks.workunit.client.0.smithi138.stdout:1/276: mknod df/d1b/d1d/d25/c62 0 2024-02-15T22:50:53.557 INFO:tasks.workunit.client.0.smithi138.stdout:1/277: dread df/d1b/d1d/d24/d3a/f40 [0,4194304] 0 2024-02-15T22:50:53.557 INFO:tasks.workunit.client.0.smithi138.stdout:1/278: dread - df/d1b/d1d/d25/d2e/d37/f54 zero size 2024-02-15T22:50:53.558 INFO:tasks.workunit.client.0.smithi138.stdout:1/279: mknod df/c63 0 2024-02-15T22:50:53.558 INFO:tasks.workunit.client.0.smithi138.stdout:1/280: write df/d1b/d21/f32 [208523,75487] 0 2024-02-15T22:50:53.558 INFO:tasks.workunit.client.0.smithi138.stdout:4/553: dread d17/d1e/d2d/f7c [0,4194304] 0 2024-02-15T22:50:53.558 INFO:tasks.workunit.client.0.smithi138.stdout:1/281: rmdir df/d1b/d1d 39 2024-02-15T22:50:53.559 INFO:tasks.workunit.client.0.smithi138.stdout:4/554: symlink d17/d1e/db8/lbc 0 2024-02-15T22:50:53.561 INFO:tasks.workunit.client.0.smithi138.stdout:4/555: link d17/l35 d17/d1a/lbd 0 2024-02-15T22:50:53.562 INFO:tasks.workunit.client.0.smithi138.stdout:4/556: rmdir d17/db1 0 2024-02-15T22:50:53.563 INFO:tasks.workunit.client.0.smithi138.stdout:4/557: creat d17/d1e/d2d/fbe x:0 0 0 2024-02-15T22:50:53.563 INFO:tasks.workunit.client.0.smithi138.stdout:4/558: truncate f10 8057593 0 2024-02-15T22:50:53.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/559: write d17/d1a/f9b [467266,66175] 0 2024-02-15T22:50:53.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/560: mkdir d17/d1e/d2d/d84/da3/dbf 0 2024-02-15T22:50:53.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/561: readlink d17/d1a/l5b 0 2024-02-15T22:50:53.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/562: stat d17/d1e/d2d/l7d 0 2024-02-15T22:50:53.579 INFO:tasks.workunit.client.0.smithi138.stdout:4/563: dwrite d17/d1e/f4d [0,4194304] 0 2024-02-15T22:50:53.580 INFO:tasks.workunit.client.0.smithi138.stdout:4/564: fdatasync d17/f44 0 2024-02-15T22:50:53.596 INFO:tasks.workunit.client.0.smithi138.stdout:4/565: dwrite d17/d1e/d2d/f31 [0,4194304] 0 2024-02-15T22:50:53.598 INFO:tasks.workunit.client.0.smithi138.stdout:4/566: mkdir d17/d2b/d78/dc0 0 2024-02-15T22:50:53.613 INFO:tasks.workunit.client.0.smithi138.stdout:4/567: dwrite f8 [0,4194304] 0 2024-02-15T22:50:53.614 INFO:tasks.workunit.client.0.smithi138.stdout:4/568: unlink d17/c99 0 2024-02-15T22:50:53.630 INFO:tasks.workunit.client.0.smithi138.stdout:4/569: dwrite d17/d1e/d2d/d36/d3e/fb4 [0,4194304] 0 2024-02-15T22:50:53.630 INFO:tasks.workunit.client.0.smithi138.stdout:4/570: write d17/f90 [40372,63252] 0 2024-02-15T22:50:53.630 INFO:tasks.workunit.client.0.smithi138.stdout:4/571: readlink d17/d1a/l60 0 2024-02-15T22:50:53.646 INFO:tasks.workunit.client.0.smithi138.stdout:4/572: dwrite d17/d1a/f9b [0,4194304] 0 2024-02-15T22:50:53.648 INFO:tasks.workunit.client.0.smithi138.stdout:4/573: rmdir d17/d1e/db8 39 2024-02-15T22:50:53.648 INFO:tasks.workunit.client.0.smithi138.stdout:4/574: creat d17/fc1 x:0 0 0 2024-02-15T22:50:53.660 INFO:tasks.workunit.client.0.smithi138.stdout:4/575: link d17/d1e/d2d/f30 d17/d1e/d2d/fc2 0 2024-02-15T22:50:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:8/269: sync 2024-02-15T22:50:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:5/242: sync 2024-02-15T22:50:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:9/355: sync 2024-02-15T22:50:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:9/356: truncate d0/de/d33/f76 680735 0 2024-02-15T22:50:53.802 INFO:tasks.workunit.client.0.smithi138.stdout:9/357: fsync d0/de/d14/d63/f7e 0 2024-02-15T22:50:53.803 INFO:tasks.workunit.client.0.smithi138.stdout:5/243: mknod df/c46 0 2024-02-15T22:50:53.804 INFO:tasks.workunit.client.0.smithi138.stdout:9/358: rename d0/de/d14/f68 to d0/de/d33/f7f 0 2024-02-15T22:50:53.815 INFO:tasks.workunit.client.0.smithi138.stdout:8/270: dread db/dd/d22/f2f [0,4194304] 0 2024-02-15T22:50:53.815 INFO:tasks.workunit.client.0.smithi138.stdout:8/271: read db/dd/d22/f30 [93674,9724] 0 2024-02-15T22:50:53.819 INFO:tasks.workunit.client.0.smithi138.stdout:9/359: dwrite d0/d2e/f6e [0,4194304] 0 2024-02-15T22:50:53.824 INFO:tasks.workunit.client.0.smithi138.stdout:5/244: dwrite df/f44 [0,4194304] 0 2024-02-15T22:50:53.828 INFO:tasks.workunit.client.0.smithi138.stdout:5/245: rmdir df 39 2024-02-15T22:50:53.830 INFO:tasks.workunit.client.0.smithi138.stdout:5/246: unlink df/d18/f28 0 2024-02-15T22:50:53.831 INFO:tasks.workunit.client.0.smithi138.stdout:5/247: creat df/d18/d2b/f47 x:0 0 0 2024-02-15T22:50:53.832 INFO:tasks.workunit.client.0.smithi138.stdout:5/248: creat df/d18/d3e/f48 x:0 0 0 2024-02-15T22:50:53.832 INFO:tasks.workunit.client.0.smithi138.stdout:5/249: creat df/d18/d2b/f49 x:0 0 0 2024-02-15T22:50:53.832 INFO:tasks.workunit.client.0.smithi138.stdout:8/272: dwrite db/dd/d22/f2f [0,4194304] 0 2024-02-15T22:50:53.834 INFO:tasks.workunit.client.0.smithi138.stdout:8/273: getdents db 0 2024-02-15T22:50:53.835 INFO:tasks.workunit.client.0.smithi138.stdout:8/274: mknod db/dd/c5c 0 2024-02-15T22:50:53.840 INFO:tasks.workunit.client.0.smithi138.stdout:5/250: write df/f44 [2720228,83698] 0 2024-02-15T22:50:53.842 INFO:tasks.workunit.client.0.smithi138.stdout:5/251: creat df/d18/f4a x:0 0 0 2024-02-15T22:50:53.844 INFO:tasks.workunit.client.0.smithi138.stdout:5/252: unlink df/l10 0 2024-02-15T22:50:53.844 INFO:tasks.workunit.client.0.smithi138.stdout:5/253: write df/f37 [1655812,106470] 0 2024-02-15T22:50:53.844 INFO:tasks.workunit.client.0.smithi138.stdout:5/254: dread - df/f15 zero size 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/255: dread df/f11 [0,4194304] 0 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/256: fdatasync df/d18/f20 0 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/257: stat df/d18/d3e/f48 0 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/258: creat df/d18/d2b/f4b x:0 0 0 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/259: creat df/d18/f4c x:0 0 0 2024-02-15T22:50:53.848 INFO:tasks.workunit.client.0.smithi138.stdout:8/275: dwrite db/dd/d13/d19/d52/f5b [0,4194304] 0 2024-02-15T22:50:53.855 INFO:tasks.workunit.client.0.smithi138.stdout:5/260: read fc [3721109,63811] 0 2024-02-15T22:50:53.856 INFO:tasks.workunit.client.0.smithi138.stdout:8/276: dread db/dd/d13/d19/d52/f46 [0,4194304] 0 2024-02-15T22:50:53.856 INFO:tasks.workunit.client.0.smithi138.stdout:8/277: write db/dd/d13/f1c [756672,26210] 0 2024-02-15T22:50:53.856 INFO:tasks.workunit.client.0.smithi138.stdout:8/278: write db/f29 [1198604,9956] 0 2024-02-15T22:50:53.857 INFO:tasks.workunit.client.0.smithi138.stdout:5/261: creat df/d18/d2b/f4d x:0 0 0 2024-02-15T22:50:53.857 INFO:tasks.workunit.client.0.smithi138.stdout:5/262: creat df/d18/d3e/f4e x:0 0 0 2024-02-15T22:50:53.858 INFO:tasks.workunit.client.0.smithi138.stdout:8/279: rename db/dd/d13/l4b to db/dd/l5d 0 2024-02-15T22:50:53.862 INFO:tasks.workunit.client.0.smithi138.stdout:5/263: symlink df/d18/d2b/l4f 0 2024-02-15T22:50:53.864 INFO:tasks.workunit.client.0.smithi138.stdout:5/264: fdatasync df/f13 0 2024-02-15T22:50:53.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/265: chown df/l1d 973021108 1 2024-02-15T22:50:53.874 INFO:tasks.workunit.client.0.smithi138.stdout:8/280: dwrite db/dd/d13/d19/d24/f4a [0,4194304] 0 2024-02-15T22:50:53.878 INFO:tasks.workunit.client.0.smithi138.stdout:5/266: dread df/f17 [0,4194304] 0 2024-02-15T22:50:53.878 INFO:tasks.workunit.client.0.smithi138.stdout:5/267: mknod df/d18/d3e/c50 0 2024-02-15T22:50:53.897 INFO:tasks.workunit.client.0.smithi138.stdout:8/281: dwrite db/f28 [4194304,4194304] 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/282: mknod db/c5e 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/283: truncate db/dd/f11 2606913 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/284: truncate db/dd/f4e 100064 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/285: creat db/d15/f5f x:0 0 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/286: creat db/dd/d13/d19/d24/f60 x:0 0 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/287: rename db/dd/d13/d19/d52/f50 to db/dd/d13/d19/d52/f61 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/288: dread - db/f58 zero size 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/289: creat db/d15/f62 x:0 0 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/290: dwrite db/d15/f36 [0,4194304] 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/291: symlink db/dd/d13/d19/l63 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/292: creat db/dd/d13/f64 x:0 0 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/293: dwrite db/dd/f4e [0,4194304] 0 2024-02-15T22:50:53.999 INFO:tasks.workunit.client.0.smithi138.stdout:8/294: dread db/d15/f17 [0,4194304] 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/295: truncate db/f28 1810891 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/296: dwrite f3 [0,4194304] 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/297: chown db/dd/d13/l18 22280588 1 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/298: truncate db/f28 250352 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/299: getdents db/d15 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/300: symlink db/d15/l65 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/301: write db/dd/d22/f56 [254334,12854] 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/302: stat db/f28 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/303: link db/dd/d22/c25 db/dd/d13/c66 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/304: creat db/dd/f67 x:0 0 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/305: rename db/dd/d13/c66 to db/dd/c68 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/306: mknod db/dd/c69 0 2024-02-15T22:50:54.000 INFO:tasks.workunit.client.0.smithi138.stdout:8/307: chown db 0 1 2024-02-15T22:50:54.001 INFO:tasks.workunit.client.0.smithi138.stdout:8/308: mknod db/dd/d13/d19/d52/c6a 0 2024-02-15T22:50:54.001 INFO:tasks.workunit.client.0.smithi138.stdout:3/385: sync 2024-02-15T22:50:54.001 INFO:tasks.workunit.client.0.smithi138.stdout:3/386: symlink d5/d12/d23/l7e 0 2024-02-15T22:50:54.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/304: sync 2024-02-15T22:50:54.080 INFO:tasks.workunit.client.0.smithi138.stdout:7/537: sync 2024-02-15T22:50:54.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/305: creat d6/d10/f68 x:0 0 0 2024-02-15T22:50:54.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/306: chown d6/d10/d34/l5d 29711 1 2024-02-15T22:50:54.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/307: write d6/f24 [1959918,72470] 0 2024-02-15T22:50:54.081 INFO:tasks.workunit.client.0.smithi138.stdout:7/538: unlink d1/d2/c53 0 2024-02-15T22:50:54.083 INFO:tasks.workunit.client.0.smithi138.stdout:0/308: creat d6/d10/d13/f69 x:0 0 0 2024-02-15T22:50:54.095 INFO:tasks.workunit.client.0.smithi138.stdout:0/309: dread d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:50:54.096 INFO:tasks.workunit.client.0.smithi138.stdout:0/310: mknod d6/d10/d52/c6a 0 2024-02-15T22:50:54.097 INFO:tasks.workunit.client.0.smithi138.stdout:0/311: link d6/d10/d18/f60 d6/f6b 0 2024-02-15T22:50:54.101 INFO:tasks.workunit.client.0.smithi138.stdout:7/539: dwrite d1/d79/d84/da0/fa5 [0,4194304] 0 2024-02-15T22:50:54.102 INFO:tasks.workunit.client.0.smithi138.stdout:7/540: creat d1/d2/fbb x:0 0 0 2024-02-15T22:50:54.102 INFO:tasks.workunit.client.0.smithi138.stdout:7/541: readlink d1/d2/db/d3c/d4d/la3 0 2024-02-15T22:50:54.102 INFO:tasks.workunit.client.0.smithi138.stdout:7/542: write d1/d2/db/d25/f36 [10246757,102497] 0 2024-02-15T22:50:54.103 INFO:tasks.workunit.client.0.smithi138.stdout:7/543: fdatasync d1/d2/db/d3c/d4d/d5b/f62 0 2024-02-15T22:50:54.114 INFO:tasks.workunit.client.0.smithi138.stdout:0/312: dwrite d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:50:54.114 INFO:tasks.workunit.client.0.smithi138.stdout:0/313: chown d6/d10/d18/d57/f63 44068 1 2024-02-15T22:50:54.114 INFO:tasks.workunit.client.0.smithi138.stdout:0/314: dread - d6/d10/d13/f2b zero size 2024-02-15T22:50:54.116 INFO:tasks.workunit.client.0.smithi138.stdout:0/315: symlink d6/d10/d40/l6c 0 2024-02-15T22:50:54.117 INFO:tasks.workunit.client.0.smithi138.stdout:0/316: rmdir d6/d10/d13/d3d/d61 0 2024-02-15T22:50:54.118 INFO:tasks.workunit.client.0.smithi138.stdout:0/317: creat d6/f6d x:0 0 0 2024-02-15T22:50:54.118 INFO:tasks.workunit.client.0.smithi138.stdout:0/318: chown d6/d10/f11 0 1 2024-02-15T22:50:54.120 INFO:tasks.workunit.client.0.smithi138.stdout:7/544: dwrite d1/d79/d84/d8c/f8f [0,4194304] 0 2024-02-15T22:50:54.120 INFO:tasks.workunit.client.0.smithi138.stdout:7/545: write d1/d2/fbb [399869,9335] 0 2024-02-15T22:50:54.121 INFO:tasks.workunit.client.0.smithi138.stdout:0/319: fsync d6/f6b 0 2024-02-15T22:50:54.122 INFO:tasks.workunit.client.0.smithi138.stdout:7/546: mknod d1/d2/db/d3c/cbc 0 2024-02-15T22:50:54.124 INFO:tasks.workunit.client.0.smithi138.stdout:7/547: rename d1/d2/db/d25/d41/la4 to d1/d28/d7c/lbd 0 2024-02-15T22:50:54.125 INFO:tasks.workunit.client.0.smithi138.stdout:7/548: rename d1/d2/db/d3c/d4d/f65 to d1/d28/d7c/fbe 0 2024-02-15T22:50:54.126 INFO:tasks.workunit.client.0.smithi138.stdout:7/549: creat d1/d28/d7c/fbf x:0 0 0 2024-02-15T22:50:54.130 INFO:tasks.workunit.client.0.smithi138.stdout:0/320: read d6/fb [418797,63234] 0 2024-02-15T22:50:54.130 INFO:tasks.workunit.client.0.smithi138.stdout:0/321: chown d6/d10/f4e 62 1 2024-02-15T22:50:54.131 INFO:tasks.workunit.client.0.smithi138.stdout:0/322: mkdir d6/d10/d18/d6e 0 2024-02-15T22:50:54.131 INFO:tasks.workunit.client.0.smithi138.stdout:0/323: chown d6/d10/d40/c44 2064 1 2024-02-15T22:50:54.132 INFO:tasks.workunit.client.0.smithi138.stdout:0/324: mkdir d6/d10/d52/d6f 0 2024-02-15T22:50:54.139 INFO:tasks.workunit.client.0.smithi138.stdout:0/325: write d6/d10/d13/f1e [822477,121929] 0 2024-02-15T22:50:54.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/326: creat d6/d10/d13/d3d/f70 x:0 0 0 2024-02-15T22:50:54.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/327: fdatasync d6/f39 0 2024-02-15T22:50:54.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/328: fsync d6/d10/d34/f35 0 2024-02-15T22:50:54.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/329: creat d6/d10/d13/d3d/f71 x:0 0 0 2024-02-15T22:50:54.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/330: chown d6/fb 53 1 2024-02-15T22:50:54.142 INFO:tasks.workunit.client.0.smithi138.stdout:0/331: mkdir d6/d10/d52/d72 0 2024-02-15T22:50:54.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/550: dwrite d1/d2/f30 [0,4194304] 0 2024-02-15T22:50:54.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/551: fsync d1/d2/db/d3c/f75 0 2024-02-15T22:50:54.145 INFO:tasks.workunit.client.0.smithi138.stdout:7/552: read d1/d2/db/d3c/f56 [164149,101371] 0 2024-02-15T22:50:54.146 INFO:tasks.workunit.client.0.smithi138.stdout:7/553: truncate d1/d2/db/d3c/d4d/f78 472129 0 2024-02-15T22:50:54.146 INFO:tasks.workunit.client.0.smithi138.stdout:7/554: fsync d1/d2/db/d3c/f56 0 2024-02-15T22:50:54.153 INFO:tasks.workunit.client.0.smithi138.stdout:7/555: read d1/d2/db/d3c/d4d/d5b/f76 [4123813,117768] 0 2024-02-15T22:50:54.153 INFO:tasks.workunit.client.0.smithi138.stdout:7/556: creat d1/d2/db/fc0 x:0 0 0 2024-02-15T22:50:54.153 INFO:tasks.workunit.client.0.smithi138.stdout:7/557: chown d1/c47 10 1 2024-02-15T22:50:54.156 INFO:tasks.workunit.client.0.smithi138.stdout:7/558: unlink d1/d79/d84/d8c/f8f 0 2024-02-15T22:50:54.156 INFO:tasks.workunit.client.0.smithi138.stdout:7/559: dread - d1/d2/db/d25/d41/f46 zero size 2024-02-15T22:50:54.156 INFO:tasks.workunit.client.0.smithi138.stdout:7/560: creat d1/d79/d84/d8c/fc1 x:0 0 0 2024-02-15T22:50:54.158 INFO:tasks.workunit.client.0.smithi138.stdout:0/332: dwrite d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:50:54.159 INFO:tasks.workunit.client.0.smithi138.stdout:0/333: creat d6/d10/f73 x:0 0 0 2024-02-15T22:50:54.159 INFO:tasks.workunit.client.0.smithi138.stdout:7/561: unlink d1/d2/f31 0 2024-02-15T22:50:54.161 INFO:tasks.workunit.client.0.smithi138.stdout:0/334: creat d6/d10/d40/f74 x:0 0 0 2024-02-15T22:50:54.161 INFO:tasks.workunit.client.0.smithi138.stdout:0/335: readlink d6/d10/d34/l5d 0 2024-02-15T22:50:54.161 INFO:tasks.workunit.client.0.smithi138.stdout:7/562: truncate d1/d2/db/d25/f99 537878 0 2024-02-15T22:50:54.161 INFO:tasks.workunit.client.0.smithi138.stdout:7/563: truncate d1/d2/db/d3c/f56 838242 0 2024-02-15T22:50:54.166 INFO:tasks.workunit.client.0.smithi138.stdout:0/336: mkdir d6/d10/d75 0 2024-02-15T22:50:54.166 INFO:tasks.workunit.client.0.smithi138.stdout:0/337: truncate d6/d10/d18/d57/f5e 357589 0 2024-02-15T22:50:54.167 INFO:tasks.workunit.client.0.smithi138.stdout:7/564: unlink d1/d2/db/f20 0 2024-02-15T22:50:54.168 INFO:tasks.workunit.client.0.smithi138.stdout:0/338: symlink d6/d10/d13/d3d/l76 0 2024-02-15T22:50:54.170 INFO:tasks.workunit.client.0.smithi138.stdout:7/565: fsync d1/d2/fbb 0 2024-02-15T22:50:54.170 INFO:tasks.workunit.client.0.smithi138.stdout:7/566: write d1/d2/db/f7b [288975,32378] 0 2024-02-15T22:50:54.170 INFO:tasks.workunit.client.0.smithi138.stdout:7/567: write d1/d2/d29/f2d [654057,129692] 0 2024-02-15T22:50:54.170 INFO:tasks.workunit.client.0.smithi138.stdout:7/568: read - d1/d2/f80 zero size 2024-02-15T22:50:54.170 INFO:tasks.workunit.client.0.smithi138.stdout:0/339: rename d6/d10/d18/d1b/c49 to d6/d10/d34/c77 0 2024-02-15T22:50:54.172 INFO:tasks.workunit.client.0.smithi138.stdout:0/340: symlink d6/d10/d64/l78 0 2024-02-15T22:50:54.172 INFO:tasks.workunit.client.0.smithi138.stdout:0/341: dread - d6/f6d zero size 2024-02-15T22:50:54.173 INFO:tasks.workunit.client.0.smithi138.stdout:0/342: symlink d6/d10/d52/l79 0 2024-02-15T22:50:54.173 INFO:tasks.workunit.client.0.smithi138.stdout:0/343: truncate d6/d10/f14 1457662 0 2024-02-15T22:50:54.179 INFO:tasks.workunit.client.0.smithi138.stdout:2/331: sync 2024-02-15T22:50:54.179 INFO:tasks.workunit.client.0.smithi138.stdout:6/334: sync 2024-02-15T22:50:54.179 INFO:tasks.workunit.client.0.smithi138.stdout:1/282: sync 2024-02-15T22:50:54.179 INFO:tasks.workunit.client.0.smithi138.stdout:6/335: truncate dc/d24/f56 979190 0 2024-02-15T22:50:54.179 INFO:tasks.workunit.client.0.smithi138.stdout:6/336: truncate dc/d4b/f70 711718 0 2024-02-15T22:50:54.180 INFO:tasks.workunit.client.0.smithi138.stdout:1/283: rename df/f19 to df/d1b/d1d/d60/f64 0 2024-02-15T22:50:54.181 INFO:tasks.workunit.client.0.smithi138.stdout:2/332: mkdir d0/da/d19/d53/d5d/d74/d79 0 2024-02-15T22:50:54.182 INFO:tasks.workunit.client.0.smithi138.stdout:6/337: symlink dc/d24/d34/d3b/d66/l73 0 2024-02-15T22:50:54.183 INFO:tasks.workunit.client.0.smithi138.stdout:1/284: mkdir df/d1b/d1d/d25/d2e/d5b/d65 0 2024-02-15T22:50:54.184 INFO:tasks.workunit.client.0.smithi138.stdout:6/338: rename dc/d24/d34/d3b/f45 to dc/d24/d34/d3b/d66/f74 0 2024-02-15T22:50:54.185 INFO:tasks.workunit.client.0.smithi138.stdout:1/285: creat df/d1b/d1d/d60/f66 x:0 0 0 2024-02-15T22:50:54.185 INFO:tasks.workunit.client.0.smithi138.stdout:1/286: chown df/d1b/d1d/d25/d2e/d37/l43 105207 1 2024-02-15T22:50:54.187 INFO:tasks.workunit.client.0.smithi138.stdout:1/287: creat df/d1b/d1d/d25/d2e/d5b/f67 x:0 0 0 2024-02-15T22:50:54.188 INFO:tasks.workunit.client.0.smithi138.stdout:7/569: dwrite d1/d79/d84/d8c/fc1 [0,4194304] 0 2024-02-15T22:50:54.191 INFO:tasks.workunit.client.0.smithi138.stdout:7/570: write d1/d2/db/d3c/d4d/d5b/f62 [484397,129440] 0 2024-02-15T22:50:54.193 INFO:tasks.workunit.client.0.smithi138.stdout:7/571: link d1/d2/db/d3c/f45 d1/d79/d84/da0/fc2 0 2024-02-15T22:50:54.193 INFO:tasks.workunit.client.0.smithi138.stdout:7/572: creat d1/d2/fc3 x:0 0 0 2024-02-15T22:50:54.196 INFO:tasks.workunit.client.0.smithi138.stdout:7/573: mknod d1/d79/d84/da0/cc4 0 2024-02-15T22:50:54.198 INFO:tasks.workunit.client.0.smithi138.stdout:7/574: unlink d1/d2/db/d3c/la8 0 2024-02-15T22:50:54.199 INFO:tasks.workunit.client.0.smithi138.stdout:7/575: mkdir d1/d28/dc5 0 2024-02-15T22:50:54.199 INFO:tasks.workunit.client.0.smithi138.stdout:7/576: fdatasync d1/d2/db/d3c/f56 0 2024-02-15T22:50:54.205 INFO:tasks.workunit.client.0.smithi138.stdout:0/344: dwrite d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:54.205 INFO:tasks.workunit.client.0.smithi138.stdout:0/345: creat d6/f7a x:0 0 0 2024-02-15T22:50:54.206 INFO:tasks.workunit.client.0.smithi138.stdout:0/346: fdatasync d6/f7a 0 2024-02-15T22:50:54.206 INFO:tasks.workunit.client.0.smithi138.stdout:6/339: dwrite dc/d24/d34/d3b/f41 [0,4194304] 0 2024-02-15T22:50:54.206 INFO:tasks.workunit.client.0.smithi138.stdout:6/340: fdatasync dc/d24/d34/d3b/f5d 0 2024-02-15T22:50:54.206 INFO:tasks.workunit.client.0.smithi138.stdout:6/341: chown dc/d24/d34/d3b 4167611 1 2024-02-15T22:50:54.206 INFO:tasks.workunit.client.0.smithi138.stdout:2/333: dwrite d0/dd/f2c [0,4194304] 0 2024-02-15T22:50:54.207 INFO:tasks.workunit.client.0.smithi138.stdout:2/334: dread - d0/dd/f4f zero size 2024-02-15T22:50:54.214 INFO:tasks.workunit.client.0.smithi138.stdout:6/342: creat dc/d24/d34/d3b/d66/f75 x:0 0 0 2024-02-15T22:50:54.216 INFO:tasks.workunit.client.0.smithi138.stdout:7/577: dwrite d1/d2/fbb [0,4194304] 0 2024-02-15T22:50:54.216 INFO:tasks.workunit.client.0.smithi138.stdout:7/578: chown d1/d2/db/d25/d41/c55 103 1 2024-02-15T22:50:54.216 INFO:tasks.workunit.client.0.smithi138.stdout:7/579: fdatasync d1/d2/fbb 0 2024-02-15T22:50:54.216 INFO:tasks.workunit.client.0.smithi138.stdout:2/335: rename d0/d3/c45 to d0/dd/c7a 0 2024-02-15T22:50:54.218 INFO:tasks.workunit.client.0.smithi138.stdout:0/347: mknod d6/d10/d40/c7b 0 2024-02-15T22:50:54.222 INFO:tasks.workunit.client.0.smithi138.stdout:7/580: symlink d1/d79/lc6 0 2024-02-15T22:50:54.224 INFO:tasks.workunit.client.0.smithi138.stdout:2/336: mkdir d0/da/d19/d53/d5d/d6d/d7b 0 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:2/337: write d0/dd/d15/f71 [612944,7542] 0 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:3/387: sync 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:5/268: sync 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:4/576: sync 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:9/360: sync 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:5/269: stat df/d18/f4a 0 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:4/577: write d17/d1e/d2d/d36/f96 [479328,88225] 0 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:8/309: sync 2024-02-15T22:50:54.225 INFO:tasks.workunit.client.0.smithi138.stdout:8/310: chown db/dd/d22/f30 25384648 1 2024-02-15T22:50:54.226 INFO:tasks.workunit.client.0.smithi138.stdout:0/348: dread d6/d10/f11 [0,4194304] 0 2024-02-15T22:50:54.228 INFO:tasks.workunit.client.0.smithi138.stdout:2/338: creat d0/da/d19/d53/d5d/d6d/f7c x:0 0 0 2024-02-15T22:50:54.229 INFO:tasks.workunit.client.0.smithi138.stdout:5/270: mkdir df/d18/d3e/d51 0 2024-02-15T22:50:54.230 INFO:tasks.workunit.client.0.smithi138.stdout:5/271: truncate df/d18/d3e/f4e 486502 0 2024-02-15T22:50:54.230 INFO:tasks.workunit.client.0.smithi138.stdout:4/578: chown d17/d1a/fb7 6482 1 2024-02-15T22:50:54.231 INFO:tasks.workunit.client.0.smithi138.stdout:4/579: dread - d17/d1e/d2d/d36/d3e/d64/f65 zero size 2024-02-15T22:50:54.231 INFO:tasks.workunit.client.0.smithi138.stdout:8/311: mkdir db/dd/d13/d19/d6b 0 2024-02-15T22:50:54.231 INFO:tasks.workunit.client.0.smithi138.stdout:8/312: creat db/dd/f6c x:0 0 0 2024-02-15T22:50:54.232 INFO:tasks.workunit.client.0.smithi138.stdout:7/581: getdents d1/d2/db 0 2024-02-15T22:50:54.233 INFO:tasks.workunit.client.0.smithi138.stdout:3/388: dread d5/d16/dc/f66 [0,4194304] 0 2024-02-15T22:50:54.234 INFO:tasks.workunit.client.0.smithi138.stdout:0/349: truncate d6/d10/d13/f16 2916712 0 2024-02-15T22:50:54.234 INFO:tasks.workunit.client.0.smithi138.stdout:0/350: chown d6/d10/d52/l56 27020434 1 2024-02-15T22:50:54.234 INFO:tasks.workunit.client.0.smithi138.stdout:6/343: dwrite dc/d24/d34/d3b/d66/f75 [0,4194304] 0 2024-02-15T22:50:54.235 INFO:tasks.workunit.client.0.smithi138.stdout:2/339: mknod d0/da/c7d 0 2024-02-15T22:50:54.236 INFO:tasks.workunit.client.0.smithi138.stdout:5/272: mknod df/d18/d2b/c52 0 2024-02-15T22:50:54.236 INFO:tasks.workunit.client.0.smithi138.stdout:5/273: write df/d18/d2b/f4d [812370,101654] 0 2024-02-15T22:50:54.236 INFO:tasks.workunit.client.0.smithi138.stdout:4/580: write d17/f49 [2863168,80549] 0 2024-02-15T22:50:54.238 INFO:tasks.workunit.client.0.smithi138.stdout:7/582: mknod d1/d2/d29/cc7 0 2024-02-15T22:50:54.238 INFO:tasks.workunit.client.0.smithi138.stdout:7/583: creat d1/d28/d7c/fc8 x:0 0 0 2024-02-15T22:50:54.240 INFO:tasks.workunit.client.0.smithi138.stdout:3/389: rename d5/d18/c33 to d5/d12/c7f 0 2024-02-15T22:50:54.243 INFO:tasks.workunit.client.0.smithi138.stdout:0/351: dread d6/d10/d18/f32 [0,4194304] 0 2024-02-15T22:50:54.244 INFO:tasks.workunit.client.0.smithi138.stdout:2/340: creat d0/dd/d15/d65/f7e x:0 0 0 2024-02-15T22:50:54.244 INFO:tasks.workunit.client.0.smithi138.stdout:9/361: dwrite d0/f8 [4194304,4194304] 0 2024-02-15T22:50:54.245 INFO:tasks.workunit.client.0.smithi138.stdout:2/341: dread d0/dd/f5c [0,4194304] 0 2024-02-15T22:50:54.245 INFO:tasks.workunit.client.0.smithi138.stdout:8/313: getdents db/dd/d13/d19 0 2024-02-15T22:50:54.248 INFO:tasks.workunit.client.0.smithi138.stdout:7/584: stat d1/d2/db/d25/c2b 0 2024-02-15T22:50:54.250 INFO:tasks.workunit.client.0.smithi138.stdout:6/344: getdents dc 0 2024-02-15T22:50:54.251 INFO:tasks.workunit.client.0.smithi138.stdout:0/352: mknod d6/d10/d18/d57/c7c 0 2024-02-15T22:50:54.252 INFO:tasks.workunit.client.0.smithi138.stdout:0/353: stat d6/d10/d13 0 2024-02-15T22:50:54.254 INFO:tasks.workunit.client.0.smithi138.stdout:2/342: creat d0/da/d19/d53/f7f x:0 0 0 2024-02-15T22:50:54.254 INFO:tasks.workunit.client.0.smithi138.stdout:2/343: write d0/da/d19/d53/d5d/d74/f5f [1842144,76226] 0 2024-02-15T22:50:54.255 INFO:tasks.workunit.client.0.smithi138.stdout:7/585: link d1/d2/db/d25/d41/cab d1/d2/db/cc9 0 2024-02-15T22:50:54.256 INFO:tasks.workunit.client.0.smithi138.stdout:7/586: chown d1/d5a/d97/l9c 347112265 1 2024-02-15T22:50:54.257 INFO:tasks.workunit.client.0.smithi138.stdout:8/314: write f3 [5841345,45871] 0 2024-02-15T22:50:54.257 INFO:tasks.workunit.client.0.smithi138.stdout:6/345: getdents dc/d24/d34/d3b 0 2024-02-15T22:50:54.257 INFO:tasks.workunit.client.0.smithi138.stdout:8/315: write db/f58 [56417,31194] 0 2024-02-15T22:50:54.258 INFO:tasks.workunit.client.0.smithi138.stdout:8/316: write db/dd/d13/d19/d24/f60 [602087,71028] 0 2024-02-15T22:50:54.258 INFO:tasks.workunit.client.0.smithi138.stdout:0/354: creat d6/d10/d52/d6f/f7d x:0 0 0 2024-02-15T22:50:54.259 INFO:tasks.workunit.client.0.smithi138.stdout:0/355: read - d6/f6b zero size 2024-02-15T22:50:54.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/362: getdents d0/de/d33 0 2024-02-15T22:50:54.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/363: fdatasync d0/de/d14/d63/f7e 0 2024-02-15T22:50:54.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/364: fsync d0/de/d14/f44 0 2024-02-15T22:50:54.261 INFO:tasks.workunit.client.0.smithi138.stdout:6/346: mkdir dc/d76 0 2024-02-15T22:50:54.261 INFO:tasks.workunit.client.0.smithi138.stdout:5/274: dwrite df/f13 [0,4194304] 0 2024-02-15T22:50:54.262 INFO:tasks.workunit.client.0.smithi138.stdout:0/356: mknod d6/d10/d52/c7e 0 2024-02-15T22:50:54.262 INFO:tasks.workunit.client.0.smithi138.stdout:0/357: fsync d6/d10/d40/f43 0 2024-02-15T22:50:54.262 INFO:tasks.workunit.client.0.smithi138.stdout:0/358: fsync d6/d10/d18/f65 0 2024-02-15T22:50:54.263 INFO:tasks.workunit.client.0.smithi138.stdout:9/365: creat d0/d4/f80 x:0 0 0 2024-02-15T22:50:54.263 INFO:tasks.workunit.client.0.smithi138.stdout:6/347: mknod dc/d24/d34/c77 0 2024-02-15T22:50:54.267 INFO:tasks.workunit.client.0.smithi138.stdout:4/581: read d17/d1e/f3f [3420320,119372] 0 2024-02-15T22:50:54.267 INFO:tasks.workunit.client.0.smithi138.stdout:0/359: rename d6/d10/d18/d1b/f36 to d6/d10/d75/f7f 0 2024-02-15T22:50:54.267 INFO:tasks.workunit.client.0.smithi138.stdout:4/582: rename d17/d1e/d2d/d84/da3/dbf to d17/d1e/d2d/d84/da3/dbf/dc3 22 2024-02-15T22:50:54.269 INFO:tasks.workunit.client.0.smithi138.stdout:9/366: getdents d0 0 2024-02-15T22:50:54.270 INFO:tasks.workunit.client.0.smithi138.stdout:6/348: creat dc/d24/d34/d3b/f78 x:0 0 0 2024-02-15T22:50:54.271 INFO:tasks.workunit.client.0.smithi138.stdout:5/275: symlink df/l53 0 2024-02-15T22:50:54.272 INFO:tasks.workunit.client.0.smithi138.stdout:0/360: symlink d6/d10/d75/l80 0 2024-02-15T22:50:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:6/349: rename dc/f13 to dc/f79 0 2024-02-15T22:50:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:6/350: stat dc/d24/l67 0 2024-02-15T22:50:54.276 INFO:tasks.workunit.client.0.smithi138.stdout:4/583: mkdir d17/d2b/d78/dc0/dc4 0 2024-02-15T22:50:54.276 INFO:tasks.workunit.client.0.smithi138.stdout:4/584: stat d17/d1e/d2d/d36/d3e/c66 0 2024-02-15T22:50:54.276 INFO:tasks.workunit.client.0.smithi138.stdout:2/344: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:50:54.276 INFO:tasks.workunit.client.0.smithi138.stdout:5/276: dread df/f16 [0,4194304] 0 2024-02-15T22:50:54.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/277: write df/d18/d2b/f49 [853024,80281] 0 2024-02-15T22:50:54.277 INFO:tasks.workunit.client.0.smithi138.stdout:6/351: rmdir dc 39 2024-02-15T22:50:54.277 INFO:tasks.workunit.client.0.smithi138.stdout:6/352: creat dc/d4b/f7a x:0 0 0 2024-02-15T22:50:54.281 INFO:tasks.workunit.client.0.smithi138.stdout:8/317: read db/dd/d22/f2f [3263437,86325] 0 2024-02-15T22:50:54.281 INFO:tasks.workunit.client.0.smithi138.stdout:8/318: readlink db/dd/d13/d19/l3a 0 2024-02-15T22:50:54.285 INFO:tasks.workunit.client.0.smithi138.stdout:5/278: rename c6 to df/d18/d3e/c54 0 2024-02-15T22:50:54.285 INFO:tasks.workunit.client.0.smithi138.stdout:6/353: dread dc/d24/f5e [0,4194304] 0 2024-02-15T22:50:54.285 INFO:tasks.workunit.client.0.smithi138.stdout:9/367: dread d0/d55/f5e [4194304,4194304] 0 2024-02-15T22:50:54.285 INFO:tasks.workunit.client.0.smithi138.stdout:9/368: stat d0/d4/f3b 0 2024-02-15T22:50:54.285 INFO:tasks.workunit.client.0.smithi138.stdout:3/390: dwrite d5/d16/dc/f76 [0,4194304] 0 2024-02-15T22:50:54.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/319: link db/dd/d13/d19/d24/f2c db/dd/d13/f6d 0 2024-02-15T22:50:54.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/320: chown db/dd/d13/f6d 20463 1 2024-02-15T22:50:54.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/321: creat db/dd/d13/d19/d24/f6e x:0 0 0 2024-02-15T22:50:54.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/322: chown db/dd/d4d 194 1 2024-02-15T22:50:54.288 INFO:tasks.workunit.client.0.smithi138.stdout:4/585: dread d17/d1e/d2d/f31 [0,4194304] 0 2024-02-15T22:50:54.289 INFO:tasks.workunit.client.0.smithi138.stdout:3/391: link d5/d12/d23/f4c d5/d18/d35/f80 0 2024-02-15T22:50:54.293 INFO:tasks.workunit.client.0.smithi138.stdout:7/587: dwrite d1/d2/db/fc0 [0,4194304] 0 2024-02-15T22:50:54.293 INFO:tasks.workunit.client.0.smithi138.stdout:5/279: dread f5 [0,4194304] 0 2024-02-15T22:50:54.293 INFO:tasks.workunit.client.0.smithi138.stdout:5/280: chown df/d18/c21 14548 1 2024-02-15T22:50:54.294 INFO:tasks.workunit.client.0.smithi138.stdout:8/323: rename db/dd/d13/d19/d52/l54 to db/dd/d13/d19/l6f 0 2024-02-15T22:50:54.295 INFO:tasks.workunit.client.0.smithi138.stdout:4/586: rmdir d17/d1e/d2d/d52 39 2024-02-15T22:50:54.295 INFO:tasks.workunit.client.0.smithi138.stdout:4/587: creat d17/d1e/d56/fc5 x:0 0 0 2024-02-15T22:50:54.296 INFO:tasks.workunit.client.0.smithi138.stdout:3/392: creat d5/d12/d26/d2e/f81 x:0 0 0 2024-02-15T22:50:54.296 INFO:tasks.workunit.client.0.smithi138.stdout:3/393: readlink d5/d12/d26/l38 0 2024-02-15T22:50:54.299 INFO:tasks.workunit.client.0.smithi138.stdout:7/588: symlink d1/d28/lca 0 2024-02-15T22:50:54.302 INFO:tasks.workunit.client.0.smithi138.stdout:5/281: read df/f37 [1381263,53580] 0 2024-02-15T22:50:54.307 INFO:tasks.workunit.client.0.smithi138.stdout:0/361: dwrite d6/d10/d75/f7f [0,4194304] 0 2024-02-15T22:50:54.307 INFO:tasks.workunit.client.0.smithi138.stdout:0/362: fdatasync d6/d10/d18/d57/f63 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:6/354: dwrite dc/d24/d34/d3b/f64 [0,4194304] 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:6/355: readlink dc/d4b/l4c 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:6/356: getdents dc/d76 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/345: dwrite d0/da/f3a [0,4194304] 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/346: fdatasync d0/d3/f44 0 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:4/588: rmdir d17/d1e/d2d/d36/d3e/d64 39 2024-02-15T22:50:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:4/589: creat d17/d1e/d2d/d8c/fc6 x:0 0 0 2024-02-15T22:50:54.313 INFO:tasks.workunit.client.0.smithi138.stdout:3/394: mknod d5/d12/d23/d29/d4f/c82 0 2024-02-15T22:50:54.315 INFO:tasks.workunit.client.0.smithi138.stdout:2/347: write d0/dd/d15/f71 [80446,122709] 0 2024-02-15T22:50:54.315 INFO:tasks.workunit.client.0.smithi138.stdout:2/348: chown d0/da/d19/d3f 941857816 1 2024-02-15T22:50:54.318 INFO:tasks.workunit.client.0.smithi138.stdout:6/357: mkdir dc/d4b/d7b 0 2024-02-15T22:50:54.321 INFO:tasks.workunit.client.0.smithi138.stdout:2/349: mkdir d0/da/d19/d53/d80 0 2024-02-15T22:50:54.322 INFO:tasks.workunit.client.0.smithi138.stdout:2/350: dread - d0/da/d19/d53/d5d/d6d/f7c zero size 2024-02-15T22:50:54.323 INFO:tasks.workunit.client.0.smithi138.stdout:6/358: mkdir dc/d24/d34/d3b/d7c 0 2024-02-15T22:50:54.326 INFO:tasks.workunit.client.0.smithi138.stdout:8/324: rename db/dd/d13/d19/d52 to db/d15/d70 0 2024-02-15T22:50:54.329 INFO:tasks.workunit.client.0.smithi138.stdout:7/589: dwrite d1/d28/d7c/fc8 [0,4194304] 0 2024-02-15T22:50:54.329 INFO:tasks.workunit.client.0.smithi138.stdout:3/395: write d5/d16/dc/f76 [1565955,106885] 0 2024-02-15T22:50:54.329 INFO:tasks.workunit.client.0.smithi138.stdout:3/396: fdatasync d5/f61 0 2024-02-15T22:50:54.330 INFO:tasks.workunit.client.0.smithi138.stdout:3/397: creat d5/d16/dc/d43/f83 x:0 0 0 2024-02-15T22:50:54.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/369: dwrite d0/de/f47 [4194304,4194304] 0 2024-02-15T22:50:54.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/370: write d0/de/d14/d18/f62 [985389,127339] 0 2024-02-15T22:50:54.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/371: chown d0/d1/l4b 61680 1 2024-02-15T22:50:54.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/590: truncate d1/d2/f44 1315343 0 2024-02-15T22:50:54.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/591: chown d1/d28/d7c/lbd 508276773 1 2024-02-15T22:50:54.335 INFO:tasks.workunit.client.0.smithi138.stdout:7/592: dread - d1/d2/db/d3c/d4d/d5b/f9a zero size 2024-02-15T22:50:54.337 INFO:tasks.workunit.client.0.smithi138.stdout:7/593: dread d1/f40 [0,4194304] 0 2024-02-15T22:50:54.338 INFO:tasks.workunit.client.0.smithi138.stdout:3/398: mkdir d5/d84 0 2024-02-15T22:50:54.338 INFO:tasks.workunit.client.0.smithi138.stdout:3/399: read - d5/d12/d23/d29/d4f/f70 zero size 2024-02-15T22:50:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:3/400: fdatasync d5/d12/d23/d29/d4a/f7d 0 2024-02-15T22:50:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:3/401: write d5/d12/f1d [2577906,16123] 0 2024-02-15T22:50:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:7/594: creat d1/d5a/d97/fcb x:0 0 0 2024-02-15T22:50:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:7/595: chown d1/d2/db/l71 500616210 1 2024-02-15T22:50:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:7/596: creat d1/d2/fcc x:0 0 0 2024-02-15T22:50:54.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/402: creat d5/d16/d4d/f85 x:0 0 0 2024-02-15T22:50:54.341 INFO:tasks.workunit.client.0.smithi138.stdout:3/403: creat d5/d16/dc/d43/f86 x:0 0 0 2024-02-15T22:50:54.343 INFO:tasks.workunit.client.0.smithi138.stdout:3/404: creat d5/d16/dc/d43/d47/d67/f87 x:0 0 0 2024-02-15T22:50:54.343 INFO:tasks.workunit.client.0.smithi138.stdout:3/405: creat d5/d12/f88 x:0 0 0 2024-02-15T22:50:54.345 INFO:tasks.workunit.client.0.smithi138.stdout:6/359: rmdir dc/d24/d34 39 2024-02-15T22:50:54.348 INFO:tasks.workunit.client.0.smithi138.stdout:2/351: dwrite d0/f1 [4194304,4194304] 0 2024-02-15T22:50:54.348 INFO:tasks.workunit.client.0.smithi138.stdout:2/352: write d0/f3b [2239573,37618] 0 2024-02-15T22:50:54.348 INFO:tasks.workunit.client.0.smithi138.stdout:9/372: dread d0/d4/fd [0,4194304] 0 2024-02-15T22:50:54.349 INFO:tasks.workunit.client.0.smithi138.stdout:9/373: readlink d0/d1/l4b 0 2024-02-15T22:50:54.349 INFO:tasks.workunit.client.0.smithi138.stdout:8/325: read db/d15/f17 [1913121,100373] 0 2024-02-15T22:50:54.349 INFO:tasks.workunit.client.0.smithi138.stdout:9/374: chown d0/d2e 105826 1 2024-02-15T22:50:54.349 INFO:tasks.workunit.client.0.smithi138.stdout:8/326: write f3 [8543617,13735] 0 2024-02-15T22:50:54.349 INFO:tasks.workunit.client.0.smithi138.stdout:5/282: dwrite df/d18/d3e/f41 [0,4194304] 0 2024-02-15T22:50:54.351 INFO:tasks.workunit.client.0.smithi138.stdout:0/363: dwrite d6/d10/f73 [0,4194304] 0 2024-02-15T22:50:54.352 INFO:tasks.workunit.client.0.smithi138.stdout:2/353: rmdir d0/da/d19/d53/d5d 39 2024-02-15T22:50:54.353 INFO:tasks.workunit.client.0.smithi138.stdout:5/283: read df/f44 [2945408,80475] 0 2024-02-15T22:50:54.356 INFO:tasks.workunit.client.0.smithi138.stdout:0/364: symlink d6/d10/d52/d72/l81 0 2024-02-15T22:50:54.356 INFO:tasks.workunit.client.0.smithi138.stdout:4/590: dwrite d17/d2b/f9f [0,4194304] 0 2024-02-15T22:50:54.356 INFO:tasks.workunit.client.0.smithi138.stdout:2/354: creat d0/da/d19/f81 x:0 0 0 2024-02-15T22:50:54.357 INFO:tasks.workunit.client.0.smithi138.stdout:5/284: creat df/d18/d3e/d51/f55 x:0 0 0 2024-02-15T22:50:54.358 INFO:tasks.workunit.client.0.smithi138.stdout:0/365: mknod d6/d10/d64/c82 0 2024-02-15T22:50:54.358 INFO:tasks.workunit.client.0.smithi138.stdout:0/366: write d6/d10/d13/d3d/f71 [919297,48609] 0 2024-02-15T22:50:54.359 INFO:tasks.workunit.client.0.smithi138.stdout:4/591: mkdir d17/d1e/d2d/dc7 0 2024-02-15T22:50:54.361 INFO:tasks.workunit.client.0.smithi138.stdout:2/355: rename d0/da/d19/d3f/c4c to d0/dd/d15/d72/c82 0 2024-02-15T22:50:54.363 INFO:tasks.workunit.client.0.smithi138.stdout:4/592: mknod d17/d1e/d2d/d36/d3e/daf/cc8 0 2024-02-15T22:50:54.364 INFO:tasks.workunit.client.0.smithi138.stdout:2/356: stat d0/da/l24 0 2024-02-15T22:50:54.364 INFO:tasks.workunit.client.0.smithi138.stdout:2/357: truncate d0/dd/d15/f4b 751940 0 2024-02-15T22:50:54.381 INFO:tasks.workunit.client.0.smithi138.stdout:6/360: dwrite dc/f46 [0,4194304] 0 2024-02-15T22:50:54.382 INFO:tasks.workunit.client.0.smithi138.stdout:4/593: dread d17/d1e/d2d/d36/f6e [0,4194304] 0 2024-02-15T22:50:54.387 INFO:tasks.workunit.client.0.smithi138.stdout:2/358: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:50:54.387 INFO:tasks.workunit.client.0.smithi138.stdout:3/406: dwrite d5/d12/d23/d29/d4f/f53 [0,4194304] 0 2024-02-15T22:50:54.389 INFO:tasks.workunit.client.0.smithi138.stdout:3/407: creat d5/d12/d23/d29/d4f/f89 x:0 0 0 2024-02-15T22:50:54.390 INFO:tasks.workunit.client.0.smithi138.stdout:0/367: dread d6/d10/d13/d3d/f71 [0,4194304] 0 2024-02-15T22:50:54.390 INFO:tasks.workunit.client.0.smithi138.stdout:0/368: fsync d6/d10/d13/d3d/f70 0 2024-02-15T22:50:54.393 INFO:tasks.workunit.client.0.smithi138.stdout:3/408: mkdir d5/d16/dc/d43/d47/d67/d8a 0 2024-02-15T22:50:54.393 INFO:tasks.workunit.client.0.smithi138.stdout:3/409: truncate d5/d12/d26/d2e/f5b 800149 0 2024-02-15T22:50:54.393 INFO:tasks.workunit.client.0.smithi138.stdout:5/285: dread df/f27 [0,4194304] 0 2024-02-15T22:50:54.393 INFO:tasks.workunit.client.0.smithi138.stdout:5/286: write df/d18/d3e/f48 [840726,54513] 0 2024-02-15T22:50:54.394 INFO:tasks.workunit.client.0.smithi138.stdout:7/597: dwrite d1/d2/db/f7b [0,4194304] 0 2024-02-15T22:50:54.395 INFO:tasks.workunit.client.0.smithi138.stdout:4/594: write d17/d1e/d2d/d8c/f8e [847772,89331] 0 2024-02-15T22:50:54.396 INFO:tasks.workunit.client.0.smithi138.stdout:0/369: mknod d6/d10/d34/c83 0 2024-02-15T22:50:54.399 INFO:tasks.workunit.client.0.smithi138.stdout:8/327: dwrite db/f3d [0,4194304] 0 2024-02-15T22:50:54.399 INFO:tasks.workunit.client.0.smithi138.stdout:7/598: dread d1/f40 [0,4194304] 0 2024-02-15T22:50:54.403 INFO:tasks.workunit.client.0.smithi138.stdout:6/361: dwrite dc/d4b/f70 [0,4194304] 0 2024-02-15T22:50:54.405 INFO:tasks.workunit.client.0.smithi138.stdout:5/287: mkdir df/d18/d56 0 2024-02-15T22:50:54.407 INFO:tasks.workunit.client.0.smithi138.stdout:4/595: mknod d17/d1e/d2d/d52/cc9 0 2024-02-15T22:50:54.409 INFO:tasks.workunit.client.0.smithi138.stdout:0/370: symlink d6/d10/d18/d6e/l84 0 2024-02-15T22:50:54.409 INFO:tasks.workunit.client.0.smithi138.stdout:0/371: truncate d6/d10/d18/d1b/f3a 952508 0 2024-02-15T22:50:54.411 INFO:tasks.workunit.client.0.smithi138.stdout:2/359: dwrite d0/d3/f2b [0,4194304] 0 2024-02-15T22:50:54.411 INFO:tasks.workunit.client.0.smithi138.stdout:2/360: stat d0/dd/d15/c6b 0 2024-02-15T22:50:54.412 INFO:tasks.workunit.client.0.smithi138.stdout:6/362: unlink dc/l2e 0 2024-02-15T22:50:54.413 INFO:tasks.workunit.client.0.smithi138.stdout:6/363: dread - dc/d24/d34/d3b/f78 zero size 2024-02-15T22:50:54.414 INFO:tasks.workunit.client.0.smithi138.stdout:5/288: rename df/d18/d2b/c52 to df/d18/c57 0 2024-02-15T22:50:54.415 INFO:tasks.workunit.client.0.smithi138.stdout:2/361: mkdir d0/da/d19/d53/d5d/d83 0 2024-02-15T22:50:54.416 INFO:tasks.workunit.client.0.smithi138.stdout:2/362: symlink d0/da/d19/d3f/l84 0 2024-02-15T22:50:54.420 INFO:tasks.workunit.client.0.smithi138.stdout:2/363: symlink d0/da/d19/d53/d5d/d74/l85 0 2024-02-15T22:50:54.422 INFO:tasks.workunit.client.0.smithi138.stdout:1/288: sync 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/289: symlink df/d1b/d1d/l68 0 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/290: chown df/d1b/d1d/d25/l57 383 1 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/291: fdatasync f8 0 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/292: write df/d1b/d21/f32 [814661,118527] 0 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/293: fdatasync df/d1b/d1d/d25/d2e/d37/f4b 0 2024-02-15T22:50:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:1/294: write df/d1b/d1d/d25/d2c/d3f/f56 [337210,45488] 0 2024-02-15T22:50:54.426 INFO:tasks.workunit.client.0.smithi138.stdout:6/364: write dc/f1c [949003,66632] 0 2024-02-15T22:50:54.426 INFO:tasks.workunit.client.0.smithi138.stdout:1/295: creat df/d1b/f69 x:0 0 0 2024-02-15T22:50:54.426 INFO:tasks.workunit.client.0.smithi138.stdout:0/372: dread d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:50:54.427 INFO:tasks.workunit.client.0.smithi138.stdout:6/365: mkdir dc/d24/d34/d3b/d7d 0 2024-02-15T22:50:54.428 INFO:tasks.workunit.client.0.smithi138.stdout:2/364: write d0/d3/f2b [2484765,79953] 0 2024-02-15T22:50:54.430 INFO:tasks.workunit.client.0.smithi138.stdout:0/373: unlink d6/d10/d18/d1b/f26 0 2024-02-15T22:50:54.430 INFO:tasks.workunit.client.0.smithi138.stdout:0/374: write d6/d10/d13/f16 [3669442,34605] 0 2024-02-15T22:50:54.431 INFO:tasks.workunit.client.0.smithi138.stdout:6/366: symlink dc/d24/d34/d3b/d7d/l7e 0 2024-02-15T22:50:54.431 INFO:tasks.workunit.client.0.smithi138.stdout:6/367: stat dc/d24/d34/c62 0 2024-02-15T22:50:54.431 INFO:tasks.workunit.client.0.smithi138.stdout:6/368: fdatasync dc/f1a 0 2024-02-15T22:50:54.432 INFO:tasks.workunit.client.0.smithi138.stdout:6/369: chown dc/d24/f39 483658 1 2024-02-15T22:50:54.432 INFO:tasks.workunit.client.0.smithi138.stdout:6/370: fsync f0 0 2024-02-15T22:50:54.432 INFO:tasks.workunit.client.0.smithi138.stdout:6/371: dread - dc/d24/d34/f63 zero size 2024-02-15T22:50:54.434 INFO:tasks.workunit.client.0.smithi138.stdout:2/365: mknod d0/da/d19/d53/d5d/d74/c86 0 2024-02-15T22:50:54.434 INFO:tasks.workunit.client.0.smithi138.stdout:2/366: fsync d0/f36 0 2024-02-15T22:50:54.437 INFO:tasks.workunit.client.0.smithi138.stdout:1/296: dread f4 [4194304,4194304] 0 2024-02-15T22:50:54.439 INFO:tasks.workunit.client.0.smithi138.stdout:2/367: dread d0/da/d19/f30 [0,4194304] 0 2024-02-15T22:50:54.440 INFO:tasks.workunit.client.0.smithi138.stdout:1/297: dread df/d1b/f3d [0,4194304] 0 2024-02-15T22:50:54.440 INFO:tasks.workunit.client.0.smithi138.stdout:1/298: read - df/d1b/d1d/d25/f61 zero size 2024-02-15T22:50:54.440 INFO:tasks.workunit.client.0.smithi138.stdout:7/599: dwrite d1/d2/d29/fb8 [0,4194304] 0 2024-02-15T22:50:54.443 INFO:tasks.workunit.client.0.smithi138.stdout:1/299: mknod df/d1b/d1d/d60/c6a 0 2024-02-15T22:50:54.443 INFO:tasks.workunit.client.0.smithi138.stdout:1/300: fsync df/f11 0 2024-02-15T22:50:54.443 INFO:tasks.workunit.client.0.smithi138.stdout:1/301: read df/d41/f49 [70543,46934] 0 2024-02-15T22:50:54.444 INFO:tasks.workunit.client.0.smithi138.stdout:3/410: dwrite d5/d16/dc/f6f [0,4194304] 0 2024-02-15T22:50:54.444 INFO:tasks.workunit.client.0.smithi138.stdout:7/600: symlink d1/d2/db/lcd 0 2024-02-15T22:50:54.444 INFO:tasks.workunit.client.0.smithi138.stdout:7/601: write d1/faa [866829,95530] 0 2024-02-15T22:50:54.447 INFO:tasks.workunit.client.0.smithi138.stdout:7/602: unlink d1/d28/d7c/fbe 0 2024-02-15T22:50:54.448 INFO:tasks.workunit.client.0.smithi138.stdout:3/411: getdents d5/d16/dc 0 2024-02-15T22:50:54.448 INFO:tasks.workunit.client.0.smithi138.stdout:3/412: write d5/d16/f3c [4270129,6084] 0 2024-02-15T22:50:54.449 INFO:tasks.workunit.client.0.smithi138.stdout:3/413: write d5/d12/d23/d29/d4a/f7d [188715,29399] 0 2024-02-15T22:50:54.451 INFO:tasks.workunit.client.0.smithi138.stdout:7/603: creat d1/d79/d84/d64/fce x:0 0 0 2024-02-15T22:50:54.452 INFO:tasks.workunit.client.0.smithi138.stdout:6/372: read dc/d24/f2c [924567,15539] 0 2024-02-15T22:50:54.459 INFO:tasks.workunit.client.0.smithi138.stdout:6/373: getdents dc 0 2024-02-15T22:50:54.493 INFO:tasks.workunit.client.0.smithi138.stdout:8/328: dwrite db/d15/f62 [0,4194304] 0 2024-02-15T22:50:54.494 INFO:tasks.workunit.client.0.smithi138.stdout:4/596: dwrite d17/d1e/f4d [0,4194304] 0 2024-02-15T22:50:54.496 INFO:tasks.workunit.client.0.smithi138.stdout:6/374: unlink dc/c25 0 2024-02-15T22:50:54.496 INFO:tasks.workunit.client.0.smithi138.stdout:6/375: read f1 [732450,53684] 0 2024-02-15T22:50:54.496 INFO:tasks.workunit.client.0.smithi138.stdout:7/604: dread d1/d2/d29/fb8 [0,4194304] 0 2024-02-15T22:50:54.499 INFO:tasks.workunit.client.0.smithi138.stdout:8/329: symlink db/dd/l71 0 2024-02-15T22:50:54.503 INFO:tasks.workunit.client.0.smithi138.stdout:1/302: dwrite df/d1b/d1d/d25/f61 [0,4194304] 0 2024-02-15T22:50:54.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/376: rename dc/d24/c5a to dc/d4b/d7b/c7f 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:1/303: link df/d1b/d1d/d24/l3b df/d1b/d21/d4f/l6b 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:4/597: dread f10 [0,4194304] 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:1/304: dread - df/d1b/f69 zero size 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:0/375: dwrite d6/d10/d18/d57/f5e [0,4194304] 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:3/414: dwrite d5/d12/d26/d2e/f81 [0,4194304] 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:0/376: write d6/d10/d18/d57/f63 [563620,80025] 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:4/598: stat d17/d1a/daa 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:4/599: write f6 [1213149,6831] 0 2024-02-15T22:50:54.509 INFO:tasks.workunit.client.0.smithi138.stdout:4/600: truncate d17/d1e/d2d/d8c/fc6 808777 0 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/368: dwrite d0/da/d19/f81 [0,4194304] 0 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/369: truncate d0/dd/f5c 1052856 0 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/370: chown d0/da/d19/c35 26 1 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/371: creat d0/f87 x:0 0 0 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/372: write d0/dd/d15/f71 [409408,46332] 0 2024-02-15T22:50:54.510 INFO:tasks.workunit.client.0.smithi138.stdout:7/605: rename d1/d2/db/d3c/c98 to d1/d2/d29/ccf 0 2024-02-15T22:50:54.514 INFO:tasks.workunit.client.0.smithi138.stdout:6/377: write dc/f40 [1580463,125962] 0 2024-02-15T22:50:54.514 INFO:tasks.workunit.client.0.smithi138.stdout:6/378: read f1 [1369957,81100] 0 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 -- 172.21.15.138:0/2192683370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 msgr2=0x7fbb140fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 --2- 172.21.15.138:0/2192683370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb140fee40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009910 tx=0x7fbb04009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 -- 172.21.15.138:0/2192683370 shutdown_connections 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 --2- 172.21.15.138:0/2192683370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140ff380 0x7fbb140ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 --2- 172.21.15.138:0/2192683370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb140fee40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.515+0000 7fbb19586700 1 -- 172.21.15.138:0/2192683370 >> 172.21.15.138:0/2192683370 conn(0x7fbb140fa5e0 msgr2=0x7fbb140fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.516+0000 7fbb19586700 1 -- 172.21.15.138:0/2192683370 shutdown_connections 2024-02-15T22:50:54.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.516+0000 7fbb19586700 1 -- 172.21.15.138:0/2192683370 wait complete. 2024-02-15T22:50:54.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.516+0000 7fbb19586700 1 Processor -- start 2024-02-15T22:50:54.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb19586700 1 -- start start 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb19586700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb19586700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140ff380 0x7fbb14198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb19586700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14198670 con 0x7fbb140fea30 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb19586700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb141987b0 con 0x7fbb140ff380 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35632/0 (socket says 172.21.15.138:35632) 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 -- 172.21.15.138:0/2134008814 learned_addr learned my addr 172.21.15.138:0/2134008814 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 -- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140ff380 msgr2=0x7fbb14198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140ff380 0x7fbb14198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.517+0000 7fbb12ffd700 1 -- 172.21.15.138:0/2134008814 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040095f0 con 0x7fbb140fea30 2024-02-15T22:50:54.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbb12ffd700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400bd70 tx=0x7fbb0400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:54.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0401d070 con 0x7fbb140fea30 2024-02-15T22:50:54.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1419d200 con 0x7fbb140fea30 2024-02-15T22:50:54.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1419d6f0 con 0x7fbb140fea30 2024-02-15T22:50:54.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb04022470 con 0x7fbb140fea30 2024-02-15T22:50:54.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.518+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0400f670 con 0x7fbb140fea30 2024-02-15T22:50:54.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.519+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1410ae80 con 0x7fbb140fea30 2024-02-15T22:50:54.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.520+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fbb04022a50 con 0x7fbb140fea30 2024-02-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.520+0000 7fbafbfff700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 0x7fbafc06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.521+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbb0408dc00 con 0x7fbb140fea30 2024-02-15T22:50:54.523 INFO:tasks.workunit.client.0.smithi138.stdout:0/377: unlink d6/d10/f11 0 2024-02-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.521+0000 7fbb127fc700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 0x7fbafc06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:54.524 INFO:tasks.workunit.client.0.smithi138.stdout:4/601: getdents d17/d1e/d2d/d52 0 2024-02-15T22:50:54.524 INFO:tasks.workunit.client.0.smithi138.stdout:4/602: chown d17/d1e/d2d/d8c/cbb 1622205 1 2024-02-15T22:50:54.524 INFO:tasks.workunit.client.0.smithi138.stdout:4/603: stat d17/d2b/f80 0 2024-02-15T22:50:54.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.522+0000 7fbb127fc700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 0x7fbafc06f3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb08005d90 tx=0x7fbb08005d00 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:54.527 INFO:tasks.workunit.client.0.smithi138.stdout:3/415: dwrite d5/d16/dc/d43/d47/d67/f87 [0,4194304] 0 2024-02-15T22:50:54.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.529+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fbb04093020 con 0x7fbb140fea30 2024-02-15T22:50:54.533 INFO:tasks.workunit.client.0.smithi138.stdout:2/373: truncate d0/da/f8 4026790 0 2024-02-15T22:50:54.533 INFO:tasks.workunit.client.0.smithi138.stdout:2/374: dread - d0/da/d19/d53/d5d/d6d/f7c zero size 2024-02-15T22:50:54.533 INFO:tasks.workunit.client.0.smithi138.stdout:2/375: write d0/d3/f5e [4393207,79794] 0 2024-02-15T22:50:54.534 INFO:tasks.workunit.client.0.smithi138.stdout:7/606: symlink d1/d2/db/d25/d41/ld0 0 2024-02-15T22:50:54.537 INFO:tasks.workunit.client.0.smithi138.stdout:6/379: creat dc/d24/d34/d3b/d7d/f80 x:0 0 0 2024-02-15T22:50:54.538 INFO:tasks.workunit.client.0.smithi138.stdout:1/305: rmdir df/d1b/d1d/d25/d2e/d5b 39 2024-02-15T22:50:54.539 INFO:tasks.workunit.client.0.smithi138.stdout:6/380: dread dc/d24/f5e [0,4194304] 0 2024-02-15T22:50:54.539 INFO:tasks.workunit.client.0.smithi138.stdout:6/381: stat dc/d24/d34 0 2024-02-15T22:50:54.542 INFO:tasks.workunit.client.0.smithi138.stdout:0/378: dwrite d6/d10/d40/f43 [0,4194304] 0 2024-02-15T22:50:54.545 INFO:tasks.workunit.client.0.smithi138.stdout:2/376: creat d0/da/d19/d53/d5d/d83/f88 x:0 0 0 2024-02-15T22:50:54.547 INFO:tasks.workunit.client.0.smithi138.stdout:3/416: dwrite d5/d12/d26/d2e/f5b [0,4194304] 0 2024-02-15T22:50:54.547 INFO:tasks.workunit.client.0.smithi138.stdout:1/306: mkdir df/d1b/d1d/d25/d2e/d6c 0 2024-02-15T22:50:54.549 INFO:tasks.workunit.client.0.smithi138.stdout:7/607: dread d1/d2/db/d3c/f4a [4194304,4194304] 0 2024-02-15T22:50:54.555 INFO:tasks.workunit.client.0.smithi138.stdout:6/382: dwrite dc/d24/d34/f6a [0,4194304] 0 2024-02-15T22:50:54.555 INFO:tasks.workunit.client.0.smithi138.stdout:6/383: dread - dc/d24/d34/d3b/f78 zero size 2024-02-15T22:50:54.556 INFO:tasks.workunit.client.0.smithi138.stdout:2/377: unlink d0/f36 0 2024-02-15T22:50:54.556 INFO:tasks.workunit.client.0.smithi138.stdout:2/378: fdatasync d0/da/d19/d53/d5d/d74/f5f 0 2024-02-15T22:50:54.556 INFO:tasks.workunit.client.0.smithi138.stdout:2/379: chown d0/dd/d15/c41 62947931 1 2024-02-15T22:50:54.558 INFO:tasks.workunit.client.0.smithi138.stdout:3/417: getdents d5/d12/d26 0 2024-02-15T22:50:54.558 INFO:tasks.workunit.client.0.smithi138.stdout:0/379: read d6/d10/d18/f4b [609917,43237] 0 2024-02-15T22:50:54.560 INFO:tasks.workunit.client.0.smithi138.stdout:4/604: rename d17/d1e/d2d/d84 to d17/d1e/d2d/d36/dca 0 2024-02-15T22:50:54.562 INFO:tasks.workunit.client.0.smithi138.stdout:4/605: dread d17/d1e/d2d/f61 [0,4194304] 0 2024-02-15T22:50:54.563 INFO:tasks.workunit.client.0.smithi138.stdout:6/384: creat dc/d76/f81 x:0 0 0 2024-02-15T22:50:54.566 INFO:tasks.workunit.client.0.smithi138.stdout:2/380: creat d0/da/d19/d53/d5d/d74/d79/f89 x:0 0 0 2024-02-15T22:50:54.568 INFO:tasks.workunit.client.0.smithi138.stdout:3/418: rmdir d5/d16/dc/d43/d47/d67/d8a 0 2024-02-15T22:50:54.568 INFO:tasks.workunit.client.0.smithi138.stdout:0/380: mkdir d6/d10/d52/d6f/d85 0 2024-02-15T22:50:54.570 INFO:tasks.workunit.client.0.smithi138.stdout:4/606: rename d17/d1a/l4e to d17/d1e/d2d/lcb 0 2024-02-15T22:50:54.570 INFO:tasks.workunit.client.0.smithi138.stdout:6/385: symlink dc/d4b/l82 0 2024-02-15T22:50:54.570 INFO:tasks.workunit.client.0.smithi138.stdout:6/386: fsync dc/d24/d34/d3b/d66/f74 0 2024-02-15T22:50:54.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/419: write d5/d16/f10 [1904497,33519] 0 2024-02-15T22:50:54.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/420: write d5/d12/d23/f4c [438028,4231] 0 2024-02-15T22:50:54.576 INFO:tasks.workunit.client.0.smithi138.stdout:4/607: link d17/d1e/d2d/d36/d3e/c66 d17/d1e/d2d/ccc 0 2024-02-15T22:50:54.577 INFO:tasks.workunit.client.0.smithi138.stdout:3/421: symlink d5/d16/dc/l8b 0 2024-02-15T22:50:54.578 INFO:tasks.workunit.client.0.smithi138.stdout:4/608: creat d17/d1e/fcd x:0 0 0 2024-02-15T22:50:54.579 INFO:tasks.workunit.client.0.smithi138.stdout:0/381: mknod d6/d10/d18/d1b/c86 0 2024-02-15T22:50:54.581 INFO:tasks.workunit.client.0.smithi138.stdout:4/609: rename d17/d1e/d2d/d36/d3e/d64/c48 to d17/d1e/d56/cce 0 2024-02-15T22:50:54.582 INFO:tasks.workunit.client.0.smithi138.stdout:0/382: unlink d6/d10/d75/f7f 0 2024-02-15T22:50:54.583 INFO:tasks.workunit.client.0.smithi138.stdout:6/387: write dc/d24/d34/d3b/f64 [1932759,9763] 0 2024-02-15T22:50:54.583 INFO:tasks.workunit.client.0.smithi138.stdout:0/383: creat d6/d10/d64/f87 x:0 0 0 2024-02-15T22:50:54.585 INFO:tasks.workunit.client.0.smithi138.stdout:0/384: chown d6/d10/d18/d57 62 1 2024-02-15T22:50:54.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/385: stat d6/d10/d40/l54 0 2024-02-15T22:50:54.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/386: write f0 [858322,86091] 0 2024-02-15T22:50:54.587 INFO:tasks.workunit.client.0.smithi138.stdout:3/422: write d5/d16/dc/d43/d47/d67/f87 [2245620,19709] 0 2024-02-15T22:50:54.587 INFO:tasks.workunit.client.0.smithi138.stdout:3/423: dread - d5/d16/dc/d43/f83 zero size 2024-02-15T22:50:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:2/381: dwrite d0/da/d19/d53/f7f [0,4194304] 0 2024-02-15T22:50:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:2/382: dread - d0/dd/d15/d65/f7e zero size 2024-02-15T22:50:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:2/383: chown d0/f3b 0 1 2024-02-15T22:50:54.589 INFO:tasks.workunit.client.0.smithi138.stdout:0/387: unlink d6/d10/d13/f2c 0 2024-02-15T22:50:54.595 INFO:tasks.workunit.client.0.smithi138.stdout:4/610: dread d17/f49 [0,4194304] 0 2024-02-15T22:50:54.595 INFO:tasks.workunit.client.0.smithi138.stdout:4/611: fsync d17/d2b/fba 0 2024-02-15T22:50:54.595 INFO:tasks.workunit.client.0.smithi138.stdout:4/612: truncate d17/d1e/d2d/f31 4782814 0 2024-02-15T22:50:54.596 INFO:tasks.workunit.client.0.smithi138.stdout:3/424: dread d5/d16/f3c [0,4194304] 0 2024-02-15T22:50:54.597 INFO:tasks.workunit.client.0.smithi138.stdout:2/384: mkdir d0/da/d19/d53/d5d/d83/d8a 0 2024-02-15T22:50:54.598 INFO:tasks.workunit.client.0.smithi138.stdout:3/425: fdatasync d5/d16/dc/d43/d47/d67/f87 0 2024-02-15T22:50:54.598 INFO:tasks.workunit.client.0.smithi138.stdout:3/426: stat d5/d18/c72 0 2024-02-15T22:50:54.600 INFO:tasks.workunit.client.0.smithi138.stdout:3/427: creat d5/d18/d35/f8c x:0 0 0 2024-02-15T22:50:54.605 INFO:tasks.workunit.client.0.smithi138.stdout:2/385: read d0/da/d19/f2d [1800654,82525] 0 2024-02-15T22:50:54.606 INFO:tasks.workunit.client.0.smithi138.stdout:2/386: rmdir d0/da/d19/d53/d5d 39 2024-02-15T22:50:54.606 INFO:tasks.workunit.client.0.smithi138.stdout:2/387: chown d0/d3/c28 20 1 2024-02-15T22:50:54.606 INFO:tasks.workunit.client.0.smithi138.stdout:2/388: chown d0/f87 11 1 2024-02-15T22:50:54.606 INFO:tasks.workunit.client.0.smithi138.stdout:2/389: rename d0/da to d0/da/d19/d73/d8b 22 2024-02-15T22:50:54.608 INFO:tasks.workunit.client.0.smithi138.stdout:2/390: rename d0/dd/f5c to d0/dd/d15/f8c 0 2024-02-15T22:50:54.610 INFO:tasks.workunit.client.0.smithi138.stdout:0/388: truncate f0 1894933 0 2024-02-15T22:50:54.610 INFO:tasks.workunit.client.0.smithi138.stdout:0/389: stat d6/f6d 0 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:3/428: write d5/d12/d26/d2e/f81 [2517785,71975] 0 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:3/429: read - d5/d16/d4d/f85 zero size 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:3/430: chown d5/d16/dc/d43/d57/d5d 8916 1 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:3/431: fsync d5/d12/d26/f5c 0 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:2/391: rename d0/d3/l42 to d0/dd/d15/d72/l8d 0 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:0/390: dread d6/d10/d40/f5c [0,4194304] 0 2024-02-15T22:50:54.611 INFO:tasks.workunit.client.0.smithi138.stdout:0/391: creat d6/d10/d64/f88 x:0 0 0 2024-02-15T22:50:54.612 INFO:tasks.workunit.client.0.smithi138.stdout:0/392: write d6/d10/d13/d3d/f71 [883434,9015] 0 2024-02-15T22:50:54.612 INFO:tasks.workunit.client.0.smithi138.stdout:0/393: readlink d6/lf 0 2024-02-15T22:50:54.612 INFO:tasks.workunit.client.0.smithi138.stdout:0/394: write d6/d10/d34/f5a [1772760,45942] 0 2024-02-15T22:50:54.613 INFO:tasks.workunit.client.0.smithi138.stdout:3/432: link d5/f61 d5/d16/dc/d43/d47/d67/f8d 0 2024-02-15T22:50:54.613 INFO:tasks.workunit.client.0.smithi138.stdout:3/433: chown d5/d12/d23 33263473 1 2024-02-15T22:50:54.613 INFO:tasks.workunit.client.0.smithi138.stdout:3/434: chown d5/d16/dc/d43/d47/f75 2317 1 2024-02-15T22:50:54.614 INFO:tasks.workunit.client.0.smithi138.stdout:2/392: unlink d0/da/c25 0 2024-02-15T22:50:54.619 INFO:tasks.workunit.client.0.smithi138.stdout:0/395: mknod d6/d10/d13/c89 0 2024-02-15T22:50:54.619 INFO:tasks.workunit.client.0.smithi138.stdout:3/435: creat d5/d16/d4d/f8e x:0 0 0 2024-02-15T22:50:54.619 INFO:tasks.workunit.client.0.smithi138.stdout:3/436: dread - d5/d16/dc/d43/f86 zero size 2024-02-15T22:50:54.620 INFO:tasks.workunit.client.0.smithi138.stdout:0/396: unlink d6/d10/d18/d57/c7c 0 2024-02-15T22:50:54.621 INFO:tasks.workunit.client.0.smithi138.stdout:0/397: mknod d6/d10/d13/c8a 0 2024-02-15T22:50:54.622 INFO:tasks.workunit.client.0.smithi138.stdout:0/398: mknod d6/d10/d13/c8b 0 2024-02-15T22:50:54.624 INFO:tasks.workunit.client.0.smithi138.stdout:0/399: creat d6/d10/d52/d72/f8c x:0 0 0 2024-02-15T22:50:54.625 INFO:tasks.workunit.client.0.smithi138.stdout:0/400: mkdir d6/d10/d18/d57/d8d 0 2024-02-15T22:50:54.626 INFO:tasks.workunit.client.0.smithi138.stdout:0/401: write d6/d10/d52/d6f/f7d [4242,66908] 0 2024-02-15T22:50:54.631 INFO:tasks.workunit.client.0.smithi138.stdout:3/437: dread d5/d12/d23/f50 [0,4194304] 0 2024-02-15T22:50:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:0/402: dread d6/d10/d13/f45 [0,4194304] 0 2024-02-15T22:50:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:0/403: symlink d6/d10/d64/l8e 0 2024-02-15T22:50:54.640 INFO:tasks.workunit.client.0.smithi138.stdout:0/404: rmdir d6/d10/d13 39 2024-02-15T22:50:54.640 INFO:tasks.workunit.client.0.smithi138.stdout:0/405: stat d6/d10/d18/d57/f5e 0 2024-02-15T22:50:54.640 INFO:tasks.workunit.client.0.smithi138.stdout:0/406: getdents d6/d10/d13/d3d 0 2024-02-15T22:50:54.641 INFO:tasks.workunit.client.0.smithi138.stdout:2/393: dwrite d0/da/d19/d3f/f58 [0,4194304] 0 2024-02-15T22:50:54.641 INFO:tasks.workunit.client.0.smithi138.stdout:2/394: creat d0/da/d19/d53/f8e x:0 0 0 2024-02-15T22:50:54.642 INFO:tasks.workunit.client.0.smithi138.stdout:0/407: unlink d6/d10/d18/d1b/c86 0 2024-02-15T22:50:54.642 INFO:tasks.workunit.client.0.smithi138.stdout:2/395: dread d0/f51 [0,4194304] 0 2024-02-15T22:50:54.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/408: mknod d6/c8f 0 2024-02-15T22:50:54.645 INFO:tasks.workunit.client.0.smithi138.stdout:0/409: fsync d6/d10/d13/f45 0 2024-02-15T22:50:54.645 INFO:tasks.workunit.client.0.smithi138.stdout:0/410: write d6/d10/d40/f5c [1213719,117386] 0 2024-02-15T22:50:54.646 INFO:tasks.workunit.client.0.smithi138.stdout:2/396: symlink d0/da/d19/d53/d5d/l8f 0 2024-02-15T22:50:54.647 INFO:tasks.workunit.client.0.smithi138.stdout:3/438: dwrite d5/d12/d26/d2f/f7b [0,4194304] 0 2024-02-15T22:50:54.647 INFO:tasks.workunit.client.0.smithi138.stdout:3/439: read d5/d12/d23/d29/d4a/f7d [18708,86658] 0 2024-02-15T22:50:54.655 INFO:tasks.workunit.client.0.smithi138.stdout:3/440: dread d5/d16/dc/d43/d47/f75 [0,4194304] 0 2024-02-15T22:50:54.656 INFO:tasks.workunit.client.0.smithi138.stdout:3/441: symlink d5/d16/dc/d43/l8f 0 2024-02-15T22:50:54.657 INFO:tasks.workunit.client.0.smithi138.stdout:3/442: symlink d5/d12/d26/l90 0 2024-02-15T22:50:54.658 INFO:tasks.workunit.client.0.smithi138.stdout:2/397: write d0/da/d19/f55 [1318435,119590] 0 2024-02-15T22:50:54.658 INFO:tasks.workunit.client.0.smithi138.stdout:3/443: dread d5/f61 [0,4194304] 0 2024-02-15T22:50:54.659 INFO:tasks.workunit.client.0.smithi138.stdout:2/398: creat d0/da/d19/d53/d80/f90 x:0 0 0 2024-02-15T22:50:54.659 INFO:tasks.workunit.client.0.smithi138.stdout:2/399: chown d0/da/d19/f55 497934812 1 2024-02-15T22:50:54.660 INFO:tasks.workunit.client.0.smithi138.stdout:2/400: link d0/dd/d15/d65/l75 d0/da/d19/d53/d5d/d74/d79/l91 0 2024-02-15T22:50:54.668 INFO:tasks.workunit.client.0.smithi138.stdout:0/411: dwrite d6/f6b [0,4194304] 0 2024-02-15T22:50:54.669 INFO:tasks.workunit.client.0.smithi138.stdout:3/444: write d5/d16/dc/f6f [3266151,78395] 0 2024-02-15T22:50:54.671 INFO:tasks.workunit.client.0.smithi138.stdout:0/412: mknod d6/d10/d52/d6f/c90 0 2024-02-15T22:50:54.672 INFO:tasks.workunit.client.0.smithi138.stdout:0/413: creat d6/d10/d40/f91 x:0 0 0 2024-02-15T22:50:54.678 INFO:tasks.workunit.client.0.smithi138.stdout:2/401: dwrite d0/dd/d15/d65/f76 [0,4194304] 0 2024-02-15T22:50:54.681 INFO:tasks.workunit.client.0.smithi138.stdout:2/402: rmdir d0/da/d19/d53 39 2024-02-15T22:50:54.681 INFO:tasks.workunit.client.0.smithi138.stdout:2/403: chown d0/da/d19/d53/d5d/d74 202265 1 2024-02-15T22:50:54.683 INFO:tasks.workunit.client.0.smithi138.stdout:2/404: creat d0/dd/d15/d72/f92 x:0 0 0 2024-02-15T22:50:54.683 INFO:tasks.workunit.client.0.smithi138.stdout:2/405: creat d0/f93 x:0 0 0 2024-02-15T22:50:54.683 INFO:tasks.workunit.client.0.smithi138.stdout:2/406: write d0/da/d19/d3f/f4a [278018,7377] 0 2024-02-15T22:50:54.683 INFO:tasks.workunit.client.0.smithi138.stdout:2/407: chown d0/dd/d15/c41 10 1 2024-02-15T22:50:54.684 INFO:tasks.workunit.client.0.smithi138.stdout:2/408: rename d0/da/d19/d53/d5d/l8f to d0/da/d19/l94 0 2024-02-15T22:50:54.691 INFO:tasks.workunit.client.0.smithi138.stdout:0/414: dwrite d6/d10/f68 [0,4194304] 0 2024-02-15T22:50:54.692 INFO:tasks.workunit.client.0.smithi138.stdout:0/415: creat d6/f92 x:0 0 0 2024-02-15T22:50:54.692 INFO:tasks.workunit.client.0.smithi138.stdout:3/445: dwrite d5/d12/d26/d2e/f5b [0,4194304] 0 2024-02-15T22:50:54.697 INFO:tasks.workunit.client.0.smithi138.stdout:0/416: symlink d6/d10/d34/l93 0 2024-02-15T22:50:54.697 INFO:tasks.workunit.client.0.smithi138.stdout:0/417: fdatasync d6/d10/d64/f87 0 2024-02-15T22:50:54.697 INFO:tasks.workunit.client.0.smithi138.stdout:2/409: write d0/dd/f2c [1930359,73288] 0 2024-02-15T22:50:54.702 INFO:tasks.workunit.client.0.smithi138.stdout:0/418: dread d6/d10/d52/d6f/f7d [0,4194304] 0 2024-02-15T22:50:54.719 INFO:tasks.workunit.client.0.smithi138.stdout:3/446: dwrite d5/d12/d23/f50 [0,4194304] 0 2024-02-15T22:50:54.720 INFO:tasks.workunit.client.0.smithi138.stdout:2/410: dwrite d0/f37 [0,4194304] 0 2024-02-15T22:50:54.720 INFO:tasks.workunit.client.0.smithi138.stdout:3/447: symlink d5/d12/d23/d29/d5a/l91 0 2024-02-15T22:50:54.721 INFO:tasks.workunit.client.0.smithi138.stdout:0/419: dwrite d6/f39 [0,4194304] 0 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/448: creat d5/d12/d23/d29/d4f/f92 x:0 0 0 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/449: read d5/d12/f1d [2832584,122311] 0 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/450: chown d5/d18/f24 1387737 1 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/451: truncate d5/d16/dc/d43/d47/d67/f71 4365858 0 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/452: chown d5/d12/d23/f51 28 1 2024-02-15T22:50:54.722 INFO:tasks.workunit.client.0.smithi138.stdout:3/453: write d5/d12/d23/d29/d4a/f52 [1563090,21359] 0 2024-02-15T22:50:54.723 INFO:tasks.workunit.client.0.smithi138.stdout:0/420: creat d6/d10/d18/d57/d8d/f94 x:0 0 0 2024-02-15T22:50:54.724 INFO:tasks.workunit.client.0.smithi138.stdout:3/454: creat d5/d18/f93 x:0 0 0 2024-02-15T22:50:54.732 INFO:tasks.workunit.client.0.smithi138.stdout:2/411: read d0/f1 [2999190,103728] 0 2024-02-15T22:50:54.744 INFO:tasks.workunit.client.0.smithi138.stdout:0/421: dwrite d6/d10/d13/f45 [0,4194304] 0 2024-02-15T22:50:54.744 INFO:tasks.workunit.client.0.smithi138.stdout:0/422: fdatasync d6/d10/d18/d57/f63 0 2024-02-15T22:50:54.744 INFO:tasks.workunit.client.0.smithi138.stdout:0/423: creat d6/f95 x:0 0 0 2024-02-15T22:50:54.746 INFO:tasks.workunit.client.0.smithi138.stdout:0/424: unlink d6/d10/d34/l51 0 2024-02-15T22:50:54.756 INFO:tasks.workunit.client.0.smithi138.stdout:3/455: dwrite d5/d16/d4d/f85 [0,4194304] 0 2024-02-15T22:50:54.756 INFO:tasks.workunit.client.0.smithi138.stdout:2/412: dwrite d0/da/f27 [0,4194304] 0 2024-02-15T22:50:54.758 INFO:tasks.workunit.client.0.smithi138.stdout:3/456: rmdir d5/d12/d26 39 2024-02-15T22:50:54.759 INFO:tasks.workunit.client.0.smithi138.stdout:2/413: mkdir d0/da/d95 0 2024-02-15T22:50:54.765 INFO:tasks.workunit.client.0.smithi138.stdout:3/457: getdents d5/d12/d23/d29 0 2024-02-15T22:50:54.765 INFO:tasks.workunit.client.0.smithi138.stdout:3/458: truncate d5/d12/d26/f2d 5033247 0 2024-02-15T22:50:54.766 INFO:tasks.workunit.client.0.smithi138.stdout:0/425: dwrite d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:54.767 INFO:tasks.workunit.client.0.smithi138.stdout:3/459: unlink d5/d12/d23/d29/d4a/f52 0 2024-02-15T22:50:54.769 INFO:tasks.workunit.client.0.smithi138.stdout:0/426: mknod d6/d10/d13/c96 0 2024-02-15T22:50:54.770 INFO:tasks.workunit.client.0.smithi138.stdout:3/460: mkdir d5/d12/d23/d94 0 2024-02-15T22:50:54.771 INFO:tasks.workunit.client.0.smithi138.stdout:0/427: creat d6/d10/d52/f97 x:0 0 0 2024-02-15T22:50:54.773 INFO:tasks.workunit.client.0.smithi138.stdout:0/428: mknod d6/c98 0 2024-02-15T22:50:54.773 INFO:tasks.workunit.client.0.smithi138.stdout:0/429: truncate d6/d10/d13/f2b 625822 0 2024-02-15T22:50:54.775 INFO:tasks.workunit.client.0.smithi138.stdout:0/430: mknod d6/d10/d18/c99 0 2024-02-15T22:50:54.779 INFO:tasks.workunit.client.0.smithi138.stdout:2/414: dwrite d0/d3/f44 [4194304,4194304] 0 2024-02-15T22:50:54.780 INFO:tasks.workunit.client.0.smithi138.stdout:3/461: getdents d5/d12/d23 0 2024-02-15T22:50:54.782 INFO:tasks.workunit.client.0.smithi138.stdout:2/415: mknod d0/da/d19/d53/d5d/d74/c96 0 2024-02-15T22:50:54.782 INFO:tasks.workunit.client.0.smithi138.stdout:2/416: dread - d0/d3/f70 zero size 2024-02-15T22:50:54.784 INFO:tasks.workunit.client.0.smithi138.stdout:2/417: mkdir d0/da/d19/d53/d5d/d6d/d97 0 2024-02-15T22:50:54.785 INFO:tasks.workunit.client.0.smithi138.stdout:0/431: dread d6/f39 [0,4194304] 0 2024-02-15T22:50:54.785 INFO:tasks.workunit.client.0.smithi138.stdout:0/432: fsync f0 0 2024-02-15T22:50:54.785 INFO:tasks.workunit.client.0.smithi138.stdout:3/462: mkdir d5/d95 0 2024-02-15T22:50:54.787 INFO:tasks.workunit.client.0.smithi138.stdout:2/418: rmdir d0/da/d19/d73 0 2024-02-15T22:50:54.787 INFO:tasks.workunit.client.0.smithi138.stdout:2/419: dread - d0/f87 zero size 2024-02-15T22:50:54.787 INFO:tasks.workunit.client.0.smithi138.stdout:2/420: fdatasync d0/dd/d15/f6c 0 2024-02-15T22:50:54.787 INFO:tasks.workunit.client.0.smithi138.stdout:2/421: read - d0/da/d19/d53/f8e zero size 2024-02-15T22:50:54.788 INFO:tasks.workunit.client.0.smithi138.stdout:0/433: symlink d6/d10/d18/d57/d8d/l9a 0 2024-02-15T22:50:54.788 INFO:tasks.workunit.client.0.smithi138.stdout:3/463: mknod d5/d95/c96 0 2024-02-15T22:50:54.789 INFO:tasks.workunit.client.0.smithi138.stdout:2/422: mknod d0/da/d19/d53/d5d/d74/c98 0 2024-02-15T22:50:54.789 INFO:tasks.workunit.client.0.smithi138.stdout:2/423: write d0/dd/d15/f71 [250072,82617] 0 2024-02-15T22:50:54.791 INFO:tasks.workunit.client.0.smithi138.stdout:2/424: unlink d0/da/d19/d53/d5d/d74/l85 0 2024-02-15T22:50:54.793 INFO:tasks.workunit.client.0.smithi138.stdout:2/425: creat d0/da/d19/d53/d5d/d6d/d97/f99 x:0 0 0 2024-02-15T22:50:54.796 INFO:tasks.workunit.client.0.smithi138.stdout:0/434: write d6/d10/d13/f45 [982057,55622] 0 2024-02-15T22:50:54.798 INFO:tasks.workunit.client.0.smithi138.stdout:0/435: unlink d6/d10/d52/l79 0 2024-02-15T22:50:54.805 INFO:tasks.workunit.client.0.smithi138.stdout:3/464: dwrite d5/d18/d35/f80 [0,4194304] 0 2024-02-15T22:50:54.807 INFO:tasks.workunit.client.0.smithi138.stdout:3/465: rmdir d5/d12/d23/d29 39 2024-02-15T22:50:54.807 INFO:tasks.workunit.client.0.smithi138.stdout:3/466: readlink d5/d12/d26/l38 0 2024-02-15T22:50:54.807 INFO:tasks.workunit.client.0.smithi138.stdout:3/467: truncate d5/d16/f77 1301397 0 2024-02-15T22:50:54.808 INFO:tasks.workunit.client.0.smithi138.stdout:3/468: readlink d5/d12/d26/d2f/l55 0 2024-02-15T22:50:54.808 INFO:tasks.workunit.client.0.smithi138.stdout:2/426: dread d0/dd/f18 [0,4194304] 0 2024-02-15T22:50:54.808 INFO:tasks.workunit.client.0.smithi138.stdout:2/427: creat d0/da/d19/d53/d5d/d6d/d97/f9a x:0 0 0 2024-02-15T22:50:54.808 INFO:tasks.workunit.client.0.smithi138.stdout:3/469: truncate d5/d16/d4d/f85 72461 0 2024-02-15T22:50:54.810 INFO:tasks.workunit.client.0.smithi138.stdout:2/428: getdents d0/da/d19/d53/d5d 0 2024-02-15T22:50:54.811 INFO:tasks.workunit.client.0.smithi138.stdout:2/429: chown d0/dd/d15/c1e 156356 1 2024-02-15T22:50:54.811 INFO:tasks.workunit.client.0.smithi138.stdout:2/430: fsync d0/da/d19/f39 0 2024-02-15T22:50:54.812 INFO:tasks.workunit.client.0.smithi138.stdout:2/431: truncate d0/da/d19/f54 2337143 0 2024-02-15T22:50:54.814 INFO:tasks.workunit.client.0.smithi138.stdout:2/432: mknod d0/da/d19/c9b 0 2024-02-15T22:50:54.814 INFO:tasks.workunit.client.0.smithi138.stdout:2/433: write d0/dd/d15/f71 [1602524,127768] 0 2024-02-15T22:50:54.815 INFO:tasks.workunit.client.0.smithi138.stdout:0/436: dwrite d6/d10/d18/d1b/f3a [0,4194304] 0 2024-02-15T22:50:54.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/437: write d6/fb [968919,103875] 0 2024-02-15T22:50:54.825 INFO:tasks.workunit.client.0.smithi138.stdout:0/438: write d6/f39 [1604457,46809] 0 2024-02-15T22:50:54.829 INFO:tasks.workunit.client.0.smithi138.stdout:2/434: dread d0/dd/d15/f57 [0,4194304] 0 2024-02-15T22:50:54.829 INFO:tasks.workunit.client.0.smithi138.stdout:2/435: write d0/da/d19/f2d [3454932,72857] 0 2024-02-15T22:50:54.829 INFO:tasks.workunit.client.0.smithi138.stdout:0/439: rename d6/d10/d18/c62 to d6/c9b 0 2024-02-15T22:50:54.830 INFO:tasks.workunit.client.0.smithi138.stdout:2/436: creat d0/da/f9c x:0 0 0 2024-02-15T22:50:54.840 INFO:tasks.workunit.client.0.smithi138.stdout:0/440: fdatasync d6/d10/d13/f45 0 2024-02-15T22:50:54.841 INFO:tasks.workunit.client.0.smithi138.stdout:3/470: dwrite d5/d12/d23/d29/d4f/f92 [0,4194304] 0 2024-02-15T22:50:54.841 INFO:tasks.workunit.client.0.smithi138.stdout:3/471: fdatasync d5/d12/d26/f2d 0 2024-02-15T22:50:54.841 INFO:tasks.workunit.client.0.smithi138.stdout:3/472: readlink d5/l34 0 2024-02-15T22:50:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:3/473: getdents d5/d16/dc/d43/d47 0 2024-02-15T22:50:54.843 INFO:tasks.workunit.client.0.smithi138.stdout:3/474: fsync d5/d12/d26/d2e/f81 0 2024-02-15T22:50:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/475: rename d5/d16/d4d/f8e to d5/d12/d26/d2e/f97 0 2024-02-15T22:50:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/476: dread - d5/d12/f79 zero size 2024-02-15T22:50:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/477: chown d5/d12/d23 3206757 1 2024-02-15T22:50:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/478: stat d5/d12/d26/d2e/f81 0 2024-02-15T22:50:54.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/479: chown d5/d18/d35 28 1 2024-02-15T22:50:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:3/480: symlink d5/d16/dc/d43/l98 0 2024-02-15T22:50:54.845 INFO:tasks.workunit.client.0.smithi138.stdout:2/437: dwrite d0/f87 [0,4194304] 0 2024-02-15T22:50:54.846 INFO:tasks.workunit.client.0.smithi138.stdout:3/481: creat d5/d12/d26/f99 x:0 0 0 2024-02-15T22:50:54.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.845+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb14108780 con 0x7fbafc06cf10 2024-02-15T22:50:54.849 INFO:tasks.workunit.client.0.smithi138.stdout:2/438: mkdir d0/dd/d9d 0 2024-02-15T22:50:54.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.848+0000 7fbafbfff700 1 -- 172.21.15.138:0/2134008814 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fbb14108780 con 0x7fbafc06cf10 2024-02-15T22:50:54.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 msgr2=0x7fbafc06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:54.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 0x7fbafc06f3c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb08005d90 tx=0x7fbb08005d00 comp rx=0 tx=0).stop 2024-02-15T22:50:54.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 msgr2=0x7fbb14197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:54.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400bd70 tx=0x7fbb0400be50 comp rx=0 tx=0).stop 2024-02-15T22:50:54.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 shutdown_connections 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fbafc06cf10 0x7fbafc06f3c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb140fea30 0x7fbb14197b10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 --2- 172.21.15.138:0/2134008814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140ff380 0x7fbb14198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 >> 172.21.15.138:0/2134008814 conn(0x7fbb140fa5e0 msgr2=0x7fbb14107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 shutdown_connections 2024-02-15T22:50:54.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:54.853+0000 7fbb19586700 1 -- 172.21.15.138:0/2134008814 wait complete. 2024-02-15T22:50:54.857 INFO:tasks.workunit.client.0.smithi138.stdout:3/482: dread d5/d12/d26/f5c [0,4194304] 0 2024-02-15T22:50:54.857 INFO:tasks.workunit.client.0.smithi138.stdout:3/483: readlink d5/d16/dc/d43/l98 0 2024-02-15T22:50:54.857 INFO:tasks.workunit.client.0.smithi138.stdout:3/484: chown d5/d16/c4e 144231052 1 2024-02-15T22:50:54.857 INFO:tasks.workunit.client.0.smithi138.stdout:3/485: creat d5/d18/f9a x:0 0 0 2024-02-15T22:50:54.858 INFO:tasks.workunit.client.0.smithi138.stdout:0/441: dwrite d6/d10/d52/d6f/f7d [0,4194304] 0 2024-02-15T22:50:54.858 INFO:tasks.workunit.client.0.smithi138.stdout:3/486: rmdir d5/d84 0 2024-02-15T22:50:54.861 INFO:tasks.workunit.client.0.smithi138.stdout:2/439: dread d0/da/d19/d53/f68 [0,4194304] 0 2024-02-15T22:50:54.862 INFO:tasks.workunit.client.0.smithi138.stdout:0/442: dread d6/d10/d13/f45 [0,4194304] 0 2024-02-15T22:50:54.862 INFO:tasks.workunit.client.0.smithi138.stdout:0/443: write d6/f6d [808787,122189] 0 2024-02-15T22:50:54.864 INFO:tasks.workunit.client.0.smithi138.stdout:3/487: symlink d5/d12/d23/d29/l9b 0 2024-02-15T22:50:54.865 INFO:tasks.workunit.client.0.smithi138.stdout:0/444: mknod d6/d10/d52/d72/c9c 0 2024-02-15T22:50:54.869 INFO:tasks.workunit.client.0.smithi138.stdout:9/375: sync 2024-02-15T22:50:54.871 INFO:tasks.workunit.client.0.smithi138.stdout:9/376: mknod d0/df/d11/d23/d6a/c81 0 2024-02-15T22:50:54.871 INFO:tasks.workunit.client.0.smithi138.stdout:3/488: dread d5/d16/f77 [0,4194304] 0 2024-02-15T22:50:54.872 INFO:tasks.workunit.client.0.smithi138.stdout:9/377: mknod d0/df/d11/d23/d71/d7b/c82 0 2024-02-15T22:50:54.879 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:50:54.886 INFO:tasks.workunit.client.0.smithi138.stdout:0/445: dwrite d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:50:54.886 INFO:tasks.workunit.client.0.smithi138.stdout:0/446: chown d6/d10/d52/d6f/d85 3095 1 2024-02-15T22:50:54.886 INFO:tasks.workunit.client.0.smithi138.stdout:3/489: write d5/d12/d23/d29/d4f/f53 [3480292,9527] 0 2024-02-15T22:50:54.887 INFO:tasks.workunit.client.0.smithi138.stdout:0/447: symlink d6/d10/d18/d57/d8d/l9d 0 2024-02-15T22:50:54.889 INFO:tasks.workunit.client.0.smithi138.stdout:3/490: rename d5/d12/d23/f50 to d5/d12/d23/d94/f9c 0 2024-02-15T22:50:54.890 INFO:tasks.workunit.client.0.smithi138.stdout:0/448: unlink d6/d10/d18/d57/d8d/f94 0 2024-02-15T22:50:54.898 INFO:tasks.workunit.client.0.smithi138.stdout:3/491: write d5/d16/dc/d43/d47/f75 [2439736,46046] 0 2024-02-15T22:50:54.902 INFO:tasks.workunit.client.0.smithi138.stdout:9/378: dwrite d0/de/d34/f75 [0,4194304] 0 2024-02-15T22:50:54.902 INFO:tasks.workunit.client.0.smithi138.stdout:9/379: fsync d0/df/d11/f60 0 2024-02-15T22:50:54.907 INFO:tasks.workunit.client.0.smithi138.stdout:2/440: dwrite d0/da/d19/f81 [0,4194304] 0 2024-02-15T22:50:54.907 INFO:tasks.workunit.client.0.smithi138.stdout:0/449: dwrite d6/d10/d34/f5a [0,4194304] 0 2024-02-15T22:50:54.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/380: write d0/d4/fd [369370,46367] 0 2024-02-15T22:50:54.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/381: chown d0/de/d33/f77 74506535 1 2024-02-15T22:50:54.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/382: stat d0/de/d14/d22 0 2024-02-15T22:50:54.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/383: readlink d0/de/d14/l21 0 2024-02-15T22:50:54.920 INFO:tasks.workunit.client.0.smithi138.stdout:9/384: dread d0/d4/f5 [4194304,4194304] 0 2024-02-15T22:50:54.920 INFO:tasks.workunit.client.0.smithi138.stdout:9/385: readlink d0/de/d33/l79 0 2024-02-15T22:50:54.922 INFO:tasks.workunit.client.0.smithi138.stdout:3/492: dwrite d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:54.923 INFO:tasks.workunit.client.0.smithi138.stdout:0/450: dread f4 [0,4194304] 0 2024-02-15T22:50:54.925 INFO:tasks.workunit.client.0.smithi138.stdout:3/493: mknod d5/d12/d23/d29/c9d 0 2024-02-15T22:50:54.925 INFO:tasks.workunit.client.0.smithi138.stdout:3/494: write d5/d16/dc/d43/d47/f75 [234334,89681] 0 2024-02-15T22:50:54.926 INFO:tasks.workunit.client.0.smithi138.stdout:3/495: mknod d5/d12/d26/d2e/c9e 0 2024-02-15T22:50:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:0/451: rmdir d6/d10/d52/d6f 39 2024-02-15T22:50:54.929 INFO:tasks.workunit.client.0.smithi138.stdout:3/496: mknod d5/d18/d35/c9f 0 2024-02-15T22:50:54.930 INFO:tasks.workunit.client.0.smithi138.stdout:2/441: dwrite d0/da/d19/d53/f68 [0,4194304] 0 2024-02-15T22:50:54.932 INFO:tasks.workunit.client.0.smithi138.stdout:3/497: mknod d5/d16/dc/d43/d47/ca0 0 2024-02-15T22:50:54.934 INFO:tasks.workunit.client.0.smithi138.stdout:9/386: dread d0/d2e/f6e [0,4194304] 0 2024-02-15T22:50:54.941 INFO:tasks.workunit.client.0.smithi138.stdout:3/498: mkdir d5/d12/d23/da1 0 2024-02-15T22:50:54.941 INFO:tasks.workunit.client.0.smithi138.stdout:3/499: fsync d5/d12/d26/d2e/f97 0 2024-02-15T22:50:54.942 INFO:tasks.workunit.client.0.smithi138.stdout:2/442: rmdir d0/da/d19/d53/d5d/d6d/d97 39 2024-02-15T22:50:54.942 INFO:tasks.workunit.client.0.smithi138.stdout:2/443: read - d0/da/d19/d53/f8e zero size 2024-02-15T22:50:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:3/500: mkdir d5/d16/dc/d43/da2 0 2024-02-15T22:50:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:3/501: creat d5/d16/dc/d43/d47/d67/fa3 x:0 0 0 2024-02-15T22:50:54.946 INFO:tasks.workunit.client.0.smithi138.stdout:2/444: link d0/da/f8 d0/da/f9e 0 2024-02-15T22:50:54.946 INFO:tasks.workunit.client.0.smithi138.stdout:2/445: readlink d0/dd/d15/l1c 0 2024-02-15T22:50:54.946 INFO:tasks.workunit.client.0.smithi138.stdout:2/446: chown d0/f87 12 1 2024-02-15T22:50:54.946 INFO:tasks.workunit.client.0.smithi138.stdout:0/452: dwrite d6/f24 [0,4194304] 0 2024-02-15T22:50:54.948 INFO:tasks.workunit.client.0.smithi138.stdout:3/502: symlink d5/d16/dc/d43/d57/d5d/la4 0 2024-02-15T22:50:54.948 INFO:tasks.workunit.client.0.smithi138.stdout:9/387: dwrite d0/de/d14/f30 [0,4194304] 0 2024-02-15T22:50:54.949 INFO:tasks.workunit.client.0.smithi138.stdout:2/447: truncate d0/f37 2983508 0 2024-02-15T22:50:54.950 INFO:tasks.workunit.client.0.smithi138.stdout:9/388: mknod d0/de/c83 0 2024-02-15T22:50:54.951 INFO:tasks.workunit.client.0.smithi138.stdout:5/289: sync 2024-02-15T22:50:54.951 INFO:tasks.workunit.client.0.smithi138.stdout:8/330: sync 2024-02-15T22:50:54.952 INFO:tasks.workunit.client.0.smithi138.stdout:2/448: creat d0/da/d19/d53/f9f x:0 0 0 2024-02-15T22:50:54.953 INFO:tasks.workunit.client.0.smithi138.stdout:3/503: symlink d5/la5 0 2024-02-15T22:50:54.954 INFO:tasks.workunit.client.0.smithi138.stdout:5/290: unlink df/d18/c1b 0 2024-02-15T22:50:54.956 INFO:tasks.workunit.client.0.smithi138.stdout:3/504: mkdir d5/d12/d26/da6 0 2024-02-15T22:50:54.956 INFO:tasks.workunit.client.0.smithi138.stdout:3/505: read - d5/d12/d23/d29/d4f/f70 zero size 2024-02-15T22:50:54.959 INFO:tasks.workunit.client.0.smithi138.stdout:9/389: dread d0/de/d33/f7f [0,4194304] 0 2024-02-15T22:50:54.961 INFO:tasks.workunit.client.0.smithi138.stdout:8/331: getdents db/dd 0 2024-02-15T22:50:54.963 INFO:tasks.workunit.client.0.smithi138.stdout:2/449: write d0/da/d19/d53/d5d/d74/f5b [1096074,42578] 0 2024-02-15T22:50:54.964 INFO:tasks.workunit.client.0.smithi138.stdout:3/506: dread d5/d16/fa [0,4194304] 0 2024-02-15T22:50:54.966 INFO:tasks.workunit.client.0.smithi138.stdout:0/453: dwrite d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:54.966 INFO:tasks.workunit.client.0.smithi138.stdout:2/450: mkdir d0/da/d19/d53/d5d/d6d/d97/da0 0 2024-02-15T22:50:54.966 INFO:tasks.workunit.client.0.smithi138.stdout:5/291: dread df/f2e [0,4194304] 0 2024-02-15T22:50:54.967 INFO:tasks.workunit.client.0.smithi138.stdout:5/292: write df/d18/f20 [4672193,99871] 0 2024-02-15T22:50:54.967 INFO:tasks.workunit.client.0.smithi138.stdout:3/507: creat d5/d12/d23/d29/d5a/fa7 x:0 0 0 2024-02-15T22:50:54.967 INFO:tasks.workunit.client.0.smithi138.stdout:3/508: chown d5/d16/dc/d43/l98 22843290 1 2024-02-15T22:50:54.969 INFO:tasks.workunit.client.0.smithi138.stdout:0/454: mkdir d6/d10/d52/d72/d9e 0 2024-02-15T22:50:54.972 INFO:tasks.workunit.client.0.smithi138.stdout:8/332: write f0 [3134210,18419] 0 2024-02-15T22:50:54.973 INFO:tasks.workunit.client.0.smithi138.stdout:2/451: creat d0/da/d95/fa1 x:0 0 0 2024-02-15T22:50:54.974 INFO:tasks.workunit.client.0.smithi138.stdout:0/455: dread d6/fb [0,4194304] 0 2024-02-15T22:50:54.974 INFO:tasks.workunit.client.0.smithi138.stdout:9/390: write d0/de/f47 [3726249,3089] 0 2024-02-15T22:50:54.974 INFO:tasks.workunit.client.0.smithi138.stdout:5/293: symlink df/d18/d2b/l58 0 2024-02-15T22:50:54.976 INFO:tasks.workunit.client.0.smithi138.stdout:3/509: symlink d5/d12/d23/d29/d5a/la8 0 2024-02-15T22:50:54.976 INFO:tasks.workunit.client.0.smithi138.stdout:3/510: fsync d5/d12/d23/d29/d4f/f92 0 2024-02-15T22:50:54.976 INFO:tasks.workunit.client.0.smithi138.stdout:3/511: creat d5/d12/d26/d2e/fa9 x:0 0 0 2024-02-15T22:50:54.976 INFO:tasks.workunit.client.0.smithi138.stdout:2/452: unlink d0/da/l24 0 2024-02-15T22:50:54.977 INFO:tasks.workunit.client.0.smithi138.stdout:0/456: mknod d6/c9f 0 2024-02-15T22:50:54.978 INFO:tasks.workunit.client.0.smithi138.stdout:9/391: symlink d0/df/d11/d23/d71/l84 0 2024-02-15T22:50:54.979 INFO:tasks.workunit.client.0.smithi138.stdout:5/294: chown df/f3a 334506 1 2024-02-15T22:50:54.982 INFO:tasks.workunit.client.0.smithi138.stdout:3/512: truncate d5/d12/d26/d2e/f81 2757820 0 2024-02-15T22:50:54.982 INFO:tasks.workunit.client.0.smithi138.stdout:3/513: truncate d5/d12/d23/d29/d4f/f70 333929 0 2024-02-15T22:50:54.982 INFO:tasks.workunit.client.0.smithi138.stdout:3/514: write d5/d16/dc/d43/d47/d67/f87 [4223038,18722] 0 2024-02-15T22:50:54.985 INFO:tasks.workunit.client.0.smithi138.stdout:2/453: rename d0/da/c5a to d0/dd/ca2 0 2024-02-15T22:50:54.985 INFO:tasks.workunit.client.0.smithi138.stdout:2/454: write d0/da/d95/fa1 [122363,130900] 0 2024-02-15T22:50:54.986 INFO:tasks.workunit.client.0.smithi138.stdout:0/457: mknod d6/d10/ca0 0 2024-02-15T22:50:54.989 INFO:tasks.workunit.client.0.smithi138.stdout:9/392: creat d0/de/d33/f85 x:0 0 0 2024-02-15T22:50:54.991 INFO:tasks.workunit.client.0.smithi138.stdout:3/515: truncate d5/d16/dc/d43/d47/f75 425781 0 2024-02-15T22:50:54.991 INFO:tasks.workunit.client.0.smithi138.stdout:3/516: chown d5/d16/dc/d43/d47/l74 30132305 1 2024-02-15T22:50:54.991 INFO:tasks.workunit.client.0.smithi138.stdout:3/517: stat d5/d18/d35/c9f 0 2024-02-15T22:50:54.992 INFO:tasks.workunit.client.0.smithi138.stdout:8/333: dwrite db/d15/d70/f46 [0,4194304] 0 2024-02-15T22:50:54.992 INFO:tasks.workunit.client.0.smithi138.stdout:2/455: truncate d0/d3/f44 6005405 0 2024-02-15T22:50:54.992 INFO:tasks.workunit.client.0.smithi138.stdout:0/458: truncate d6/d10/d13/f69 641858 0 2024-02-15T22:50:54.994 INFO:tasks.workunit.client.0.smithi138.stdout:9/393: rename d0/d1/f4c to d0/df/d11/d23/d71/f86 0 2024-02-15T22:50:54.996 INFO:tasks.workunit.client.0.smithi138.stdout:3/518: rmdir d5/d16/dc/d43/d47 39 2024-02-15T22:50:54.996 INFO:tasks.workunit.client.0.smithi138.stdout:3/519: getdents d5/d16/dc/d43/da2 0 2024-02-15T22:50:54.997 INFO:tasks.workunit.client.0.smithi138.stdout:2/456: mkdir d0/da/d19/d53/d5d/d6d/d7b/da3 0 2024-02-15T22:50:55.001 INFO:tasks.workunit.client.0.smithi138.stdout:8/334: rename f5 to db/dd/d13/f72 0 2024-02-15T22:50:55.002 INFO:tasks.workunit.client.0.smithi138.stdout:5/295: dwrite df/d18/f20 [0,4194304] 0 2024-02-15T22:50:55.002 INFO:tasks.workunit.client.0.smithi138.stdout:9/394: creat d0/d55/d59/f87 x:0 0 0 2024-02-15T22:50:55.003 INFO:tasks.workunit.client.0.smithi138.stdout:3/520: unlink d5/d12/d26/f2d 0 2024-02-15T22:50:55.004 INFO:tasks.workunit.client.0.smithi138.stdout:0/459: symlink d6/d10/d40/la1 0 2024-02-15T22:50:55.005 INFO:tasks.workunit.client.0.smithi138.stdout:2/457: rename d0/d3/f70 to d0/da/d19/d53/fa4 0 2024-02-15T22:50:55.007 INFO:tasks.workunit.client.0.smithi138.stdout:9/395: creat d0/de/d14/f88 x:0 0 0 2024-02-15T22:50:55.008 INFO:tasks.workunit.client.0.smithi138.stdout:9/396: chown d0/df/d11/d23/d6a/c6b 358378316 1 2024-02-15T22:50:55.010 INFO:tasks.workunit.client.0.smithi138.stdout:2/458: creat d0/da/d19/d53/d5d/d74/d79/fa5 x:0 0 0 2024-02-15T22:50:55.011 INFO:tasks.workunit.client.0.smithi138.stdout:5/296: rename df/d18/c21 to df/c59 0 2024-02-15T22:50:55.025 INFO:tasks.workunit.client.0.smithi138.stdout:1/307: sync 2024-02-15T22:50:55.025 INFO:tasks.workunit.client.0.smithi138.stdout:6/388: sync 2024-02-15T22:50:55.025 INFO:tasks.workunit.client.0.smithi138.stdout:4/613: sync 2024-02-15T22:50:55.026 INFO:tasks.workunit.client.0.smithi138.stdout:7/608: sync 2024-02-15T22:50:55.026 INFO:tasks.workunit.client.0.smithi138.stdout:2/459: rename d0/f93 to d0/fa6 0 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 -- 172.21.15.138:0/2033552724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1990101330 msgr2=0x7f19901037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 --2- 172.21.15.138:0/2033552724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1990101330 0x7f19901037b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1984009910 tx=0x7f1984009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 -- 172.21.15.138:0/2033552724 shutdown_connections 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 --2- 172.21.15.138:0/2033552724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1990101330 0x7f19901037b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 --2- 172.21.15.138:0/2033552724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19900fe9d0 0x7f1990100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 -- 172.21.15.138:0/2033552724 >> 172.21.15.138:0/2033552724 conn(0x7f19900fa600 msgr2=0x7f19900fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:55.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 -- 172.21.15.138:0/2033552724 shutdown_connections 2024-02-15T22:50:55.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.026+0000 7f1995af0700 1 -- 172.21.15.138:0/2033552724 wait complete. 2024-02-15T22:50:55.029 INFO:tasks.workunit.client.0.smithi138.stdout:3/521: rename d5/d12/d23/d29/d5a/c60 to d5/d12/caa 0 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 Processor -- start 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 -- start start 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1990101330 0x7f199019c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199019caf0 con 0x7f19900fe9d0 2024-02-15T22:50:55.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.027+0000 7f1995af0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199019cc30 con 0x7f1990101330 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35640/0 (socket says 172.21.15.138:35640) 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 -- 172.21.15.138:0/360993659 learned_addr learned my addr 172.21.15.138:0/360993659 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 -- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1990101330 msgr2=0x7f199019c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1990101330 0x7f199019c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.028+0000 7f198f7fe700 1 -- 172.21.15.138:0/360993659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840095f0 con 0x7f19900fe9d0 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f198f7fe700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f198800ba50 tx=0x7f198800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:55.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198800ca00 con 0x7f19900fe9d0 2024-02-15T22:50:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1990105190 con 0x7f19900fe9d0 2024-02-15T22:50:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1990105760 con 0x7f19900fe9d0 2024-02-15T22:50:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f198800cb60 con 0x7f19900fe9d0 2024-02-15T22:50:55.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.029+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1988007580 con 0x7f19900fe9d0 2024-02-15T22:50:55.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.031+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c005320 con 0x7f19900fe9d0 2024-02-15T22:50:55.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:54 smithi138 ceph-mon[29229]: pgmap v10: 65 pgs: 65 active+clean; 504 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 43 MiB/s rd, 58 MiB/s wr, 879 op/s 2024-02-15T22:50:55.034 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:54 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:55.034 INFO:tasks.workunit.client.0.smithi138.stdout:5/297: link f9 df/d18/d56/f5a 0 2024-02-15T22:50:55.034 INFO:tasks.workunit.client.0.smithi138.stdout:1/308: truncate df/f12 1390483 0 2024-02-15T22:50:55.034 INFO:tasks.workunit.client.0.smithi138.stdout:6/389: creat dc/d24/d34/d3b/d7c/f83 x:0 0 0 2024-02-15T22:50:55.035 INFO:tasks.workunit.client.0.smithi138.stdout:6/390: creat dc/d76/f84 x:0 0 0 2024-02-15T22:50:55.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.031+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f198800ccd0 con 0x7f19900fe9d0 2024-02-15T22:50:55.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.032+0000 7f198cff9700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 0x7f197806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.032+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1988006e40 con 0x7f19900fe9d0 2024-02-15T22:50:55.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.036+0000 7f198effd700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 0x7f197806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:55.042 INFO:tasks.workunit.client.0.smithi138.stdout:3/522: truncate d5/d16/f77 95588 0 2024-02-15T22:50:55.042 INFO:tasks.workunit.client.0.smithi138.stdout:0/460: rename d6/d10/d40/l48 to d6/d10/d52/d72/la2 0 2024-02-15T22:50:55.042 INFO:tasks.workunit.client.0.smithi138.stdout:0/461: stat d6/d10/d52/d6f/d85 0 2024-02-15T22:50:55.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.039+0000 7f198effd700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 0x7f197806f410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5c0 tx=0x7f1984005fd0 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:55.043 INFO:tasks.workunit.client.0.smithi138.stdout:0/462: write d6/d10/d64/f88 [757972,51186] 0 2024-02-15T22:50:55.046 INFO:tasks.workunit.client.0.smithi138.stdout:1/309: unlink df/d1b/d1d/l68 0 2024-02-15T22:50:55.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.045+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f198804fa50 con 0x7f19900fe9d0 2024-02-15T22:50:55.052 INFO:tasks.workunit.client.0.smithi138.stdout:0/463: write d6/d10/d18/f32 [857572,2920] 0 2024-02-15T22:50:55.054 INFO:tasks.workunit.client.0.smithi138.stdout:1/310: link fa df/d1b/d1d/d25/d2e/d5b/f6d 0 2024-02-15T22:50:55.056 INFO:tasks.workunit.client.0.smithi138.stdout:0/464: creat d6/d10/d18/fa3 x:0 0 0 2024-02-15T22:50:55.058 INFO:tasks.workunit.client.0.smithi138.stdout:1/311: creat df/d1b/d1d/d25/d2c/d3f/f6e x:0 0 0 2024-02-15T22:50:55.064 INFO:tasks.workunit.client.0.smithi138.stdout:6/391: dwrite dc/f46 [0,4194304] 0 2024-02-15T22:50:55.064 INFO:tasks.workunit.client.0.smithi138.stdout:7/609: dwrite d1/d5a/d97/f7f [0,4194304] 0 2024-02-15T22:50:55.064 INFO:tasks.workunit.client.0.smithi138.stdout:7/610: fdatasync d1/f6b 0 2024-02-15T22:50:55.065 INFO:tasks.workunit.client.0.smithi138.stdout:4/614: dwrite d17/d2b/f9e [0,4194304] 0 2024-02-15T22:50:55.065 INFO:tasks.workunit.client.0.smithi138.stdout:4/615: write d17/d1e/d2d/d36/d3e/d64/fb5 [899484,80183] 0 2024-02-15T22:50:55.066 INFO:tasks.workunit.client.0.smithi138.stdout:8/335: link db/dd/d13/f72 db/dd/d22/f73 0 2024-02-15T22:50:55.066 INFO:tasks.workunit.client.0.smithi138.stdout:3/523: dwrite d5/f61 [0,4194304] 0 2024-02-15T22:50:55.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/336: symlink db/d15/d70/l74 0 2024-02-15T22:50:55.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/337: chown db/dd/d22 6996305 1 2024-02-15T22:50:55.072 INFO:tasks.workunit.client.0.smithi138.stdout:1/312: dread df/d1b/d1d/d25/f42 [0,4194304] 0 2024-02-15T22:50:55.072 INFO:tasks.workunit.client.0.smithi138.stdout:1/313: fsync df/d1b/d1d/f35 0 2024-02-15T22:50:55.075 INFO:tasks.workunit.client.0.smithi138.stdout:6/392: write dc/f1e [3902160,12664] 0 2024-02-15T22:50:55.076 INFO:tasks.workunit.client.0.smithi138.stdout:3/524: getdents d5/d16/d4d 0 2024-02-15T22:50:55.078 INFO:tasks.workunit.client.0.smithi138.stdout:7/611: rmdir d1/d28/d7c 39 2024-02-15T22:50:55.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/465: dwrite d6/d10/d34/f35 [0,4194304] 0 2024-02-15T22:50:55.080 INFO:tasks.workunit.client.0.smithi138.stdout:6/393: unlink la 0 2024-02-15T22:50:55.083 INFO:tasks.workunit.client.0.smithi138.stdout:3/525: unlink d5/d16/dc/f6f 0 2024-02-15T22:50:55.085 INFO:tasks.workunit.client.0.smithi138.stdout:4/616: dread d17/d1a/f9b [0,4194304] 0 2024-02-15T22:50:55.085 INFO:tasks.workunit.client.0.smithi138.stdout:4/617: truncate d17/d1e/d2d/d52/f74 4985686 0 2024-02-15T22:50:55.085 INFO:tasks.workunit.client.0.smithi138.stdout:7/612: mknod d1/d2/db/d3c/d4d/d63/cd1 0 2024-02-15T22:50:55.085 INFO:tasks.workunit.client.0.smithi138.stdout:7/613: fsync d1/d2/db/f1c 0 2024-02-15T22:50:55.086 INFO:tasks.workunit.client.0.smithi138.stdout:8/338: write db/d15/f17 [1251394,87519] 0 2024-02-15T22:50:55.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/526: mknod d5/d95/cab 0 2024-02-15T22:50:55.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/527: creat d5/d16/dc/d43/fac x:0 0 0 2024-02-15T22:50:55.091 INFO:tasks.workunit.client.0.smithi138.stdout:4/618: read d17/f90 [77784,2258] 0 2024-02-15T22:50:55.091 INFO:tasks.workunit.client.0.smithi138.stdout:4/619: truncate d17/d1e/d56/fc5 723664 0 2024-02-15T22:50:55.095 INFO:tasks.workunit.client.0.smithi138.stdout:8/339: mkdir db/dd/d75 0 2024-02-15T22:50:55.095 INFO:tasks.workunit.client.0.smithi138.stdout:8/340: fsync db/dd/d13/f64 0 2024-02-15T22:50:55.099 INFO:tasks.workunit.client.0.smithi138.stdout:3/528: dread d5/d12/d23/f51 [0,4194304] 0 2024-02-15T22:50:55.099 INFO:tasks.workunit.client.0.smithi138.stdout:3/529: chown d5/d12/d23/d29/l3f 303274335 1 2024-02-15T22:50:55.099 INFO:tasks.workunit.client.0.smithi138.stdout:3/530: fsync d5/d16/dc/d43/d47/d67/fa3 0 2024-02-15T22:50:55.100 INFO:tasks.workunit.client.0.smithi138.stdout:2/460: rename d0/f3b to d0/da/d19/d53/d5d/d74/fa7 0 2024-02-15T22:50:55.101 INFO:tasks.workunit.client.0.smithi138.stdout:1/314: dwrite df/d1b/d1d/d25/f61 [0,4194304] 0 2024-02-15T22:50:55.103 INFO:tasks.workunit.client.0.smithi138.stdout:4/620: unlink d17/d1e/d2d/l46 0 2024-02-15T22:50:55.106 INFO:tasks.workunit.client.0.smithi138.stdout:7/614: link d1/d2/db/d25/d41/lae d1/d79/d84/d64/ld2 0 2024-02-15T22:50:55.106 INFO:tasks.workunit.client.0.smithi138.stdout:7/615: truncate d1/d5a/d97/fcb 1031462 0 2024-02-15T22:50:55.107 INFO:tasks.workunit.client.0.smithi138.stdout:6/394: dwrite dc/d24/f56 [0,4194304] 0 2024-02-15T22:50:55.107 INFO:tasks.workunit.client.0.smithi138.stdout:6/395: stat dc/f2a 0 2024-02-15T22:50:55.112 INFO:tasks.workunit.client.0.smithi138.stdout:5/298: rename f9 to df/d18/d56/f5b 0 2024-02-15T22:50:55.113 INFO:tasks.workunit.client.0.smithi138.stdout:5/299: write df/d18/d56/f5a [4309269,10673] 0 2024-02-15T22:50:55.114 INFO:tasks.workunit.client.0.smithi138.stdout:2/461: creat d0/da/d19/d3f/fa8 x:0 0 0 2024-02-15T22:50:55.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:54 smithi170 ceph-mon[35248]: pgmap v10: 65 pgs: 65 active+clean; 504 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 43 MiB/s rd, 58 MiB/s wr, 879 op/s 2024-02-15T22:50:55.116 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:54 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:50:55.116 INFO:tasks.workunit.client.0.smithi138.stdout:1/315: getdents df/d1b/d33 0 2024-02-15T22:50:55.117 INFO:tasks.workunit.client.0.smithi138.stdout:2/462: dread d0/da/d19/d3f/f4a [0,4194304] 0 2024-02-15T22:50:55.119 INFO:tasks.workunit.client.0.smithi138.stdout:4/621: link d17/d2b/c7f d17/d1a/ccf 0 2024-02-15T22:50:55.123 INFO:tasks.workunit.client.0.smithi138.stdout:3/531: dread d5/d16/f77 [0,4194304] 0 2024-02-15T22:50:55.125 INFO:tasks.workunit.client.0.smithi138.stdout:6/396: unlink dc/d4b/f70 0 2024-02-15T22:50:55.127 INFO:tasks.workunit.client.0.smithi138.stdout:8/341: rename db/dd/d22/f2f to db/dd/d13/d19/f76 0 2024-02-15T22:50:55.127 INFO:tasks.workunit.client.0.smithi138.stdout:8/342: chown db/d15/d70/f5b 0 1 2024-02-15T22:50:55.129 INFO:tasks.workunit.client.0.smithi138.stdout:2/463: mknod d0/da/d19/d53/d5d/d6d/ca9 0 2024-02-15T22:50:55.130 INFO:tasks.workunit.client.0.smithi138.stdout:4/622: mknod d17/d2b/d78/cd0 0 2024-02-15T22:50:55.131 INFO:tasks.workunit.client.0.smithi138.stdout:3/532: creat d5/d12/d23/d29/fad x:0 0 0 2024-02-15T22:50:55.133 INFO:tasks.workunit.client.0.smithi138.stdout:7/616: rename d1/l9b to d1/d2/ld3 0 2024-02-15T22:50:55.134 INFO:tasks.workunit.client.0.smithi138.stdout:8/343: mkdir db/dd/d13/d77 0 2024-02-15T22:50:55.135 INFO:tasks.workunit.client.0.smithi138.stdout:8/344: chown db/f29 2 1 2024-02-15T22:50:55.135 INFO:tasks.workunit.client.0.smithi138.stdout:8/345: stat db/dd/d4d/f5a 0 2024-02-15T22:50:55.135 INFO:tasks.workunit.client.0.smithi138.stdout:8/346: write db/dd/d13/d19/d24/f2c [649190,69367] 0 2024-02-15T22:50:55.135 INFO:tasks.workunit.client.0.smithi138.stdout:8/347: write db/dd/d13/d19/d24/f6e [497083,114491] 0 2024-02-15T22:50:55.136 INFO:tasks.workunit.client.0.smithi138.stdout:3/533: link d5/d12/d23/d29/fad d5/d12/d23/d94/fae 0 2024-02-15T22:50:55.139 INFO:tasks.workunit.client.0.smithi138.stdout:4/623: rename d17/d1e/d2d/d36/d3e/d64/f65 to d17/d1a/fd1 0 2024-02-15T22:50:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:4/624: rename d17/d1e/d2d/d36 to d17/d1e/d2d/d36/d3e/daf/dd2 22 2024-02-15T22:50:55.140 INFO:tasks.workunit.client.0.smithi138.stdout:4/625: truncate d17/d1a/fa1 71327 0 2024-02-15T22:50:55.145 INFO:tasks.workunit.client.0.smithi138.stdout:3/534: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:55.146 INFO:tasks.workunit.client.0.smithi138.stdout:2/464: dread d0/da/d19/d53/f7f [0,4194304] 0 2024-02-15T22:50:55.146 INFO:tasks.workunit.client.0.smithi138.stdout:1/316: dwrite df/d1b/d1d/d60/f66 [0,4194304] 0 2024-02-15T22:50:55.146 INFO:tasks.workunit.client.0.smithi138.stdout:1/317: write df/d1b/d1d/f20 [160515,24855] 0 2024-02-15T22:50:55.146 INFO:tasks.workunit.client.0.smithi138.stdout:5/300: dwrite df/d18/d56/f5a [4194304,4194304] 0 2024-02-15T22:50:55.149 INFO:tasks.workunit.client.0.smithi138.stdout:2/465: mknod d0/da/d19/d53/d5d/d83/d8a/caa 0 2024-02-15T22:50:55.150 INFO:tasks.workunit.client.0.smithi138.stdout:8/348: dwrite db/d15/d70/f5b [0,4194304] 0 2024-02-15T22:50:55.150 INFO:tasks.workunit.client.0.smithi138.stdout:8/349: write db/dd/d13/d19/d24/f57 [219316,99403] 0 2024-02-15T22:50:55.151 INFO:tasks.workunit.client.0.smithi138.stdout:1/318: link df/d1b/d1d/d25/d2e/d37/f4b df/d1b/d1d/d60/f6f 0 2024-02-15T22:50:55.152 INFO:tasks.workunit.client.0.smithi138.stdout:8/350: read db/f29 [155433,33334] 0 2024-02-15T22:50:55.163 INFO:tasks.workunit.client.0.smithi138.stdout:4/626: dwrite d17/d1e/d2d/d36/d3e/d64/fa5 [0,4194304] 0 2024-02-15T22:50:55.164 INFO:tasks.workunit.client.0.smithi138.stdout:3/535: dwrite d5/d12/d23/f51 [4194304,4194304] 0 2024-02-15T22:50:55.164 INFO:tasks.workunit.client.0.smithi138.stdout:3/536: dread - d5/d16/dc/d43/fac zero size 2024-02-15T22:50:55.164 INFO:tasks.workunit.client.0.smithi138.stdout:3/537: stat d5/d16/d4d/l7a 0 2024-02-15T22:50:55.164 INFO:tasks.workunit.client.0.smithi138.stdout:3/538: creat d5/d16/dc/d43/d47/d67/faf x:0 0 0 2024-02-15T22:50:55.164 INFO:tasks.workunit.client.0.smithi138.stdout:3/539: stat d5/d12/d26/d2e/c9e 0 2024-02-15T22:50:55.165 INFO:tasks.workunit.client.0.smithi138.stdout:3/540: fsync d5/d12/d26/d2e/f5b 0 2024-02-15T22:50:55.192 INFO:tasks.workunit.client.0.smithi138.stdout:2/466: truncate d0/dd/d15/f8c 1142320 0 2024-02-15T22:50:55.193 INFO:tasks.workunit.client.0.smithi138.stdout:1/319: creat df/d1b/d1d/d24/d3a/f70 x:0 0 0 2024-02-15T22:50:55.197 INFO:tasks.workunit.client.0.smithi138.stdout:8/351: symlink db/dd/d22/l78 0 2024-02-15T22:50:55.197 INFO:tasks.workunit.client.0.smithi138.stdout:8/352: write db/dd/d13/d19/f49 [953224,43927] 0 2024-02-15T22:50:55.197 INFO:tasks.workunit.client.0.smithi138.stdout:8/353: creat db/dd/d13/f79 x:0 0 0 2024-02-15T22:50:55.204 INFO:tasks.workunit.client.0.smithi138.stdout:4/627: truncate d17/d1e/d2d/d52/f72 4193586 0 2024-02-15T22:50:55.205 INFO:tasks.workunit.client.0.smithi138.stdout:4/628: write d17/d2b/f77 [552251,92917] 0 2024-02-15T22:50:55.206 INFO:tasks.workunit.client.0.smithi138.stdout:5/301: getdents df/d18/d56 0 2024-02-15T22:50:55.206 INFO:tasks.workunit.client.0.smithi138.stdout:5/302: creat df/d18/d3e/d51/f5c x:0 0 0 2024-02-15T22:50:55.209 INFO:tasks.workunit.client.0.smithi138.stdout:3/541: rename d5/d12/d26/f99 to d5/d12/d23/da1/fb0 0 2024-02-15T22:50:55.215 INFO:tasks.workunit.client.0.smithi138.stdout:5/303: creat df/d18/d56/f5d x:0 0 0 2024-02-15T22:50:55.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/542: creat d5/d16/dc/fb1 x:0 0 0 2024-02-15T22:50:55.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/543: write d5/d12/d26/d2e/f5b [5135002,123186] 0 2024-02-15T22:50:55.220 INFO:tasks.workunit.client.0.smithi138.stdout:5/304: mknod df/d18/d56/c5e 0 2024-02-15T22:50:55.223 INFO:tasks.workunit.client.0.smithi138.stdout:1/320: dwrite df/f53 [0,4194304] 0 2024-02-15T22:50:55.223 INFO:tasks.workunit.client.0.smithi138.stdout:1/321: creat df/d1b/d1d/d24/d3a/f71 x:0 0 0 2024-02-15T22:50:55.224 INFO:tasks.workunit.client.0.smithi138.stdout:8/354: dwrite db/dd/d13/f21 [4194304,4194304] 0 2024-02-15T22:50:55.224 INFO:tasks.workunit.client.0.smithi138.stdout:8/355: write db/f29 [2216250,8539] 0 2024-02-15T22:50:55.224 INFO:tasks.workunit.client.0.smithi138.stdout:8/356: write db/dd/f67 [440574,70411] 0 2024-02-15T22:50:55.225 INFO:tasks.workunit.client.0.smithi138.stdout:8/357: fsync db/dd/d22/f73 0 2024-02-15T22:50:55.225 INFO:tasks.workunit.client.0.smithi138.stdout:4/629: dwrite d17/d1e/d2d/f2e [4194304,4194304] 0 2024-02-15T22:50:55.230 INFO:tasks.workunit.client.0.smithi138.stdout:1/322: mknod df/c72 0 2024-02-15T22:50:55.231 INFO:tasks.workunit.client.0.smithi138.stdout:8/358: dread f0 [0,4194304] 0 2024-02-15T22:50:55.234 INFO:tasks.workunit.client.0.smithi138.stdout:4/630: creat d17/d1e/d2d/d36/d3e/d64/fd3 x:0 0 0 2024-02-15T22:50:55.235 INFO:tasks.workunit.client.0.smithi138.stdout:1/323: symlink df/d1b/d1d/d25/d2c/l73 0 2024-02-15T22:50:55.237 INFO:tasks.workunit.client.0.smithi138.stdout:8/359: creat db/d15/d70/f7a x:0 0 0 2024-02-15T22:50:55.237 INFO:tasks.workunit.client.0.smithi138.stdout:8/360: read - db/dd/d13/d19/f43 zero size 2024-02-15T22:50:55.237 INFO:tasks.workunit.client.0.smithi138.stdout:4/631: readlink d17/l5a 0 2024-02-15T22:50:55.239 INFO:tasks.workunit.client.0.smithi138.stdout:1/324: link df/d1b/d21/d4f/l6b df/d1b/d21/d4f/l74 0 2024-02-15T22:50:55.239 INFO:tasks.workunit.client.0.smithi138.stdout:1/325: fdatasync df/d1b/d1d/d24/f38 0 2024-02-15T22:50:55.241 INFO:tasks.workunit.client.0.smithi138.stdout:8/361: symlink db/d15/d70/l7b 0 2024-02-15T22:50:55.241 INFO:tasks.workunit.client.0.smithi138.stdout:5/305: dwrite fd [0,4194304] 0 2024-02-15T22:50:55.241 INFO:tasks.workunit.client.0.smithi138.stdout:5/306: read - df/d18/d2b/f4b zero size 2024-02-15T22:50:55.242 INFO:tasks.workunit.client.0.smithi138.stdout:4/632: symlink d17/d2b/ld4 0 2024-02-15T22:50:55.242 INFO:tasks.workunit.client.0.smithi138.stdout:3/544: dwrite d5/d16/dc/d43/d47/d67/f6b [0,4194304] 0 2024-02-15T22:50:55.243 INFO:tasks.workunit.client.0.smithi138.stdout:5/307: mknod df/d18/c5f 0 2024-02-15T22:50:55.246 INFO:tasks.workunit.client.0.smithi138.stdout:3/545: symlink d5/d12/d23/d29/d5a/lb2 0 2024-02-15T22:50:55.247 INFO:tasks.workunit.client.0.smithi138.stdout:1/326: dread df/d1b/d1d/d25/d2e/d37/f3e [0,4194304] 0 2024-02-15T22:50:55.247 INFO:tasks.workunit.client.0.smithi138.stdout:1/327: write df/d41/f49 [577806,53156] 0 2024-02-15T22:50:55.247 INFO:tasks.workunit.client.0.smithi138.stdout:1/328: truncate df/d1b/f3d 1118579 0 2024-02-15T22:50:55.248 INFO:tasks.workunit.client.0.smithi138.stdout:5/308: mkdir df/d18/d3e/d60 0 2024-02-15T22:50:55.248 INFO:tasks.workunit.client.0.smithi138.stdout:5/309: dread - df/d18/d2b/f47 zero size 2024-02-15T22:50:55.248 INFO:tasks.workunit.client.0.smithi138.stdout:4/633: getdents d17/d1e/d56 0 2024-02-15T22:50:55.251 INFO:tasks.workunit.client.0.smithi138.stdout:3/546: creat d5/d16/dc/d43/da2/fb3 x:0 0 0 2024-02-15T22:50:55.251 INFO:tasks.workunit.client.0.smithi138.stdout:8/362: write db/dd/d13/d19/d24/f4a [2431463,95882] 0 2024-02-15T22:50:55.252 INFO:tasks.workunit.client.0.smithi138.stdout:1/329: creat df/d1b/d33/f75 x:0 0 0 2024-02-15T22:50:55.254 INFO:tasks.workunit.client.0.smithi138.stdout:4/634: getdents d17/d1e/d2d/d36/d3e/daf 0 2024-02-15T22:50:55.259 INFO:tasks.workunit.client.0.smithi138.stdout:3/547: write d5/d12/d23/f4c [4193867,29413] 0 2024-02-15T22:50:55.259 INFO:tasks.workunit.client.0.smithi138.stdout:1/330: rename df/d1b/d1d/f2a to df/d1b/d1d/d25/d2e/d6c/f76 0 2024-02-15T22:50:55.259 INFO:tasks.workunit.client.0.smithi138.stdout:3/548: write d5/d12/d26/f5c [2390127,24025] 0 2024-02-15T22:50:55.261 INFO:tasks.workunit.client.0.smithi138.stdout:5/310: unlink df/f15 0 2024-02-15T22:50:55.261 INFO:tasks.workunit.client.0.smithi138.stdout:5/311: write df/f37 [2107783,94447] 0 2024-02-15T22:50:55.263 INFO:tasks.workunit.client.0.smithi138.stdout:4/635: mkdir d17/d1e/d2d/dd5 0 2024-02-15T22:50:55.263 INFO:tasks.workunit.client.0.smithi138.stdout:5/312: fsync df/f37 0 2024-02-15T22:50:55.263 INFO:tasks.workunit.client.0.smithi138.stdout:5/313: truncate df/f16 379333 0 2024-02-15T22:50:55.264 INFO:tasks.workunit.client.0.smithi138.stdout:8/363: rmdir db/dd/d13/d19/d24 39 2024-02-15T22:50:55.264 INFO:tasks.workunit.client.0.smithi138.stdout:8/364: chown db/dd/d13/d19/f49 22536357 1 2024-02-15T22:50:55.264 INFO:tasks.workunit.client.0.smithi138.stdout:8/365: chown db/d15/d70/f46 655 1 2024-02-15T22:50:55.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/331: link f8 df/d1b/d1d/d24/d3a/f77 0 2024-02-15T22:50:55.271 INFO:tasks.workunit.client.0.smithi138.stdout:5/314: link df/d18/c57 df/d18/c61 0 2024-02-15T22:50:55.272 INFO:tasks.workunit.client.0.smithi138.stdout:8/366: mkdir db/d15/d70/d7c 0 2024-02-15T22:50:55.274 INFO:tasks.workunit.client.0.smithi138.stdout:1/332: mknod df/d1b/d1d/c78 0 2024-02-15T22:50:55.276 INFO:tasks.workunit.client.0.smithi138.stdout:5/315: symlink df/d18/d3e/d60/l62 0 2024-02-15T22:50:55.277 INFO:tasks.workunit.client.0.smithi138.stdout:1/333: dread df/d1b/d1d/d25/d2e/d37/f4b [0,4194304] 0 2024-02-15T22:50:55.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/316: mkdir df/d18/d2b/d63 0 2024-02-15T22:50:55.282 INFO:tasks.workunit.client.0.smithi138.stdout:5/317: unlink df/l35 0 2024-02-15T22:50:55.282 INFO:tasks.workunit.client.0.smithi138.stdout:5/318: write fc [5048744,112950] 0 2024-02-15T22:50:55.284 INFO:tasks.workunit.client.0.smithi138.stdout:5/319: creat df/d18/d3e/d60/f64 x:0 0 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/636: dwrite d17/d1a/f9b [0,4194304] 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:3/549: dwrite d5/d12/d23/d29/fad [0,4194304] 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:3/550: chown d5/d16/dc/d43/d47/d67 31336 1 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/637: fsync d17/d1e/d2d/d36/d3e/d64/f76 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/638: fsync d17/d1e/f4b 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/639: write d17/d1a/f50 [4241970,49842] 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:4/640: getdents d17/d2b/d78/dc0/dc4 0 2024-02-15T22:50:55.294 INFO:tasks.workunit.client.0.smithi138.stdout:8/367: dwrite db/f10 [4194304,4194304] 0 2024-02-15T22:50:55.296 INFO:tasks.workunit.client.0.smithi138.stdout:3/551: dread d5/d16/d4d/f85 [0,4194304] 0 2024-02-15T22:50:55.298 INFO:tasks.workunit.client.0.smithi138.stdout:8/368: mkdir db/dd/d13/d19/d7d 0 2024-02-15T22:50:55.300 INFO:tasks.workunit.client.0.smithi138.stdout:5/320: dwrite df/d18/f4a [0,4194304] 0 2024-02-15T22:50:55.300 INFO:tasks.workunit.client.0.smithi138.stdout:8/369: dread db/dd/f67 [0,4194304] 0 2024-02-15T22:50:55.305 INFO:tasks.workunit.client.0.smithi138.stdout:3/552: dread d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:55.305 INFO:tasks.workunit.client.0.smithi138.stdout:3/553: chown d5/d12/d23/d29/d4a 172 1 2024-02-15T22:50:55.310 INFO:tasks.workunit.client.0.smithi138.stdout:4/641: write d17/f6a [391446,78658] 0 2024-02-15T22:50:55.320 INFO:tasks.workunit.client.0.smithi138.stdout:5/321: mkdir df/d18/d3e/d60/d65 0 2024-02-15T22:50:55.321 INFO:tasks.workunit.client.0.smithi138.stdout:8/370: unlink db/dd/c1b 0 2024-02-15T22:50:55.322 INFO:tasks.workunit.client.0.smithi138.stdout:8/371: write db/dd/d13/d19/f49 [1256152,86131] 0 2024-02-15T22:50:55.322 INFO:tasks.workunit.client.0.smithi138.stdout:8/372: mkdir db/dd/d13/d77/d7e 0 2024-02-15T22:50:55.327 INFO:tasks.workunit.client.0.smithi138.stdout:5/322: dread df/f44 [0,4194304] 0 2024-02-15T22:50:55.327 INFO:tasks.workunit.client.0.smithi138.stdout:3/554: dwrite d5/d16/dc/d43/d47/d67/f8d [0,4194304] 0 2024-02-15T22:50:55.327 INFO:tasks.workunit.client.0.smithi138.stdout:4/642: dwrite d17/d1e/f28 [0,4194304] 0 2024-02-15T22:50:55.328 INFO:tasks.workunit.client.0.smithi138.stdout:5/323: mkdir df/d18/d3e/d66 0 2024-02-15T22:50:55.328 INFO:tasks.workunit.client.0.smithi138.stdout:5/324: fsync df/d18/f29 0 2024-02-15T22:50:55.331 INFO:tasks.workunit.client.0.smithi138.stdout:5/325: getdents df/d18 0 2024-02-15T22:50:55.332 INFO:tasks.workunit.client.0.smithi138.stdout:5/326: creat df/d18/d3e/d60/d65/f67 x:0 0 0 2024-02-15T22:50:55.332 INFO:tasks.workunit.client.0.smithi138.stdout:5/327: fdatasync df/d18/d2b/f3b 0 2024-02-15T22:50:55.333 INFO:tasks.workunit.client.0.smithi138.stdout:5/328: chown df/d18/d56/f5b 16366 1 2024-02-15T22:50:55.334 INFO:tasks.workunit.client.0.smithi138.stdout:5/329: truncate df/f13 1334373 0 2024-02-15T22:50:55.334 INFO:tasks.workunit.client.0.smithi138.stdout:5/330: stat df/f3a 0 2024-02-15T22:50:55.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/331: fdatasync df/f3a 0 2024-02-15T22:50:55.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/332: fdatasync df/d18/f4a 0 2024-02-15T22:50:55.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/333: chown df/d18/f29 0 1 2024-02-15T22:50:55.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/334: link df/d18/l45 df/d18/d3e/d66/l68 0 2024-02-15T22:50:55.337 INFO:tasks.workunit.client.0.smithi138.stdout:3/555: dread d5/d12/d26/d2e/f81 [0,4194304] 0 2024-02-15T22:50:55.337 INFO:tasks.workunit.client.0.smithi138.stdout:5/335: rmdir df/d18/d2b/d63 0 2024-02-15T22:50:55.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/556: creat d5/fb4 x:0 0 0 2024-02-15T22:50:55.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/557: creat d5/d18/fb5 x:0 0 0 2024-02-15T22:50:55.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/558: creat d5/d12/d23/d29/d5a/fb6 x:0 0 0 2024-02-15T22:50:55.344 INFO:tasks.workunit.client.0.smithi138.stdout:8/373: dwrite db/dd/f1d [0,4194304] 0 2024-02-15T22:50:55.346 INFO:tasks.workunit.client.0.smithi138.stdout:4/643: dwrite d17/d1e/f3f [0,4194304] 0 2024-02-15T22:50:55.351 INFO:tasks.workunit.client.0.smithi138.stdout:4/644: truncate d17/d1e/f22 2144201 0 2024-02-15T22:50:55.353 INFO:tasks.workunit.client.0.smithi138.stdout:4/645: truncate d17/d1e/d2d/d52/f72 2906550 0 2024-02-15T22:50:55.354 INFO:tasks.workunit.client.0.smithi138.stdout:8/374: dread db/d15/d70/f5b [0,4194304] 0 2024-02-15T22:50:55.356 INFO:tasks.workunit.client.0.smithi138.stdout:8/375: truncate db/dd/d13/f4c 847577 0 2024-02-15T22:50:55.360 INFO:tasks.workunit.client.0.smithi138.stdout:4/646: write d17/d1e/d2d/d52/f72 [719146,110675] 0 2024-02-15T22:50:55.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/376: dread db/dd/d13/d19/d24/f2c [0,4194304] 0 2024-02-15T22:50:55.363 INFO:tasks.workunit.client.0.smithi138.stdout:4/647: creat d17/d1e/d2d/d36/fd6 x:0 0 0 2024-02-15T22:50:55.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/377: read db/dd/d13/d19/d24/f6e [30224,39123] 0 2024-02-15T22:50:55.364 INFO:tasks.workunit.client.0.smithi138.stdout:4/648: getdents d17/d2b/d78 0 2024-02-15T22:50:55.364 INFO:tasks.workunit.client.0.smithi138.stdout:4/649: chown d17/d2b/fba 612 1 2024-02-15T22:50:55.366 INFO:tasks.workunit.client.0.smithi138.stdout:4/650: creat d17/d1e/db8/fd7 x:0 0 0 2024-02-15T22:50:55.375 INFO:tasks.workunit.client.0.smithi138.stdout:8/378: write db/d15/d70/f46 [3895921,77884] 0 2024-02-15T22:50:55.375 INFO:tasks.workunit.client.0.smithi138.stdout:3/559: dwrite d5/d16/dc/f1a [0,4194304] 0 2024-02-15T22:50:55.375 INFO:tasks.workunit.client.0.smithi138.stdout:3/560: stat d5/d12/d23/d29/d4f 0 2024-02-15T22:50:55.375 INFO:tasks.workunit.client.0.smithi138.stdout:3/561: fdatasync d5/fb4 0 2024-02-15T22:50:55.386 INFO:tasks.workunit.client.0.smithi138.stdout:3/562: write d5/d12/d23/d29/fad [521004,129253] 0 2024-02-15T22:50:55.386 INFO:tasks.workunit.client.0.smithi138.stdout:3/563: creat d5/d18/d35/fb7 x:0 0 0 2024-02-15T22:50:55.386 INFO:tasks.workunit.client.0.smithi138.stdout:3/564: dread - d5/d12/d23/d29/d4f/f89 zero size 2024-02-15T22:50:55.386 INFO:tasks.workunit.client.0.smithi138.stdout:3/565: readlink d5/d12/d23/d29/d5a/lb2 0 2024-02-15T22:50:55.390 INFO:tasks.workunit.client.0.smithi138.stdout:4/651: dwrite d17/d1a/fd1 [0,4194304] 0 2024-02-15T22:50:55.391 INFO:tasks.workunit.client.0.smithi138.stdout:4/652: stat d17/d1e/d56/fc5 0 2024-02-15T22:50:55.396 INFO:tasks.workunit.client.0.smithi138.stdout:3/566: dread d5/d12/d26/d2e/f5b [0,4194304] 0 2024-02-15T22:50:55.396 INFO:tasks.workunit.client.0.smithi138.stdout:8/379: dwrite db/f29 [0,4194304] 0 2024-02-15T22:50:55.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.404+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f197c000bf0 con 0x7f197806cf60 2024-02-15T22:50:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.406+0000 7f198cff9700 1 -- 172.21.15.138:0/360993659 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f197c000bf0 con 0x7f197806cf60 2024-02-15T22:50:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 msgr2=0x7f197806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 0x7f197806f410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f198400b5c0 tx=0x7f1984005fd0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 msgr2=0x7f199019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f198800ba50 tx=0x7f198800be10 comp rx=0 tx=0).stop 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 shutdown_connections 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f197806cf60 0x7f197806f410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19900fe9d0 0x7f199019bf90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 --2- 172.21.15.138:0/360993659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1990101330 0x7f199019c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 >> 172.21.15.138:0/360993659 conn(0x7f19900fa600 msgr2=0x7f19900fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 shutdown_connections 2024-02-15T22:50:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.408+0000 7f1995af0700 1 -- 172.21.15.138:0/360993659 wait complete. 2024-02-15T22:50:55.415 INFO:tasks.workunit.client.0.smithi138.stdout:8/380: dwrite f3 [4194304,4194304] 0 2024-02-15T22:50:55.415 INFO:tasks.workunit.client.0.smithi138.stdout:8/381: dread - db/dd/d22/f3f zero size 2024-02-15T22:50:55.460 INFO:tasks.workunit.client.0.smithi138.stdout:4/653: unlink d17/l35 0 2024-02-15T22:50:55.461 INFO:tasks.workunit.client.0.smithi138.stdout:8/382: rmdir db/dd 39 2024-02-15T22:50:55.462 INFO:tasks.workunit.client.0.smithi138.stdout:4/654: mkdir d17/d2b/dd8 0 2024-02-15T22:50:55.463 INFO:tasks.workunit.client.0.smithi138.stdout:4/655: creat d17/d1e/fd9 x:0 0 0 2024-02-15T22:50:55.464 INFO:tasks.workunit.client.0.smithi138.stdout:3/567: rename d5/d12/d23/d29/d4a to d5/d16/dc/db8 0 2024-02-15T22:50:55.465 INFO:tasks.workunit.client.0.smithi138.stdout:4/656: symlink d17/d1a/lda 0 2024-02-15T22:50:55.465 INFO:tasks.workunit.client.0.smithi138.stdout:4/657: fdatasync d17/d1e/d2d/d36/f96 0 2024-02-15T22:50:55.467 INFO:tasks.workunit.client.0.smithi138.stdout:3/568: getdents d5/d16/dc/d43/d47/d67 0 2024-02-15T22:50:55.467 INFO:tasks.workunit.client.0.smithi138.stdout:3/569: chown d5/d12/d26/d2f/f7b 23785 1 2024-02-15T22:50:55.467 INFO:tasks.workunit.client.0.smithi138.stdout:4/658: dread d17/d1e/d2d/f61 [0,4194304] 0 2024-02-15T22:50:55.468 INFO:tasks.workunit.client.0.smithi138.stdout:4/659: symlink d17/d1a/ldb 0 2024-02-15T22:50:55.470 INFO:tasks.workunit.client.0.smithi138.stdout:8/383: dread f3 [0,4194304] 0 2024-02-15T22:50:55.472 INFO:tasks.workunit.client.0.smithi138.stdout:8/384: creat db/dd/d22/f7f x:0 0 0 2024-02-15T22:50:55.477 INFO:tasks.workunit.client.0.smithi138.stdout:8/385: dread db/f1a [0,4194304] 0 2024-02-15T22:50:55.478 INFO:tasks.workunit.client.0.smithi138.stdout:8/386: getdents db/dd/d13/d19 0 2024-02-15T22:50:55.480 INFO:tasks.workunit.client.0.smithi138.stdout:8/387: unlink db/fc 0 2024-02-15T22:50:55.480 INFO:tasks.workunit.client.0.smithi138.stdout:8/388: chown db/dd/d13/d19/l3a 426886951 1 2024-02-15T22:50:55.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/389: mkdir db/dd/d4d/d80 0 2024-02-15T22:50:55.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/390: write db/d15/f17 [492151,61326] 0 2024-02-15T22:50:55.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/391: fdatasync db/dd/f14 0 2024-02-15T22:50:55.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/392: chown f3 3 1 2024-02-15T22:50:55.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/393: dread - db/d15/d70/f61 zero size 2024-02-15T22:50:55.484 INFO:tasks.workunit.client.0.smithi138.stdout:3/570: dwrite d5/d16/f10 [4194304,4194304] 0 2024-02-15T22:50:55.484 INFO:tasks.workunit.client.0.smithi138.stdout:4/660: dread d17/d1e/f3f [0,4194304] 0 2024-02-15T22:50:55.485 INFO:tasks.workunit.client.0.smithi138.stdout:8/394: creat db/dd/d13/d19/f81 x:0 0 0 2024-02-15T22:50:55.486 INFO:tasks.workunit.client.0.smithi138.stdout:4/661: symlink d17/d1e/d2d/d36/d3e/ldc 0 2024-02-15T22:50:55.486 INFO:tasks.workunit.client.0.smithi138.stdout:4/662: creat d17/d1e/db8/fdd x:0 0 0 2024-02-15T22:50:55.491 INFO:tasks.workunit.client.0.smithi138.stdout:8/395: mknod db/d15/d70/d7c/c82 0 2024-02-15T22:50:55.493 INFO:tasks.workunit.client.0.smithi138.stdout:4/663: unlink d17/d1e/d2d/d36/f4a 0 2024-02-15T22:50:55.495 INFO:tasks.workunit.client.0.smithi138.stdout:4/664: link d17/d2b/f80 d17/d1e/d2d/dd5/fde 0 2024-02-15T22:50:55.497 INFO:tasks.workunit.client.0.smithi138.stdout:4/665: rmdir d17/d1e/d2d/d36/d3e 39 2024-02-15T22:50:55.506 INFO:tasks.workunit.client.0.smithi138.stdout:3/571: dwrite d5/d12/d23/d29/d4f/f70 [0,4194304] 0 2024-02-15T22:50:55.509 INFO:tasks.workunit.client.0.smithi138.stdout:3/572: symlink d5/d12/d26/da6/lb9 0 2024-02-15T22:50:55.509 INFO:tasks.workunit.client.0.smithi138.stdout:3/573: stat d5/d18 0 2024-02-15T22:50:55.510 INFO:tasks.workunit.client.0.smithi138.stdout:3/574: creat d5/d12/d26/d2e/fba x:0 0 0 2024-02-15T22:50:55.510 INFO:tasks.workunit.client.0.smithi138.stdout:3/575: chown d5/d12/d26/d2f/l55 266495010 1 2024-02-15T22:50:55.518 INFO:tasks.workunit.client.0.smithi138.stdout:4/666: dwrite d17/d1e/d2d/d36/d3e/f88 [0,4194304] 0 2024-02-15T22:50:55.530 INFO:tasks.workunit.client.0.smithi138.stdout:9/397: sync 2024-02-15T22:50:55.530 INFO:tasks.workunit.client.0.smithi138.stdout:3/576: dwrite d5/d18/d35/fb7 [0,4194304] 0 2024-02-15T22:50:55.531 INFO:tasks.workunit.client.0.smithi138.stdout:8/396: dwrite db/dd/d13/d19/d24/f2c [0,4194304] 0 2024-02-15T22:50:55.531 INFO:tasks.workunit.client.0.smithi138.stdout:8/397: chown db/dd/d13/d19/d24/f57 10 1 2024-02-15T22:50:55.531 INFO:tasks.workunit.client.0.smithi138.stdout:8/398: creat db/dd/d13/d19/f83 x:0 0 0 2024-02-15T22:50:55.532 INFO:tasks.workunit.client.0.smithi138.stdout:3/577: creat d5/d12/d23/d29/d4f/fbb x:0 0 0 2024-02-15T22:50:55.534 INFO:tasks.workunit.client.0.smithi138.stdout:8/399: rename db/dd/d22/c35 to db/d15/c84 0 2024-02-15T22:50:55.539 INFO:tasks.workunit.client.0.smithi138.stdout:9/398: dread d0/de/d14/f66 [0,4194304] 0 2024-02-15T22:50:55.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.539+0000 7fa72a7fc700 1 -- 172.21.15.138:0/2112508189 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140054b0 con 0x7fa72c100250 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 -- 172.21.15.138:0/2112508189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 msgr2=0x7fa72c1006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 --2- 172.21.15.138:0/2112508189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c1006a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa714009910 tx=0x7fa714009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 -- 172.21.15.138:0/2112508189 shutdown_connections 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 --2- 172.21.15.138:0/2112508189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c1006a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 --2- 172.21.15.138:0/2112508189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c0ff050 0x7fa72c0ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 -- 172.21.15.138:0/2112508189 >> 172.21.15.138:0/2112508189 conn(0x7fa72c0fa600 msgr2=0x7fa72c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:55.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 -- 172.21.15.138:0/2112508189 shutdown_connections 2024-02-15T22:50:55.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.540+0000 7fa7312dd700 1 -- 172.21.15.138:0/2112508189 wait complete. 2024-02-15T22:50:55.543 INFO:tasks.workunit.client.0.smithi138.stdout:9/399: rename d0/de/d14/d63 to d0/de/d34/d89 0 2024-02-15T22:50:55.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.541+0000 7fa7312dd700 1 Processor -- start 2024-02-15T22:50:55.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.541+0000 7fa7312dd700 1 -- start start 2024-02-15T22:50:55.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.541+0000 7fa7312dd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c0ff050 0x7fa72c197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.541+0000 7fa7312dd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.544 INFO:tasks.workunit.client.0.smithi138.stdout:3/578: dread d5/d16/dc/d43/d47/d67/f71 [0,4194304] 0 2024-02-15T22:50:55.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa7312dd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c198790 con 0x7fa72c100250 2024-02-15T22:50:55.545 INFO:tasks.workunit.client.0.smithi138.stdout:3/579: read - d5/d18/f9a zero size 2024-02-15T22:50:55.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa7312dd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c19d1a0 con 0x7fa72c0ff050 2024-02-15T22:50:55.545 INFO:tasks.workunit.client.0.smithi138.stdout:3/580: stat d5/d12/d26/d2e/c9e 0 2024-02-15T22:50:55.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:55.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35654/0 (socket says 172.21.15.138:35654) 2024-02-15T22:50:55.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 -- 172.21.15.138:0/3268846317 learned_addr learned my addr 172.21.15.138:0/3268846317 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:55.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 -- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c0ff050 msgr2=0x7fa72c197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c0ff050 0x7fa72c197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 -- 172.21.15.138:0/3268846317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140095f0 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.542+0000 7fa723fff700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa71400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.543+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71401d070 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.543+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c19d340 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.543+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa71400f460 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.543+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa714021640 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.543+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c19d880 con 0x7fa72c100250 2024-02-15T22:50:55.547 INFO:tasks.workunit.client.0.smithi138.stdout:3/581: symlink d5/d18/lbc 0 2024-02-15T22:50:55.547 INFO:tasks.workunit.client.0.smithi138.stdout:3/582: write d5/d12/d23/d29/d4f/f53 [1859235,62082] 0 2024-02-15T22:50:55.547 INFO:tasks.workunit.client.0.smithi138.stdout:3/583: chown d5/d16/dc/d43/d47/d67 10 1 2024-02-15T22:50:55.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.544+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c106d40 con 0x7fa72c100250 2024-02-15T22:50:55.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.545+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fa71402b440 con 0x7fa72c100250 2024-02-15T22:50:55.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.545+0000 7fa728ff9700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 0x7fa71806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:55.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.545+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa71408da70 con 0x7fa72c100250 2024-02-15T22:50:55.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.545+0000 7fa72affd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 0x7fa71806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:55.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.547+0000 7fa72affd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 0x7fa71806f3a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa72c199110 tx=0x7fa71c006d20 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:55.551 INFO:tasks.workunit.client.0.smithi138.stdout:9/400: dread d0/d55/f5e [4194304,4194304] 0 2024-02-15T22:50:55.551 INFO:tasks.workunit.client.0.smithi138.stdout:3/584: dread d5/d12/f1d [0,4194304] 0 2024-02-15T22:50:55.554 INFO:tasks.workunit.client.0.smithi138.stdout:9/401: link d0/de/d34/f75 d0/de/d33/f8a 0 2024-02-15T22:50:55.554 INFO:tasks.workunit.client.0.smithi138.stdout:9/402: readlink d0/df/l65 0 2024-02-15T22:50:55.554 INFO:tasks.workunit.client.0.smithi138.stdout:9/403: chown d0/d4/c28 304854495 1 2024-02-15T22:50:55.554 INFO:tasks.workunit.client.0.smithi138.stdout:9/404: write d0/d4/fd [1080930,31838] 0 2024-02-15T22:50:55.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.552+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fa714057850 con 0x7fa72c100250 2024-02-15T22:50:55.555 INFO:tasks.workunit.client.0.smithi138.stdout:9/405: symlink d0/df/d11/d23/d71/d7b/l8b 0 2024-02-15T22:50:55.555 INFO:tasks.workunit.client.0.smithi138.stdout:8/400: dwrite db/dd/d22/f7f [0,4194304] 0 2024-02-15T22:50:55.557 INFO:tasks.workunit.client.0.smithi138.stdout:9/406: rename d0/de/d33/d57/f5a to d0/df/d11/d23/d71/d7b/f8c 0 2024-02-15T22:50:55.557 INFO:tasks.workunit.client.0.smithi138.stdout:9/407: fsync d0/de/d34/f3e 0 2024-02-15T22:50:55.561 INFO:tasks.workunit.client.0.smithi138.stdout:9/408: unlink d0/df/d11/d23/d6a/c81 0 2024-02-15T22:50:55.561 INFO:tasks.workunit.client.0.smithi138.stdout:9/409: readlink d0/d1/l26 0 2024-02-15T22:50:55.561 INFO:tasks.workunit.client.0.smithi138.stdout:9/410: chown d0/df/d11/d23/c46 1212336 1 2024-02-15T22:50:55.565 INFO:tasks.workunit.client.0.smithi138.stdout:9/411: write d0/de/d14/f30 [1771191,37995] 0 2024-02-15T22:50:55.565 INFO:tasks.workunit.client.0.smithi138.stdout:9/412: write d0/de/d33/f7f [4271237,10056] 0 2024-02-15T22:50:55.565 INFO:tasks.workunit.client.0.smithi138.stdout:9/413: readlink d0/de/l5c 0 2024-02-15T22:50:55.565 INFO:tasks.workunit.client.0.smithi138.stdout:9/414: fsync d0/de/d14/d18/f49 0 2024-02-15T22:50:55.567 INFO:tasks.workunit.client.0.smithi138.stdout:9/415: symlink d0/d4/l8d 0 2024-02-15T22:50:55.567 INFO:tasks.workunit.client.0.smithi138.stdout:9/416: fsync d0/d2e/f6e 0 2024-02-15T22:50:55.567 INFO:tasks.workunit.client.0.smithi138.stdout:9/417: fdatasync d0/d55/d59/f87 0 2024-02-15T22:50:55.567 INFO:tasks.workunit.client.0.smithi138.stdout:9/418: rename d0/df/c15 to d0/df/c8e 0 2024-02-15T22:50:55.568 INFO:tasks.workunit.client.0.smithi138.stdout:9/419: link d0/df/d11/f32 d0/d2e/f8f 0 2024-02-15T22:50:55.569 INFO:tasks.workunit.client.0.smithi138.stdout:9/420: mkdir d0/de/d34/d89/d90 0 2024-02-15T22:50:55.573 INFO:tasks.workunit.client.0.smithi138.stdout:3/585: dwrite d5/d16/dc/d43/f86 [0,4194304] 0 2024-02-15T22:50:55.573 INFO:tasks.workunit.client.0.smithi138.stdout:3/586: chown d5/d12/d23/d29/l9b 72408368 1 2024-02-15T22:50:55.573 INFO:tasks.workunit.client.0.smithi138.stdout:3/587: dread - d5/d16/dc/d43/d47/d67/faf zero size 2024-02-15T22:50:55.573 INFO:tasks.workunit.client.0.smithi138.stdout:3/588: chown d5/d16/dc/f1a 97250 1 2024-02-15T22:50:55.574 INFO:tasks.workunit.client.0.smithi138.stdout:8/401: dwrite db/dd/d13/f31 [0,4194304] 0 2024-02-15T22:50:55.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/589: symlink d5/d16/d4d/lbd 0 2024-02-15T22:50:55.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/590: dread - d5/d16/dc/fb1 zero size 2024-02-15T22:50:55.576 INFO:tasks.workunit.client.0.smithi138.stdout:3/591: creat d5/d18/fbe x:0 0 0 2024-02-15T22:50:55.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/402: creat db/dd/d13/d19/d7d/f85 x:0 0 0 2024-02-15T22:50:55.583 INFO:tasks.workunit.client.0.smithi138.stdout:9/421: dwrite d0/df/d11/d23/f42 [0,4194304] 0 2024-02-15T22:50:55.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/422: dwrite d0/de/d33/f7f [0,4194304] 0 2024-02-15T22:50:55.601 INFO:tasks.workunit.client.0.smithi138.stdout:8/403: dwrite db/dd/f47 [0,4194304] 0 2024-02-15T22:50:55.613 INFO:tasks.workunit.client.0.smithi138.stdout:9/423: dwrite d0/df/d11/d23/d71/d7b/f8c [0,4194304] 0 2024-02-15T22:50:55.617 INFO:tasks.workunit.client.0.smithi138.stdout:9/424: dread d0/d55/f61 [0,4194304] 0 2024-02-15T22:50:55.618 INFO:tasks.workunit.client.0.smithi138.stdout:8/404: dread db/dd/d22/f7f [0,4194304] 0 2024-02-15T22:50:55.621 INFO:tasks.workunit.client.0.smithi138.stdout:8/405: rmdir db/dd/d4d/d80 0 2024-02-15T22:50:55.621 INFO:tasks.workunit.client.0.smithi138.stdout:8/406: mknod db/c86 0 2024-02-15T22:50:55.640 INFO:tasks.workunit.client.0.smithi138.stdout:8/407: dwrite db/dd/d13/d19/d24/f4a [0,4194304] 0 2024-02-15T22:50:55.640 INFO:tasks.workunit.client.0.smithi138.stdout:9/425: dwrite d0/df/d11/f32 [4194304,4194304] 0 2024-02-15T22:50:55.641 INFO:tasks.workunit.client.0.smithi138.stdout:8/408: dread - db/dd/d13/f64 zero size 2024-02-15T22:50:55.642 INFO:tasks.workunit.client.0.smithi138.stdout:8/409: rmdir db/dd/d13/d19/d24 39 2024-02-15T22:50:55.644 INFO:tasks.workunit.client.0.smithi138.stdout:9/426: truncate d0/df/d11/d23/d71/d7b/f8c 1541687 0 2024-02-15T22:50:55.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/410: unlink db/dd/f6c 0 2024-02-15T22:50:55.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/411: fsync db/dd/f14 0 2024-02-15T22:50:55.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/412: stat db/dd/c2d 0 2024-02-15T22:50:55.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/413: readlink db/d15/l65 0 2024-02-15T22:50:55.648 INFO:tasks.workunit.client.0.smithi138.stdout:9/427: rename d0/de/l5c to d0/d55/d59/l91 0 2024-02-15T22:50:55.649 INFO:tasks.workunit.client.0.smithi138.stdout:8/414: symlink db/dd/d13/d19/d7d/l87 0 2024-02-15T22:50:55.651 INFO:tasks.workunit.client.0.smithi138.stdout:9/428: truncate d0/f1d 5006554 0 2024-02-15T22:50:55.651 INFO:tasks.workunit.client.0.smithi138.stdout:8/415: chown db/d15/f36 11469333 1 2024-02-15T22:50:55.651 INFO:tasks.workunit.client.0.smithi138.stdout:8/416: fdatasync db/dd/d13/d19/f76 0 2024-02-15T22:50:55.652 INFO:tasks.workunit.client.0.smithi138.stdout:8/417: fsync db/dd/d13/d19/f43 0 2024-02-15T22:50:55.652 INFO:tasks.workunit.client.0.smithi138.stdout:9/429: symlink d0/df/d11/d23/d6a/l92 0 2024-02-15T22:50:55.653 INFO:tasks.workunit.client.0.smithi138.stdout:9/430: truncate d0/de/f47 1969291 0 2024-02-15T22:50:55.669 INFO:tasks.workunit.client.0.smithi138.stdout:9/431: dwrite d0/d4/f80 [0,4194304] 0 2024-02-15T22:50:55.671 INFO:tasks.workunit.client.0.smithi138.stdout:9/432: creat d0/df/f93 x:0 0 0 2024-02-15T22:50:55.671 INFO:tasks.workunit.client.0.smithi138.stdout:9/433: readlink d0/de/d14/l72 0 2024-02-15T22:50:55.682 INFO:tasks.workunit.client.0.smithi138.stdout:9/434: dwrite d0/de/d33/f36 [0,4194304] 0 2024-02-15T22:50:55.682 INFO:tasks.workunit.client.0.smithi138.stdout:9/435: write d0/de/d14/d18/f49 [4150525,53932] 0 2024-02-15T22:50:55.682 INFO:tasks.workunit.client.0.smithi138.stdout:0/466: sync 2024-02-15T22:50:55.684 INFO:tasks.workunit.client.0.smithi138.stdout:0/467: getdents d6/d10/d34 0 2024-02-15T22:50:55.684 INFO:tasks.workunit.client.0.smithi138.stdout:0/468: write d6/d10/d13/f1e [1345814,123314] 0 2024-02-15T22:50:55.702 INFO:tasks.workunit.client.0.smithi138.stdout:9/436: read d0/df/d11/f32 [4754471,39600] 0 2024-02-15T22:50:55.705 INFO:tasks.workunit.client.0.smithi138.stdout:0/469: dread d6/d10/f68 [0,4194304] 0 2024-02-15T22:50:55.705 INFO:tasks.workunit.client.0.smithi138.stdout:0/470: readlink d6/d10/d52/d72/l81 0 2024-02-15T22:50:55.706 INFO:tasks.workunit.client.0.smithi138.stdout:0/471: symlink d6/d10/la4 0 2024-02-15T22:50:55.711 INFO:tasks.workunit.client.0.smithi138.stdout:0/472: fsync d6/d10/d13/f1e 0 2024-02-15T22:50:55.711 INFO:tasks.workunit.client.0.smithi138.stdout:9/437: dread d0/f1d [0,4194304] 0 2024-02-15T22:50:55.713 INFO:tasks.workunit.client.0.smithi138.stdout:0/473: link d6/f39 d6/d10/d13/fa5 0 2024-02-15T22:50:55.713 INFO:tasks.workunit.client.0.smithi138.stdout:9/438: creat d0/de/d34/f94 x:0 0 0 2024-02-15T22:50:55.715 INFO:tasks.workunit.client.0.smithi138.stdout:9/439: creat d0/de/d33/d57/f95 x:0 0 0 2024-02-15T22:50:55.715 INFO:tasks.workunit.client.0.smithi138.stdout:9/440: write d0/de/d14/d18/f62 [1472505,95758] 0 2024-02-15T22:50:55.716 INFO:tasks.workunit.client.0.smithi138.stdout:9/441: creat d0/de/d48/f96 x:0 0 0 2024-02-15T22:50:55.718 INFO:tasks.workunit.client.0.smithi138.stdout:9/442: link d0/de/c16 d0/de/d34/d89/c97 0 2024-02-15T22:50:55.720 INFO:tasks.workunit.client.0.smithi138.stdout:9/443: mkdir d0/de/d33/d98 0 2024-02-15T22:50:55.724 INFO:tasks.workunit.client.0.smithi138.stdout:9/444: rmdir d0/de/d33/d57 39 2024-02-15T22:50:55.726 INFO:tasks.workunit.client.0.smithi138.stdout:9/445: mknod d0/d2e/c99 0 2024-02-15T22:50:55.726 INFO:tasks.workunit.client.0.smithi138.stdout:9/446: write d0/f20 [3688335,59777] 0 2024-02-15T22:50:55.727 INFO:tasks.workunit.client.0.smithi138.stdout:9/447: symlink d0/d55/d59/l9a 0 2024-02-15T22:50:55.731 INFO:tasks.workunit.client.0.smithi138.stdout:0/474: dwrite d6/f92 [0,4194304] 0 2024-02-15T22:50:55.732 INFO:tasks.workunit.client.0.smithi138.stdout:0/475: fdatasync d6/fb 0 2024-02-15T22:50:55.732 INFO:tasks.workunit.client.0.smithi138.stdout:0/476: write d6/d10/d52/f97 [10516,21687] 0 2024-02-15T22:50:55.737 INFO:tasks.workunit.client.0.smithi138.stdout:9/448: dread d0/df/d11/d23/f43 [0,4194304] 0 2024-02-15T22:50:55.737 INFO:tasks.workunit.client.0.smithi138.stdout:9/449: write d0/f8 [26164,62925] 0 2024-02-15T22:50:55.739 INFO:tasks.workunit.client.0.smithi138.stdout:9/450: creat d0/df/d11/d23/f9b x:0 0 0 2024-02-15T22:50:55.741 INFO:tasks.workunit.client.0.smithi138.stdout:9/451: getdents d0/d55/d59 0 2024-02-15T22:50:55.749 INFO:tasks.workunit.client.0.smithi138.stdout:0/477: dwrite d6/d10/d13/d3d/f70 [0,4194304] 0 2024-02-15T22:50:55.774 INFO:tasks.workunit.client.0.smithi138.stdout:0/478: dwrite d6/d10/d52/f97 [0,4194304] 0 2024-02-15T22:50:55.774 INFO:tasks.workunit.client.0.smithi138.stdout:0/479: creat d6/d10/d64/fa6 x:0 0 0 2024-02-15T22:50:55.774 INFO:tasks.workunit.client.0.smithi138.stdout:9/452: dwrite d0/de/d14/d18/f49 [0,4194304] 0 2024-02-15T22:50:55.778 INFO:tasks.workunit.client.0.smithi138.stdout:9/453: getdents d0/de/d33/d57 0 2024-02-15T22:50:55.784 INFO:tasks.workunit.client.0.smithi138.stdout:7/617: sync 2024-02-15T22:50:55.784 INFO:tasks.workunit.client.0.smithi138.stdout:6/397: sync 2024-02-15T22:50:55.787 INFO:tasks.workunit.client.0.smithi138.stdout:6/398: rename dc/d24/l67 to dc/d76/l85 0 2024-02-15T22:50:55.790 INFO:tasks.workunit.client.0.smithi138.stdout:6/399: rename dc/d24/c61 to dc/d24/d34/d3b/d7c/c86 0 2024-02-15T22:50:55.791 INFO:tasks.workunit.client.0.smithi138.stdout:0/480: dwrite d6/d10/d52/d72/f8c [0,4194304] 0 2024-02-15T22:50:55.792 INFO:tasks.workunit.client.0.smithi138.stdout:6/400: symlink dc/d24/d34/d3b/d7c/l87 0 2024-02-15T22:50:55.794 INFO:tasks.workunit.client.0.smithi138.stdout:0/481: dread d6/f42 [0,4194304] 0 2024-02-15T22:50:55.803 INFO:tasks.workunit.client.0.smithi138.stdout:6/401: write dc/f3a [2938255,15535] 0 2024-02-15T22:50:55.803 INFO:tasks.workunit.client.0.smithi138.stdout:6/402: chown dc/f46 6 1 2024-02-15T22:50:55.805 INFO:tasks.workunit.client.0.smithi138.stdout:7/618: dwrite d1/f42 [0,4194304] 0 2024-02-15T22:50:55.806 INFO:tasks.workunit.client.0.smithi138.stdout:6/403: rename dc/c18 to dc/d24/d34/d3b/d7c/c88 0 2024-02-15T22:50:55.807 INFO:tasks.workunit.client.0.smithi138.stdout:7/619: symlink d1/d28/ld4 0 2024-02-15T22:50:55.808 INFO:tasks.workunit.client.0.smithi138.stdout:9/454: dwrite d0/d4/f80 [4194304,4194304] 0 2024-02-15T22:50:55.808 INFO:tasks.workunit.client.0.smithi138.stdout:9/455: dread - d0/df/f56 zero size 2024-02-15T22:50:55.808 INFO:tasks.workunit.client.0.smithi138.stdout:9/456: readlink d0/d4/l73 0 2024-02-15T22:50:55.809 INFO:tasks.workunit.client.0.smithi138.stdout:7/620: creat d1/d79/d84/fd5 x:0 0 0 2024-02-15T22:50:55.811 INFO:tasks.workunit.client.0.smithi138.stdout:7/621: truncate d1/d2/f44 392259 0 2024-02-15T22:50:55.812 INFO:tasks.workunit.client.0.smithi138.stdout:7/622: creat d1/d5a/d97/fd6 x:0 0 0 2024-02-15T22:50:55.813 INFO:tasks.workunit.client.0.smithi138.stdout:0/482: dwrite d6/d10/f30 [0,4194304] 0 2024-02-15T22:50:55.813 INFO:tasks.workunit.client.0.smithi138.stdout:7/623: symlink d1/d28/ld7 0 2024-02-15T22:50:55.813 INFO:tasks.workunit.client.0.smithi138.stdout:7/624: dread - d1/d28/d7c/fbf zero size 2024-02-15T22:50:55.813 INFO:tasks.workunit.client.0.smithi138.stdout:7/625: write d1/d5a/f6d [4319496,22855] 0 2024-02-15T22:50:55.813 INFO:tasks.workunit.client.0.smithi138.stdout:0/483: write d6/f6d [72716,25785] 0 2024-02-15T22:50:55.822 INFO:tasks.workunit.client.0.smithi138.stdout:9/457: dread d0/d4/f2c [0,4194304] 0 2024-02-15T22:50:55.822 INFO:tasks.workunit.client.0.smithi138.stdout:0/484: dread d6/d10/d34/f3b [0,4194304] 0 2024-02-15T22:50:55.824 INFO:tasks.workunit.client.0.smithi138.stdout:9/458: read d0/f27 [1207220,40913] 0 2024-02-15T22:50:55.825 INFO:tasks.workunit.client.0.smithi138.stdout:9/459: creat d0/de/d33/d98/f9c x:0 0 0 2024-02-15T22:50:55.826 INFO:tasks.workunit.client.0.smithi138.stdout:6/404: dwrite dc/d24/f27 [0,4194304] 0 2024-02-15T22:50:55.826 INFO:tasks.workunit.client.0.smithi138.stdout:6/405: readlink dc/d24/d34/d3b/l4f 0 2024-02-15T22:50:55.828 INFO:tasks.workunit.client.0.smithi138.stdout:6/406: link dc/d24/d34/d3b/d66/l72 dc/d4b/d7b/l89 0 2024-02-15T22:50:55.829 INFO:tasks.workunit.client.0.smithi138.stdout:6/407: creat dc/d24/d34/d3b/d68/f8a x:0 0 0 2024-02-15T22:50:55.831 INFO:tasks.workunit.client.0.smithi138.stdout:0/485: write f4 [988314,108391] 0 2024-02-15T22:50:55.832 INFO:tasks.workunit.client.0.smithi138.stdout:0/486: creat d6/d10/d18/fa7 x:0 0 0 2024-02-15T22:50:55.832 INFO:tasks.workunit.client.0.smithi138.stdout:0/487: write d6/d10/d34/f66 [559659,121423] 0 2024-02-15T22:50:55.833 INFO:tasks.workunit.client.0.smithi138.stdout:0/488: symlink d6/d10/d40/la8 0 2024-02-15T22:50:55.834 INFO:tasks.workunit.client.0.smithi138.stdout:0/489: mknod d6/d10/d52/d6f/d85/ca9 0 2024-02-15T22:50:55.834 INFO:tasks.workunit.client.0.smithi138.stdout:0/490: stat d6/d10/d34/l58 0 2024-02-15T22:50:55.834 INFO:tasks.workunit.client.0.smithi138.stdout:7/626: dwrite d1/d2/db/d25/f36 [4194304,4194304] 0 2024-02-15T22:50:55.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/491: mknod d6/d10/d40/caa 0 2024-02-15T22:50:55.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/492: fsync d6/d10/d64/f87 0 2024-02-15T22:50:55.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/493: chown d6/d10/la4 216 1 2024-02-15T22:50:55.837 INFO:tasks.workunit.client.0.smithi138.stdout:0/494: read - d6/d10/d18/f65 zero size 2024-02-15T22:50:55.839 INFO:tasks.workunit.client.0.smithi138.stdout:0/495: mknod d6/d10/d52/d72/cab 0 2024-02-15T22:50:55.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.838+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa72c104ba0 con 0x7fa71806cef0 2024-02-15T22:50:55.844 INFO:tasks.workunit.client.0.smithi138.stdout:0/496: symlink d6/d10/d64/lac 0 2024-02-15T22:50:55.844 INFO:tasks.workunit.client.0.smithi138.stdout:0/497: chown d6/d10/d64/f88 6543 1 2024-02-15T22:50:55.844 INFO:tasks.workunit.client.0.smithi138.stdout:0/498: symlink d6/d10/d52/d6f/d85/lad 0 2024-02-15T22:50:55.846 INFO:tasks.workunit.client.0.smithi138.stdout:0/499: rename d6/d10/f31 to d6/d10/d52/d72/d9e/fae 0 2024-02-15T22:50:55.846 INFO:tasks.workunit.client.0.smithi138.stdout:0/500: creat d6/d10/d64/faf x:0 0 0 2024-02-15T22:50:55.846 INFO:tasks.workunit.client.0.smithi138.stdout:0/501: read - d6/d10/d40/f91 zero size 2024-02-15T22:50:55.849 INFO:tasks.workunit.client.0.smithi138.stdout:0/502: rename d6/d10/d40/la8 to d6/d10/d18/d57/d8d/lb0 0 2024-02-15T22:50:55.852 INFO:tasks.workunit.client.0.smithi138.stdout:6/408: dwrite dc/d24/f26 [0,4194304] 0 2024-02-15T22:50:55.852 INFO:tasks.workunit.client.0.smithi138.stdout:6/409: stat dc/f46 0 2024-02-15T22:50:55.852 INFO:tasks.workunit.client.0.smithi138.stdout:9/460: dwrite d0/de/d33/f77 [0,4194304] 0 2024-02-15T22:50:55.855 INFO:tasks.workunit.client.0.smithi138.stdout:7/627: dwrite d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.858+0000 7fa728ff9700 1 -- 172.21.15.138:0/3268846317 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa72c104ba0 con 0x7fa71806cef0 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (6m) 2m ago 7m 27.3M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (8m) 2m ago 8m 7470k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (7m) 6s ago 7m 7658k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (8m) 2m ago 8m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (7m) 6s ago 7m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (6m) 2m ago 7m 84.3M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (2m) 2m ago 2m 12.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:50:55.860 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (2m) 2m ago 2m 16.2M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (2m) 6s ago 2m 98.4M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (2m) 6s ago 2m 41.7M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:9283,8765,8443 running (9m) 2m ago 9m 488M - 18.2.0 dc2bc1663786 8807f70e9831 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (34s) 6s ago 6m 488M - 19.0.0-1450-gf78a58c0 f081f847070a 3b76cab03601 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (9m) 2m ago 9m 50.6M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (6m) 6s ago 6m 41.6M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 2m ago 8m 14.1M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 6s ago 7m 15.8M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (6m) 2m ago 6m 48.4M 3946M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (5m) 2m ago 5m 48.6M 3946M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (5m) 2m ago 5m 49.2M 3946M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (4m) 6s ago 4m 145M 4970M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (4m) 6s ago 4m 128M 4970M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:50:55.861 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (3m) 6s ago 3m 123M 4970M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:50:55.862 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (6m) 2m ago 7m 62.5M - 2.43.0 a07b618ecd1d 52e833c326a0 2024-02-15T22:50:55.862 INFO:tasks.workunit.client.0.smithi138.stdout:0/503: rmdir d6/d10 39 2024-02-15T22:50:55.862 INFO:tasks.workunit.client.0.smithi138.stdout:0/504: write d6/d10/d64/f87 [1040532,2754] 0 2024-02-15T22:50:55.862 INFO:tasks.workunit.client.0.smithi138.stdout:6/410: dread dc/f1a [0,4194304] 0 2024-02-15T22:50:55.862 INFO:tasks.workunit.client.0.smithi138.stdout:9/461: write d0/de/d33/f7f [3609295,9804] 0 2024-02-15T22:50:55.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 msgr2=0x7fa71806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 0x7fa71806f3a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa72c199110 tx=0x7fa71c006d20 comp rx=0 tx=0).stop 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 msgr2=0x7fa72c198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa714006010 tx=0x7fa71400be20 comp rx=0 tx=0).stop 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 shutdown_connections 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa71806cef0 0x7fa71806f3a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa72c0ff050 0x7fa72c197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 --2- 172.21.15.138:0/3268846317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa72c100250 0x7fa72c198170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 >> 172.21.15.138:0/3268846317 conn(0x7fa72c0fa600 msgr2=0x7fa72c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 shutdown_connections 2024-02-15T22:50:55.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:55.862+0000 7fa7312dd700 1 -- 172.21.15.138:0/3268846317 wait complete. 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/628: rmdir d1/d5a 39 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/629: chown d1/d2/db/d3c/d4d/lad 898 1 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/630: fsync d1/d2/db/f16 0 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/631: creat d1/d79/d84/fd8 x:0 0 0 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/632: creat d1/d2/d29/fd9 x:0 0 0 2024-02-15T22:50:55.865 INFO:tasks.workunit.client.0.smithi138.stdout:7/633: chown d1/d2 73505394 1 2024-02-15T22:50:55.866 INFO:tasks.workunit.client.0.smithi138.stdout:7/634: dread - d1/d2/db/d25/d41/f46 zero size 2024-02-15T22:50:55.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/505: rename d6/d10/d52/d72/d9e to d6/d10/d75/db1 0 2024-02-15T22:50:55.874 INFO:tasks.workunit.client.0.smithi138.stdout:6/411: symlink dc/d24/d34/l8b 0 2024-02-15T22:50:55.876 INFO:tasks.workunit.client.0.smithi138.stdout:9/462: link d0/d55/f5e d0/de/f9d 0 2024-02-15T22:50:55.876 INFO:tasks.workunit.client.0.smithi138.stdout:9/463: stat d0/df/d11/d23/f42 0 2024-02-15T22:50:55.876 INFO:tasks.workunit.client.0.smithi138.stdout:9/464: chown d0/de/d14 0 1 2024-02-15T22:50:55.876 INFO:tasks.workunit.client.0.smithi138.stdout:9/465: chown d0/de/c83 107210 1 2024-02-15T22:50:55.880 INFO:tasks.workunit.client.0.smithi138.stdout:7/635: rename d1/d28/dc5 to d1/d2/db/d3c/d4d/d5b/dda 0 2024-02-15T22:50:55.880 INFO:tasks.workunit.client.0.smithi138.stdout:7/636: write d1/d5a/f6d [5325172,35675] 0 2024-02-15T22:50:55.882 INFO:tasks.workunit.client.0.smithi138.stdout:0/506: symlink d6/lb2 0 2024-02-15T22:50:55.882 INFO:tasks.workunit.client.0.smithi138.stdout:6/412: symlink dc/d24/d34/d3b/d7c/l8c 0 2024-02-15T22:50:55.884 INFO:tasks.workunit.client.0.smithi138.stdout:9/466: mkdir d0/df/d11/d23/d71/d7b/d9e 0 2024-02-15T22:50:55.884 INFO:tasks.workunit.client.0.smithi138.stdout:9/467: creat d0/df/d11/d23/f9f x:0 0 0 2024-02-15T22:50:55.885 INFO:tasks.workunit.client.0.smithi138.stdout:9/468: chown d0/de/d14/f1b 6 1 2024-02-15T22:50:55.885 INFO:tasks.workunit.client.0.smithi138.stdout:0/507: symlink d6/d10/d64/lb3 0 2024-02-15T22:50:55.885 INFO:tasks.workunit.client.0.smithi138.stdout:0/508: write d6/f39 [3133954,78471] 0 2024-02-15T22:50:55.885 INFO:tasks.workunit.client.0.smithi138.stdout:0/509: fdatasync d6/d10/d13/f2b 0 2024-02-15T22:50:55.886 INFO:tasks.workunit.client.0.smithi138.stdout:6/413: creat dc/d24/d34/d3b/d66/f8d x:0 0 0 2024-02-15T22:50:55.890 INFO:tasks.workunit.client.0.smithi138.stdout:9/469: mknod d0/de/d33/d98/ca0 0 2024-02-15T22:50:55.890 INFO:tasks.workunit.client.0.smithi138.stdout:9/470: readlink d0/df/d11/d23/d71/d7b/l8b 0 2024-02-15T22:50:55.891 INFO:tasks.workunit.client.0.smithi138.stdout:0/510: mknod d6/d10/d18/d57/cb4 0 2024-02-15T22:50:55.892 INFO:tasks.workunit.client.0.smithi138.stdout:9/471: dread d0/de/d14/f41 [0,4194304] 0 2024-02-15T22:50:55.893 INFO:tasks.workunit.client.0.smithi138.stdout:9/472: readlink d0/df/d11/d23/l29 0 2024-02-15T22:50:55.893 INFO:tasks.workunit.client.0.smithi138.stdout:9/473: fdatasync d0/d55/d59/f87 0 2024-02-15T22:50:55.894 INFO:tasks.workunit.client.0.smithi138.stdout:0/511: unlink d6/d10/d34/f35 0 2024-02-15T22:50:55.895 INFO:tasks.workunit.client.0.smithi138.stdout:6/414: rmdir dc/d24/d34/d3b/d7d 39 2024-02-15T22:50:55.897 INFO:tasks.workunit.client.0.smithi138.stdout:0/512: mkdir d6/db5 0 2024-02-15T22:50:55.897 INFO:tasks.workunit.client.0.smithi138.stdout:0/513: write d6/d10/d18/fa7 [782467,31587] 0 2024-02-15T22:50:55.898 INFO:tasks.workunit.client.0.smithi138.stdout:6/415: symlink dc/d24/d34/d3b/l8e 0 2024-02-15T22:50:55.898 INFO:tasks.workunit.client.0.smithi138.stdout:2/467: sync 2024-02-15T22:50:55.898 INFO:tasks.workunit.client.0.smithi138.stdout:1/334: sync 2024-02-15T22:50:55.898 INFO:tasks.workunit.client.0.smithi138.stdout:1/335: truncate df/d1b/d1d/d25/d2e/d37/f54 338451 0 2024-02-15T22:50:55.899 INFO:tasks.workunit.client.0.smithi138.stdout:0/514: rename d6/d10/d52/d72/l81 to d6/d10/lb6 0 2024-02-15T22:50:55.901 INFO:tasks.workunit.client.0.smithi138.stdout:2/468: mknod d0/da/cab 0 2024-02-15T22:50:55.901 INFO:tasks.workunit.client.0.smithi138.stdout:2/469: stat d0/da/l6f 0 2024-02-15T22:50:55.903 INFO:tasks.workunit.client.0.smithi138.stdout:1/336: link df/d1b/d1d/d25/d2c/f39 df/f79 0 2024-02-15T22:50:55.903 INFO:tasks.workunit.client.0.smithi138.stdout:1/337: write df/d1b/d1d/d24/d3a/f40 [1495471,36941] 0 2024-02-15T22:50:55.903 INFO:tasks.workunit.client.0.smithi138.stdout:1/338: write df/d1b/d1d/d25/d2c/f39 [455841,84783] 0 2024-02-15T22:50:55.905 INFO:tasks.workunit.client.0.smithi138.stdout:2/470: creat d0/da/d19/d53/d5d/d6d/d7b/fac x:0 0 0 2024-02-15T22:50:55.905 INFO:tasks.workunit.client.0.smithi138.stdout:2/471: truncate d0/da/d19/d53/f8e 190777 0 2024-02-15T22:50:55.905 INFO:tasks.workunit.client.0.smithi138.stdout:2/472: fsync d0/da/f33 0 2024-02-15T22:50:55.908 INFO:tasks.workunit.client.0.smithi138.stdout:2/473: symlink d0/dd/d9d/lad 0 2024-02-15T22:50:55.908 INFO:tasks.workunit.client.0.smithi138.stdout:2/474: write d0/da/d19/d53/d5d/d6d/d7b/fac [371401,109614] 0 2024-02-15T22:50:55.909 INFO:tasks.workunit.client.0.smithi138.stdout:6/416: write dc/fe [2290949,65414] 0 2024-02-15T22:50:55.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/474: dwrite d0/df/d11/d23/f9b [0,4194304] 0 2024-02-15T22:50:55.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/475: write d0/de/d34/f75 [5061987,27003] 0 2024-02-15T22:50:55.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/475: rmdir d0/da/d19/d53/d5d 39 2024-02-15T22:50:55.910 INFO:tasks.workunit.client.0.smithi138.stdout:2/476: write d0/da/d19/f2d [4315022,53871] 0 2024-02-15T22:50:55.913 INFO:tasks.workunit.client.0.smithi138.stdout:6/417: unlink dc/d76/f84 0 2024-02-15T22:50:55.913 INFO:tasks.workunit.client.0.smithi138.stdout:6/418: read - dc/d24/f39 zero size 2024-02-15T22:50:55.913 INFO:tasks.workunit.client.0.smithi138.stdout:6/419: chown dc/d24/f47 902 1 2024-02-15T22:50:55.915 INFO:tasks.workunit.client.0.smithi138.stdout:9/476: mkdir d0/df/d11/d23/d71/d7b/d9e/da1 0 2024-02-15T22:50:55.915 INFO:tasks.workunit.client.0.smithi138.stdout:0/515: dwrite d6/d10/d18/d1b/f23 [0,4194304] 0 2024-02-15T22:50:55.916 INFO:tasks.workunit.client.0.smithi138.stdout:6/420: symlink dc/l8f 0 2024-02-15T22:50:55.918 INFO:tasks.workunit.client.0.smithi138.stdout:6/421: dread dc/f2a [0,4194304] 0 2024-02-15T22:50:55.918 INFO:tasks.workunit.client.0.smithi138.stdout:6/422: write dc/f46 [4876187,2353] 0 2024-02-15T22:50:55.920 INFO:tasks.workunit.client.0.smithi138.stdout:9/477: symlink d0/de/d14/d18/la2 0 2024-02-15T22:50:55.920 INFO:tasks.workunit.client.0.smithi138.stdout:9/478: chown d0/de/d14/c51 12340467 1 2024-02-15T22:50:55.920 INFO:tasks.workunit.client.0.smithi138.stdout:9/479: stat d0/df/d11/d23 0 2024-02-15T22:50:55.924 INFO:tasks.workunit.client.0.smithi138.stdout:2/477: link d0/d3/c28 d0/dd/d15/d72/cae 0 2024-02-15T22:50:55.924 INFO:tasks.workunit.client.0.smithi138.stdout:2/478: chown d0/da/d95/fa1 1 1 2024-02-15T22:50:55.925 INFO:tasks.workunit.client.0.smithi138.stdout:9/480: dread d0/df/d11/d23/d71/d7b/f8c [0,4194304] 0 2024-02-15T22:50:55.926 INFO:tasks.workunit.client.0.smithi138.stdout:2/479: truncate d0/d3/f2b 4339986 0 2024-02-15T22:50:55.927 INFO:tasks.workunit.client.0.smithi138.stdout:9/481: mkdir d0/de/d14/da3 0 2024-02-15T22:50:55.930 INFO:tasks.workunit.client.0.smithi138.stdout:2/480: creat d0/da/d19/d53/d5d/d83/faf x:0 0 0 2024-02-15T22:50:55.932 INFO:tasks.workunit.client.0.smithi138.stdout:9/482: rename d0/de/d34/c45 to d0/d1/ca4 0 2024-02-15T22:50:55.932 INFO:tasks.workunit.client.0.smithi138.stdout:9/483: write d0/de/f9d [1249122,45140] 0 2024-02-15T22:50:55.932 INFO:tasks.workunit.client.0.smithi138.stdout:9/484: dread - d0/df/f93 zero size 2024-02-15T22:50:55.934 INFO:tasks.workunit.client.0.smithi138.stdout:2/481: truncate d0/da/d19/d3f/f4a 177520 0 2024-02-15T22:50:55.934 INFO:tasks.workunit.client.0.smithi138.stdout:2/482: chown d0/da/d19/d53/d5d/d6d/d97/da0 16041 1 2024-02-15T22:50:55.934 INFO:tasks.workunit.client.0.smithi138.stdout:2/483: chown d0/dd/d9d/lad 0 1 2024-02-15T22:50:55.935 INFO:tasks.workunit.client.0.smithi138.stdout:9/485: mknod d0/de/d14/ca5 0 2024-02-15T22:50:55.935 INFO:tasks.workunit.client.0.smithi138.stdout:9/486: readlink d0/d4/l73 0 2024-02-15T22:50:55.936 INFO:tasks.workunit.client.0.smithi138.stdout:2/484: fdatasync d0/f51 0 2024-02-15T22:50:55.936 INFO:tasks.workunit.client.0.smithi138.stdout:2/485: fsync d0/da/f9e 0 2024-02-15T22:50:55.937 INFO:tasks.workunit.client.0.smithi138.stdout:0/516: dwrite d6/f39 [4194304,4194304] 0 2024-02-15T22:50:55.937 INFO:tasks.workunit.client.0.smithi138.stdout:6/423: dwrite dc/d24/f38 [4194304,4194304] 0 2024-02-15T22:50:55.938 INFO:tasks.workunit.client.0.smithi138.stdout:2/486: unlink d0/dd/f4e 0 2024-02-15T22:50:55.943 INFO:tasks.workunit.client.0.smithi138.stdout:2/487: creat d0/da/d19/d53/d80/fb0 x:0 0 0 2024-02-15T22:50:55.943 INFO:tasks.workunit.client.0.smithi138.stdout:2/488: creat d0/da/d19/d3f/fb1 x:0 0 0 2024-02-15T22:50:55.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:55 smithi170 ceph-mon[35248]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:55.946 INFO:tasks.workunit.client.0.smithi138.stdout:9/487: read d0/de/d33/f77 [150187,25687] 0 2024-02-15T22:50:55.947 INFO:tasks.workunit.client.0.smithi138.stdout:9/488: fdatasync d0/de/d33/f77 0 2024-02-15T22:50:55.947 INFO:tasks.workunit.client.0.smithi138.stdout:9/489: chown d0/d55/d59 3 1 2024-02-15T22:50:55.948 INFO:tasks.workunit.client.0.smithi138.stdout:6/424: rmdir dc/d24/d34/d3b/d68 39 2024-02-15T22:50:55.953 INFO:tasks.workunit.client.0.smithi138.stdout:2/489: rename d0/da/d19/f1b to d0/da/d19/d53/d5d/fb2 0 2024-02-15T22:50:55.953 INFO:tasks.workunit.client.0.smithi138.stdout:2/490: dread - d0/da/d19/d53/fa4 zero size 2024-02-15T22:50:55.955 INFO:tasks.workunit.client.0.smithi138.stdout:9/490: mkdir d0/de/d33/d98/da6 0 2024-02-15T22:50:55.955 INFO:tasks.workunit.client.0.smithi138.stdout:9/491: fsync d0/de/d33/f7a 0 2024-02-15T22:50:55.957 INFO:tasks.workunit.client.0.smithi138.stdout:6/425: unlink dc/d24/d34/d3b/d66/l73 0 2024-02-15T22:50:55.959 INFO:tasks.workunit.client.0.smithi138.stdout:2/491: symlink d0/da/d19/d53/d5d/d6d/d7b/lb3 0 2024-02-15T22:50:55.959 INFO:tasks.workunit.client.0.smithi138.stdout:2/492: creat d0/da/fb4 x:0 0 0 2024-02-15T22:50:55.962 INFO:tasks.workunit.client.0.smithi138.stdout:9/492: rename d0/df/d11/d23/f9b to d0/de/d48/d70/fa7 0 2024-02-15T22:50:55.962 INFO:tasks.workunit.client.0.smithi138.stdout:9/493: write d0/de/d33/f77 [495576,58803] 0 2024-02-15T22:50:55.963 INFO:tasks.workunit.client.0.smithi138.stdout:6/426: truncate dc/f79 2360052 0 2024-02-15T22:50:55.967 INFO:tasks.workunit.client.0.smithi138.stdout:2/493: mknod d0/da/d19/d53/d5d/d6d/d7b/cb5 0 2024-02-15T22:50:55.969 INFO:tasks.workunit.client.0.smithi138.stdout:9/494: symlink d0/de/d33/d98/da6/la8 0 2024-02-15T22:50:55.970 INFO:tasks.workunit.client.0.smithi138.stdout:6/427: creat dc/d24/d34/d3b/f90 x:0 0 0 2024-02-15T22:50:55.971 INFO:tasks.workunit.client.0.smithi138.stdout:6/428: chown dc/c29 23117 1 2024-02-15T22:50:55.971 INFO:tasks.workunit.client.0.smithi138.stdout:2/494: mknod d0/da/d19/d53/d5d/d6d/cb6 0 2024-02-15T22:50:55.973 INFO:tasks.workunit.client.0.smithi138.stdout:9/495: symlink d0/de/d34/la9 0 2024-02-15T22:50:55.976 INFO:tasks.workunit.client.0.smithi138.stdout:9/496: creat d0/d1/faa x:0 0 0 2024-02-15T22:50:55.976 INFO:tasks.workunit.client.0.smithi138.stdout:9/497: readlink d0/d1/l4b 0 2024-02-15T22:50:55.981 INFO:tasks.workunit.client.0.smithi138.stdout:2/495: dread d0/da/d19/f30 [0,4194304] 0 2024-02-15T22:50:55.982 INFO:tasks.workunit.client.0.smithi138.stdout:2/496: write d0/dd/f2c [439638,86919] 0 2024-02-15T22:50:55.982 INFO:tasks.workunit.client.0.smithi138.stdout:2/497: truncate d0/da/d19/d53/f8e 428452 0 2024-02-15T22:50:55.982 INFO:tasks.workunit.client.0.smithi138.stdout:2/498: truncate d0/da/d19/d53/f9f 385473 0 2024-02-15T22:50:55.982 INFO:tasks.workunit.client.0.smithi138.stdout:2/499: read - d0/da/d19/d53/d5d/d83/faf zero size 2024-02-15T22:50:55.983 INFO:tasks.workunit.client.0.smithi138.stdout:2/500: link d0/da/l61 d0/da/lb7 0 2024-02-15T22:50:55.984 INFO:tasks.workunit.client.0.smithi138.stdout:9/498: write d0/de/d33/f8a [79326,102724] 0 2024-02-15T22:50:55.985 INFO:tasks.workunit.client.0.smithi138.stdout:2/501: mknod d0/da/d19/d53/d5d/d83/d8a/cb8 0 2024-02-15T22:50:55.987 INFO:tasks.workunit.client.0.smithi138.stdout:9/499: symlink d0/df/d11/d23/d6a/lab 0 2024-02-15T22:50:55.994 INFO:tasks.workunit.client.0.smithi138.stdout:2/502: dread d0/da/f9e [0,4194304] 0 2024-02-15T22:50:55.994 INFO:tasks.workunit.client.0.smithi138.stdout:2/503: read - d0/da/d19/d53/d80/f90 zero size 2024-02-15T22:50:55.999 INFO:tasks.workunit.client.0.smithi138.stdout:9/500: getdents d0/de/d48 0 2024-02-15T22:50:55.999 INFO:tasks.workunit.client.0.smithi138.stdout:9/501: fsync d0/de/d14/d18/f49 0 2024-02-15T22:50:56.001 INFO:tasks.workunit.client.0.smithi138.stdout:9/502: mkdir d0/d55/d59/dac 0 2024-02-15T22:50:56.003 INFO:tasks.workunit.client.0.smithi138.stdout:9/503: creat d0/de/d34/d89/d90/fad x:0 0 0 2024-02-15T22:50:56.003 INFO:tasks.workunit.client.0.smithi138.stdout:9/504: stat d0/df/d11/d23/c46 0 2024-02-15T22:50:56.003 INFO:tasks.workunit.client.0.smithi138.stdout:9/505: creat d0/de/d33/d98/fae x:0 0 0 2024-02-15T22:50:56.011 INFO:tasks.workunit.client.0.smithi138.stdout:2/504: dwrite d0/d3/f2b [4194304,4194304] 0 2024-02-15T22:50:56.013 INFO:tasks.workunit.client.0.smithi138.stdout:2/505: mknod d0/da/d19/d53/d80/cb9 0 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.011+0000 7f89a1014700 1 -- 172.21.15.138:0/267687681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c0fe9d0 msgr2=0x7f899c100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.011+0000 7f89a1014700 1 --2- 172.21.15.138:0/267687681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c0fe9d0 0x7f899c100df0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8990009910 tx=0x7f8990009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 -- 172.21.15.138:0/267687681 shutdown_connections 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 --2- 172.21.15.138:0/267687681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c101330 0x7f899c1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 --2- 172.21.15.138:0/267687681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c0fe9d0 0x7f899c100df0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 -- 172.21.15.138:0/267687681 >> 172.21.15.138:0/267687681 conn(0x7f899c0fa5e0 msgr2=0x7f899c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 -- 172.21.15.138:0/267687681 shutdown_connections 2024-02-15T22:50:56.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.012+0000 7f89a1014700 1 -- 172.21.15.138:0/267687681 wait complete. 2024-02-15T22:50:56.015 INFO:tasks.workunit.client.0.smithi138.stdout:2/506: mkdir d0/da/d19/d53/d80/dba 0 2024-02-15T22:50:56.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 Processor -- start 2024-02-15T22:50:56.015 INFO:tasks.workunit.client.0.smithi138.stdout:2/507: creat d0/da/d19/d53/d80/fbb x:0 0 0 2024-02-15T22:50:56.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 -- start start 2024-02-15T22:50:56.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c101330 0x7f899c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19cbc0 con 0x7f899c101330 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.013+0000 7f89a1014700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19cd00 con 0x7f899c0fe9d0 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:57428/0 (socket says 172.21.15.138:57428) 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 -- 172.21.15.138:0/1967125831 learned_addr learned my addr 172.21.15.138:0/1967125831 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899a59c700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c101330 0x7f899c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 -- 172.21.15.138:0/1967125831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c101330 msgr2=0x7f899c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c101330 0x7f899c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 -- 172.21.15.138:0/1967125831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900095f0 con 0x7f899c0fe9d0 2024-02-15T22:50:56.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.014+0000 7f899ad9d700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8990005b40 tx=0x7f899000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:56.018 INFO:tasks.workunit.client.0.smithi138.stdout:2/508: creat d0/da/d19/d53/d5d/d74/fbc x:0 0 0 2024-02-15T22:50:56.019 INFO:tasks.workunit.client.0.smithi138.stdout:2/509: mkdir d0/dd/d15/d72/dbd 0 2024-02-15T22:50:56.021 INFO:tasks.workunit.client.0.smithi138.stdout:9/506: dwrite d0/de/d14/f88 [0,4194304] 0 2024-02-15T22:50:56.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.020+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f899001d070 con 0x7f899c0fe9d0 2024-02-15T22:50:56.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.020+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f899000f460 con 0x7f899c0fe9d0 2024-02-15T22:50:56.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.020+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c1a1750 con 0x7f899c0fe9d0 2024-02-15T22:50:56.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.020+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8990005720 con 0x7f899c0fe9d0 2024-02-15T22:50:56.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.020+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c1a1cc0 con 0x7f899c0fe9d0 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:4/667: sync 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:3/592: sync 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:5/336: sync 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:8/418: sync 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:8/419: read - db/dd/d13/d19/f81 zero size 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:8/420: fdatasync db/dd/d13/d19/f43 0 2024-02-15T22:50:56.023 INFO:tasks.workunit.client.0.smithi138.stdout:8/421: write f0 [497786,67454] 0 2024-02-15T22:50:56.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.021+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c1961f0 con 0x7f899c0fe9d0 2024-02-15T22:50:56.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.022+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f899000f5d0 con 0x7f899c0fe9d0 2024-02-15T22:50:56.024 INFO:tasks.workunit.client.0.smithi138.stdout:9/507: rename d0/de/d33/d57/l7c to d0/de/d34/d89/laf 0 2024-02-15T22:50:56.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.023+0000 7f8983fff700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 0x7f898406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.023+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f899008d990 con 0x7f899c0fe9d0 2024-02-15T22:50:56.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.023+0000 7f899a59c700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 0x7f898406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.023+0000 7f899a59c700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 0x7f898406f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f898c009a10 tx=0x7f898c009190 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:56.026 INFO:tasks.workunit.client.0.smithi138.stdout:4/668: creat d17/d1e/d2d/dd5/fdf x:0 0 0 2024-02-15T22:50:56.026 INFO:tasks.workunit.client.0.smithi138.stdout:4/669: truncate d17/d1e/d2d/d36/dca/fb2 535316 0 2024-02-15T22:50:56.026 INFO:tasks.workunit.client.0.smithi138.stdout:4/670: chown d17/d2b/f9f 2 1 2024-02-15T22:50:56.027 INFO:tasks.workunit.client.0.smithi138.stdout:9/508: read d0/df/d11/d23/f43 [2933102,88891] 0 2024-02-15T22:50:56.028 INFO:tasks.workunit.client.0.smithi138.stdout:5/337: rename df/d18/d3e/d66/l68 to df/d18/d3e/d66/l69 0 2024-02-15T22:50:56.028 INFO:tasks.workunit.client.0.smithi138.stdout:5/338: creat df/d18/d3e/d51/f6a x:0 0 0 2024-02-15T22:50:56.028 INFO:tasks.workunit.client.0.smithi138.stdout:5/339: fdatasync fb 0 2024-02-15T22:50:56.029 INFO:tasks.workunit.client.0.smithi138.stdout:8/422: rename db/dd/d13/d19/l6f to db/d15/d70/l88 0 2024-02-15T22:50:56.030 INFO:tasks.workunit.client.0.smithi138.stdout:3/593: truncate d5/d18/f24 1497739 0 2024-02-15T22:50:56.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.029+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f899005b150 con 0x7f899c0fe9d0 2024-02-15T22:50:56.031 INFO:tasks.workunit.client.0.smithi138.stdout:9/509: mknod d0/de/d34/d89/cb0 0 2024-02-15T22:50:56.031 INFO:tasks.workunit.client.0.smithi138.stdout:9/510: write d0/de/d14/f58 [71924,126103] 0 2024-02-15T22:50:56.031 INFO:tasks.workunit.client.0.smithi138.stdout:9/511: write d0/d2e/f8f [5764180,84622] 0 2024-02-15T22:50:56.031 INFO:tasks.workunit.client.0.smithi138.stdout:9/512: fsync d0/d55/f5b 0 2024-02-15T22:50:56.032 INFO:tasks.workunit.client.0.smithi138.stdout:8/423: chown db/dd/d13/l18 14543 1 2024-02-15T22:50:56.036 INFO:tasks.workunit.client.0.smithi138.stdout:3/594: dread d5/d16/dc/d43/d47/d67/f71 [0,4194304] 0 2024-02-15T22:50:56.036 INFO:tasks.workunit.client.0.smithi138.stdout:9/513: unlink d0/de/d14/f1b 0 2024-02-15T22:50:56.038 INFO:tasks.workunit.client.0.smithi138.stdout:4/671: rename d17/d1a/lbd to d17/d1e/d2d/dc7/le0 0 2024-02-15T22:50:56.041 INFO:tasks.workunit.client.0.smithi138.stdout:8/424: rmdir db/dd/d75 0 2024-02-15T22:50:56.041 INFO:tasks.workunit.client.0.smithi138.stdout:8/425: write db/dd/f3e [4462898,62599] 0 2024-02-15T22:50:56.041 INFO:tasks.workunit.client.0.smithi138.stdout:8/426: dread - db/dd/d22/f3f zero size 2024-02-15T22:50:56.043 INFO:tasks.workunit.client.0.smithi138.stdout:3/595: unlink d5/d12/d26/d2e/c69 0 2024-02-15T22:50:56.047 INFO:tasks.workunit.client.0.smithi138.stdout:9/514: link d0/df/d11/f17 d0/de/d34/d89/fb1 0 2024-02-15T22:50:56.047 INFO:tasks.workunit.client.0.smithi138.stdout:9/515: creat d0/d1/fb2 x:0 0 0 2024-02-15T22:50:56.048 INFO:tasks.workunit.client.0.smithi138.stdout:4/672: dread d17/d1e/d2d/f2e [4194304,4194304] 0 2024-02-15T22:50:56.048 INFO:tasks.workunit.client.0.smithi138.stdout:4/673: truncate d17/d2b/f3d 4604092 0 2024-02-15T22:50:56.050 INFO:tasks.workunit.client.0.smithi138.stdout:3/596: mknod d5/d12/d23/d29/d4f/cbf 0 2024-02-15T22:50:56.051 INFO:tasks.workunit.client.0.smithi138.stdout:4/674: rename d17/d1e/d2d/d36/lac to d17/d2b/le1 0 2024-02-15T22:50:56.052 INFO:tasks.workunit.client.0.smithi138.stdout:4/675: truncate d17/d1e/fd9 646252 0 2024-02-15T22:50:56.052 INFO:tasks.workunit.client.0.smithi138.stdout:3/597: creat d5/d12/d23/d29/d4f/fc0 x:0 0 0 2024-02-15T22:50:56.054 INFO:tasks.workunit.client.0.smithi138.stdout:3/598: dread d5/d16/d4d/f85 [0,4194304] 0 2024-02-15T22:50:56.054 INFO:tasks.workunit.client.0.smithi138.stdout:3/599: truncate d5/d18/fbe 10856 0 2024-02-15T22:50:56.055 INFO:tasks.workunit.client.0.smithi138.stdout:3/600: creat d5/d16/fc1 x:0 0 0 2024-02-15T22:50:56.055 INFO:tasks.workunit.client.0.smithi138.stdout:3/601: dread - d5/d18/fb5 zero size 2024-02-15T22:50:56.055 INFO:tasks.workunit.client.0.smithi138.stdout:3/602: chown d5/d16/d4d 57486 1 2024-02-15T22:50:56.055 INFO:tasks.workunit.client.0.smithi138.stdout:3/603: dread - d5/d18/fb5 zero size 2024-02-15T22:50:56.059 INFO:tasks.workunit.client.0.smithi138.stdout:3/604: mkdir d5/d12/d23/d29/d5a/dc2 0 2024-02-15T22:50:56.059 INFO:tasks.workunit.client.0.smithi138.stdout:3/605: creat d5/d18/d35/fc3 x:0 0 0 2024-02-15T22:50:56.060 INFO:tasks.workunit.client.0.smithi138.stdout:8/427: dwrite db/dd/d13/d19/f76 [0,4194304] 0 2024-02-15T22:50:56.062 INFO:tasks.workunit.client.0.smithi138.stdout:9/516: read d0/de/d14/d18/f62 [3576985,45801] 0 2024-02-15T22:50:56.062 INFO:tasks.workunit.client.0.smithi138.stdout:9/517: truncate d0/d1/faa 143528 0 2024-02-15T22:50:56.063 INFO:tasks.workunit.client.0.smithi138.stdout:3/606: getdents d5/d16/dc/d43/d47 0 2024-02-15T22:50:56.069 INFO:tasks.workunit.client.0.smithi138.stdout:4/676: dwrite d17/d2b/fa4 [0,4194304] 0 2024-02-15T22:50:56.072 INFO:tasks.workunit.client.0.smithi138.stdout:3/607: dread d5/d16/fa [0,4194304] 0 2024-02-15T22:50:56.074 INFO:tasks.workunit.client.0.smithi138.stdout:3/608: creat d5/d12/d23/d29/d4f/fc4 x:0 0 0 2024-02-15T22:50:56.075 INFO:tasks.workunit.client.0.smithi138.stdout:3/609: symlink d5/d16/lc5 0 2024-02-15T22:50:56.077 INFO:tasks.workunit.client.0.smithi138.stdout:3/610: mkdir d5/d16/dc/d43/da2/dc6 0 2024-02-15T22:50:56.077 INFO:tasks.workunit.client.0.smithi138.stdout:3/611: getdents d5/d12/d23/d29/d5a/dc2 0 2024-02-15T22:50:56.078 INFO:tasks.workunit.client.0.smithi138.stdout:8/428: dwrite db/dd/f14 [0,4194304] 0 2024-02-15T22:50:56.078 INFO:tasks.workunit.client.0.smithi138.stdout:8/429: write db/dd/d13/f31 [4561633,32471] 0 2024-02-15T22:50:56.079 INFO:tasks.workunit.client.0.smithi138.stdout:8/430: creat db/dd/d13/d19/d7d/f89 x:0 0 0 2024-02-15T22:50:56.080 INFO:tasks.workunit.client.0.smithi138.stdout:9/518: rename d0/f20 to d0/d55/d59/fb3 0 2024-02-15T22:50:56.086 INFO:tasks.workunit.client.0.smithi138.stdout:3/612: rename d5/d12/d26/d2f/l45 to d5/d12/d23/d29/lc7 0 2024-02-15T22:50:56.088 INFO:tasks.workunit.client.0.smithi138.stdout:3/613: mknod d5/d12/d23/cc8 0 2024-02-15T22:50:56.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/614: mknod d5/d12/cc9 0 2024-02-15T22:50:56.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/615: truncate d5/d16/dc/d43/d47/f75 777800 0 2024-02-15T22:50:56.091 INFO:tasks.workunit.client.0.smithi138.stdout:4/677: dwrite d17/d1e/d2d/d36/d3e/d64/f76 [0,4194304] 0 2024-02-15T22:50:56.093 INFO:tasks.workunit.client.0.smithi138.stdout:4/678: write d17/f29 [996157,120124] 0 2024-02-15T22:50:56.094 INFO:tasks.workunit.client.0.smithi138.stdout:4/679: link f8 d17/d2b/fe2 0 2024-02-15T22:50:56.095 INFO:tasks.workunit.client.0.smithi138.stdout:4/680: dread d17/d1e/d2d/d8c/fc6 [0,4194304] 0 2024-02-15T22:50:56.096 INFO:tasks.workunit.client.0.smithi138.stdout:4/681: fsync d17/d1e/d2d/d36/d3e/f88 0 2024-02-15T22:50:56.096 INFO:tasks.workunit.client.0.smithi138.stdout:4/682: write d17/f44 [489379,79298] 0 2024-02-15T22:50:56.097 INFO:tasks.workunit.client.0.smithi138.stdout:4/683: mknod d17/d1e/d2d/ce3 0 2024-02-15T22:50:56.097 INFO:tasks.workunit.client.0.smithi138.stdout:4/684: truncate d17/d1e/d2d/d8c/fa2 617870 0 2024-02-15T22:50:56.101 INFO:tasks.workunit.client.0.smithi138.stdout:4/685: dread d17/d1e/d56/f5c [0,4194304] 0 2024-02-15T22:50:56.102 INFO:tasks.workunit.client.0.smithi138.stdout:8/431: dwrite db/dd/d13/d19/d7d/f85 [0,4194304] 0 2024-02-15T22:50:56.105 INFO:tasks.workunit.client.0.smithi138.stdout:4/686: dread d17/d1e/d2d/d36/f96 [0,4194304] 0 2024-02-15T22:50:56.106 INFO:tasks.workunit.client.0.smithi138.stdout:8/432: truncate db/dd/d13/f4c 243096 0 2024-02-15T22:50:56.106 INFO:tasks.workunit.client.0.smithi138.stdout:8/433: creat db/dd/d22/f8a x:0 0 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:4/687: link d17/d1e/d2d/d36/d3e/f88 d17/d1e/d2d/d36/fe4 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:4/688: stat d17/d2b/d78 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:9/519: dwrite d0/de/d34/d89/fb1 [0,4194304] 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:9/520: write d0/df/d11/f60 [409380,29052] 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:3/616: dwrite d5/d16/dc/d43/d47/d67/f71 [0,4194304] 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:3/617: write d5/d12/d23/f4c [3036210,49717] 0 2024-02-15T22:50:56.109 INFO:tasks.workunit.client.0.smithi138.stdout:3/618: truncate d5/d16/dc/fb1 956445 0 2024-02-15T22:50:56.110 INFO:tasks.workunit.client.0.smithi138.stdout:3/619: stat d5/d12/d23/f4c 0 2024-02-15T22:50:56.110 INFO:tasks.workunit.client.0.smithi138.stdout:9/521: dread d0/de/d33/f76 [0,4194304] 0 2024-02-15T22:50:56.110 INFO:tasks.workunit.client.0.smithi138.stdout:8/434: rename db/dd/d13/d19/f81 to db/dd/d22/f8b 0 2024-02-15T22:50:56.112 INFO:tasks.workunit.client.0.smithi138.stdout:4/689: fdatasync d17/d1a/fd1 0 2024-02-15T22:50:56.114 INFO:tasks.workunit.client.0.smithi138.stdout:9/522: symlink d0/de/d33/d98/lb4 0 2024-02-15T22:50:56.115 INFO:tasks.workunit.client.0.smithi138.stdout:4/690: unlink d17/f29 0 2024-02-15T22:50:56.123 INFO:tasks.workunit.client.0.smithi138.stdout:8/435: write db/d15/f62 [1353908,125473] 0 2024-02-15T22:50:56.123 INFO:tasks.workunit.client.0.smithi138.stdout:8/436: write db/d15/f36 [4326528,10192] 0 2024-02-15T22:50:56.124 INFO:tasks.workunit.client.0.smithi138.stdout:8/437: symlink db/dd/l8c 0 2024-02-15T22:50:56.133 INFO:tasks.workunit.client.0.smithi138.stdout:9/523: dwrite d0/d55/d59/f5f [0,4194304] 0 2024-02-15T22:50:56.140 INFO:tasks.workunit.client.0.smithi138.stdout:8/438: dwrite db/f28 [0,4194304] 0 2024-02-15T22:50:56.140 INFO:tasks.workunit.client.0.smithi138.stdout:8/439: stat db/d15/d70 0 2024-02-15T22:50:56.140 INFO:tasks.workunit.client.0.smithi138.stdout:9/524: dread d0/de/d14/f66 [0,4194304] 0 2024-02-15T22:50:56.141 INFO:tasks.workunit.client.0.smithi138.stdout:9/525: stat d0/de/d14/f2a 0 2024-02-15T22:50:56.141 INFO:tasks.workunit.client.0.smithi138.stdout:8/440: rename db/d15/f36 to db/dd/d4d/f8d 0 2024-02-15T22:50:56.161 INFO:tasks.workunit.client.0.smithi138.stdout:9/526: dwrite d0/de/d33/d98/fae [0,4194304] 0 2024-02-15T22:50:56.161 INFO:tasks.workunit.client.0.smithi138.stdout:9/527: creat d0/df/d11/d23/fb5 x:0 0 0 2024-02-15T22:50:56.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/441: dwrite db/f10 [0,4194304] 0 2024-02-15T22:50:56.163 INFO:tasks.workunit.client.0.smithi138.stdout:9/528: truncate d0/df/d11/f60 159361 0 2024-02-15T22:50:56.164 INFO:tasks.workunit.client.0.smithi138.stdout:8/442: symlink db/dd/d13/d19/d45/l8e 0 2024-02-15T22:50:56.164 INFO:tasks.workunit.client.0.smithi138.stdout:9/529: dread d0/d1/faa [0,4194304] 0 2024-02-15T22:50:56.165 INFO:tasks.workunit.client.0.smithi138.stdout:9/530: symlink d0/de/lb6 0 2024-02-15T22:50:56.166 INFO:tasks.workunit.client.0.smithi138.stdout:8/443: mkdir db/dd/d13/d77/d8f 0 2024-02-15T22:50:56.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/444: fdatasync db/dd/d13/f64 0 2024-02-15T22:50:56.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/445: write db/f58 [975074,94497] 0 2024-02-15T22:50:56.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/446: dread - db/dd/d13/d19/d7d/f89 zero size 2024-02-15T22:50:56.167 INFO:tasks.workunit.client.0.smithi138.stdout:9/531: creat d0/d55/fb7 x:0 0 0 2024-02-15T22:50:56.175 INFO:tasks.workunit.client.0.smithi138.stdout:8/447: write db/dd/d13/d19/d7d/f85 [3860391,86586] 0 2024-02-15T22:50:56.175 INFO:tasks.workunit.client.0.smithi138.stdout:8/448: readlink db/dd/l5d 0 2024-02-15T22:50:56.177 INFO:tasks.workunit.client.0.smithi138.stdout:8/449: unlink db/dd/f11 0 2024-02-15T22:50:56.178 INFO:tasks.workunit.client.0.smithi138.stdout:8/450: creat db/f90 x:0 0 0 2024-02-15T22:50:56.178 INFO:tasks.workunit.client.0.smithi138.stdout:9/532: write d0/df/d11/d23/f42 [1274395,104511] 0 2024-02-15T22:50:56.178 INFO:tasks.workunit.client.0.smithi138.stdout:9/533: read - d0/de/d14/f2a zero size 2024-02-15T22:50:56.178 INFO:tasks.workunit.client.0.smithi138.stdout:8/451: mkdir db/dd/d13/d19/d7d/d91 0 2024-02-15T22:50:56.180 INFO:tasks.workunit.client.0.smithi138.stdout:9/534: mkdir d0/d1/db8 0 2024-02-15T22:50:56.180 INFO:tasks.workunit.client.0.smithi138.stdout:9/535: write d0/de/d34/d89/f7e [523507,83115] 0 2024-02-15T22:50:56.180 INFO:tasks.workunit.client.0.smithi138.stdout:9/536: mknod d0/de/d34/d89/cb9 0 2024-02-15T22:50:56.181 INFO:tasks.workunit.client.0.smithi138.stdout:9/537: creat d0/de/fba x:0 0 0 2024-02-15T22:50:56.182 INFO:tasks.workunit.client.0.smithi138.stdout:9/538: link d0/de/d33/f7a d0/df/d11/d23/fbb 0 2024-02-15T22:50:56.182 INFO:tasks.workunit.client.0.smithi138.stdout:9/539: getdents d0/de/d33/d57 0 2024-02-15T22:50:56.183 INFO:tasks.workunit.client.0.smithi138.stdout:9/540: mkdir d0/df/dbc 0 2024-02-15T22:50:56.183 INFO:tasks.workunit.client.0.smithi138.stdout:9/541: stat d0/d4/c25 0 2024-02-15T22:50:56.184 INFO:tasks.workunit.client.0.smithi138.stdout:9/542: mkdir d0/de/d14/dbd 0 2024-02-15T22:50:56.184 INFO:tasks.workunit.client.0.smithi138.stdout:9/543: fdatasync d0/df/d11/d23/d71/d7b/f8c 0 2024-02-15T22:50:56.184 INFO:tasks.workunit.client.0.smithi138.stdout:9/544: fsync d0/d1/fb2 0 2024-02-15T22:50:56.186 INFO:tasks.workunit.client.0.smithi138.stdout:9/545: link d0/de/d33/d57/f95 d0/de/d34/d89/d90/fbe 0 2024-02-15T22:50:56.186 INFO:tasks.workunit.client.0.smithi138.stdout:9/546: creat d0/de/d33/d98/fbf x:0 0 0 2024-02-15T22:50:56.188 INFO:tasks.workunit.client.0.smithi138.stdout:8/452: write db/dd/d13/f1c [4229360,77215] 0 2024-02-15T22:50:56.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:55 smithi138 ceph-mon[29229]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:56.189 INFO:tasks.workunit.client.0.smithi138.stdout:8/453: rmdir db/dd/d13/d19/d7d/d91 0 2024-02-15T22:50:56.191 INFO:tasks.workunit.client.0.smithi138.stdout:8/454: truncate db/dd/d13/d19/d24/f2c 4097448 0 2024-02-15T22:50:56.191 INFO:tasks.workunit.client.0.smithi138.stdout:9/547: dread d0/de/d14/f30 [0,4194304] 0 2024-02-15T22:50:56.192 INFO:tasks.workunit.client.0.smithi138.stdout:9/548: truncate d0/d55/f5e 6701087 0 2024-02-15T22:50:56.212 INFO:tasks.workunit.client.0.smithi138.stdout:8/455: dwrite db/dd/f3e [0,4194304] 0 2024-02-15T22:50:56.212 INFO:tasks.workunit.client.0.smithi138.stdout:9/549: dwrite d0/de/d33/d57/f95 [0,4194304] 0 2024-02-15T22:50:56.218 INFO:tasks.workunit.client.0.smithi138.stdout:9/550: rename d0/de/d33/f7d to d0/fc0 0 2024-02-15T22:50:56.225 INFO:tasks.workunit.client.0.smithi138.stdout:8/456: dwrite db/dd/d13/d19/d7d/f89 [0,4194304] 0 2024-02-15T22:50:56.226 INFO:tasks.workunit.client.0.smithi138.stdout:9/551: rename d0/df/dbc to d0/df/d11/d23/d71/d7b/d9e/dc1 0 2024-02-15T22:50:56.227 INFO:tasks.workunit.client.0.smithi138.stdout:9/552: write d0/de/d34/f3e [600662,31530] 0 2024-02-15T22:50:56.227 INFO:tasks.workunit.client.0.smithi138.stdout:9/553: read - d0/fc0 zero size 2024-02-15T22:50:56.234 INFO:tasks.workunit.client.0.smithi138.stdout:8/457: dread db/d15/f17 [0,4194304] 0 2024-02-15T22:50:56.235 INFO:tasks.workunit.client.0.smithi138.stdout:8/458: truncate db/f3d 293381 0 2024-02-15T22:50:56.242 INFO:tasks.workunit.client.0.smithi138.stdout:9/554: dwrite d0/f1d [4194304,4194304] 0 2024-02-15T22:50:56.243 INFO:tasks.workunit.client.0.smithi138.stdout:9/555: mkdir d0/de/d14/d22/dc2 0 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/556: dread d0/f27 [0,4194304] 0 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/557: chown d0/de/f47 31 1 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/558: chown d0/de/d34/d89/l6f 129482 1 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/559: write d0/df/f56 [18710,128134] 0 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/560: readlink d0/df/d11/d23/l4d 0 2024-02-15T22:50:56.246 INFO:tasks.workunit.client.0.smithi138.stdout:9/561: stat d0/d1/ca4 0 2024-02-15T22:50:56.247 INFO:tasks.workunit.client.0.smithi138.stdout:8/459: dread db/dd/f4e [0,4194304] 0 2024-02-15T22:50:56.247 INFO:tasks.workunit.client.0.smithi138.stdout:8/460: chown db/d15 26979195 1 2024-02-15T22:50:56.247 INFO:tasks.workunit.client.0.smithi138.stdout:8/461: write db/dd/d13/d19/f83 [453036,126525] 0 2024-02-15T22:50:56.248 INFO:tasks.workunit.client.0.smithi138.stdout:9/562: link d0/c69 d0/df/d11/d23/d71/d7b/d9e/da1/cc3 0 2024-02-15T22:50:56.248 INFO:tasks.workunit.client.0.smithi138.stdout:9/563: chown d0/de/fba 271208 1 2024-02-15T22:50:56.253 INFO:tasks.workunit.client.0.smithi138.stdout:8/462: rename db/dd/d13/d19/d24 to db/d15/d70/d7c/d92 0 2024-02-15T22:50:56.253 INFO:tasks.workunit.client.0.smithi138.stdout:8/463: stat db/dd/c59 0 2024-02-15T22:50:56.257 INFO:tasks.workunit.client.0.smithi138.stdout:9/564: read d0/d4/f80 [7894019,3718] 0 2024-02-15T22:50:56.257 INFO:tasks.workunit.client.0.smithi138.stdout:9/565: write d0/df/d11/f32 [3912014,70158] 0 2024-02-15T22:50:56.258 INFO:tasks.workunit.client.0.smithi138.stdout:9/566: mknod d0/df/d11/d23/d71/d7b/cc4 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:8/464: read db/f29 [1083976,47746] 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/567: unlink d0/de/d33/d98/f9c 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/568: truncate d0/de/fba 621834 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/569: write d0/d55/f5b [137741,81197] 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/570: dread - d0/de/d33/f85 zero size 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/571: write d0/de/f47 [1924032,95213] 0 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/572: read - d0/de/d34/f94 zero size 2024-02-15T22:50:56.260 INFO:tasks.workunit.client.0.smithi138.stdout:9/573: write d0/df/d11/d23/f43 [2777473,4260] 0 2024-02-15T22:50:56.261 INFO:tasks.workunit.client.0.smithi138.stdout:9/574: mkdir d0/d2e/dc5 0 2024-02-15T22:50:56.262 INFO:tasks.workunit.client.0.smithi138.stdout:8/465: getdents db 0 2024-02-15T22:50:56.263 INFO:tasks.workunit.client.0.smithi138.stdout:9/575: unlink d0/de/d34/d89/d90/fbe 0 2024-02-15T22:50:56.272 INFO:tasks.workunit.client.0.smithi138.stdout:9/576: dread d0/de/d14/f44 [4194304,4194304] 0 2024-02-15T22:50:56.273 INFO:tasks.workunit.client.0.smithi138.stdout:9/577: write d0/d4/f80 [5327177,35267] 0 2024-02-15T22:50:56.274 INFO:tasks.workunit.client.0.smithi138.stdout:9/578: dread d0/f27 [0,4194304] 0 2024-02-15T22:50:56.274 INFO:tasks.workunit.client.0.smithi138.stdout:9/579: fsync d0/de/d33/f76 0 2024-02-15T22:50:56.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/580: write d0/f27 [2015076,74185] 0 2024-02-15T22:50:56.275 INFO:tasks.workunit.client.0.smithi138.stdout:8/466: dwrite db/f1a [8388608,4194304] 0 2024-02-15T22:50:56.276 INFO:tasks.workunit.client.0.smithi138.stdout:8/467: mknod db/dd/d13/d77/c93 0 2024-02-15T22:50:56.276 INFO:tasks.workunit.client.0.smithi138.stdout:8/468: write db/dd/f67 [740751,119829] 0 2024-02-15T22:50:56.278 INFO:tasks.workunit.client.0.smithi138.stdout:8/469: dread db/d15/d70/d7c/d92/f60 [0,4194304] 0 2024-02-15T22:50:56.279 INFO:tasks.workunit.client.0.smithi138.stdout:8/470: rmdir db/dd/d13/d19/d7d 39 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:8/471: creat db/d15/f94 x:0 0 0 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:9/581: write d0/d2e/f6e [756565,86359] 0 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:9/582: write d0/de/d34/f75 [3993942,32428] 0 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:9/583: stat d0/de/d14/d22 0 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:9/584: chown d0/de/d34/f75 1148937184 1 2024-02-15T22:50:56.281 INFO:tasks.workunit.client.0.smithi138.stdout:8/472: mkdir db/d95 0 2024-02-15T22:50:56.288 INFO:tasks.workunit.client.0.smithi138.stdout:9/585: write d0/d4/f5 [4352885,4225] 0 2024-02-15T22:50:56.290 INFO:tasks.workunit.client.0.smithi138.stdout:8/473: dread db/dd/f3e [0,4194304] 0 2024-02-15T22:50:56.293 INFO:tasks.workunit.client.0.smithi138.stdout:8/474: unlink db/dd/d13/l18 0 2024-02-15T22:50:56.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/586: dread d0/de/d33/f7f [0,4194304] 0 2024-02-15T22:50:56.293 INFO:tasks.workunit.client.0.smithi138.stdout:8/475: truncate db/dd/d13/d19/f43 143609 0 2024-02-15T22:50:56.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/587: creat d0/d2e/fc6 x:0 0 0 2024-02-15T22:50:56.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/588: dread d0/d55/f61 [0,4194304] 0 2024-02-15T22:50:56.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/589: write d0/f27 [2124646,55226] 0 2024-02-15T22:50:56.296 INFO:tasks.workunit.client.0.smithi138.stdout:9/590: mkdir d0/dc7 0 2024-02-15T22:50:56.314 INFO:tasks.workunit.client.0.smithi138.stdout:9/591: dwrite d0/de/d33/d98/fae [0,4194304] 0 2024-02-15T22:50:56.315 INFO:tasks.workunit.client.0.smithi138.stdout:8/476: dwrite db/d15/d70/f61 [0,4194304] 0 2024-02-15T22:50:56.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/477: mkdir db/dd/d13/d19/d96 0 2024-02-15T22:50:56.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/478: creat db/dd/d13/d19/f97 x:0 0 0 2024-02-15T22:50:56.327 INFO:tasks.workunit.client.0.smithi138.stdout:8/479: dread f3 [4194304,4194304] 0 2024-02-15T22:50:56.329 INFO:tasks.workunit.client.0.smithi138.stdout:8/480: unlink db/dd/d13/d19/f49 0 2024-02-15T22:50:56.330 INFO:tasks.workunit.client.0.smithi138.stdout:8/481: rmdir db/d15/d70 39 2024-02-15T22:50:56.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/592: dwrite d0/d55/f5e [4194304,4194304] 0 2024-02-15T22:50:56.332 INFO:tasks.workunit.client.0.smithi138.stdout:9/593: fdatasync d0/de/f47 0 2024-02-15T22:50:56.332 INFO:tasks.workunit.client.0.smithi138.stdout:8/482: rmdir db/dd/d13/d77/d7e 0 2024-02-15T22:50:56.332 INFO:tasks.workunit.client.0.smithi138.stdout:8/483: read - db/dd/d13/d19/f97 zero size 2024-02-15T22:50:56.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/594: unlink d0/d55/f5b 0 2024-02-15T22:50:56.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/595: write d0/de/d14/f2a [437609,94172] 0 2024-02-15T22:50:56.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/596: write d0/de/d33/f36 [4196740,39899] 0 2024-02-15T22:50:56.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/597: readlink d0/de/d48/l4a 0 2024-02-15T22:50:56.340 INFO:tasks.workunit.client.0.smithi138.stdout:8/484: write db/dd/d13/d19/d7d/f89 [9271,8961] 0 2024-02-15T22:50:56.340 INFO:tasks.workunit.client.0.smithi138.stdout:8/485: creat db/dd/d22/f98 x:0 0 0 2024-02-15T22:50:56.341 INFO:tasks.workunit.client.0.smithi138.stdout:8/486: write db/f58 [21756,9857] 0 2024-02-15T22:50:56.343 INFO:tasks.workunit.client.0.smithi138.stdout:8/487: unlink db/dd/d13/d19/l3a 0 2024-02-15T22:50:56.345 INFO:tasks.workunit.client.0.smithi138.stdout:8/488: rename db/d15/d70/f61 to db/f99 0 2024-02-15T22:50:56.346 INFO:tasks.workunit.client.0.smithi138.stdout:8/489: rename db/dd/d13/f1c to db/dd/d4d/f9a 0 2024-02-15T22:50:56.347 INFO:tasks.workunit.client.0.smithi138.stdout:8/490: unlink c8 0 2024-02-15T22:50:56.351 INFO:tasks.workunit.client.0.smithi138.stdout:9/598: dwrite d0/de/d33/d98/fbf [0,4194304] 0 2024-02-15T22:50:56.354 INFO:tasks.workunit.client.0.smithi138.stdout:9/599: rmdir d0/d2e/dc5 0 2024-02-15T22:50:56.356 INFO:tasks.workunit.client.0.smithi138.stdout:8/491: fsync f3 0 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/600: rename d0/df/d11/d23 to d0/de/d14/da3/dc8 0 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/601: chown d0/de/d33/d98/fae 30112168 1 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/602: read - d0/d1/fb2 zero size 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/603: write d0/d55/fb7 [475692,87602] 0 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/604: write d0/de/d14/da3/dc8/f9f [1029022,62431] 0 2024-02-15T22:50:56.361 INFO:tasks.workunit.client.0.smithi138.stdout:9/605: read d0/de/d14/da3/dc8/f43 [606651,78704] 0 2024-02-15T22:50:56.362 INFO:tasks.workunit.client.0.smithi138.stdout:9/606: symlink d0/de/d14/lc9 0 2024-02-15T22:50:56.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/492: rename db/dd/d13/l44 to db/d95/l9b 0 2024-02-15T22:50:56.364 INFO:tasks.workunit.client.0.smithi138.stdout:9/607: mknod d0/de/d14/d22/dc2/cca 0 2024-02-15T22:50:56.365 INFO:tasks.workunit.client.0.smithi138.stdout:9/608: symlink d0/dc7/lcb 0 2024-02-15T22:50:56.366 INFO:tasks.workunit.client.0.smithi138.stdout:9/609: dread - d0/de/d14/da3/dc8/fbb zero size 2024-02-15T22:50:56.384 INFO:tasks.workunit.client.0.smithi138.stdout:8/493: dwrite db/f38 [0,4194304] 0 2024-02-15T22:50:56.384 INFO:tasks.workunit.client.0.smithi138.stdout:9/610: dwrite d0/d1/faa [0,4194304] 0 2024-02-15T22:50:56.384 INFO:tasks.workunit.client.0.smithi138.stdout:9/611: write d0/de/d33/f8a [2847404,99282] 0 2024-02-15T22:50:56.388 INFO:tasks.workunit.client.0.smithi138.stdout:8/494: rmdir db/dd/d13/d19/d96 0 2024-02-15T22:50:56.389 INFO:tasks.workunit.client.0.smithi138.stdout:8/495: rename db to db/d15/d9c 22 2024-02-15T22:50:56.391 INFO:tasks.workunit.client.0.smithi138.stdout:8/496: creat db/d15/f9d x:0 0 0 2024-02-15T22:50:56.391 INFO:tasks.workunit.client.0.smithi138.stdout:8/497: fdatasync db/dd/f14 0 2024-02-15T22:50:56.391 INFO:tasks.workunit.client.0.smithi138.stdout:8/498: readlink db/dd/d13/d19/d45/l51 0 2024-02-15T22:50:56.397 INFO:tasks.workunit.client.0.smithi138.stdout:8/499: dread db/dd/d13/f31 [0,4194304] 0 2024-02-15T22:50:56.402 INFO:tasks.workunit.client.0.smithi138.stdout:9/612: dwrite d0/d1/fb2 [0,4194304] 0 2024-02-15T22:50:56.402 INFO:tasks.workunit.client.0.smithi138.stdout:9/613: write d0/de/f47 [2835712,96051] 0 2024-02-15T22:50:56.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/614: truncate d0/d55/f61 984788 0 2024-02-15T22:50:56.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/615: fdatasync d0/df/f56 0 2024-02-15T22:50:56.405 INFO:tasks.workunit.client.0.smithi138.stdout:9/616: rmdir d0/de/d14/d18 39 2024-02-15T22:50:56.405 INFO:tasks.workunit.client.0.smithi138.stdout:9/617: fdatasync d0/df/f56 0 2024-02-15T22:50:56.407 INFO:tasks.workunit.client.0.smithi138.stdout:9/618: link d0/de/d14/c51 d0/de/d14/da3/dc8/ccc 0 2024-02-15T22:50:56.409 INFO:tasks.workunit.client.0.smithi138.stdout:9/619: link d0/de/d33/f36 d0/d2e/fcd 0 2024-02-15T22:50:56.409 INFO:tasks.workunit.client.0.smithi138.stdout:9/620: creat d0/d55/fce x:0 0 0 2024-02-15T22:50:56.410 INFO:tasks.workunit.client.0.smithi138.stdout:8/500: dwrite db/dd/d13/d19/f83 [0,4194304] 0 2024-02-15T22:50:56.414 INFO:tasks.workunit.client.0.smithi138.stdout:8/501: mkdir db/dd/d22/d9e 0 2024-02-15T22:50:56.416 INFO:tasks.workunit.client.0.smithi138.stdout:8/502: mknod db/d15/d70/d7c/c9f 0 2024-02-15T22:50:56.418 INFO:tasks.workunit.client.0.smithi138.stdout:8/503: mkdir db/da0 0 2024-02-15T22:50:56.421 INFO:tasks.workunit.client.0.smithi138.stdout:8/504: symlink db/d15/d70/d7c/la1 0 2024-02-15T22:50:56.421 INFO:tasks.workunit.client.0.smithi138.stdout:8/505: truncate db/d15/f9d 1031707 0 2024-02-15T22:50:56.422 INFO:tasks.workunit.client.0.smithi138.stdout:8/506: creat db/d95/fa2 x:0 0 0 2024-02-15T22:50:56.438 INFO:tasks.workunit.client.0.smithi138.stdout:9/621: dwrite d0/de/d33/f77 [4194304,4194304] 0 2024-02-15T22:50:56.438 INFO:tasks.workunit.client.0.smithi138.stdout:9/622: write d0/d1/faa [4724971,85346] 0 2024-02-15T22:50:56.438 INFO:tasks.workunit.client.0.smithi138.stdout:9/623: creat d0/d2e/fcf x:0 0 0 2024-02-15T22:50:56.439 INFO:tasks.workunit.client.0.smithi138.stdout:8/507: dwrite db/dd/f4e [0,4194304] 0 2024-02-15T22:50:56.441 INFO:tasks.workunit.client.0.smithi138.stdout:9/624: rename d0/de/d33/f8a to d0/de/d14/da3/dc8/d6a/fd0 0 2024-02-15T22:50:56.443 INFO:tasks.workunit.client.0.smithi138.stdout:8/508: dread - db/d15/f5f zero size 2024-02-15T22:50:56.443 INFO:tasks.workunit.client.0.smithi138.stdout:8/509: creat db/dd/d13/d19/fa3 x:0 0 0 2024-02-15T22:50:56.443 INFO:tasks.workunit.client.0.smithi138.stdout:8/510: readlink db/dd/d22/l78 0 2024-02-15T22:50:56.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.443+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f899c02ce80 con 0x7f899c0fe9d0 2024-02-15T22:50:56.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.443+0000 7f8983fff700 1 -- 172.21.15.138:0/1967125831 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f899005ace0 con 0x7f899c0fe9d0 2024-02-15T22:50:56.445 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:50:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-02-15T22:50:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:50:56.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:50:56.447 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:50:56.447 INFO:tasks.workunit.client.0.smithi138.stdout:9/625: rmdir d0/de/d14/da3/dc8/d71/d7b/d9e/dc1 0 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.446+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 msgr2=0x7f898406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.446+0000 7f89a1014700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 0x7f898406f3c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f898c009a10 tx=0x7f898c009190 comp rx=0 tx=0).stop 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.446+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 msgr2=0x7f899c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.446+0000 7f89a1014700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8990005b40 tx=0x7f899000bd70 comp rx=0 tx=0).stop 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 shutdown_connections 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f898406cf10 0x7f898406f3c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f899c0fe9d0 0x7f899c19c060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 --2- 172.21.15.138:0/1967125831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c101330 0x7f899c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 >> 172.21.15.138:0/1967125831 conn(0x7f899c0fa5e0 msgr2=0x7f899c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:56.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 shutdown_connections 2024-02-15T22:50:56.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.447+0000 7f89a1014700 1 -- 172.21.15.138:0/1967125831 wait complete. 2024-02-15T22:50:56.450 INFO:tasks.workunit.client.0.smithi138.stdout:8/511: unlink db/d95/fa2 0 2024-02-15T22:50:56.455 INFO:tasks.workunit.client.0.smithi138.stdout:9/626: getdents d0/de/d14 0 2024-02-15T22:50:56.471 INFO:tasks.workunit.client.0.smithi138.stdout:8/512: dwrite db/dd/d13/f79 [0,4194304] 0 2024-02-15T22:50:56.476 INFO:tasks.workunit.client.0.smithi138.stdout:9/627: dwrite d0/de/d34/f94 [0,4194304] 0 2024-02-15T22:50:56.478 INFO:tasks.workunit.client.0.smithi138.stdout:9/628: symlink d0/d55/d59/ld1 0 2024-02-15T22:50:56.478 INFO:tasks.workunit.client.0.smithi138.stdout:9/629: truncate d0/de/d48/f96 90633 0 2024-02-15T22:50:56.478 INFO:tasks.workunit.client.0.smithi138.stdout:9/630: fdatasync d0/fc0 0 2024-02-15T22:50:56.481 INFO:tasks.workunit.client.0.smithi138.stdout:8/513: write db/dd/d13/d19/f83 [2457872,126334] 0 2024-02-15T22:50:56.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/514: creat db/dd/d4d/fa4 x:0 0 0 2024-02-15T22:50:56.483 INFO:tasks.workunit.client.0.smithi138.stdout:8/515: link db/ff db/fa5 0 2024-02-15T22:50:56.484 INFO:tasks.workunit.client.0.smithi138.stdout:8/516: rename db/dd/l71 to db/d95/la6 0 2024-02-15T22:50:56.486 INFO:tasks.workunit.client.0.smithi138.stdout:8/517: write db/dd/d22/f73 [274735,83427] 0 2024-02-15T22:50:56.495 INFO:tasks.workunit.client.0.smithi138.stdout:9/631: dwrite d0/de/d14/f44 [4194304,4194304] 0 2024-02-15T22:50:56.500 INFO:tasks.workunit.client.0.smithi138.stdout:7/637: sync 2024-02-15T22:50:56.500 INFO:tasks.workunit.client.0.smithi138.stdout:1/339: sync 2024-02-15T22:50:56.500 INFO:tasks.workunit.client.0.smithi138.stdout:1/340: fdatasync df/d1b/f69 0 2024-02-15T22:50:56.500 INFO:tasks.workunit.client.0.smithi138.stdout:1/341: chown df/c63 16 1 2024-02-15T22:50:56.502 INFO:tasks.workunit.client.0.smithi138.stdout:7/638: unlink d1/d79/d84/fd8 0 2024-02-15T22:50:56.502 INFO:tasks.workunit.client.0.smithi138.stdout:7/639: truncate d1/d2/db/d3c/d4d/d5b/f62 1628863 0 2024-02-15T22:50:56.502 INFO:tasks.workunit.client.0.smithi138.stdout:7/640: fsync d1/d2/db/d3c/f45 0 2024-02-15T22:50:56.504 INFO:tasks.workunit.client.0.smithi138.stdout:7/641: creat d1/d79/d84/da0/fdb x:0 0 0 2024-02-15T22:50:56.505 INFO:tasks.workunit.client.0.smithi138.stdout:7/642: truncate d1/d79/d84/da0/fb7 578386 0 2024-02-15T22:50:56.509 INFO:tasks.workunit.client.0.smithi138.stdout:1/342: write df/d1b/d1d/d25/f61 [3779700,54626] 0 2024-02-15T22:50:56.510 INFO:tasks.workunit.client.0.smithi138.stdout:7/643: mknod d1/d2/db/d3c/d4d/d5b/cdc 0 2024-02-15T22:50:56.510 INFO:tasks.workunit.client.0.smithi138.stdout:1/343: rmdir df 39 2024-02-15T22:50:56.512 INFO:tasks.workunit.client.0.smithi138.stdout:7/644: dread d1/d2/f44 [0,4194304] 0 2024-02-15T22:50:56.513 INFO:tasks.workunit.client.0.smithi138.stdout:1/344: rmdir df/d1b/d1d 39 2024-02-15T22:50:56.517 INFO:tasks.workunit.client.0.smithi138.stdout:9/632: dwrite d0/de/d33/f7f [4194304,4194304] 0 2024-02-15T22:50:56.518 INFO:tasks.workunit.client.0.smithi138.stdout:8/518: dwrite db/dd/d22/f73 [0,4194304] 0 2024-02-15T22:50:56.518 INFO:tasks.workunit.client.0.smithi138.stdout:1/345: dread df/d1b/f3d [0,4194304] 0 2024-02-15T22:50:56.520 INFO:tasks.workunit.client.0.smithi138.stdout:9/633: getdents d0/de/d14/da3/dc8/d71 0 2024-02-15T22:50:56.521 INFO:tasks.workunit.client.0.smithi138.stdout:7/645: dread d1/d2/db/d3c/f45 [0,4194304] 0 2024-02-15T22:50:56.521 INFO:tasks.workunit.client.0.smithi138.stdout:9/634: creat d0/dc7/fd2 x:0 0 0 2024-02-15T22:50:56.522 INFO:tasks.workunit.client.0.smithi138.stdout:7/646: symlink d1/d2/db/d25/d41/ldd 0 2024-02-15T22:50:56.523 INFO:tasks.workunit.client.0.smithi138.stdout:9/635: rmdir d0/de/d33/d57 39 2024-02-15T22:50:56.535 INFO:tasks.workunit.client.0.smithi138.stdout:1/346: dread df/d1b/d1d/d25/d2c/f2f [0,4194304] 0 2024-02-15T22:50:56.536 INFO:tasks.workunit.client.0.smithi138.stdout:1/347: getdents df/d1b/d21/d4f 0 2024-02-15T22:50:56.537 INFO:tasks.workunit.client.0.smithi138.stdout:1/348: symlink df/d1b/d1d/d60/l7a 0 2024-02-15T22:50:56.538 INFO:tasks.workunit.client.0.smithi138.stdout:1/349: stat df/d1b/d1d/d25/c62 0 2024-02-15T22:50:56.540 INFO:tasks.workunit.client.0.smithi138.stdout:8/519: dwrite db/f29 [0,4194304] 0 2024-02-15T22:50:56.541 INFO:tasks.workunit.client.0.smithi138.stdout:8/520: rmdir db/dd/d13/d77 39 2024-02-15T22:50:56.542 INFO:tasks.workunit.client.0.smithi138.stdout:1/350: dread df/d1b/d1d/d25/f42 [0,4194304] 0 2024-02-15T22:50:56.542 INFO:tasks.workunit.client.0.smithi138.stdout:8/521: symlink db/dd/d22/la7 0 2024-02-15T22:50:56.542 INFO:tasks.workunit.client.0.smithi138.stdout:7/647: dwrite d1/d79/d84/da0/fdb [0,4194304] 0 2024-02-15T22:50:56.543 INFO:tasks.workunit.client.0.smithi138.stdout:1/351: mkdir df/d1b/d1d/d25/d2e/d5b/d7b 0 2024-02-15T22:50:56.543 INFO:tasks.workunit.client.0.smithi138.stdout:1/352: chown fa 6737 1 2024-02-15T22:50:56.543 INFO:tasks.workunit.client.0.smithi138.stdout:1/353: stat df/d1b/d1d/d25/d2c/f2f 0 2024-02-15T22:50:56.545 INFO:tasks.workunit.client.0.smithi138.stdout:8/522: creat db/dd/fa8 x:0 0 0 2024-02-15T22:50:56.547 INFO:tasks.workunit.client.0.smithi138.stdout:1/354: link df/d1b/d1d/c31 df/d1b/d1d/d60/c7c 0 2024-02-15T22:50:56.548 INFO:tasks.workunit.client.0.smithi138.stdout:8/523: symlink db/d15/d70/d7c/d92/la9 0 2024-02-15T22:50:56.550 INFO:tasks.workunit.client.0.smithi138.stdout:1/355: mknod df/d1b/d1d/d25/d2c/d3f/c7d 0 2024-02-15T22:50:56.551 INFO:tasks.workunit.client.0.smithi138.stdout:7/648: dread d1/d5a/f6d [0,4194304] 0 2024-02-15T22:50:56.551 INFO:tasks.workunit.client.0.smithi138.stdout:9/636: dwrite d0/fc0 [0,4194304] 0 2024-02-15T22:50:56.551 INFO:tasks.workunit.client.0.smithi138.stdout:1/356: mknod df/c7e 0 2024-02-15T22:50:56.557 INFO:tasks.workunit.client.0.smithi138.stdout:8/524: dread db/ff [4194304,4194304] 0 2024-02-15T22:50:56.557 INFO:tasks.workunit.client.0.smithi138.stdout:7/649: rename d1/c47 to d1/d79/d84/cde 0 2024-02-15T22:50:56.559 INFO:tasks.workunit.client.0.smithi138.stdout:1/357: mknod df/d1b/c7f 0 2024-02-15T22:50:56.567 INFO:tasks.workunit.client.0.smithi138.stdout:9/637: write d0/de/d33/d57/f95 [3512748,117765] 0 2024-02-15T22:50:56.568 INFO:tasks.workunit.client.0.smithi138.stdout:1/358: dread df/d1b/d1d/d25/d2e/d6c/f76 [0,4194304] 0 2024-02-15T22:50:56.569 INFO:tasks.workunit.client.0.smithi138.stdout:8/525: fsync db/dd/d13/f6d 0 2024-02-15T22:50:56.574 INFO:tasks.workunit.client.0.smithi138.stdout:8/526: mkdir db/d15/daa 0 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:0/517: sync 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/429: sync 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/430: stat dc/c20 0 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/431: creat dc/d24/d34/d3b/d7c/f91 x:0 0 0 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/432: write dc/f1e [5062732,11059] 0 2024-02-15T22:50:56.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/433: truncate dc/d24/d34/d3b/f90 34375 0 2024-02-15T22:50:56.576 INFO:tasks.workunit.client.0.smithi138.stdout:7/650: rename d1/d79/d84/d64 to d1/d79/d84/da0/ddf 0 2024-02-15T22:50:56.576 INFO:tasks.workunit.client.0.smithi138.stdout:9/638: dread d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:56.576 INFO:tasks.workunit.client.0.smithi138.stdout:8/527: creat db/dd/d13/d77/d8f/fab x:0 0 0 2024-02-15T22:50:56.577 INFO:tasks.workunit.client.0.smithi138.stdout:0/518: creat d6/d10/d13/fb7 x:0 0 0 2024-02-15T22:50:56.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/359: rename df/d1b/d1d/d25/d2c to df/d1b/d1d/d25/d2e/d5b/d65/d80 0 2024-02-15T22:50:56.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/360: truncate df/d1b/d1d/d24/d3a/f40 1930707 0 2024-02-15T22:50:56.581 INFO:tasks.workunit.client.0.smithi138.stdout:9/639: mkdir d0/de/d34/dd3 0 2024-02-15T22:50:56.581 INFO:tasks.workunit.client.0.smithi138.stdout:7/651: write d1/d2/d29/fb8 [3046350,78343] 0 2024-02-15T22:50:56.583 INFO:tasks.workunit.client.0.smithi138.stdout:6/434: rename dc/f2a to dc/d24/d34/d3b/d7c/f92 0 2024-02-15T22:50:56.584 INFO:tasks.workunit.client.0.smithi138.stdout:6/435: creat dc/d24/d34/d3b/d7c/f93 x:0 0 0 2024-02-15T22:50:56.585 INFO:tasks.workunit.client.0.smithi138.stdout:1/361: link df/d1b/d1d/f20 df/d1b/d1d/d25/d2e/d37/f81 0 2024-02-15T22:50:56.585 INFO:tasks.workunit.client.0.smithi138.stdout:0/519: dread d6/d10/d18/f32 [0,4194304] 0 2024-02-15T22:50:56.587 INFO:tasks.workunit.client.0.smithi138.stdout:9/640: creat d0/fd4 x:0 0 0 2024-02-15T22:50:56.587 INFO:tasks.workunit.client.0.smithi138.stdout:9/641: truncate d0/de/d33/f76 1029655 0 2024-02-15T22:50:56.588 INFO:tasks.workunit.client.0.smithi138.stdout:7/652: mknod d1/d2/ce0 0 2024-02-15T22:50:56.588 INFO:tasks.workunit.client.0.smithi138.stdout:7/653: write d1/d2/db/d25/f99 [574955,118998] 0 2024-02-15T22:50:56.588 INFO:tasks.workunit.client.0.smithi138.stdout:7/654: write d1/f12 [182100,44263] 0 2024-02-15T22:50:56.588 INFO:tasks.workunit.client.0.smithi138.stdout:7/655: creat d1/d79/d84/da0/fe1 x:0 0 0 2024-02-15T22:50:56.588 INFO:tasks.workunit.client.0.smithi138.stdout:7/656: read d1/d2/db/fe [4539805,19654] 0 2024-02-15T22:50:56.590 INFO:tasks.workunit.client.0.smithi138.stdout:1/362: symlink df/d1b/d1d/l82 0 2024-02-15T22:50:56.591 INFO:tasks.workunit.client.0.smithi138.stdout:8/528: write db/dd/d13/f3b [3543768,59752] 0 2024-02-15T22:50:56.591 INFO:tasks.workunit.client.0.smithi138.stdout:8/529: dread - db/d15/d70/f7a zero size 2024-02-15T22:50:56.593 INFO:tasks.workunit.client.0.smithi138.stdout:9/642: rename d0/de/d14/ca5 to d0/de/d14/da3/dc8/d71/d7b/d9e/cd5 0 2024-02-15T22:50:56.595 INFO:tasks.workunit.client.0.smithi138.stdout:1/363: creat df/f83 x:0 0 0 2024-02-15T22:50:56.596 INFO:tasks.workunit.client.0.smithi138.stdout:1/364: write df/d1b/d1d/f28 [788726,35989] 0 2024-02-15T22:50:56.597 INFO:tasks.workunit.client.0.smithi138.stdout:9/643: symlink d0/de/d33/ld6 0 2024-02-15T22:50:56.598 INFO:tasks.workunit.client.0.smithi138.stdout:1/365: rmdir df/d1b/d1d 39 2024-02-15T22:50:56.600 INFO:tasks.workunit.client.0.smithi138.stdout:7/657: read d1/d2/fbb [2156117,12814] 0 2024-02-15T22:50:56.600 INFO:tasks.workunit.client.0.smithi138.stdout:7/658: write d1/d2/db/fe [4457934,49450] 0 2024-02-15T22:50:56.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/644: link d0/de/d14/da3/dc8/d71/d7b/f8c d0/d55/d59/dac/fd7 0 2024-02-15T22:50:56.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/645: write d0/de/d34/f3e [941973,123461] 0 2024-02-15T22:50:56.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/646: chown d0/ca 97265 1 2024-02-15T22:50:56.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/647: fsync d0/f8 0 2024-02-15T22:50:56.601 INFO:tasks.workunit.client.0.smithi138.stdout:9/648: fsync d0/de/fba 0 2024-02-15T22:50:56.603 INFO:tasks.workunit.client.0.smithi138.stdout:1/366: link df/d1b/d1d/f20 df/d1b/d1d/d25/d2e/f84 0 2024-02-15T22:50:56.603 INFO:tasks.workunit.client.0.smithi138.stdout:1/367: write df/d1b/d1d/d24/f38 [871301,49415] 0 2024-02-15T22:50:56.603 INFO:tasks.workunit.client.0.smithi138.stdout:1/368: write df/f14 [4530751,4310] 0 2024-02-15T22:50:56.604 INFO:tasks.workunit.client.0.smithi138.stdout:1/369: chown df/d1b/d1d/d25/d2e/d5b/d65/d80 820772 1 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 -- 172.21.15.138:0/366567767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc101360 msgr2=0x7f5ecc1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/366567767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc101360 0x7f5ecc1017b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009910 tx=0x7f5eb4009c20 comp rx=0 tx=0).stop 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 -- 172.21.15.138:0/366567767 shutdown_connections 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/366567767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc101360 0x7f5ecc1017b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/366567767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc100160 0x7f5ecc100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 -- 172.21.15.138:0/366567767 >> 172.21.15.138:0/366567767 conn(0x7f5ecc0fb6f0 msgr2=0x7f5ecc0fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:56.605 INFO:tasks.workunit.client.0.smithi138.stdout:0/520: dwrite d6/d10/d13/f2b [0,4194304] 0 2024-02-15T22:50:56.605 INFO:tasks.workunit.client.0.smithi138.stdout:0/521: chown d6/d10/d13/f16 289391 1 2024-02-15T22:50:56.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 -- 172.21.15.138:0/366567767 shutdown_connections 2024-02-15T22:50:56.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.602+0000 7f5ed21aa700 1 -- 172.21.15.138:0/366567767 wait complete. 2024-02-15T22:50:56.606 INFO:tasks.workunit.client.0.smithi138.stdout:7/659: mkdir d1/d28/d7c/de2 0 2024-02-15T22:50:56.606 INFO:tasks.workunit.client.0.smithi138.stdout:7/660: fdatasync d1/d79/d84/da0/fc2 0 2024-02-15T22:50:56.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.603+0000 7f5ed21aa700 1 Processor -- start 2024-02-15T22:50:56.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ed21aa700 1 -- start start 2024-02-15T22:50:56.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ed21aa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 0x7f5ecc191d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ed21aa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ed21aa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc18e850 con 0x7f5ecc101360 2024-02-15T22:50:56.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ed21aa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc18e9c0 con 0x7f5ecc100160 2024-02-15T22:50:56.607 INFO:tasks.workunit.client.0.smithi138.stdout:9/649: link d0/de/d14/lc9 d0/df/d11/ld8 0 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ecaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ecaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35688/0 (socket says 172.21.15.138:35688) 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ecaffd700 1 -- 172.21.15.138:0/4010382090 learned_addr learned my addr 172.21.15.138:0/4010382090 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.604+0000 7f5ecb7fe700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 0x7f5ecc191d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ecaffd700 1 -- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 msgr2=0x7f5ecc191d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ecaffd700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 0x7f5ecc191d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ecaffd700 1 -- 172.21.15.138:0/4010382090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40095f0 con 0x7f5ecc101360 2024-02-15T22:50:56.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ecb7fe700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 0x7f5ecc191d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ecaffd700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400fa00 tx=0x7f5eb400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb401d070 con 0x7f5ecc101360 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc18ec40 con 0x7f5ecc101360 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc18f130 con 0x7f5ecc101360 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5eb4005640 con 0x7f5ecc101360 2024-02-15T22:50:56.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.605+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb4017630 con 0x7f5ecc101360 2024-02-15T22:50:56.609 INFO:tasks.workunit.client.0.smithi138.stdout:6/436: dread dc/f1e [0,4194304] 0 2024-02-15T22:50:56.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.606+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac005320 con 0x7f5ecc101360 2024-02-15T22:50:56.610 INFO:tasks.workunit.client.0.smithi138.stdout:1/370: rmdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f 39 2024-02-15T22:50:56.610 INFO:tasks.workunit.client.0.smithi138.stdout:1/371: write df/d1b/d1d/d25/d2e/d5b/f67 [649707,126626] 0 2024-02-15T22:50:56.610 INFO:tasks.workunit.client.0.smithi138.stdout:1/372: chown df/d1b/d1d/l82 176743 1 2024-02-15T22:50:56.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.608+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f5eb40050d0 con 0x7f5ecc101360 2024-02-15T22:50:56.611 INFO:tasks.workunit.client.0.smithi138.stdout:7/661: truncate d1/d79/d84/d8c/fc1 1547205 0 2024-02-15T22:50:56.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.609+0000 7f5ec8ff9700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 0x7f5eb806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:50:56.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.609+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5eb408dd60 con 0x7f5ecc101360 2024-02-15T22:50:56.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.609+0000 7f5ecb7fe700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 0x7f5eb806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:50:56.612 INFO:tasks.workunit.client.0.smithi138.stdout:9/650: mknod d0/de/d33/d98/da6/cd9 0 2024-02-15T22:50:56.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.610+0000 7f5ecb7fe700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 0x7f5eb806f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc1011c0 tx=0x7f5ebc009260 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:50:56.614 INFO:tasks.workunit.client.0.smithi138.stdout:9/651: link d0/d55/d59/l91 d0/dc7/lda 0 2024-02-15T22:50:56.615 INFO:tasks.workunit.client.0.smithi138.stdout:9/652: truncate d0/d1/faa 2929767 0 2024-02-15T22:50:56.616 INFO:tasks.workunit.client.0.smithi138.stdout:1/373: write df/d1b/d1d/d24/d3a/f44 [2800675,39574] 0 2024-02-15T22:50:56.617 INFO:tasks.workunit.client.0.smithi138.stdout:9/653: creat d0/de/d34/d89/fdb x:0 0 0 2024-02-15T22:50:56.617 INFO:tasks.workunit.client.0.smithi138.stdout:1/374: dread df/d1b/d1d/d60/f6f [0,4194304] 0 2024-02-15T22:50:56.617 INFO:tasks.workunit.client.0.smithi138.stdout:9/654: write d0/dc7/fd2 [283023,28194] 0 2024-02-15T22:50:56.620 INFO:tasks.workunit.client.0.smithi138.stdout:9/655: mkdir d0/d1/db8/ddc 0 2024-02-15T22:50:56.620 INFO:tasks.workunit.client.0.smithi138.stdout:9/656: creat d0/df/d11/fdd x:0 0 0 2024-02-15T22:50:56.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.618+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f5eb405b520 con 0x7f5ecc101360 2024-02-15T22:50:56.625 INFO:tasks.workunit.client.0.smithi138.stdout:7/662: write d1/d2/db/f7b [307309,31114] 0 2024-02-15T22:50:56.625 INFO:tasks.workunit.client.0.smithi138.stdout:9/657: rename d0/df/d11/f60 to d0/df/fde 0 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:5/340: sync 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:5/341: creat df/d18/d3e/d60/f6b x:0 0 0 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:4/691: sync 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:4/692: chown d17/d2b/f9f 15 1 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:2/510: sync 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:3/620: sync 2024-02-15T22:50:56.627 INFO:tasks.workunit.client.0.smithi138.stdout:3/621: chown d5/d12/c25 29938 1 2024-02-15T22:50:56.629 INFO:tasks.workunit.client.0.smithi138.stdout:1/375: write fe [1083296,66935] 0 2024-02-15T22:50:56.629 INFO:tasks.workunit.client.0.smithi138.stdout:1/376: truncate df/d1b/d33/f75 635238 0 2024-02-15T22:50:56.631 INFO:tasks.workunit.client.0.smithi138.stdout:0/522: dwrite d6/d10/d40/f5c [0,4194304] 0 2024-02-15T22:50:56.631 INFO:tasks.workunit.client.0.smithi138.stdout:0/523: chown d6/d10/d40/l54 639494 1 2024-02-15T22:50:56.640 INFO:tasks.workunit.client.0.smithi138.stdout:9/658: rename d0/de/d14/f88 to d0/d55/d59/fdf 0 2024-02-15T22:50:56.647 INFO:tasks.workunit.client.0.smithi138.stdout:1/377: mknod df/d1b/c85 0 2024-02-15T22:50:56.653 INFO:tasks.workunit.client.0.smithi138.stdout:2/511: dwrite d0/da/d19/f54 [0,4194304] 0 2024-02-15T22:50:56.654 INFO:tasks.workunit.client.0.smithi138.stdout:0/524: rename f0 to d6/d10/d34/fb8 0 2024-02-15T22:50:56.654 INFO:tasks.workunit.client.0.smithi138.stdout:0/525: chown d6/d10/d52/d72/c9c 11135 1 2024-02-15T22:50:56.654 INFO:tasks.workunit.client.0.smithi138.stdout:0/526: stat d6/d10/d18/d57/f5e 0 2024-02-15T22:50:56.655 INFO:tasks.workunit.client.0.smithi138.stdout:3/622: dwrite d5/d12/d23/f4c [0,4194304] 0 2024-02-15T22:50:56.660 INFO:tasks.workunit.client.0.smithi138.stdout:1/378: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d86 0 2024-02-15T22:50:56.664 INFO:tasks.workunit.client.0.smithi138.stdout:7/663: dwrite d1/d2/d29/fd9 [0,4194304] 0 2024-02-15T22:50:56.667 INFO:tasks.workunit.client.0.smithi138.stdout:0/527: write d6/d10/d18/d1b/f23 [3825190,103027] 0 2024-02-15T22:50:56.672 INFO:tasks.workunit.client.0.smithi138.stdout:2/512: dread - d0/fa6 zero size 2024-02-15T22:50:56.673 INFO:tasks.workunit.client.0.smithi138.stdout:1/379: truncate df/f12 548873 0 2024-02-15T22:50:56.675 INFO:tasks.workunit.client.0.smithi138.stdout:2/513: dread d0/dd/d15/f71 [0,4194304] 0 2024-02-15T22:50:56.675 INFO:tasks.workunit.client.0.smithi138.stdout:2/514: fdatasync d0/dd/d15/f4b 0 2024-02-15T22:50:56.675 INFO:tasks.workunit.client.0.smithi138.stdout:2/515: fsync d0/da/d19/d53/d5d/d83/f88 0 2024-02-15T22:50:56.676 INFO:tasks.workunit.client.0.smithi138.stdout:1/380: dread df/f79 [0,4194304] 0 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:1/381: write df/d1b/d1d/d60/f6f [1148063,88751] 0 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:1/382: getdents df/d1b/d21/d4f 0 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:1/383: readlink df/d1b/d1d/d25/d2e/d37/l43 0 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:1/384: dread - df/d1b/d1d/d24/d3a/f71 zero size 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:5/342: dwrite df/f11 [0,4194304] 0 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:5/343: dread - df/d18/d3e/d51/f5c zero size 2024-02-15T22:50:56.677 INFO:tasks.workunit.client.0.smithi138.stdout:3/623: dwrite d5/fb4 [0,4194304] 0 2024-02-15T22:50:56.679 INFO:tasks.workunit.client.0.smithi138.stdout:7/664: rmdir d1/d28/d7c/de2 0 2024-02-15T22:50:56.683 INFO:tasks.workunit.client.0.smithi138.stdout:0/528: rename d6/d10/d40/la1 to d6/d10/d52/d6f/lb9 0 2024-02-15T22:50:56.690 INFO:tasks.workunit.client.0.smithi138.stdout:5/344: link df/d18/l31 df/d18/d3e/d51/l6c 0 2024-02-15T22:50:56.693 INFO:tasks.workunit.client.0.smithi138.stdout:3/624: mkdir d5/d16/dc/dca 0 2024-02-15T22:50:56.696 INFO:tasks.workunit.client.0.smithi138.stdout:7/665: dwrite d1/d2/f93 [0,4194304] 0 2024-02-15T22:50:56.696 INFO:tasks.workunit.client.0.smithi138.stdout:2/516: write d0/f87 [17495,17603] 0 2024-02-15T22:50:56.698 INFO:tasks.workunit.client.0.smithi138.stdout:0/529: rename d6/db5 to d6/dba 0 2024-02-15T22:50:56.698 INFO:tasks.workunit.client.0.smithi138.stdout:0/530: truncate d6/d10/d40/f74 948492 0 2024-02-15T22:50:56.702 INFO:tasks.workunit.client.0.smithi138.stdout:5/345: link df/d18/c1f df/d18/d3e/d60/c6d 0 2024-02-15T22:50:56.702 INFO:tasks.workunit.client.0.smithi138.stdout:5/346: write df/f17 [3181281,36607] 0 2024-02-15T22:50:56.703 INFO:tasks.workunit.client.0.smithi138.stdout:3/625: link d5/d12/d23/d29/d5a/fb6 d5/d12/d26/d2f/fcb 0 2024-02-15T22:50:56.703 INFO:tasks.workunit.client.0.smithi138.stdout:3/626: chown d5/d12/d23/d29/c9d 1341116 1 2024-02-15T22:50:56.706 INFO:tasks.workunit.client.0.smithi138.stdout:2/517: symlink d0/da/d19/d53/d5d/d83/d8a/lbe 0 2024-02-15T22:50:56.706 INFO:tasks.workunit.client.0.smithi138.stdout:2/518: fsync d0/da/f9e 0 2024-02-15T22:50:56.707 INFO:tasks.workunit.client.0.smithi138.stdout:0/531: mkdir d6/d10/d75/dbb 0 2024-02-15T22:50:56.711 INFO:tasks.workunit.client.0.smithi138.stdout:3/627: symlink d5/d95/lcc 0 2024-02-15T22:50:56.711 INFO:tasks.workunit.client.0.smithi138.stdout:3/628: chown d5/d12/d23/d29/d5a/lb2 342243 1 2024-02-15T22:50:56.711 INFO:tasks.workunit.client.0.smithi138.stdout:3/629: chown d5/d12/d23/d29/lc7 409746 1 2024-02-15T22:50:56.713 INFO:tasks.workunit.client.0.smithi138.stdout:0/532: creat d6/d10/d13/d3d/fbc x:0 0 0 2024-02-15T22:50:56.713 INFO:tasks.workunit.client.0.smithi138.stdout:0/533: chown d6/d10/c1f 221240 1 2024-02-15T22:50:56.714 INFO:tasks.workunit.client.0.smithi138.stdout:7/666: dwrite d1/d2/f9f [0,4194304] 0 2024-02-15T22:50:56.714 INFO:tasks.workunit.client.0.smithi138.stdout:5/347: rmdir df/d18/d56 39 2024-02-15T22:50:56.719 INFO:tasks.workunit.client.0.smithi138.stdout:2/519: dread d0/dd/d15/d65/f76 [0,4194304] 0 2024-02-15T22:50:56.720 INFO:tasks.workunit.client.0.smithi138.stdout:7/667: rmdir d1/d2/db/d25 39 2024-02-15T22:50:56.722 INFO:tasks.workunit.client.0.smithi138.stdout:0/534: write d6/fb [1921170,4349] 0 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/630: dread d5/d12/d23/f4c [0,4194304] 0 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:7/668: getdents d1/d28 0 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:7/669: stat d1/d2/db/d3c/d4d/d5b/cdc 0 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/631: dread - d5/d12/d23/d29/d5a/fb6 zero size 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/632: creat d5/d16/dc/fcd x:0 0 0 2024-02-15T22:50:56.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/633: readlink d5/d16/dc/d43/d47/l74 0 2024-02-15T22:50:56.724 INFO:tasks.workunit.client.0.smithi138.stdout:0/535: dread d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:50:56.726 INFO:tasks.workunit.client.0.smithi138.stdout:5/348: write df/d18/f29 [1041912,51309] 0 2024-02-15T22:50:56.726 INFO:tasks.workunit.client.0.smithi138.stdout:7/670: rename d1/d2/db/d3c/d4d/lad to d1/d2/db/d3c/le3 0 2024-02-15T22:50:56.729 INFO:tasks.workunit.client.0.smithi138.stdout:3/634: mknod d5/d18/cce 0 2024-02-15T22:50:56.729 INFO:tasks.workunit.client.0.smithi138.stdout:3/635: fdatasync d5/d16/dc/d43/fac 0 2024-02-15T22:50:56.731 INFO:tasks.workunit.client.0.smithi138.stdout:0/536: creat d6/d10/d52/d6f/fbd x:0 0 0 2024-02-15T22:50:56.736 INFO:tasks.workunit.client.0.smithi138.stdout:5/349: unlink c8 0 2024-02-15T22:50:56.737 INFO:tasks.workunit.client.0.smithi138.stdout:3/636: dread d5/d16/dc/d43/d47/d67/f71 [0,4194304] 0 2024-02-15T22:50:56.739 INFO:tasks.workunit.client.0.smithi138.stdout:0/537: symlink d6/d10/d52/d6f/lbe 0 2024-02-15T22:50:56.740 INFO:tasks.workunit.client.0.smithi138.stdout:5/350: chown df/d18/d56/f5a 1438051859 1 2024-02-15T22:50:56.741 INFO:tasks.workunit.client.0.smithi138.stdout:3/637: mkdir d5/d16/dcf 0 2024-02-15T22:50:56.743 INFO:tasks.workunit.client.0.smithi138.stdout:5/351: rmdir df/d18/d2b 39 2024-02-15T22:50:56.749 INFO:tasks.workunit.client.0.smithi138.stdout:0/538: write d6/d10/d40/f43 [2753918,34940] 0 2024-02-15T22:50:56.753 INFO:tasks.workunit.client.0.smithi138.stdout:0/539: chown d6/d10/d18/l3e 65927 1 2024-02-15T22:50:56.754 INFO:tasks.workunit.client.0.smithi138.stdout:3/638: dread d5/d12/d23/d29/d4f/f53 [0,4194304] 0 2024-02-15T22:50:56.754 INFO:tasks.workunit.client.0.smithi138.stdout:3/639: stat d5/d12/d23/l7e 0 2024-02-15T22:50:56.754 INFO:tasks.workunit.client.0.smithi138.stdout:5/352: dread df/f37 [0,4194304] 0 2024-02-15T22:50:56.756 INFO:tasks.workunit.client.0.smithi138.stdout:0/540: mkdir d6/d10/d64/dbf 0 2024-02-15T22:50:56.758 INFO:tasks.workunit.client.0.smithi138.stdout:5/353: creat df/d18/d3e/d66/f6e x:0 0 0 2024-02-15T22:50:56.758 INFO:tasks.workunit.client.0.smithi138.stdout:5/354: write df/d18/d56/f5d [801419,6198] 0 2024-02-15T22:50:56.758 INFO:tasks.workunit.client.0.smithi138.stdout:5/355: chown df/d18/c5f 237141830 1 2024-02-15T22:50:56.761 INFO:tasks.workunit.client.0.smithi138.stdout:5/356: creat df/d18/f6f x:0 0 0 2024-02-15T22:50:56.761 INFO:tasks.workunit.client.0.smithi138.stdout:5/357: readlink df/d18/l36 0 2024-02-15T22:50:56.763 INFO:tasks.workunit.client.0.smithi138.stdout:0/541: mknod d6/d10/d40/cc0 0 2024-02-15T22:50:56.776 INFO:tasks.workunit.client.0.smithi138.stdout:3/640: dwrite d5/d18/d35/f80 [0,4194304] 0 2024-02-15T22:50:56.777 INFO:tasks.workunit.client.0.smithi138.stdout:3/641: creat d5/d12/d23/d29/fd0 x:0 0 0 2024-02-15T22:50:56.777 INFO:tasks.workunit.client.0.smithi138.stdout:3/642: symlink d5/d12/d23/d29/d5a/dc2/ld1 0 2024-02-15T22:50:56.777 INFO:tasks.workunit.client.0.smithi138.stdout:3/643: truncate d5/d12/d26/d2e/fba 673290 0 2024-02-15T22:50:56.777 INFO:tasks.workunit.client.0.smithi138.stdout:3/644: read d5/d16/dc/f76 [3074756,128873] 0 2024-02-15T22:50:56.784 INFO:tasks.workunit.client.0.smithi138.stdout:5/358: dwrite df/d18/f6f [0,4194304] 0 2024-02-15T22:50:56.786 INFO:tasks.workunit.client.0.smithi138.stdout:5/359: mknod df/d18/d3e/d60/c70 0 2024-02-15T22:50:56.787 INFO:tasks.workunit.client.0.smithi138.stdout:5/360: truncate f5 3025586 0 2024-02-15T22:50:56.787 INFO:tasks.workunit.client.0.smithi138.stdout:5/361: readlink df/d18/l36 0 2024-02-15T22:50:56.790 INFO:tasks.workunit.client.0.smithi138.stdout:3/645: dread d5/d16/dc/d43/d47/d67/f87 [0,4194304] 0 2024-02-15T22:50:56.793 INFO:tasks.workunit.client.0.smithi138.stdout:7/671: dwrite d1/d79/d84/da0/fb7 [0,4194304] 0 2024-02-15T22:50:56.793 INFO:tasks.workunit.client.0.smithi138.stdout:7/672: write d1/d2/db/d3c/d4d/d5b/f76 [1828843,94633] 0 2024-02-15T22:50:56.793 INFO:tasks.workunit.client.0.smithi138.stdout:7/673: fdatasync d1/d5a/f6d 0 2024-02-15T22:50:56.793 INFO:tasks.workunit.client.0.smithi138.stdout:7/674: readlink d1/d79/d84/l77 0 2024-02-15T22:50:56.793 INFO:tasks.workunit.client.0.smithi138.stdout:7/675: truncate d1/d5a/d97/fd6 882113 0 2024-02-15T22:50:56.794 INFO:tasks.workunit.client.0.smithi138.stdout:0/542: dwrite d6/d10/d13/f45 [0,4194304] 0 2024-02-15T22:50:56.798 INFO:tasks.workunit.client.0.smithi138.stdout:0/543: link d6/d10/d13/c89 d6/d10/d75/dbb/cc1 0 2024-02-15T22:50:56.799 INFO:tasks.workunit.client.0.smithi138.stdout:5/362: dread df/d18/d56/f5a [4194304,4194304] 0 2024-02-15T22:50:56.803 INFO:tasks.workunit.client.0.smithi138.stdout:5/363: link df/l24 df/d18/d3e/d66/l71 0 2024-02-15T22:50:56.805 INFO:tasks.workunit.client.0.smithi138.stdout:0/544: getdents d6/d10/d40 0 2024-02-15T22:50:56.807 INFO:tasks.workunit.client.0.smithi138.stdout:3/646: dwrite d5/d12/d26/d2e/f97 [0,4194304] 0 2024-02-15T22:50:56.813 INFO:tasks.workunit.client.0.smithi138.stdout:0/545: link d6/d10/d13/c8a d6/d10/d34/cc2 0 2024-02-15T22:50:56.813 INFO:tasks.workunit.client.0.smithi138.stdout:0/546: readlink d6/d10/d40/l54 0 2024-02-15T22:50:56.814 INFO:tasks.workunit.client.0.smithi138.stdout:7/676: dwrite d1/d2/db/d3c/d4d/d5b/f9a [0,4194304] 0 2024-02-15T22:50:56.814 INFO:tasks.workunit.client.0.smithi138.stdout:7/677: chown d1/d2/f30 30478 1 2024-02-15T22:50:56.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/647: mkdir d5/d16/dc/d43/da2/dc6/dd2 0 2024-02-15T22:50:56.817 INFO:tasks.workunit.client.0.smithi138.stdout:3/648: creat d5/d16/dc/d43/fd3 x:0 0 0 2024-02-15T22:50:56.817 INFO:tasks.workunit.client.0.smithi138.stdout:5/364: rmdir df/d18 39 2024-02-15T22:50:56.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/547: rename d6/d10/d18/d57/cb4 to d6/d10/d52/d72/cc3 0 2024-02-15T22:50:56.823 INFO:tasks.workunit.client.0.smithi138.stdout:7/678: symlink d1/d2/db/db9/le4 0 2024-02-15T22:50:56.825 INFO:tasks.workunit.client.0.smithi138.stdout:3/649: creat d5/d12/d23/d29/d5a/dc2/fd4 x:0 0 0 2024-02-15T22:50:56.832 INFO:tasks.workunit.client.0.smithi138.stdout:7/679: unlink d1/d2/db/d3c/d4d/c57 0 2024-02-15T22:50:56.833 INFO:tasks.workunit.client.0.smithi138.stdout:5/365: mkdir df/d18/d3e/d60/d72 0 2024-02-15T22:50:56.834 INFO:tasks.workunit.client.0.smithi138.stdout:5/366: fdatasync df/f2e 0 2024-02-15T22:50:56.834 INFO:tasks.workunit.client.0.smithi138.stdout:5/367: stat df/f27 0 2024-02-15T22:50:56.835 INFO:tasks.workunit.client.0.smithi138.stdout:7/680: symlink d1/d2/db/db9/le5 0 2024-02-15T22:50:56.835 INFO:tasks.workunit.client.0.smithi138.stdout:7/681: write d1/d2/f73 [4004012,30109] 0 2024-02-15T22:50:56.836 INFO:tasks.workunit.client.0.smithi138.stdout:5/368: creat df/d18/d3e/d60/d65/f73 x:0 0 0 2024-02-15T22:50:56.837 INFO:tasks.workunit.client.0.smithi138.stdout:0/548: dwrite d6/d10/d40/f5c [0,4194304] 0 2024-02-15T22:50:56.838 INFO:tasks.workunit.client.0.smithi138.stdout:0/549: mknod d6/d10/d75/cc4 0 2024-02-15T22:50:56.838 INFO:tasks.workunit.client.0.smithi138.stdout:0/550: fdatasync d6/d10/d64/faf 0 2024-02-15T22:50:56.840 INFO:tasks.workunit.client.0.smithi138.stdout:5/369: dread df/f13 [0,4194304] 0 2024-02-15T22:50:56.842 INFO:tasks.workunit.client.0.smithi138.stdout:5/370: link df/d18/d3e/d51/l6c df/l74 0 2024-02-15T22:50:56.842 INFO:tasks.workunit.client.0.smithi138.stdout:5/371: truncate df/d18/f25 1236481 0 2024-02-15T22:50:56.843 INFO:tasks.workunit.client.0.smithi138.stdout:5/372: dread - df/d18/d3e/d66/f6e zero size 2024-02-15T22:50:56.843 INFO:tasks.workunit.client.0.smithi138.stdout:5/373: write df/d18/d3e/f4e [482949,90343] 0 2024-02-15T22:50:56.843 INFO:tasks.workunit.client.0.smithi138.stdout:5/374: readlink df/d18/d2b/l2c 0 2024-02-15T22:50:56.844 INFO:tasks.workunit.client.0.smithi138.stdout:3/650: truncate d5/d12/d23/f4c 4184297 0 2024-02-15T22:50:56.845 INFO:tasks.workunit.client.0.smithi138.stdout:7/682: dread d1/d79/d84/da0/fb7 [0,4194304] 0 2024-02-15T22:50:56.846 INFO:tasks.workunit.client.0.smithi138.stdout:3/651: truncate d5/d16/dc/d43/d47/d67/f6b 1538554 0 2024-02-15T22:50:56.847 INFO:tasks.workunit.client.0.smithi138.stdout:3/652: getdents d5/d16/dc/d43/d57/d5d 0 2024-02-15T22:50:56.847 INFO:tasks.workunit.client.0.smithi138.stdout:3/653: read - d5/d12/d26/d2f/fcb zero size 2024-02-15T22:50:56.847 INFO:tasks.workunit.client.0.smithi138.stdout:0/551: dread d6/f24 [0,4194304] 0 2024-02-15T22:50:56.848 INFO:tasks.workunit.client.0.smithi138.stdout:3/654: mkdir d5/d12/d26/dd5 0 2024-02-15T22:50:56.853 INFO:tasks.workunit.client.0.smithi138.stdout:3/655: symlink d5/d16/dc/d43/d47/ld6 0 2024-02-15T22:50:56.853 INFO:tasks.workunit.client.0.smithi138.stdout:3/656: write d5/d12/f88 [858571,52985] 0 2024-02-15T22:50:56.853 INFO:tasks.workunit.client.0.smithi138.stdout:3/657: creat d5/d12/fd7 x:0 0 0 2024-02-15T22:50:56.855 INFO:tasks.workunit.client.0.smithi138.stdout:3/658: link d5/d18/fb5 d5/d12/d23/d29/fd8 0 2024-02-15T22:50:56.860 INFO:tasks.workunit.client.0.smithi138.stdout:5/375: dwrite df/f37 [0,4194304] 0 2024-02-15T22:50:56.860 INFO:tasks.workunit.client.0.smithi138.stdout:5/376: fdatasync df/d18/f4a 0 2024-02-15T22:50:56.860 INFO:tasks.workunit.client.0.smithi138.stdout:5/377: stat fc 0 2024-02-15T22:50:56.877 INFO:tasks.workunit.client.0.smithi138.stdout:8/530: sync 2024-02-15T22:50:56.877 INFO:tasks.workunit.client.0.smithi138.stdout:6/437: sync 2024-02-15T22:50:56.877 INFO:tasks.workunit.client.0.smithi138.stdout:8/531: chown db/dd/d13/d19/f40 1 1 2024-02-15T22:50:56.877 INFO:tasks.workunit.client.0.smithi138.stdout:6/438: write f1 [1125465,130256] 0 2024-02-15T22:50:56.878 INFO:tasks.workunit.client.0.smithi138.stdout:8/532: mknod db/d95/cac 0 2024-02-15T22:50:56.882 INFO:tasks.workunit.client.0.smithi138.stdout:5/378: dwrite df/d18/d3e/d60/f6b [0,4194304] 0 2024-02-15T22:50:56.882 INFO:tasks.workunit.client.0.smithi138.stdout:5/379: truncate df/d18/d3e/d60/d65/f73 474074 0 2024-02-15T22:50:56.882 INFO:tasks.workunit.client.0.smithi138.stdout:5/380: truncate df/f3a 42744 0 2024-02-15T22:50:56.882 INFO:tasks.workunit.client.0.smithi138.stdout:5/381: stat df/d18/d3e/c42 0 2024-02-15T22:50:56.882 INFO:tasks.workunit.client.0.smithi138.stdout:3/659: dwrite d5/d16/dc/d43/d47/d67/f6b [0,4194304] 0 2024-02-15T22:50:56.884 INFO:tasks.workunit.client.0.smithi138.stdout:6/439: truncate f1 545042 0 2024-02-15T22:50:56.886 INFO:tasks.workunit.client.0.smithi138.stdout:5/382: rmdir df/d18/d3e/d51 39 2024-02-15T22:50:56.886 INFO:tasks.workunit.client.0.smithi138.stdout:6/440: rmdir dc/d24/d34/d3b/d7d 39 2024-02-15T22:50:56.889 INFO:tasks.workunit.client.0.smithi138.stdout:6/441: creat dc/d4b/d7b/f94 x:0 0 0 2024-02-15T22:50:56.889 INFO:tasks.workunit.client.0.smithi138.stdout:6/442: fsync dc/d24/d34/f63 0 2024-02-15T22:50:56.890 INFO:tasks.workunit.client.0.smithi138.stdout:5/383: getdents df 0 2024-02-15T22:50:56.890 INFO:tasks.workunit.client.0.smithi138.stdout:5/384: chown df/d18/l31 104693341 1 2024-02-15T22:50:56.890 INFO:tasks.workunit.client.0.smithi138.stdout:5/385: dread - df/d18/d2b/f4b zero size 2024-02-15T22:50:56.890 INFO:tasks.workunit.client.0.smithi138.stdout:5/386: dread - df/d18/d3e/d51/f55 zero size 2024-02-15T22:50:56.891 INFO:tasks.workunit.client.0.smithi138.stdout:3/660: write d5/d16/dc/f66 [372324,71381] 0 2024-02-15T22:50:56.891 INFO:tasks.workunit.client.0.smithi138.stdout:6/443: link dc/d24/f26 dc/d24/d34/d3b/d68/f95 0 2024-02-15T22:50:56.892 INFO:tasks.workunit.client.0.smithi138.stdout:6/444: chown dc/d24/d34/d3b/l4f 2 1 2024-02-15T22:50:56.892 INFO:tasks.workunit.client.0.smithi138.stdout:5/387: symlink df/d18/d3e/l75 0 2024-02-15T22:50:56.895 INFO:tasks.workunit.client.0.smithi138.stdout:3/661: symlink d5/d12/d23/d29/ld9 0 2024-02-15T22:50:56.896 INFO:tasks.workunit.client.0.smithi138.stdout:8/533: dwrite db/dd/d13/f79 [0,4194304] 0 2024-02-15T22:50:56.897 INFO:tasks.workunit.client.0.smithi138.stdout:6/445: mkdir dc/d76/d96 0 2024-02-15T22:50:56.897 INFO:tasks.workunit.client.0.smithi138.stdout:6/446: write dc/d24/d34/d3b/f64 [4238082,35914] 0 2024-02-15T22:50:56.898 INFO:tasks.workunit.client.0.smithi138.stdout:8/534: symlink db/d15/d70/lad 0 2024-02-15T22:50:56.900 INFO:tasks.workunit.client.0.smithi138.stdout:6/447: symlink dc/d24/d34/l97 0 2024-02-15T22:50:56.900 INFO:tasks.workunit.client.0.smithi138.stdout:6/448: dread - dc/d4b/f7a zero size 2024-02-15T22:50:56.902 INFO:tasks.workunit.client.0.smithi138.stdout:6/449: mkdir dc/d4b/d98 0 2024-02-15T22:50:56.904 INFO:tasks.workunit.client.0.smithi138.stdout:8/535: rmdir db/dd/d13 39 2024-02-15T22:50:56.906 INFO:tasks.workunit.client.0.smithi138.stdout:6/450: mkdir dc/d24/d34/d99 0 2024-02-15T22:50:56.910 INFO:tasks.workunit.client.0.smithi138.stdout:5/388: dwrite df/d18/d3e/d66/f6e [0,4194304] 0 2024-02-15T22:50:56.910 INFO:tasks.workunit.client.0.smithi138.stdout:8/536: link db/dd/d13/l3c db/d15/d70/d7c/d92/lae 0 2024-02-15T22:50:56.910 INFO:tasks.workunit.client.0.smithi138.stdout:8/537: chown db/dd/d13/d19/f76 12155368 1 2024-02-15T22:50:56.910 INFO:tasks.workunit.client.0.smithi138.stdout:8/538: dread - db/dd/d22/f98 zero size 2024-02-15T22:50:56.910 INFO:tasks.workunit.client.0.smithi138.stdout:8/539: dread - db/dd/d13/f64 zero size 2024-02-15T22:50:56.911 INFO:tasks.workunit.client.0.smithi138.stdout:6/451: getdents dc/d76 0 2024-02-15T22:50:56.913 INFO:tasks.workunit.client.0.smithi138.stdout:5/389: link df/d18/d2b/f4b df/d18/d2b/f76 0 2024-02-15T22:50:56.913 INFO:tasks.workunit.client.0.smithi138.stdout:5/390: read - df/d18/d3e/f3f zero size 2024-02-15T22:50:56.914 INFO:tasks.workunit.client.0.smithi138.stdout:5/391: stat df/d18/d56/c5e 0 2024-02-15T22:50:56.914 INFO:tasks.workunit.client.0.smithi138.stdout:5/392: fsync fc 0 2024-02-15T22:50:56.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/540: symlink db/d15/d70/d7c/d92/laf 0 2024-02-15T22:50:56.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/541: fdatasync db/dd/f67 0 2024-02-15T22:50:56.915 INFO:tasks.workunit.client.0.smithi138.stdout:6/452: symlink dc/l9a 0 2024-02-15T22:50:56.916 INFO:tasks.workunit.client.0.smithi138.stdout:5/393: mkdir df/d18/d77 0 2024-02-15T22:50:56.916 INFO:tasks.workunit.client.0.smithi138.stdout:5/394: creat df/d18/d3e/d60/d65/f78 x:0 0 0 2024-02-15T22:50:56.916 INFO:tasks.workunit.client.0.smithi138.stdout:5/395: chown df/d18/d2b/c40 1974 1 2024-02-15T22:50:56.917 INFO:tasks.workunit.client.0.smithi138.stdout:8/542: symlink db/dd/d13/d19/d6b/lb0 0 2024-02-15T22:50:56.918 INFO:tasks.workunit.client.0.smithi138.stdout:6/453: creat dc/d24/f9b x:0 0 0 2024-02-15T22:50:56.922 INFO:tasks.workunit.client.0.smithi138.stdout:5/396: link fc df/d18/d3e/d66/f79 0 2024-02-15T22:50:56.923 INFO:tasks.workunit.client.0.smithi138.stdout:5/397: truncate df/f3a 750511 0 2024-02-15T22:50:56.923 INFO:tasks.workunit.client.0.smithi138.stdout:5/398: fdatasync df/d18/d3e/f48 0 2024-02-15T22:50:56.923 INFO:tasks.workunit.client.0.smithi138.stdout:5/399: read df/f44 [3726643,71999] 0 2024-02-15T22:50:56.923 INFO:tasks.workunit.client.0.smithi138.stdout:5/400: chown df/d18/d56 516750 1 2024-02-15T22:50:56.940 INFO:tasks.workunit.client.0.smithi138.stdout:8/543: dwrite db/dd/d4d/f9a [8388608,4194304] 0 2024-02-15T22:50:56.942 INFO:tasks.workunit.client.0.smithi138.stdout:6/454: dwrite dc/d24/f9b [0,4194304] 0 2024-02-15T22:50:56.942 INFO:tasks.workunit.client.0.smithi138.stdout:6/455: truncate dc/d24/d34/d3b/d7d/f80 377739 0 2024-02-15T22:50:56.942 INFO:tasks.workunit.client.0.smithi138.stdout:6/456: fsync dc/d24/f27 0 2024-02-15T22:50:56.946 INFO:tasks.workunit.client.0.smithi138.stdout:5/401: dwrite df/f27 [0,4194304] 0 2024-02-15T22:50:56.949 INFO:tasks.workunit.client.0.smithi138.stdout:5/402: dread df/d18/d2b/f4d [0,4194304] 0 2024-02-15T22:50:56.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.953+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eac000bf0 con 0x7f5eb806cf10 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.955+0000 7f5ec8ff9700 1 -- 172.21.15.138:0/4010382090 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5eac000bf0 con 0x7f5eb806cf10 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:50:56.957 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [], 2024-02-15T22:50:56.958 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "1/2 daemons upgraded", 2024-02-15T22:50:56.958 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "", 2024-02-15T22:50:56.958 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:50:56.958 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:50:56.958 INFO:tasks.workunit.client.0.smithi138.stdout:8/544: dwrite db/dd/d13/d19/f43 [0,4194304] 0 2024-02-15T22:50:56.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 msgr2=0x7f5eb806f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 0x7f5eb806f3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc1011c0 tx=0x7f5ebc009260 comp rx=0 tx=0).stop 2024-02-15T22:50:56.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 msgr2=0x7f5ecc1922a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:50:56.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400fa00 tx=0x7f5eb400fae0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 shutdown_connections 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f5eb806cf10 0x7f5eb806f3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ecc100160 0x7f5ecc191d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 --2- 172.21.15.138:0/4010382090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ecc101360 0x7f5ecc1922a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 >> 172.21.15.138:0/4010382090 conn(0x7f5ecc0fb6f0 msgr2=0x7f5ecc102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 shutdown_connections 2024-02-15T22:50:56.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:50:56.957+0000 7f5ed21aa700 1 -- 172.21.15.138:0/4010382090 wait complete. 2024-02-15T22:50:57.013 INFO:tasks.workunit.client.0.smithi138.stdout:5/403: creat df/d18/d3e/d60/f7a x:0 0 0 2024-02-15T22:50:57.024 INFO:tasks.workunit.client.0.smithi138.stdout:8/545: link db/dd/l8c db/dd/d13/d77/d8f/lb1 0 2024-02-15T22:50:57.033 INFO:tasks.workunit.client.0.smithi138.stdout:5/404: creat df/d18/f7b x:0 0 0 2024-02-15T22:50:57.035 INFO:tasks.workunit.client.0.smithi138.stdout:8/546: mkdir db/dd/d13/d19/d7d/db2 0 2024-02-15T22:50:57.037 INFO:tasks.workunit.client.0.smithi138.stdout:5/405: mkdir df/d18/d3e/d60/d65/d7c 0 2024-02-15T22:50:57.037 INFO:tasks.workunit.client.0.smithi138.stdout:8/547: truncate db/dd/f3e 1016077 0 2024-02-15T22:50:57.040 INFO:tasks.workunit.client.0.smithi138.stdout:5/406: unlink df/d18/d2b/l30 0 2024-02-15T22:50:57.061 INFO:tasks.workunit.client.0.smithi138.stdout:8/548: unlink db/dd/d13/f72 0 2024-02-15T22:50:57.063 INFO:tasks.workunit.client.0.smithi138.stdout:8/549: fsync db/dd/d13/f21 0 2024-02-15T22:50:57.065 INFO:tasks.workunit.client.0.smithi138.stdout:8/550: getdents db/dd/d4d 0 2024-02-15T22:50:57.067 INFO:tasks.workunit.client.0.smithi138.stdout:8/551: dread db/d15/d70/d7c/d92/f57 [0,4194304] 0 2024-02-15T22:50:57.067 INFO:tasks.workunit.client.0.smithi138.stdout:8/552: write db/d15/d70/f7a [603391,104728] 0 2024-02-15T22:50:57.069 INFO:tasks.workunit.client.0.smithi138.stdout:8/553: mknod db/dd/d13/cb3 0 2024-02-15T22:50:57.069 INFO:tasks.workunit.client.0.smithi138.stdout:8/554: stat db 0 2024-02-15T22:50:57.069 INFO:tasks.workunit.client.0.smithi138.stdout:8/555: chown db/dd/d13/d77 7201428 1 2024-02-15T22:50:57.071 INFO:tasks.workunit.client.0.smithi138.stdout:8/556: dread db/d15/d70/d7c/d92/f60 [0,4194304] 0 2024-02-15T22:50:57.072 INFO:tasks.workunit.client.0.smithi138.stdout:8/557: creat db/dd/d13/d19/d6b/fb4 x:0 0 0 2024-02-15T22:50:57.077 INFO:tasks.workunit.client.0.smithi138.stdout:6/457: mknod dc/c9c 0 2024-02-15T22:50:57.078 INFO:tasks.workunit.client.0.smithi138.stdout:6/458: mknod dc/d24/d6c/c9d 0 2024-02-15T22:50:57.078 INFO:tasks.workunit.client.0.smithi138.stdout:6/459: creat dc/d4b/f9e x:0 0 0 2024-02-15T22:50:57.078 INFO:tasks.workunit.client.0.smithi138.stdout:6/460: chown dc/d24/l32 62070 1 2024-02-15T22:50:57.080 INFO:tasks.workunit.client.0.smithi138.stdout:6/461: mkdir dc/d24/d34/d3b/d7c/d9f 0 2024-02-15T22:50:57.089 INFO:tasks.workunit.client.0.smithi138.stdout:5/407: rmdir df 39 2024-02-15T22:50:57.089 INFO:tasks.workunit.client.0.smithi138.stdout:8/558: dwrite db/dd/d4d/fa4 [0,4194304] 0 2024-02-15T22:50:57.091 INFO:tasks.workunit.client.0.smithi138.stdout:5/408: creat df/d18/d3e/d60/d72/f7d x:0 0 0 2024-02-15T22:50:57.099 INFO:tasks.workunit.client.0.smithi138.stdout:8/559: unlink db/d15/d70/d7c/d92/l42 0 2024-02-15T22:50:57.100 INFO:tasks.workunit.client.0.smithi138.stdout:6/462: dwrite dc/fe [0,4194304] 0 2024-02-15T22:50:57.100 INFO:tasks.workunit.client.0.smithi138.stdout:5/409: symlink df/d18/d56/l7e 0 2024-02-15T22:50:57.102 INFO:tasks.workunit.client.0.smithi138.stdout:8/560: creat db/da0/fb5 x:0 0 0 2024-02-15T22:50:57.103 INFO:tasks.workunit.client.0.smithi138.stdout:6/463: symlink dc/d4b/la0 0 2024-02-15T22:50:57.104 INFO:tasks.workunit.client.0.smithi138.stdout:5/410: mkdir df/d18/d3e/d60/d65/d7f 0 2024-02-15T22:50:57.105 INFO:tasks.workunit.client.0.smithi138.stdout:6/464: symlink dc/d24/d34/d3b/d7d/la1 0 2024-02-15T22:50:57.107 INFO:tasks.workunit.client.0.smithi138.stdout:5/411: rename df/d18/l36 to df/d18/d3e/d51/l80 0 2024-02-15T22:50:57.108 INFO:tasks.workunit.client.0.smithi138.stdout:8/561: mkdir db/d15/db6 0 2024-02-15T22:50:57.113 INFO:tasks.workunit.client.0.smithi138.stdout:8/562: link db/dd/d22/f30 db/d15/db6/fb7 0 2024-02-15T22:50:57.113 INFO:tasks.workunit.client.0.smithi138.stdout:8/563: fdatasync db/f39 0 2024-02-15T22:50:57.113 INFO:tasks.workunit.client.0.smithi138.stdout:6/465: dread dc/f15 [0,4194304] 0 2024-02-15T22:50:57.115 INFO:tasks.workunit.client.0.smithi138.stdout:6/466: symlink dc/d4b/d7b/la2 0 2024-02-15T22:50:57.122 INFO:tasks.workunit.client.0.smithi138.stdout:5/412: dwrite df/d18/d2b/f47 [0,4194304] 0 2024-02-15T22:50:57.125 INFO:tasks.workunit.client.0.smithi138.stdout:5/413: unlink df/d18/d3e/d60/d65/f78 0 2024-02-15T22:50:57.126 INFO:tasks.workunit.client.0.smithi138.stdout:5/414: mknod df/c81 0 2024-02-15T22:50:57.132 INFO:tasks.workunit.client.0.smithi138.stdout:5/415: dread df/d18/f29 [0,4194304] 0 2024-02-15T22:50:57.133 INFO:tasks.workunit.client.0.smithi138.stdout:5/416: dread df/d18/d3e/d60/d65/f73 [0,4194304] 0 2024-02-15T22:50:57.133 INFO:tasks.workunit.client.0.smithi138.stdout:5/417: fsync df/d18/d3e/d60/d65/f73 0 2024-02-15T22:50:57.136 INFO:tasks.workunit.client.0.smithi138.stdout:8/564: dwrite db/d15/db6/fb7 [0,4194304] 0 2024-02-15T22:50:57.137 INFO:tasks.workunit.client.0.smithi138.stdout:6/467: dwrite dc/d24/f27 [4194304,4194304] 0 2024-02-15T22:50:57.138 INFO:tasks.workunit.client.0.smithi138.stdout:8/565: symlink db/dd/d22/lb8 0 2024-02-15T22:50:57.139 INFO:tasks.workunit.client.0.smithi138.stdout:6/468: creat dc/d24/d34/d3b/d68/fa3 x:0 0 0 2024-02-15T22:50:57.141 INFO:tasks.workunit.client.0.smithi138.stdout:6/469: mknod dc/d24/d34/ca4 0 2024-02-15T22:50:57.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/566: write db/dd/d22/f73 [1116636,130842] 0 2024-02-15T22:50:57.151 INFO:tasks.workunit.client.0.smithi138.stdout:8/567: fdatasync db/d15/d70/f7a 0 2024-02-15T22:50:57.155 INFO:tasks.workunit.client.0.smithi138.stdout:5/418: dwrite df/d18/d3e/d60/f6b [0,4194304] 0 2024-02-15T22:50:57.156 INFO:tasks.workunit.client.0.smithi138.stdout:6/470: dread f2 [0,4194304] 0 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/568: dread db/dd/d4d/f8d [0,4194304] 0 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/569: dread - db/dd/d22/f3f zero size 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/570: chown db/d15/d70/d7c/la1 58799864 1 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/571: dread - db/f90 zero size 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/572: fsync db/d15/d70/f7a 0 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/573: chown db/dd/d22/f30 4377 1 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/574: chown db/d15/d70/c6a 49016 1 2024-02-15T22:50:57.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/575: read - db/dd/d13/f64 zero size 2024-02-15T22:50:57.163 INFO:tasks.workunit.client.0.smithi138.stdout:8/576: rename db/dd/d22/f30 to db/d95/fb9 0 2024-02-15T22:50:57.164 INFO:tasks.workunit.client.0.smithi138.stdout:4/693: sync 2024-02-15T22:50:57.164 INFO:tasks.workunit.client.0.smithi138.stdout:9/659: sync 2024-02-15T22:50:57.164 INFO:tasks.workunit.client.0.smithi138.stdout:4/694: write d17/d1e/d2d/d8c/fa2 [213236,64555] 0 2024-02-15T22:50:57.165 INFO:tasks.workunit.client.0.smithi138.stdout:9/660: mkdir d0/de/d34/d89/d90/de0 0 2024-02-15T22:50:57.165 INFO:tasks.workunit.client.0.smithi138.stdout:9/661: creat d0/de/d34/fe1 x:0 0 0 2024-02-15T22:50:57.173 INFO:tasks.workunit.client.0.smithi138.stdout:9/662: write d0/de/d34/d89/fb1 [558037,79020] 0 2024-02-15T22:50:57.190 INFO:tasks.workunit.client.0.smithi138.stdout:4/695: rename d17/d1e/f2f to d17/d1e/d2d/d36/dca/da3/dbf/fe5 0 2024-02-15T22:50:57.190 INFO:tasks.workunit.client.0.smithi138.stdout:4/696: fdatasync d17/d1e/d2d/d8c/f8e 0 2024-02-15T22:50:57.193 INFO:tasks.workunit.client.0.smithi138.stdout:9/663: truncate d0/df/d11/f32 699534 0 2024-02-15T22:50:57.194 INFO:tasks.workunit.client.0.smithi138.stdout:9/664: dread d0/df/f4e [0,4194304] 0 2024-02-15T22:50:57.195 INFO:tasks.workunit.client.0.smithi138.stdout:9/665: readlink d0/de/d14/da3/dc8/d6a/lab 0 2024-02-15T22:50:57.197 INFO:tasks.workunit.client.0.smithi138.stdout:4/697: symlink d17/d2b/le6 0 2024-02-15T22:50:57.197 INFO:tasks.workunit.client.0.smithi138.stdout:4/698: creat d17/d1e/db8/fe7 x:0 0 0 2024-02-15T22:50:57.197 INFO:tasks.workunit.client.0.smithi138.stdout:6/471: dwrite dc/d24/f5e [0,4194304] 0 2024-02-15T22:50:57.198 INFO:tasks.workunit.client.0.smithi138.stdout:9/666: symlink d0/de/d34/d89/le2 0 2024-02-15T22:50:57.204 INFO:tasks.workunit.client.0.smithi138.stdout:6/472: rename dc/d24/f9b to dc/d24/d34/d3b/d7c/d9f/fa5 0 2024-02-15T22:50:57.205 INFO:tasks.workunit.client.0.smithi138.stdout:9/667: creat d0/de/d14/dbd/fe3 x:0 0 0 2024-02-15T22:50:57.205 INFO:tasks.workunit.client.0.smithi138.stdout:4/699: dread d17/d2b/f9f [0,4194304] 0 2024-02-15T22:50:57.205 INFO:tasks.workunit.client.0.smithi138.stdout:4/700: dread - d17/d1e/d2d/d36/d3e/d64/f87 zero size 2024-02-15T22:50:57.205 INFO:tasks.workunit.client.0.smithi138.stdout:6/473: truncate dc/d24/d34/d3b/f41 2034213 0 2024-02-15T22:50:57.207 INFO:tasks.workunit.client.0.smithi138.stdout:4/701: creat d17/d1e/d2d/d52/fe8 x:0 0 0 2024-02-15T22:50:57.207 INFO:tasks.workunit.client.0.smithi138.stdout:4/702: fsync d17/d1e/d2d/dd5/fde 0 2024-02-15T22:50:57.207 INFO:tasks.workunit.client.0.smithi138.stdout:6/474: mknod dc/d24/ca6 0 2024-02-15T22:50:57.208 INFO:tasks.workunit.client.0.smithi138.stdout:9/668: rmdir d0/d2e 39 2024-02-15T22:50:57.214 INFO:tasks.workunit.client.0.smithi138.stdout:8/577: dwrite db/f38 [0,4194304] 0 2024-02-15T22:50:57.217 INFO:tasks.workunit.client.0.smithi138.stdout:8/578: mkdir db/dd/d13/d19/d6b/dba 0 2024-02-15T22:50:57.218 INFO:tasks.workunit.client.0.smithi138.stdout:5/419: dwrite df/d18/d3e/d51/f55 [0,4194304] 0 2024-02-15T22:50:57.224 INFO:tasks.workunit.client.0.smithi138.stdout:5/420: mkdir df/d18/d3e/d66/d82 0 2024-02-15T22:50:57.224 INFO:tasks.workunit.client.0.smithi138.stdout:5/421: write f5 [2694084,43260] 0 2024-02-15T22:50:57.224 INFO:tasks.workunit.client.0.smithi138.stdout:5/422: chown df/f17 1174010 1 2024-02-15T22:50:57.225 INFO:tasks.workunit.client.0.smithi138.stdout:5/423: creat df/f83 x:0 0 0 2024-02-15T22:50:57.227 INFO:tasks.workunit.client.0.smithi138.stdout:5/424: truncate df/f13 681010 0 2024-02-15T22:50:57.227 INFO:tasks.workunit.client.0.smithi138.stdout:6/475: dwrite dc/d24/d34/f6a [0,4194304] 0 2024-02-15T22:50:57.227 INFO:tasks.workunit.client.0.smithi138.stdout:6/476: chown dc/d24/l37 25493800 1 2024-02-15T22:50:57.227 INFO:tasks.workunit.client.0.smithi138.stdout:6/477: chown dc/l8f 13 1 2024-02-15T22:50:57.228 INFO:tasks.workunit.client.0.smithi138.stdout:5/425: unlink df/d18/d56/f5b 0 2024-02-15T22:50:57.229 INFO:tasks.workunit.client.0.smithi138.stdout:6/478: mknod dc/d24/d34/d3b/d7c/d9f/ca7 0 2024-02-15T22:50:57.230 INFO:tasks.workunit.client.0.smithi138.stdout:6/479: mkdir dc/d24/d34/d3b/d7c/da8 0 2024-02-15T22:50:57.231 INFO:tasks.workunit.client.0.smithi138.stdout:6/480: truncate dc/d24/f47 2150577 0 2024-02-15T22:50:57.233 INFO:tasks.workunit.client.0.smithi138.stdout:6/481: link dc/d24/d34/d3b/d7c/f91 dc/d24/fa9 0 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: pgmap v11: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 126 MiB/s rd, 157 MiB/s wr, 1.01k op/s 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:56 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1967125831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:57.235 INFO:tasks.workunit.client.0.smithi138.stdout:4/703: write d17/fc1 [984607,31309] 0 2024-02-15T22:50:57.235 INFO:tasks.workunit.client.0.smithi138.stdout:4/704: readlink d17/d2b/le6 0 2024-02-15T22:50:57.237 INFO:tasks.workunit.client.0.smithi138.stdout:4/705: link d17/d1e/f3f d17/d1e/db8/fe9 0 2024-02-15T22:50:57.237 INFO:tasks.workunit.client.0.smithi138.stdout:4/706: creat d17/d1e/d2d/d8c/fea x:0 0 0 2024-02-15T22:50:57.238 INFO:tasks.workunit.client.0.smithi138.stdout:9/669: dwrite d0/de/d33/d98/fbf [0,4194304] 0 2024-02-15T22:50:57.238 INFO:tasks.workunit.client.0.smithi138.stdout:9/670: stat d0/de/d14/da3/dc8/f43 0 2024-02-15T22:50:57.239 INFO:tasks.workunit.client.0.smithi138.stdout:5/426: write df/d18/d3e/d51/f55 [649378,118372] 0 2024-02-15T22:50:57.239 INFO:tasks.workunit.client.0.smithi138.stdout:5/427: chown df/d18/d3e/l75 119441779 1 2024-02-15T22:50:57.239 INFO:tasks.workunit.client.0.smithi138.stdout:5/428: truncate df/f17 4476193 0 2024-02-15T22:50:57.240 INFO:tasks.workunit.client.0.smithi138.stdout:8/579: dwrite db/dd/f67 [0,4194304] 0 2024-02-15T22:50:57.241 INFO:tasks.workunit.client.0.smithi138.stdout:4/707: rmdir d17/d1e/d2d/dd5 39 2024-02-15T22:50:57.249 INFO:tasks.workunit.client.0.smithi138.stdout:4/708: mknod d17/d1a/daa/ceb 0 2024-02-15T22:50:57.250 INFO:tasks.workunit.client.0.smithi138.stdout:8/580: write db/dd/f67 [3392480,16678] 0 2024-02-15T22:50:57.250 INFO:tasks.workunit.client.0.smithi138.stdout:8/581: truncate db/dd/d22/f3f 835442 0 2024-02-15T22:50:57.255 INFO:tasks.workunit.client.0.smithi138.stdout:5/429: write df/f2e [4149046,54556] 0 2024-02-15T22:50:57.255 INFO:tasks.workunit.client.0.smithi138.stdout:8/582: creat db/dd/d13/d19/fbb x:0 0 0 2024-02-15T22:50:57.255 INFO:tasks.workunit.client.0.smithi138.stdout:6/482: dwrite dc/d24/f38 [4194304,4194304] 0 2024-02-15T22:50:57.255 INFO:tasks.workunit.client.0.smithi138.stdout:6/483: fdatasync dc/d24/d34/f63 0 2024-02-15T22:50:57.258 INFO:tasks.workunit.client.0.smithi138.stdout:8/583: dread db/dd/d22/f3f [0,4194304] 0 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: pgmap v11: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 126 MiB/s rd, 157 MiB/s wr, 1.01k op/s 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:50:57.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:56 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1967125831' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:50:57.262 INFO:tasks.workunit.client.0.smithi138.stdout:6/484: rename dc/d4b/d7b/l89 to dc/d24/d34/d3b/d7c/laa 0 2024-02-15T22:50:57.262 INFO:tasks.workunit.client.0.smithi138.stdout:6/485: chown dc/d76/f81 333 1 2024-02-15T22:50:57.266 INFO:tasks.workunit.client.0.smithi138.stdout:8/584: write db/d15/d70/d7c/d92/f60 [1065432,48817] 0 2024-02-15T22:50:57.267 INFO:tasks.workunit.client.0.smithi138.stdout:8/585: stat db/d15/d70/d7c 0 2024-02-15T22:50:57.267 INFO:tasks.workunit.client.0.smithi138.stdout:4/709: dwrite d17/d1e/d2d/d8c/f8e [4194304,4194304] 0 2024-02-15T22:50:57.271 INFO:tasks.workunit.client.0.smithi138.stdout:4/710: link f6 d17/d1e/d2d/dc7/fec 0 2024-02-15T22:50:57.271 INFO:tasks.workunit.client.0.smithi138.stdout:4/711: chown f8 502 1 2024-02-15T22:50:57.275 INFO:tasks.workunit.client.0.smithi138.stdout:4/712: dread d17/d1e/d2d/d36/f96 [0,4194304] 0 2024-02-15T22:50:57.275 INFO:tasks.workunit.client.0.smithi138.stdout:4/713: stat d17/d1e/d2d/d36/d3e/d64/l51 0 2024-02-15T22:50:57.276 INFO:tasks.workunit.client.0.smithi138.stdout:8/586: dread f0 [0,4194304] 0 2024-02-15T22:50:57.276 INFO:tasks.workunit.client.0.smithi138.stdout:8/587: dread - db/da0/fb5 zero size 2024-02-15T22:50:57.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/430: dwrite df/d18/d2b/f3b [0,4194304] 0 2024-02-15T22:50:57.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/431: chown df/d18/d2b/f3b 1132 1 2024-02-15T22:50:57.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/432: creat df/d18/f84 x:0 0 0 2024-02-15T22:50:57.277 INFO:tasks.workunit.client.0.smithi138.stdout:6/486: dwrite dc/d24/d34/d3b/d66/f74 [0,4194304] 0 2024-02-15T22:50:57.278 INFO:tasks.workunit.client.0.smithi138.stdout:8/588: rename db/dd/c2d to db/dd/d4d/cbc 0 2024-02-15T22:50:57.278 INFO:tasks.workunit.client.0.smithi138.stdout:8/589: creat db/dd/d13/d19/fbd x:0 0 0 2024-02-15T22:50:57.282 INFO:tasks.workunit.client.0.smithi138.stdout:6/487: creat dc/d24/d34/d99/fab x:0 0 0 2024-02-15T22:50:57.284 INFO:tasks.workunit.client.0.smithi138.stdout:5/433: rename df/l24 to df/d18/d2b/l85 0 2024-02-15T22:50:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:8/590: getdents db 0 2024-02-15T22:50:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:4/714: dread d17/d1e/d2d/fc2 [0,4194304] 0 2024-02-15T22:50:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:4/715: write d17/f49 [2715391,94239] 0 2024-02-15T22:50:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:4/716: write f6 [3651872,95702] 0 2024-02-15T22:50:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:4/717: fsync d17/d1a/daa/fb9 0 2024-02-15T22:50:57.287 INFO:tasks.workunit.client.0.smithi138.stdout:5/434: mknod df/d18/d3e/d60/d65/c86 0 2024-02-15T22:50:57.287 INFO:tasks.workunit.client.0.smithi138.stdout:5/435: write df/d18/d3e/d51/f5c [1046447,17026] 0 2024-02-15T22:50:57.288 INFO:tasks.workunit.client.0.smithi138.stdout:4/718: read d17/d1e/d2d/d36/d3e/d64/fb5 [882562,66212] 0 2024-02-15T22:50:57.288 INFO:tasks.workunit.client.0.smithi138.stdout:4/719: readlink d17/d1e/d56/l82 0 2024-02-15T22:50:57.288 INFO:tasks.workunit.client.0.smithi138.stdout:8/591: mknod db/d15/d70/cbe 0 2024-02-15T22:50:57.288 INFO:tasks.workunit.client.0.smithi138.stdout:8/592: write db/dd/d13/f3b [3057660,24824] 0 2024-02-15T22:50:57.289 INFO:tasks.workunit.client.0.smithi138.stdout:5/436: mknod df/d18/d3e/d51/c87 0 2024-02-15T22:50:57.290 INFO:tasks.workunit.client.0.smithi138.stdout:4/720: symlink d17/d1e/d2d/d36/dca/led 0 2024-02-15T22:50:57.294 INFO:tasks.workunit.client.0.smithi138.stdout:8/593: dread db/dd/d13/d19/d7d/f89 [0,4194304] 0 2024-02-15T22:50:57.295 INFO:tasks.workunit.client.0.smithi138.stdout:8/594: chown db/dd/d13/d19/f97 16789 1 2024-02-15T22:50:57.296 INFO:tasks.workunit.client.0.smithi138.stdout:8/595: symlink db/dd/d13/d77/lbf 0 2024-02-15T22:50:57.298 INFO:tasks.workunit.client.0.smithi138.stdout:8/596: rename db/dd/f67 to db/fc0 0 2024-02-15T22:50:57.298 INFO:tasks.workunit.client.0.smithi138.stdout:8/597: readlink db/dd/d13/d19/d45/l51 0 2024-02-15T22:50:57.299 INFO:tasks.workunit.client.0.smithi138.stdout:8/598: symlink db/lc1 0 2024-02-15T22:50:57.299 INFO:tasks.workunit.client.0.smithi138.stdout:8/599: readlink db/dd/l8c 0 2024-02-15T22:50:57.301 INFO:tasks.workunit.client.0.smithi138.stdout:6/488: dwrite dc/f3a [0,4194304] 0 2024-02-15T22:50:57.302 INFO:tasks.workunit.client.0.smithi138.stdout:6/489: creat dc/d76/fac x:0 0 0 2024-02-15T22:50:57.311 INFO:tasks.workunit.client.0.smithi138.stdout:1/385: sync 2024-02-15T22:50:57.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/520: sync 2024-02-15T22:50:57.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/521: chown d0/dd/d15/c41 1051567294 1 2024-02-15T22:50:57.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/522: chown d0/da/d19/d53/d5d 127183 1 2024-02-15T22:50:57.311 INFO:tasks.workunit.client.0.smithi138.stdout:8/600: dread db/dd/f14 [0,4194304] 0 2024-02-15T22:50:57.313 INFO:tasks.workunit.client.0.smithi138.stdout:5/437: dwrite df/d18/f6f [0,4194304] 0 2024-02-15T22:50:57.313 INFO:tasks.workunit.client.0.smithi138.stdout:5/438: creat df/d18/d3e/d60/d65/f88 x:0 0 0 2024-02-15T22:50:57.313 INFO:tasks.workunit.client.0.smithi138.stdout:1/386: mknod df/d1b/d1d/d25/c87 0 2024-02-15T22:50:57.314 INFO:tasks.workunit.client.0.smithi138.stdout:1/387: write f4 [8206471,38053] 0 2024-02-15T22:50:57.316 INFO:tasks.workunit.client.0.smithi138.stdout:8/601: symlink db/dd/d4d/lc2 0 2024-02-15T22:50:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:5/439: getdents df/d18/d3e 0 2024-02-15T22:50:57.319 INFO:tasks.workunit.client.0.smithi138.stdout:1/388: creat df/d1b/d21/f88 x:0 0 0 2024-02-15T22:50:57.319 INFO:tasks.workunit.client.0.smithi138.stdout:1/389: chown df/d1b/d1d/d60/f64 161 1 2024-02-15T22:50:57.319 INFO:tasks.workunit.client.0.smithi138.stdout:1/390: readlink df/l13 0 2024-02-15T22:50:57.319 INFO:tasks.workunit.client.0.smithi138.stdout:1/391: chown df/d1b/d1d/d25/d2e/d37/f4b 631912350 1 2024-02-15T22:50:57.320 INFO:tasks.workunit.client.0.smithi138.stdout:1/392: fdatasync df/d1b/d1d/d25/f61 0 2024-02-15T22:50:57.320 INFO:tasks.workunit.client.0.smithi138.stdout:1/393: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f [3296073,10077] 0 2024-02-15T22:50:57.321 INFO:tasks.workunit.client.0.smithi138.stdout:8/602: creat db/d15/d70/fc3 x:0 0 0 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/440: mknod df/c89 0 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/441: fdatasync df/d18/f84 0 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/442: chown df/d18/d3e/d60/d65/d7f 12 1 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:2/523: dread d0/da/d19/f81 [0,4194304] 0 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:2/524: write d0/dd/f2c [2383129,20849] 0 2024-02-15T22:50:57.322 INFO:tasks.workunit.client.0.smithi138.stdout:1/394: rmdir df/d1b/d1d/d25/d2e/d6c 39 2024-02-15T22:50:57.323 INFO:tasks.workunit.client.0.smithi138.stdout:8/603: truncate db/dd/f4e 1830811 0 2024-02-15T22:50:57.323 INFO:tasks.workunit.client.0.smithi138.stdout:8/604: read db/dd/d22/f73 [3563763,33342] 0 2024-02-15T22:50:57.324 INFO:tasks.workunit.client.0.smithi138.stdout:8/605: truncate db/dd/d13/f6d 4618472 0 2024-02-15T22:50:57.324 INFO:tasks.workunit.client.0.smithi138.stdout:1/395: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 [42961,34477] 0 2024-02-15T22:50:57.324 INFO:tasks.workunit.client.0.smithi138.stdout:2/525: mkdir d0/da/d19/d53/d5d/d6d/d7b/dbf 0 2024-02-15T22:50:57.324 INFO:tasks.workunit.client.0.smithi138.stdout:8/606: mknod db/dd/d13/d19/d6b/dba/cc4 0 2024-02-15T22:50:57.325 INFO:tasks.workunit.client.0.smithi138.stdout:1/396: creat df/d1b/d1d/d24/d3a/f89 x:0 0 0 2024-02-15T22:50:57.325 INFO:tasks.workunit.client.0.smithi138.stdout:1/397: stat df/d1b/d1d/d25/f61 0 2024-02-15T22:50:57.325 INFO:tasks.workunit.client.0.smithi138.stdout:4/721: dwrite d17/d2b/f3d [0,4194304] 0 2024-02-15T22:50:57.327 INFO:tasks.workunit.client.0.smithi138.stdout:2/526: truncate d0/da/d19/f2d 4914705 0 2024-02-15T22:50:57.327 INFO:tasks.workunit.client.0.smithi138.stdout:6/490: dwrite dc/f1a [0,4194304] 0 2024-02-15T22:50:57.327 INFO:tasks.workunit.client.0.smithi138.stdout:2/527: creat d0/da/d19/d53/d5d/d83/fc0 x:0 0 0 2024-02-15T22:50:57.327 INFO:tasks.workunit.client.0.smithi138.stdout:8/607: mknod db/da0/cc5 0 2024-02-15T22:50:57.327 INFO:tasks.workunit.client.0.smithi138.stdout:1/398: rmdir df/d1b/d1d 39 2024-02-15T22:50:57.328 INFO:tasks.workunit.client.0.smithi138.stdout:4/722: mkdir d17/d1e/d2d/d36/dca/da3/dee 0 2024-02-15T22:50:57.333 INFO:tasks.workunit.client.0.smithi138.stdout:8/608: mknod db/dd/d13/d19/d45/cc6 0 2024-02-15T22:50:57.335 INFO:tasks.workunit.client.0.smithi138.stdout:1/399: symlink df/d1b/d1d/d60/l8a 0 2024-02-15T22:50:57.337 INFO:tasks.workunit.client.0.smithi138.stdout:2/528: dread d0/da/d19/d53/f7f [0,4194304] 0 2024-02-15T22:50:57.343 INFO:tasks.workunit.client.0.smithi138.stdout:5/443: dwrite df/f37 [0,4194304] 0 2024-02-15T22:50:57.344 INFO:tasks.workunit.client.0.smithi138.stdout:6/491: dwrite dc/d24/d34/d3b/f41 [0,4194304] 0 2024-02-15T22:50:57.344 INFO:tasks.workunit.client.0.smithi138.stdout:6/492: readlink dc/d24/d34/d3b/d66/l72 0 2024-02-15T22:50:57.344 INFO:tasks.workunit.client.0.smithi138.stdout:6/493: creat dc/d24/d34/d3b/d7c/fad x:0 0 0 2024-02-15T22:50:57.353 INFO:tasks.workunit.client.0.smithi138.stdout:8/609: rename db/dd/d13/d77/d8f/fab to db/d15/d70/d7c/fc7 0 2024-02-15T22:50:57.353 INFO:tasks.workunit.client.0.smithi138.stdout:8/610: fdatasync db/dd/f47 0 2024-02-15T22:50:57.353 INFO:tasks.workunit.client.0.smithi138.stdout:2/529: dwrite d0/da/d19/d53/f8e [0,4194304] 0 2024-02-15T22:50:57.354 INFO:tasks.workunit.client.0.smithi138.stdout:1/400: truncate df/d1b/f1f 1224554 0 2024-02-15T22:50:57.356 INFO:tasks.workunit.client.0.smithi138.stdout:5/444: mkdir df/d18/d3e/d8a 0 2024-02-15T22:50:57.359 INFO:tasks.workunit.client.0.smithi138.stdout:6/494: getdents dc/d24 0 2024-02-15T22:50:57.360 INFO:tasks.workunit.client.0.smithi138.stdout:4/723: symlink d17/lef 0 2024-02-15T22:50:57.364 INFO:tasks.workunit.client.0.smithi138.stdout:2/530: creat d0/da/d19/d53/d5d/d6d/d97/da0/fc1 x:0 0 0 2024-02-15T22:50:57.366 INFO:tasks.workunit.client.0.smithi138.stdout:1/401: symlink df/d1b/l8b 0 2024-02-15T22:50:57.367 INFO:tasks.workunit.client.0.smithi138.stdout:5/445: symlink df/d18/d3e/d60/d65/d7c/l8b 0 2024-02-15T22:50:57.367 INFO:tasks.workunit.client.0.smithi138.stdout:5/446: chown df/l74 1 1 2024-02-15T22:50:57.369 INFO:tasks.workunit.client.0.smithi138.stdout:6/495: creat dc/d24/d34/d3b/d7d/fae x:0 0 0 2024-02-15T22:50:57.369 INFO:tasks.workunit.client.0.smithi138.stdout:8/611: dwrite db/dd/d4d/f8d [0,4194304] 0 2024-02-15T22:50:57.372 INFO:tasks.workunit.client.0.smithi138.stdout:1/402: link df/d1b/d33/f75 df/d1b/d1d/d25/d2e/d5b/d65/f8c 0 2024-02-15T22:50:57.372 INFO:tasks.workunit.client.0.smithi138.stdout:1/403: fdatasync df/d1b/f3d 0 2024-02-15T22:50:57.375 INFO:tasks.workunit.client.0.smithi138.stdout:8/612: rename db/fa5 to db/dd/d13/d19/d7d/fc8 0 2024-02-15T22:50:57.375 INFO:tasks.workunit.client.0.smithi138.stdout:8/613: dread - db/dd/fa8 zero size 2024-02-15T22:50:57.375 INFO:tasks.workunit.client.0.smithi138.stdout:8/614: fsync db/dd/d13/d19/f76 0 2024-02-15T22:50:57.375 INFO:tasks.workunit.client.0.smithi138.stdout:4/724: write d17/d1e/d2d/d52/f5d [1760517,8760] 0 2024-02-15T22:50:57.378 INFO:tasks.workunit.client.0.smithi138.stdout:4/725: chown d17/d1a/ccf 87 1 2024-02-15T22:50:57.379 INFO:tasks.workunit.client.0.smithi138.stdout:6/496: dread dc/f3a [0,4194304] 0 2024-02-15T22:50:57.379 INFO:tasks.workunit.client.0.smithi138.stdout:1/404: rmdir df/d1b/d1d/d24/d3a 39 2024-02-15T22:50:57.382 INFO:tasks.workunit.client.0.smithi138.stdout:5/447: dwrite df/d18/d3e/d60/f7a [0,4194304] 0 2024-02-15T22:50:57.383 INFO:tasks.workunit.client.0.smithi138.stdout:6/497: rename dc/f3e to dc/d76/faf 0 2024-02-15T22:50:57.383 INFO:tasks.workunit.client.0.smithi138.stdout:6/498: dread - dc/d24/d34/d3b/d7c/f83 zero size 2024-02-15T22:50:57.386 INFO:tasks.workunit.client.0.smithi138.stdout:5/448: mknod df/d18/d3e/c8c 0 2024-02-15T22:50:57.397 INFO:tasks.workunit.client.0.smithi138.stdout:6/499: rename dc/d76/faf to dc/d24/fb0 0 2024-02-15T22:50:57.397 INFO:tasks.workunit.client.0.smithi138.stdout:6/500: chown dc/d24/d34/d3b/d7c/d9f/ca7 1 1 2024-02-15T22:50:57.397 INFO:tasks.workunit.client.0.smithi138.stdout:6/501: write f1 [9064,24603] 0 2024-02-15T22:50:57.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/502: getdents dc/d4b/d7b 0 2024-02-15T22:50:57.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/503: chown dc/d24/d34/c3d 3125 1 2024-02-15T22:50:57.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/504: getdents dc/d24/d34/d3b/d7c/da8 0 2024-02-15T22:50:57.400 INFO:tasks.workunit.client.0.smithi138.stdout:6/505: rename dc/d4b/f7a to dc/d4b/fb1 0 2024-02-15T22:50:57.400 INFO:tasks.workunit.client.0.smithi138.stdout:6/506: write dc/d24/d34/d3b/d7c/f83 [54299,41302] 0 2024-02-15T22:50:57.418 INFO:tasks.workunit.client.0.smithi138.stdout:8/615: dwrite db/d15/d70/d7c/d92/f2c [0,4194304] 0 2024-02-15T22:50:57.430 INFO:tasks.workunit.client.0.smithi138.stdout:8/616: read db/f28 [1349807,64414] 0 2024-02-15T22:50:57.431 INFO:tasks.workunit.client.0.smithi138.stdout:8/617: mknod db/dd/cc9 0 2024-02-15T22:50:57.433 INFO:tasks.workunit.client.0.smithi138.stdout:4/726: dwrite d17/f18 [0,4194304] 0 2024-02-15T22:50:57.433 INFO:tasks.workunit.client.0.smithi138.stdout:4/727: truncate d17/d1e/db8/fdd 474989 0 2024-02-15T22:50:57.433 INFO:tasks.workunit.client.0.smithi138.stdout:6/507: dwrite dc/d24/d34/d3b/f41 [0,4194304] 0 2024-02-15T22:50:57.433 INFO:tasks.workunit.client.0.smithi138.stdout:5/449: dwrite df/f11 [0,4194304] 0 2024-02-15T22:50:57.435 INFO:tasks.workunit.client.0.smithi138.stdout:5/450: unlink df/c81 0 2024-02-15T22:50:57.436 INFO:tasks.workunit.client.0.smithi138.stdout:4/728: rename d17/d2b/fa4 to d17/ff0 0 2024-02-15T22:50:57.436 INFO:tasks.workunit.client.0.smithi138.stdout:4/729: chown d17/d1e/d2d/d36/f6e 61 1 2024-02-15T22:50:57.438 INFO:tasks.workunit.client.0.smithi138.stdout:4/730: link d17/d1e/d2d/d36/d3e/fb4 d17/d1e/d2d/d36/ff1 0 2024-02-15T22:50:57.440 INFO:tasks.workunit.client.0.smithi138.stdout:6/508: dread dc/d24/d34/d3b/d7c/f83 [0,4194304] 0 2024-02-15T22:50:57.444 INFO:tasks.workunit.client.0.smithi138.stdout:8/618: dread db/f38 [0,4194304] 0 2024-02-15T22:50:57.451 INFO:tasks.workunit.client.0.smithi138.stdout:4/731: write d17/d1e/d2d/fc2 [2439681,85407] 0 2024-02-15T22:50:57.454 INFO:tasks.workunit.client.0.smithi138.stdout:4/732: rename d17/d1e/d2d/d36/d3e/d64/l51 to d17/d1e/d2d/d36/dca/da3/lf2 0 2024-02-15T22:50:57.454 INFO:tasks.workunit.client.0.smithi138.stdout:4/733: fdatasync d17/d1a/daa/fb9 0 2024-02-15T22:50:57.454 INFO:tasks.workunit.client.0.smithi138.stdout:4/734: fsync d17/d2b/f9e 0 2024-02-15T22:50:57.454 INFO:tasks.workunit.client.0.smithi138.stdout:6/509: read dc/d24/d34/d3b/d7c/d9f/fa5 [2536156,121933] 0 2024-02-15T22:50:57.454 INFO:tasks.workunit.client.0.smithi138.stdout:6/510: fdatasync dc/d24/d34/d3b/d7c/d9f/fa5 0 2024-02-15T22:50:57.457 INFO:tasks.workunit.client.0.smithi138.stdout:8/619: write db/dd/d4d/f9a [1545885,63605] 0 2024-02-15T22:50:57.458 INFO:tasks.workunit.client.0.smithi138.stdout:8/620: creat db/dd/d13/d19/d7d/db2/fca x:0 0 0 2024-02-15T22:50:57.458 INFO:tasks.workunit.client.0.smithi138.stdout:8/621: creat db/dd/d13/d19/d6b/fcb x:0 0 0 2024-02-15T22:50:57.461 INFO:tasks.workunit.client.0.smithi138.stdout:8/622: creat db/dd/fcc x:0 0 0 2024-02-15T22:50:57.461 INFO:tasks.workunit.client.0.smithi138.stdout:8/623: read f0 [1272634,28694] 0 2024-02-15T22:50:57.461 INFO:tasks.workunit.client.0.smithi138.stdout:8/624: chown db/dd/d13/d19/d45/c4f 9 1 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:5/451: dwrite df/d18/d2b/f49 [0,4194304] 0 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:5/452: fdatasync df/d18/d2b/f4d 0 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/625: symlink db/d15/d70/d7c/lcd 0 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/626: creat db/dd/fce x:0 0 0 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/627: stat db/f1a 0 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/628: dread - db/dd/d22/f8a zero size 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/629: chown db/dd/d13/d19/l37 1930272 1 2024-02-15T22:50:57.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/630: creat db/dd/d13/d19/d6b/fcf x:0 0 0 2024-02-15T22:50:57.465 INFO:tasks.workunit.client.0.smithi138.stdout:5/453: mknod df/d18/d3e/d8a/c8d 0 2024-02-15T22:50:57.467 INFO:tasks.workunit.client.0.smithi138.stdout:5/454: link df/l53 df/d18/d77/l8e 0 2024-02-15T22:50:57.469 INFO:tasks.workunit.client.0.smithi138.stdout:5/455: rename df/d18/d2b/f76 to df/d18/d3e/d60/f8f 0 2024-02-15T22:50:57.469 INFO:tasks.workunit.client.0.smithi138.stdout:5/456: chown df/f2e 4 1 2024-02-15T22:50:57.469 INFO:tasks.workunit.client.0.smithi138.stdout:5/457: write df/d18/d3e/d60/f6b [5198562,117152] 0 2024-02-15T22:50:57.472 INFO:tasks.workunit.client.0.smithi138.stdout:8/631: write db/d15/d70/d7c/d92/f2c [3693631,64530] 0 2024-02-15T22:50:57.476 INFO:tasks.workunit.client.0.smithi138.stdout:8/632: rmdir db/dd/d13/d19/d45 39 2024-02-15T22:50:57.476 INFO:tasks.workunit.client.0.smithi138.stdout:8/633: chown db/dd/d13/d19/d7d/fc8 2089130 1 2024-02-15T22:50:57.476 INFO:tasks.workunit.client.0.smithi138.stdout:6/511: dwrite dc/f3a [0,4194304] 0 2024-02-15T22:50:57.476 INFO:tasks.workunit.client.0.smithi138.stdout:4/735: dwrite d17/d2b/fba [0,4194304] 0 2024-02-15T22:50:57.476 INFO:tasks.workunit.client.0.smithi138.stdout:4/736: dread d17/d1e/d2d/d8c/fc6 [0,4194304] 0 2024-02-15T22:50:57.477 INFO:tasks.workunit.client.0.smithi138.stdout:8/634: link db/d15/d70/d7c/lcd db/ld0 0 2024-02-15T22:50:57.477 INFO:tasks.workunit.client.0.smithi138.stdout:8/635: write db/dd/d13/d19/d6b/fcf [266782,95796] 0 2024-02-15T22:50:57.478 INFO:tasks.workunit.client.0.smithi138.stdout:6/512: creat dc/d4b/d98/fb2 x:0 0 0 2024-02-15T22:50:57.482 INFO:tasks.workunit.client.0.smithi138.stdout:8/636: getdents db/dd/d4d 0 2024-02-15T22:50:57.484 INFO:tasks.workunit.client.0.smithi138.stdout:6/513: link dc/d24/d34/c62 dc/cb3 0 2024-02-15T22:50:57.484 INFO:tasks.workunit.client.0.smithi138.stdout:8/637: rmdir db/dd/d4d 39 2024-02-15T22:50:57.486 INFO:tasks.workunit.client.0.smithi138.stdout:6/514: rename dc/d24/c4e to dc/d4b/d98/cb4 0 2024-02-15T22:50:57.490 INFO:tasks.workunit.client.0.smithi138.stdout:8/638: dread db/f10 [4194304,4194304] 0 2024-02-15T22:50:57.495 INFO:tasks.workunit.client.0.smithi138.stdout:6/515: dread dc/f15 [0,4194304] 0 2024-02-15T22:50:57.497 INFO:tasks.workunit.client.0.smithi138.stdout:5/458: dwrite df/d18/d3e/d51/f6a [0,4194304] 0 2024-02-15T22:50:57.497 INFO:tasks.workunit.client.0.smithi138.stdout:5/459: chown df/d18/d3e/d8a/c8d 14678400 1 2024-02-15T22:50:57.497 INFO:tasks.workunit.client.0.smithi138.stdout:4/737: dwrite d17/d1e/d2d/f7c [0,4194304] 0 2024-02-15T22:50:57.497 INFO:tasks.workunit.client.0.smithi138.stdout:6/516: mknod dc/d24/d34/d3b/d7c/cb5 0 2024-02-15T22:50:57.497 INFO:tasks.workunit.client.0.smithi138.stdout:6/517: write dc/d24/d34/f49 [2105825,31556] 0 2024-02-15T22:50:57.498 INFO:tasks.workunit.client.0.smithi138.stdout:6/518: chown dc/d24/d34/d3b/d7c/l87 1567 1 2024-02-15T22:50:57.498 INFO:tasks.workunit.client.0.smithi138.stdout:5/460: mkdir df/d18/d3e/d60/d65/d7f/d90 0 2024-02-15T22:50:57.501 INFO:tasks.workunit.client.0.smithi138.stdout:8/639: write db/dd/d13/d19/f43 [320402,127325] 0 2024-02-15T22:50:57.501 INFO:tasks.workunit.client.0.smithi138.stdout:8/640: creat db/dd/d13/d19/d6b/fd1 x:0 0 0 2024-02-15T22:50:57.501 INFO:tasks.workunit.client.0.smithi138.stdout:8/641: dread - db/dd/d13/f64 zero size 2024-02-15T22:50:57.501 INFO:tasks.workunit.client.0.smithi138.stdout:4/738: unlink d17/d1a/lda 0 2024-02-15T22:50:57.501 INFO:tasks.workunit.client.0.smithi138.stdout:4/739: readlink d17/d1e/d2d/l7d 0 2024-02-15T22:50:57.504 INFO:tasks.workunit.client.0.smithi138.stdout:8/642: symlink db/d15/daa/ld2 0 2024-02-15T22:50:57.506 INFO:tasks.workunit.client.0.smithi138.stdout:8/643: truncate db/dd/d13/f3b 2192840 0 2024-02-15T22:50:57.509 INFO:tasks.workunit.client.0.smithi138.stdout:6/519: read dc/d24/f27 [6740628,6482] 0 2024-02-15T22:50:57.509 INFO:tasks.workunit.client.0.smithi138.stdout:6/520: write f1 [851264,118983] 0 2024-02-15T22:50:57.519 INFO:tasks.workunit.client.0.smithi138.stdout:5/461: dwrite df/d18/d3e/d51/f55 [0,4194304] 0 2024-02-15T22:50:57.520 INFO:tasks.workunit.client.0.smithi138.stdout:5/462: stat fc 0 2024-02-15T22:50:57.520 INFO:tasks.workunit.client.0.smithi138.stdout:5/463: write f5 [2598762,72949] 0 2024-02-15T22:50:57.534 INFO:tasks.workunit.client.0.smithi138.stdout:5/464: dwrite df/d18/d3e/d60/d72/f7d [0,4194304] 0 2024-02-15T22:50:57.542 INFO:tasks.workunit.client.0.smithi138.stdout:5/465: write df/d18/d3e/d60/f6b [998162,124644] 0 2024-02-15T22:50:57.543 INFO:tasks.workunit.client.0.smithi138.stdout:5/466: chown df/d18/c1f 7 1 2024-02-15T22:50:57.551 INFO:tasks.workunit.client.0.smithi138.stdout:5/467: dread fc [0,4194304] 0 2024-02-15T22:50:57.552 INFO:tasks.workunit.client.0.smithi138.stdout:5/468: symlink df/d18/d3e/l91 0 2024-02-15T22:50:57.567 INFO:tasks.workunit.client.0.smithi138.stdout:5/469: dwrite df/d18/d3e/d60/d65/f67 [0,4194304] 0 2024-02-15T22:50:57.569 INFO:tasks.workunit.client.0.smithi138.stdout:5/470: creat df/d18/d3e/d60/d65/d7f/d90/f92 x:0 0 0 2024-02-15T22:50:57.570 INFO:tasks.workunit.client.0.smithi138.stdout:5/471: creat df/d18/d3e/d66/f93 x:0 0 0 2024-02-15T22:50:57.572 INFO:tasks.workunit.client.0.smithi138.stdout:5/472: creat df/d18/d3e/d66/d82/f94 x:0 0 0 2024-02-15T22:50:57.572 INFO:tasks.workunit.client.0.smithi138.stdout:5/473: write df/d18/f29 [2760247,57773] 0 2024-02-15T22:50:57.573 INFO:tasks.workunit.client.0.smithi138.stdout:5/474: mknod df/d18/d3e/d60/d65/d7c/c95 0 2024-02-15T22:50:57.580 INFO:tasks.workunit.client.0.smithi138.stdout:5/475: dread df/d18/d3e/d66/f6e [0,4194304] 0 2024-02-15T22:50:57.580 INFO:tasks.workunit.client.0.smithi138.stdout:5/476: dread - df/d18/f4c zero size 2024-02-15T22:50:57.582 INFO:tasks.workunit.client.0.smithi138.stdout:5/477: symlink df/l96 0 2024-02-15T22:50:57.583 INFO:tasks.workunit.client.0.smithi138.stdout:5/478: dread df/d18/d3e/d60/d65/f73 [0,4194304] 0 2024-02-15T22:50:57.583 INFO:tasks.workunit.client.0.smithi138.stdout:5/479: write df/d18/f7b [871658,26594] 0 2024-02-15T22:50:57.583 INFO:tasks.workunit.client.0.smithi138.stdout:5/480: creat df/d18/f97 x:0 0 0 2024-02-15T22:50:57.591 INFO:tasks.workunit.client.0.smithi138.stdout:5/481: write df/d18/d3e/d51/f55 [3878977,88155] 0 2024-02-15T22:50:57.592 INFO:tasks.workunit.client.0.smithi138.stdout:5/482: fdatasync df/d18/d3e/d51/f55 0 2024-02-15T22:50:57.594 INFO:tasks.workunit.client.0.smithi138.stdout:5/483: creat df/d18/d3e/d51/f98 x:0 0 0 2024-02-15T22:50:57.613 INFO:tasks.workunit.client.0.smithi138.stdout:5/484: dwrite df/d18/d3e/d60/f6b [0,4194304] 0 2024-02-15T22:50:57.613 INFO:tasks.workunit.client.0.smithi138.stdout:5/485: fdatasync df/d18/d3e/d60/f8f 0 2024-02-15T22:50:57.613 INFO:tasks.workunit.client.0.smithi138.stdout:5/486: write df/d18/d3e/d66/f93 [901876,10711] 0 2024-02-15T22:50:57.613 INFO:tasks.workunit.client.0.smithi138.stdout:5/487: creat df/d18/d3e/d60/f99 x:0 0 0 2024-02-15T22:50:57.617 INFO:tasks.workunit.client.0.smithi138.stdout:5/488: rmdir df/d18/d3e/d60/d65 39 2024-02-15T22:50:57.618 INFO:tasks.workunit.client.0.smithi138.stdout:5/489: mknod df/d18/d3e/d51/c9a 0 2024-02-15T22:50:57.619 INFO:tasks.workunit.client.0.smithi138.stdout:5/490: symlink df/d18/d3e/d60/d72/l9b 0 2024-02-15T22:50:57.619 INFO:tasks.workunit.client.0.smithi138.stdout:5/491: fsync df/d18/d3e/d60/f7a 0 2024-02-15T22:50:57.619 INFO:tasks.workunit.client.0.smithi138.stdout:5/492: getdents df/d18/d56 0 2024-02-15T22:50:57.620 INFO:tasks.workunit.client.0.smithi138.stdout:5/493: truncate df/d18/d3e/f4e 824668 0 2024-02-15T22:50:57.621 INFO:tasks.workunit.client.0.smithi138.stdout:5/494: write df/d18/d3e/f48 [147553,91531] 0 2024-02-15T22:50:57.621 INFO:tasks.workunit.client.0.smithi138.stdout:5/495: read - df/d18/d3e/d60/f99 zero size 2024-02-15T22:50:57.621 INFO:tasks.workunit.client.0.smithi138.stdout:5/496: mkdir df/d18/d2b/d9c 0 2024-02-15T22:50:57.630 INFO:tasks.workunit.client.0.smithi138.stdout:5/497: write df/d18/d3e/d60/d72/f7d [4021391,57527] 0 2024-02-15T22:50:57.640 INFO:tasks.workunit.client.0.smithi138.stdout:7/683: sync 2024-02-15T22:50:57.640 INFO:tasks.workunit.client.0.smithi138.stdout:0/552: sync 2024-02-15T22:50:57.648 INFO:tasks.workunit.client.0.smithi138.stdout:5/498: dwrite fb [0,4194304] 0 2024-02-15T22:50:57.649 INFO:tasks.workunit.client.0.smithi138.stdout:5/499: truncate df/d18/d2b/f3b 1635957 0 2024-02-15T22:50:57.650 INFO:tasks.workunit.client.0.smithi138.stdout:5/500: write df/f2e [251065,109598] 0 2024-02-15T22:50:57.651 INFO:tasks.workunit.client.0.smithi138.stdout:5/501: chown df/d18/d3e/d60/d65/d7f 13 1 2024-02-15T22:50:57.652 INFO:tasks.workunit.client.0.smithi138.stdout:5/502: rmdir df/d18/d56 39 2024-02-15T22:50:57.652 INFO:tasks.workunit.client.0.smithi138.stdout:5/503: mkdir df/d18/d3e/d60/d65/d7f/d9d 0 2024-02-15T22:50:57.670 INFO:tasks.workunit.client.0.smithi138.stdout:0/553: dwrite d6/d10/d18/fa7 [0,4194304] 0 2024-02-15T22:50:57.670 INFO:tasks.workunit.client.0.smithi138.stdout:7/684: dwrite d1/d2/db/d3c/d4d/f52 [0,4194304] 0 2024-02-15T22:50:57.670 INFO:tasks.workunit.client.0.smithi138.stdout:0/554: fsync d6/d10/d40/f43 0 2024-02-15T22:50:57.670 INFO:tasks.workunit.client.0.smithi138.stdout:0/555: chown d6/d10/d13/f1e 1156 1 2024-02-15T22:50:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:7/685: getdents d1/d2/db/db9 0 2024-02-15T22:50:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:7/686: dread - d1/d79/d84/da0/ddf/fce zero size 2024-02-15T22:50:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:5/504: dread df/d18/d2b/f3b [0,4194304] 0 2024-02-15T22:50:57.675 INFO:tasks.workunit.client.0.smithi138.stdout:7/687: symlink d1/d2/d29/le6 0 2024-02-15T22:50:57.675 INFO:tasks.workunit.client.0.smithi138.stdout:7/688: chown d1/d5a/d97/c91 101915926 1 2024-02-15T22:50:57.675 INFO:tasks.workunit.client.0.smithi138.stdout:7/689: write d1/d2/db/f7b [4930285,125477] 0 2024-02-15T22:50:57.675 INFO:tasks.workunit.client.0.smithi138.stdout:7/690: chown d1/d2/db/db9 118513600 1 2024-02-15T22:50:57.676 INFO:tasks.workunit.client.0.smithi138.stdout:5/505: creat df/d18/d3e/d60/d65/f9e x:0 0 0 2024-02-15T22:50:57.679 INFO:tasks.workunit.client.0.smithi138.stdout:7/691: creat d1/d2/db/d25/fe7 x:0 0 0 2024-02-15T22:50:57.680 INFO:tasks.workunit.client.0.smithi138.stdout:5/506: rmdir df/d18/d77 39 2024-02-15T22:50:57.681 INFO:tasks.workunit.client.0.smithi138.stdout:5/507: unlink df/d18/d3e/d51/c87 0 2024-02-15T22:50:57.681 INFO:tasks.workunit.client.0.smithi138.stdout:5/508: chown df/d18/d56 0 1 2024-02-15T22:50:57.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/509: mkdir df/d18/d2b/d9c/d9f 0 2024-02-15T22:50:57.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/510: fsync df/f17 0 2024-02-15T22:50:57.686 INFO:tasks.workunit.client.0.smithi138.stdout:0/556: dwrite d6/d10/d13/fb7 [0,4194304] 0 2024-02-15T22:50:57.688 INFO:tasks.workunit.client.0.smithi138.stdout:0/557: creat d6/d10/d75/fc5 x:0 0 0 2024-02-15T22:50:57.690 INFO:tasks.workunit.client.0.smithi138.stdout:7/692: dread d1/d2/d29/f3a [0,4194304] 0 2024-02-15T22:50:57.693 INFO:tasks.workunit.client.0.smithi138.stdout:5/511: write df/f17 [299519,117067] 0 2024-02-15T22:50:57.699 INFO:tasks.workunit.client.0.smithi138.stdout:7/693: read d1/d5a/d97/f7f [1610087,97181] 0 2024-02-15T22:50:57.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/512: read df/d18/d3e/d51/f6a [1287114,89961] 0 2024-02-15T22:50:57.704 INFO:tasks.workunit.client.0.smithi138.stdout:0/558: dwrite d6/f95 [0,4194304] 0 2024-02-15T22:50:57.704 INFO:tasks.workunit.client.0.smithi138.stdout:0/559: write d6/d10/d34/f5a [4831868,73143] 0 2024-02-15T22:50:57.704 INFO:tasks.workunit.client.0.smithi138.stdout:0/560: truncate d6/d10/d64/f88 1154687 0 2024-02-15T22:50:57.704 INFO:tasks.workunit.client.0.smithi138.stdout:5/513: creat df/d18/d2b/fa0 x:0 0 0 2024-02-15T22:50:57.708 INFO:tasks.workunit.client.0.smithi138.stdout:7/694: write d1/d2/f9f [126975,50627] 0 2024-02-15T22:50:57.709 INFO:tasks.workunit.client.0.smithi138.stdout:7/695: write d1/d79/d84/da0/fe1 [910237,94476] 0 2024-02-15T22:50:57.710 INFO:tasks.workunit.client.0.smithi138.stdout:0/561: mkdir d6/d10/d13/d3d/dc6 0 2024-02-15T22:50:57.711 INFO:tasks.workunit.client.0.smithi138.stdout:5/514: rmdir df/d18/d2b/d9c/d9f 0 2024-02-15T22:50:57.711 INFO:tasks.workunit.client.0.smithi138.stdout:5/515: truncate df/d18/d3e/d60/f8f 283555 0 2024-02-15T22:50:57.713 INFO:tasks.workunit.client.0.smithi138.stdout:7/696: creat d1/d28/d7c/fe8 x:0 0 0 2024-02-15T22:50:57.714 INFO:tasks.workunit.client.0.smithi138.stdout:7/697: chown d1/d5a/d97/fcb 0 1 2024-02-15T22:50:57.714 INFO:tasks.workunit.client.0.smithi138.stdout:5/516: mknod df/d18/d3e/d8a/ca1 0 2024-02-15T22:50:57.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/698: truncate d1/d79/d84/da0/fc2 3003297 0 2024-02-15T22:50:57.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/699: stat d1/d2/db/d3c/d4d/d5b 0 2024-02-15T22:50:57.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/700: readlink d1/d28/d7c/lbd 0 2024-02-15T22:50:57.716 INFO:tasks.workunit.client.0.smithi138.stdout:7/701: fdatasync d1/d2/f1d 0 2024-02-15T22:50:57.717 INFO:tasks.workunit.client.0.smithi138.stdout:5/517: mknod df/d18/d77/ca2 0 2024-02-15T22:50:57.718 INFO:tasks.workunit.client.0.smithi138.stdout:7/702: link d1/f6b d1/d28/fe9 0 2024-02-15T22:50:57.719 INFO:tasks.workunit.client.0.smithi138.stdout:7/703: write d1/d2/db/d3c/d4d/f52 [5462137,116673] 0 2024-02-15T22:50:57.724 INFO:tasks.workunit.client.0.smithi138.stdout:5/518: read df/d18/d2b/f47 [1813349,46345] 0 2024-02-15T22:50:57.725 INFO:tasks.workunit.client.0.smithi138.stdout:7/704: creat d1/d79/d84/da0/ddf/fea x:0 0 0 2024-02-15T22:50:57.725 INFO:tasks.workunit.client.0.smithi138.stdout:7/705: getdents d1/d2/db/d3c/d4d/d5b/dda 0 2024-02-15T22:50:57.728 INFO:tasks.workunit.client.0.smithi138.stdout:7/706: creat d1/d2/db/d3c/feb x:0 0 0 2024-02-15T22:50:57.730 INFO:tasks.workunit.client.0.smithi138.stdout:7/707: dread d1/d2/db/d3c/d4d/d5b/f62 [0,4194304] 0 2024-02-15T22:50:57.731 INFO:tasks.workunit.client.0.smithi138.stdout:7/708: symlink d1/d79/d84/d8c/lec 0 2024-02-15T22:50:57.733 INFO:tasks.workunit.client.0.smithi138.stdout:7/709: truncate d1/d2/f93 2481500 0 2024-02-15T22:50:57.733 INFO:tasks.workunit.client.0.smithi138.stdout:7/710: write d1/faa [1918761,28566] 0 2024-02-15T22:50:57.739 INFO:tasks.workunit.client.0.smithi138.stdout:5/519: dwrite df/d18/f6f [0,4194304] 0 2024-02-15T22:50:57.741 INFO:tasks.workunit.client.0.smithi138.stdout:5/520: link df/d18/d3e/d60/d65/d7c/l8b df/d18/d3e/d60/d65/d7f/d90/la3 0 2024-02-15T22:50:57.743 INFO:tasks.workunit.client.0.smithi138.stdout:5/521: rename df/d18/d2b/l58 to df/d18/d77/la4 0 2024-02-15T22:50:57.745 INFO:tasks.workunit.client.0.smithi138.stdout:7/711: read d1/d79/d84/da0/fb7 [4162055,7514] 0 2024-02-15T22:50:57.745 INFO:tasks.workunit.client.0.smithi138.stdout:7/712: fsync d1/d28/fe9 0 2024-02-15T22:50:57.745 INFO:tasks.workunit.client.0.smithi138.stdout:5/522: mkdir df/d18/d3e/d60/d72/da5 0 2024-02-15T22:50:57.746 INFO:tasks.workunit.client.0.smithi138.stdout:5/523: creat df/d18/d3e/d60/d65/fa6 x:0 0 0 2024-02-15T22:50:57.746 INFO:tasks.workunit.client.0.smithi138.stdout:7/713: symlink d1/d79/d84/da0/led 0 2024-02-15T22:50:57.747 INFO:tasks.workunit.client.0.smithi138.stdout:7/714: write d1/d2/db/d3c/f56 [1174832,88991] 0 2024-02-15T22:50:57.747 INFO:tasks.workunit.client.0.smithi138.stdout:5/524: truncate f5 2643998 0 2024-02-15T22:50:57.748 INFO:tasks.workunit.client.0.smithi138.stdout:7/715: mkdir d1/d2/db/d25/d41/dee 0 2024-02-15T22:50:57.750 INFO:tasks.workunit.client.0.smithi138.stdout:7/716: creat d1/d5a/fef x:0 0 0 2024-02-15T22:50:57.750 INFO:tasks.workunit.client.0.smithi138.stdout:7/717: fsync d1/f42 0 2024-02-15T22:50:57.750 INFO:tasks.workunit.client.0.smithi138.stdout:7/718: creat d1/d28/d7c/ff0 x:0 0 0 2024-02-15T22:50:57.751 INFO:tasks.workunit.client.0.smithi138.stdout:5/525: dread df/d18/d2b/f3b [0,4194304] 0 2024-02-15T22:50:57.751 INFO:tasks.workunit.client.0.smithi138.stdout:5/526: write df/d18/d2b/f49 [4972242,48384] 0 2024-02-15T22:50:57.751 INFO:tasks.workunit.client.0.smithi138.stdout:5/527: fsync df/d18/f7b 0 2024-02-15T22:50:57.752 INFO:tasks.workunit.client.0.smithi138.stdout:5/528: creat df/d18/d3e/d60/d65/d7f/fa7 x:0 0 0 2024-02-15T22:50:57.753 INFO:tasks.workunit.client.0.smithi138.stdout:7/719: mknod d1/d79/d84/da0/ddf/cf1 0 2024-02-15T22:50:57.754 INFO:tasks.workunit.client.0.smithi138.stdout:5/529: unlink df/d18/d3e/d60/d65/f9e 0 2024-02-15T22:50:57.755 INFO:tasks.workunit.client.0.smithi138.stdout:7/720: mkdir d1/df2 0 2024-02-15T22:50:57.756 INFO:tasks.workunit.client.0.smithi138.stdout:5/530: mknod df/d18/d3e/ca8 0 2024-02-15T22:50:57.758 INFO:tasks.workunit.client.0.smithi138.stdout:7/721: truncate d1/d2/db/d3c/d4d/d5b/f76 113337 0 2024-02-15T22:50:57.767 INFO:tasks.workunit.client.0.smithi138.stdout:7/722: dread d1/d79/d84/da0/fdb [0,4194304] 0 2024-02-15T22:50:57.785 INFO:tasks.workunit.client.0.smithi138.stdout:7/723: dwrite d1/d2/f30 [0,4194304] 0 2024-02-15T22:50:57.786 INFO:tasks.workunit.client.0.smithi138.stdout:7/724: creat d1/d79/ff3 x:0 0 0 2024-02-15T22:50:57.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/725: mknod d1/df2/cf4 0 2024-02-15T22:50:57.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/726: creat d1/d2/db/d25/ff5 x:0 0 0 2024-02-15T22:50:57.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/727: fsync d1/d2/db/fb0 0 2024-02-15T22:50:57.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/728: truncate d1/d2/db/d25/ff5 503209 0 2024-02-15T22:50:57.788 INFO:tasks.workunit.client.0.smithi138.stdout:7/729: mkdir d1/d2/db/d25/df6 0 2024-02-15T22:50:57.788 INFO:tasks.workunit.client.0.smithi138.stdout:7/730: rmdir d1/df2 39 2024-02-15T22:50:57.789 INFO:tasks.workunit.client.0.smithi138.stdout:7/731: mknod d1/d2/db/d3c/d4d/cf7 0 2024-02-15T22:50:57.789 INFO:tasks.workunit.client.0.smithi138.stdout:7/732: fdatasync d1/faa 0 2024-02-15T22:50:57.789 INFO:tasks.workunit.client.0.smithi138.stdout:7/733: getdents d1/d2/db/db9 0 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:3/662: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:4/740: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:9/671: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:4/741: creat d17/d1e/d2d/d52/ff3 x:0 0 0 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:1/405: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:2/531: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:2/532: readlink d0/dd/d15/d65/l75 0 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:2/533: write d0/da/d19/d53/d5d/d83/faf [132258,62514] 0 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:8/644: sync 2024-02-15T22:50:57.791 INFO:tasks.workunit.client.0.smithi138.stdout:6/521: sync 2024-02-15T22:50:57.792 INFO:tasks.workunit.client.0.smithi138.stdout:7/734: symlink d1/d79/d84/lf8 0 2024-02-15T22:50:57.792 INFO:tasks.workunit.client.0.smithi138.stdout:1/406: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f [1847720,102310] 0 2024-02-15T22:50:57.796 INFO:tasks.workunit.client.0.smithi138.stdout:2/534: mkdir d0/da/d19/d53/d5d/d83/d8a/dc2 0 2024-02-15T22:50:57.797 INFO:tasks.workunit.client.0.smithi138.stdout:2/535: chown d0/da/d19/d53/d5d/d74/c67 907457395 1 2024-02-15T22:50:57.797 INFO:tasks.workunit.client.0.smithi138.stdout:2/536: write d0/dd/d15/d65/f7e [28907,94138] 0 2024-02-15T22:50:57.797 INFO:tasks.workunit.client.0.smithi138.stdout:2/537: dread - d0/da/d19/d53/fa4 zero size 2024-02-15T22:50:57.797 INFO:tasks.workunit.client.0.smithi138.stdout:6/522: creat dc/fb6 x:0 0 0 2024-02-15T22:50:57.799 INFO:tasks.workunit.client.0.smithi138.stdout:7/735: mknod d1/d2/db/d25/df6/cf9 0 2024-02-15T22:50:57.801 INFO:tasks.workunit.client.0.smithi138.stdout:4/742: read d17/d1e/f3f [2575184,73335] 0 2024-02-15T22:50:57.801 INFO:tasks.workunit.client.0.smithi138.stdout:4/743: truncate d17/d1e/d2d/d36/fd6 990941 0 2024-02-15T22:50:57.802 INFO:tasks.workunit.client.0.smithi138.stdout:1/407: mkdir df/d1b/d1d/d25/d8d 0 2024-02-15T22:50:57.804 INFO:tasks.workunit.client.0.smithi138.stdout:1/408: dread df/d1b/d1d/d25/f42 [0,4194304] 0 2024-02-15T22:50:57.804 INFO:tasks.workunit.client.0.smithi138.stdout:1/409: write df/d1b/d1d/d24/d3a/f70 [887128,16254] 0 2024-02-15T22:50:57.805 INFO:tasks.workunit.client.0.smithi138.stdout:4/744: dread d17/d1e/d2d/f61 [0,4194304] 0 2024-02-15T22:50:57.810 INFO:tasks.workunit.client.0.smithi138.stdout:9/672: rmdir d0 39 2024-02-15T22:50:57.811 INFO:tasks.workunit.client.0.smithi138.stdout:2/538: rmdir d0/d3 39 2024-02-15T22:50:57.811 INFO:tasks.workunit.client.0.smithi138.stdout:2/539: getdents d0/da/d19/d53/d80/dba 0 2024-02-15T22:50:57.811 INFO:tasks.workunit.client.0.smithi138.stdout:3/663: dwrite d5/d16/dc/d43/d47/d67/f6b [0,4194304] 0 2024-02-15T22:50:57.812 INFO:tasks.workunit.client.0.smithi138.stdout:6/523: truncate f2 2785346 0 2024-02-15T22:50:57.812 INFO:tasks.workunit.client.0.smithi138.stdout:6/524: chown dc/d24/d34/c62 852940221 1 2024-02-15T22:50:57.813 INFO:tasks.workunit.client.0.smithi138.stdout:7/736: link d1/d79/d84/da0/cc4 d1/d2/db/db9/cfa 0 2024-02-15T22:50:57.814 INFO:tasks.workunit.client.0.smithi138.stdout:9/673: truncate d0/f19 3799668 0 2024-02-15T22:50:57.814 INFO:tasks.workunit.client.0.smithi138.stdout:9/674: fsync d0/de/d48/f96 0 2024-02-15T22:50:57.814 INFO:tasks.workunit.client.0.smithi138.stdout:9/675: chown d0/de/d14/f66 7 1 2024-02-15T22:50:57.815 INFO:tasks.workunit.client.0.smithi138.stdout:2/540: symlink d0/da/d19/d53/d5d/d6d/lc3 0 2024-02-15T22:50:57.815 INFO:tasks.workunit.client.0.smithi138.stdout:2/541: readlink d0/dd/d9d/lad 0 2024-02-15T22:50:57.817 INFO:tasks.workunit.client.0.smithi138.stdout:6/525: link dc/d24/d34/d3b/d66/f75 dc/d76/fb7 0 2024-02-15T22:50:57.818 INFO:tasks.workunit.client.0.smithi138.stdout:7/737: mkdir d1/d2/db/d25/d41/dfb 0 2024-02-15T22:50:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:4/745: write f8 [3245406,39559] 0 2024-02-15T22:50:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:8/645: dwrite db/f99 [0,4194304] 0 2024-02-15T22:50:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:4/746: dread - d17/d2b/f80 zero size 2024-02-15T22:50:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:8/646: creat db/d95/fd3 x:0 0 0 2024-02-15T22:50:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:8/647: creat db/dd/d22/fd4 x:0 0 0 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:6/526: rmdir dc/d24 39 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:6/527: creat dc/d4b/fb8 x:0 0 0 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:6/528: chown dc/d4b/d7b/c7f 3364751 1 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:6/529: chown dc/f15 29608775 1 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:7/738: mkdir d1/d5a/d97/dfc 0 2024-02-15T22:50:57.822 INFO:tasks.workunit.client.0.smithi138.stdout:7/739: fsync d1/f12 0 2024-02-15T22:50:57.823 INFO:tasks.workunit.client.0.smithi138.stdout:7/740: write d1/d2/fcc [819334,51538] 0 2024-02-15T22:50:57.823 INFO:tasks.workunit.client.0.smithi138.stdout:7/741: fdatasync d1/d2/db/d25/d41/f46 0 2024-02-15T22:50:57.823 INFO:tasks.workunit.client.0.smithi138.stdout:3/664: dread d5/d12/d23/f51 [4194304,4194304] 0 2024-02-15T22:50:57.824 INFO:tasks.workunit.client.0.smithi138.stdout:1/410: dwrite df/f12 [0,4194304] 0 2024-02-15T22:50:57.828 INFO:tasks.workunit.client.0.smithi138.stdout:8/648: rmdir db/dd/d13/d19/d7d 39 2024-02-15T22:50:57.829 INFO:tasks.workunit.client.0.smithi138.stdout:2/542: dread d0/f37 [0,4194304] 0 2024-02-15T22:50:57.829 INFO:tasks.workunit.client.0.smithi138.stdout:2/543: truncate d0/da/f9c 897357 0 2024-02-15T22:50:57.831 INFO:tasks.workunit.client.0.smithi138.stdout:6/530: symlink dc/d24/d34/d3b/d7c/lb9 0 2024-02-15T22:50:57.831 INFO:tasks.workunit.client.0.smithi138.stdout:6/531: dread - dc/d24/d34/d3b/f78 zero size 2024-02-15T22:50:57.833 INFO:tasks.workunit.client.0.smithi138.stdout:1/411: rmdir df/d1b/d1d/d25/d2e/d5b/d65/d80 39 2024-02-15T22:50:57.835 INFO:tasks.workunit.client.0.smithi138.stdout:2/544: symlink d0/da/d19/d53/d5d/d6d/d7b/da3/lc4 0 2024-02-15T22:50:57.836 INFO:tasks.workunit.client.0.smithi138.stdout:3/665: rmdir d5/d12/d23/d29/d5a/dc2 39 2024-02-15T22:50:57.838 INFO:tasks.workunit.client.0.smithi138.stdout:4/747: write d17/d1e/d2d/d52/f8d [1704774,73509] 0 2024-02-15T22:50:57.838 INFO:tasks.workunit.client.0.smithi138.stdout:8/649: write db/dd/f14 [3833874,44846] 0 2024-02-15T22:50:57.838 INFO:tasks.workunit.client.0.smithi138.stdout:2/545: rename d0/d3/f44 to d0/da/d19/d53/d5d/d6d/d97/fc5 0 2024-02-15T22:50:57.839 INFO:tasks.workunit.client.0.smithi138.stdout:3/666: mknod d5/d16/dc/d43/d47/d67/cda 0 2024-02-15T22:50:57.842 INFO:tasks.workunit.client.0.smithi138.stdout:3/667: unlink d5/d16/dc/d43/da2/fb3 0 2024-02-15T22:50:57.843 INFO:tasks.workunit.client.0.smithi138.stdout:4/748: read d17/d1a/f23 [33441,123959] 0 2024-02-15T22:50:57.844 INFO:tasks.workunit.client.0.smithi138.stdout:6/532: dread dc/d24/d34/d3b/d66/f75 [0,4194304] 0 2024-02-15T22:50:57.845 INFO:tasks.workunit.client.0.smithi138.stdout:4/749: creat d17/d1e/d56/ff4 x:0 0 0 2024-02-15T22:50:57.848 INFO:tasks.workunit.client.0.smithi138.stdout:3/668: dread d5/d16/dc/f6d [0,4194304] 0 2024-02-15T22:50:57.848 INFO:tasks.workunit.client.0.smithi138.stdout:8/650: write db/f38 [1343351,89821] 0 2024-02-15T22:50:57.852 INFO:tasks.workunit.client.0.smithi138.stdout:9/676: dwrite d0/de/d14/da3/dc8/f9f [0,4194304] 0 2024-02-15T22:50:57.852 INFO:tasks.workunit.client.0.smithi138.stdout:9/677: chown d0/de/d14/da3/dc8/d71/f86 6992866 1 2024-02-15T22:50:57.852 INFO:tasks.workunit.client.0.smithi138.stdout:9/678: fdatasync d0/dc7/fd2 0 2024-02-15T22:50:57.852 INFO:tasks.workunit.client.0.smithi138.stdout:3/669: rename d5/l41 to d5/d16/dcf/ldb 0 2024-02-15T22:50:57.854 INFO:tasks.workunit.client.0.smithi138.stdout:8/651: creat db/d15/daa/fd5 x:0 0 0 2024-02-15T22:50:57.859 INFO:tasks.workunit.client.0.smithi138.stdout:1/412: dwrite df/d1b/d1d/d24/d3a/f71 [0,4194304] 0 2024-02-15T22:50:57.859 INFO:tasks.workunit.client.0.smithi138.stdout:7/742: dwrite d1/d2/f73 [4194304,4194304] 0 2024-02-15T22:50:57.863 INFO:tasks.workunit.client.0.smithi138.stdout:8/652: rmdir db/dd/d22/d9e 0 2024-02-15T22:50:57.863 INFO:tasks.workunit.client.0.smithi138.stdout:8/653: write db/dd/f14 [2316976,63012] 0 2024-02-15T22:50:57.864 INFO:tasks.workunit.client.0.smithi138.stdout:3/670: dread d5/d12/d23/d29/fad [0,4194304] 0 2024-02-15T22:50:57.865 INFO:tasks.workunit.client.0.smithi138.stdout:9/679: dread d0/de/d14/da3/dc8/d6a/fd0 [0,4194304] 0 2024-02-15T22:50:57.869 INFO:tasks.workunit.client.0.smithi138.stdout:1/413: unlink df/f11 0 2024-02-15T22:50:57.870 INFO:tasks.workunit.client.0.smithi138.stdout:8/654: mkdir db/dd/d4d/dd6 0 2024-02-15T22:50:57.871 INFO:tasks.workunit.client.0.smithi138.stdout:2/546: dwrite d0/da/d19/d53/f9f [0,4194304] 0 2024-02-15T22:50:57.872 INFO:tasks.workunit.client.0.smithi138.stdout:9/680: rmdir d0/de/d33/d98 39 2024-02-15T22:50:57.874 INFO:tasks.workunit.client.0.smithi138.stdout:4/750: dwrite d17/d1e/f4d [0,4194304] 0 2024-02-15T22:50:57.883 INFO:tasks.workunit.client.0.smithi138.stdout:7/743: dwrite d1/d2/db/f7b [4194304,4194304] 0 2024-02-15T22:50:57.887 INFO:tasks.workunit.client.0.smithi138.stdout:3/671: getdents d5/d18/d35 0 2024-02-15T22:50:57.888 INFO:tasks.workunit.client.0.smithi138.stdout:2/547: symlink d0/da/d19/d53/d5d/d83/lc6 0 2024-02-15T22:50:57.890 INFO:tasks.workunit.client.0.smithi138.stdout:9/681: link d0/de/d14/da3/dc8/f43 d0/de/d33/d98/fe4 0 2024-02-15T22:50:57.890 INFO:tasks.workunit.client.0.smithi138.stdout:9/682: chown d0/df/d11/f17 1270193690 1 2024-02-15T22:50:57.892 INFO:tasks.workunit.client.0.smithi138.stdout:8/655: dwrite db/dd/d22/f7f [0,4194304] 0 2024-02-15T22:50:57.892 INFO:tasks.workunit.client.0.smithi138.stdout:4/751: creat d17/d1e/d2d/dd5/ff5 x:0 0 0 2024-02-15T22:50:57.893 INFO:tasks.workunit.client.0.smithi138.stdout:7/744: symlink d1/d2/db/d25/lfd 0 2024-02-15T22:50:57.894 INFO:tasks.workunit.client.0.smithi138.stdout:1/414: dwrite df/f14 [0,4194304] 0 2024-02-15T22:50:57.894 INFO:tasks.workunit.client.0.smithi138.stdout:1/415: write df/d1b/d1d/d24/d3a/f77 [4696027,32927] 0 2024-02-15T22:50:57.895 INFO:tasks.workunit.client.0.smithi138.stdout:1/416: truncate df/d1b/d21/f32 1940504 0 2024-02-15T22:50:57.896 INFO:tasks.workunit.client.0.smithi138.stdout:3/672: symlink d5/d12/d26/dd5/ldc 0 2024-02-15T22:50:57.896 INFO:tasks.workunit.client.0.smithi138.stdout:3/673: readlink d5/d16/dc/l8b 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:3/674: chown d5/d12/d23/d29/d4f/f92 621195437 1 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:9/683: creat d0/fe5 x:0 0 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:2/548: dread d0/da/d19/d53/d5d/d74/fa7 [0,4194304] 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:2/549: readlink d0/da/d19/d53/d5d/d6d/l66 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:9/684: write d0/de/d33/f77 [8729514,67973] 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:3/675: read d5/d16/d4d/f85 [9283,86438] 0 2024-02-15T22:50:57.897 INFO:tasks.workunit.client.0.smithi138.stdout:3/676: dread - d5/d12/d23/d29/fd8 zero size 2024-02-15T22:50:57.900 INFO:tasks.workunit.client.0.smithi138.stdout:9/685: dread d0/d4/f2b [0,4194304] 0 2024-02-15T22:50:57.901 INFO:tasks.workunit.client.0.smithi138.stdout:8/656: unlink db/dd/d13/d19/f40 0 2024-02-15T22:50:57.901 INFO:tasks.workunit.client.0.smithi138.stdout:8/657: write db/d15/f94 [868688,104685] 0 2024-02-15T22:50:57.902 INFO:tasks.workunit.client.0.smithi138.stdout:4/752: symlink d17/d2b/d78/dc0/lf6 0 2024-02-15T22:50:57.902 INFO:tasks.workunit.client.0.smithi138.stdout:4/753: write d17/d1e/d2d/d36/fd6 [1297231,4111] 0 2024-02-15T22:50:57.904 INFO:tasks.workunit.client.0.smithi138.stdout:9/686: link d0/de/d14/d22/l3f d0/de/d48/d70/le6 0 2024-02-15T22:50:57.904 INFO:tasks.workunit.client.0.smithi138.stdout:1/417: dread df/d1b/d1d/f28 [0,4194304] 0 2024-02-15T22:50:57.904 INFO:tasks.workunit.client.0.smithi138.stdout:1/418: read df/d1b/d1d/d25/f61 [430026,91100] 0 2024-02-15T22:50:57.907 INFO:tasks.workunit.client.0.smithi138.stdout:8/658: symlink db/ld7 0 2024-02-15T22:50:57.908 INFO:tasks.workunit.client.0.smithi138.stdout:2/550: dread d0/da/d19/d53/d5d/fb2 [0,4194304] 0 2024-02-15T22:50:57.912 INFO:tasks.workunit.client.0.smithi138.stdout:9/687: mknod d0/d1/db8/ce7 0 2024-02-15T22:50:57.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/659: symlink db/ld8 0 2024-02-15T22:50:57.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/660: creat db/dd/d13/d19/d6b/fd9 x:0 0 0 2024-02-15T22:50:57.914 INFO:tasks.workunit.client.0.smithi138.stdout:2/551: creat d0/da/d19/fc7 x:0 0 0 2024-02-15T22:50:57.915 INFO:tasks.workunit.client.0.smithi138.stdout:9/688: rename d0/de/d33/f36 to d0/fe8 0 2024-02-15T22:50:57.916 INFO:tasks.workunit.client.0.smithi138.stdout:7/745: dwrite d1/d79/d84/da0/fa5 [0,4194304] 0 2024-02-15T22:50:57.918 INFO:tasks.workunit.client.0.smithi138.stdout:2/552: rmdir d0 39 2024-02-15T22:50:57.918 INFO:tasks.workunit.client.0.smithi138.stdout:9/689: mknod d0/de/d34/ce9 0 2024-02-15T22:50:57.919 INFO:tasks.workunit.client.0.smithi138.stdout:3/677: dwrite d5/d12/d23/d29/d5a/fb6 [0,4194304] 0 2024-02-15T22:50:57.920 INFO:tasks.workunit.client.0.smithi138.stdout:7/746: getdents d1/df2 0 2024-02-15T22:50:57.923 INFO:tasks.workunit.client.0.smithi138.stdout:9/690: creat d0/de/d34/fea x:0 0 0 2024-02-15T22:50:57.924 INFO:tasks.workunit.client.0.smithi138.stdout:7/747: rename d1/d2/d29/l32 to d1/d79/lfe 0 2024-02-15T22:50:57.927 INFO:tasks.workunit.client.0.smithi138.stdout:1/419: dwrite fe [0,4194304] 0 2024-02-15T22:50:57.927 INFO:tasks.workunit.client.0.smithi138.stdout:1/420: stat df/d1b/d1d/d24/d3a/f77 0 2024-02-15T22:50:57.933 INFO:tasks.workunit.client.0.smithi138.stdout:9/691: dread d0/d55/d59/fdf [0,4194304] 0 2024-02-15T22:50:57.934 INFO:tasks.workunit.client.0.smithi138.stdout:9/692: creat d0/d1/feb x:0 0 0 2024-02-15T22:50:57.936 INFO:tasks.workunit.client.0.smithi138.stdout:9/693: mkdir d0/de/d34/dd3/dec 0 2024-02-15T22:50:57.936 INFO:tasks.workunit.client.0.smithi138.stdout:9/694: truncate d0/df/f4e 866663 0 2024-02-15T22:50:57.936 INFO:tasks.workunit.client.0.smithi138.stdout:3/678: dwrite d5/d16/dc/d43/d47/d67/f87 [0,4194304] 0 2024-02-15T22:50:57.936 INFO:tasks.workunit.client.0.smithi138.stdout:7/748: dread d1/d2/d29/f3a [0,4194304] 0 2024-02-15T22:50:57.938 INFO:tasks.workunit.client.0.smithi138.stdout:7/749: symlink d1/d2/db/d3c/d4d/lff 0 2024-02-15T22:50:57.938 INFO:tasks.workunit.client.0.smithi138.stdout:7/750: creat d1/d5a/d97/f100 x:0 0 0 2024-02-15T22:50:57.946 INFO:tasks.workunit.client.0.smithi138.stdout:3/679: dread d5/d12/d23/d29/d4f/f92 [0,4194304] 0 2024-02-15T22:50:57.947 INFO:tasks.workunit.client.0.smithi138.stdout:3/680: creat d5/d12/d23/da1/fdd x:0 0 0 2024-02-15T22:50:57.947 INFO:tasks.workunit.client.0.smithi138.stdout:3/681: dread - d5/d12/d23/d29/d4f/fc0 zero size 2024-02-15T22:50:57.948 INFO:tasks.workunit.client.0.smithi138.stdout:3/682: write d5/d16/f77 [68659,52592] 0 2024-02-15T22:50:57.948 INFO:tasks.workunit.client.0.smithi138.stdout:3/683: dread - d5/d18/d35/fc3 zero size 2024-02-15T22:50:57.949 INFO:tasks.workunit.client.0.smithi138.stdout:7/751: dread d1/d2/f30 [0,4194304] 0 2024-02-15T22:50:57.950 INFO:tasks.workunit.client.0.smithi138.stdout:7/752: truncate d1/d2/f9f 55003 0 2024-02-15T22:50:57.951 INFO:tasks.workunit.client.0.smithi138.stdout:9/695: dwrite d0/d55/f5e [0,4194304] 0 2024-02-15T22:50:57.951 INFO:tasks.workunit.client.0.smithi138.stdout:7/753: symlink d1/l101 0 2024-02-15T22:50:57.956 INFO:tasks.workunit.client.0.smithi138.stdout:3/684: rmdir d5/d12/d23/da1 39 2024-02-15T22:50:57.959 INFO:tasks.workunit.client.0.smithi138.stdout:3/685: rename d5/d12/d23/d29/fd8 to d5/d16/d4d/fde 0 2024-02-15T22:50:57.960 INFO:tasks.workunit.client.0.smithi138.stdout:7/754: dread d1/d2/db/fc0 [0,4194304] 0 2024-02-15T22:50:57.961 INFO:tasks.workunit.client.0.smithi138.stdout:3/686: rename d5/d12/d23/cc8 to d5/d12/d26/da6/cdf 0 2024-02-15T22:50:57.961 INFO:tasks.workunit.client.0.smithi138.stdout:3/687: write d5/d16/dc/fcd [342361,82751] 0 2024-02-15T22:50:57.961 INFO:tasks.workunit.client.0.smithi138.stdout:3/688: creat d5/d16/dc/d43/da2/fe0 x:0 0 0 2024-02-15T22:50:57.961 INFO:tasks.workunit.client.0.smithi138.stdout:7/755: mkdir d1/d2/db/d102 0 2024-02-15T22:50:57.962 INFO:tasks.workunit.client.0.smithi138.stdout:7/756: write d1/d2/db/d3c/d4d/d63/fba [478468,4631] 0 2024-02-15T22:50:57.963 INFO:tasks.workunit.client.0.smithi138.stdout:7/757: mkdir d1/d2/db/d3c/d4d/d5b/d103 0 2024-02-15T22:50:57.963 INFO:tasks.workunit.client.0.smithi138.stdout:9/696: dwrite d0/de/d14/f41 [0,4194304] 0 2024-02-15T22:50:57.968 INFO:tasks.workunit.client.0.smithi138.stdout:9/697: dread d0/de/d34/d89/f7e [0,4194304] 0 2024-02-15T22:50:57.968 INFO:tasks.workunit.client.0.smithi138.stdout:9/698: getdents d0/de/d14/dbd 0 2024-02-15T22:50:57.970 INFO:tasks.workunit.client.0.smithi138.stdout:9/699: rmdir d0/d1/db8/ddc 0 2024-02-15T22:50:57.970 INFO:tasks.workunit.client.0.smithi138.stdout:9/700: chown d0/de/d34/fea 57605 1 2024-02-15T22:50:57.970 INFO:tasks.workunit.client.0.smithi138.stdout:9/701: rmdir d0/de/d14/da3/dc8/d6a 39 2024-02-15T22:50:57.971 INFO:tasks.workunit.client.0.smithi138.stdout:9/702: write d0/de/d33/f76 [1007631,123109] 0 2024-02-15T22:50:57.972 INFO:tasks.workunit.client.0.smithi138.stdout:3/689: dread d5/d16/f10 [0,4194304] 0 2024-02-15T22:50:57.973 INFO:tasks.workunit.client.0.smithi138.stdout:9/703: link d0/de/d14/d18/f49 d0/de/d33/d98/da6/fed 0 2024-02-15T22:50:57.974 INFO:tasks.workunit.client.0.smithi138.stdout:3/690: mknod d5/d12/d26/da6/ce1 0 2024-02-15T22:50:57.975 INFO:tasks.workunit.client.0.smithi138.stdout:9/704: symlink d0/df/d11/lee 0 2024-02-15T22:50:57.976 INFO:tasks.workunit.client.0.smithi138.stdout:3/691: unlink d5/d12/d26/d2f/f7b 0 2024-02-15T22:50:57.976 INFO:tasks.workunit.client.0.smithi138.stdout:3/692: getdents d5/d16/dc/d43/da2/dc6/dd2 0 2024-02-15T22:50:57.976 INFO:tasks.workunit.client.0.smithi138.stdout:9/705: creat d0/de/d14/d18/fef x:0 0 0 2024-02-15T22:50:57.977 INFO:tasks.workunit.client.0.smithi138.stdout:9/706: creat d0/de/d34/d89/ff0 x:0 0 0 2024-02-15T22:50:57.978 INFO:tasks.workunit.client.0.smithi138.stdout:7/758: dwrite d1/d2/f30 [4194304,4194304] 0 2024-02-15T22:50:57.980 INFO:tasks.workunit.client.0.smithi138.stdout:3/693: write d5/d12/d23/d29/d4f/f92 [3447827,128645] 0 2024-02-15T22:50:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:9/707: write d0/d4/f5 [1428027,71199] 0 2024-02-15T22:50:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:7/759: link d1/d2/db/db9/cfa d1/d2/db/d3c/d4d/c104 0 2024-02-15T22:50:57.988 INFO:tasks.workunit.client.0.smithi138.stdout:9/708: rename d0/f8 to d0/de/d34/d89/d90/ff1 0 2024-02-15T22:50:57.989 INFO:tasks.workunit.client.0.smithi138.stdout:7/760: rmdir d1/d79/d84/da0/ddf 39 2024-02-15T22:50:57.992 INFO:tasks.workunit.client.0.smithi138.stdout:7/761: rename d1/d28/ld7 to d1/d2/db/d25/d41/dfb/l105 0 2024-02-15T22:50:57.992 INFO:tasks.workunit.client.0.smithi138.stdout:7/762: write d1/d79/d84/da0/ddf/fea [545905,130622] 0 2024-02-15T22:50:57.992 INFO:tasks.workunit.client.0.smithi138.stdout:7/763: chown d1/d79/d84/da0/ddf/ld2 1389 1 2024-02-15T22:50:57.992 INFO:tasks.workunit.client.0.smithi138.stdout:7/764: creat d1/d2/db/d25/f106 x:0 0 0 2024-02-15T22:50:58.020 INFO:tasks.workunit.client.0.smithi138.stdout:3/694: dwrite d5/d12/d23/d29/d4f/f92 [4194304,4194304] 0 2024-02-15T22:50:58.021 INFO:tasks.workunit.client.0.smithi138.stdout:3/695: mkdir d5/d16/dc/d43/d57/d5d/de2 0 2024-02-15T22:50:58.021 INFO:tasks.workunit.client.0.smithi138.stdout:7/765: dwrite d1/d79/d84/da0/fa2 [0,4194304] 0 2024-02-15T22:50:58.022 INFO:tasks.workunit.client.0.smithi138.stdout:9/709: dwrite d0/d4/f5 [0,4194304] 0 2024-02-15T22:50:58.022 INFO:tasks.workunit.client.0.smithi138.stdout:3/696: creat d5/d16/dc/d43/d57/d5d/de2/fe3 x:0 0 0 2024-02-15T22:50:58.023 INFO:tasks.workunit.client.0.smithi138.stdout:7/766: symlink d1/d28/d7c/l107 0 2024-02-15T22:50:58.025 INFO:tasks.workunit.client.0.smithi138.stdout:9/710: mknod d0/de/d14/da3/dc8/d71/d7b/d9e/cf2 0 2024-02-15T22:50:58.025 INFO:tasks.workunit.client.0.smithi138.stdout:9/711: write d0/d4/fd [3567493,88529] 0 2024-02-15T22:50:58.026 INFO:tasks.workunit.client.0.smithi138.stdout:3/697: mkdir d5/d16/d4d/de4 0 2024-02-15T22:50:58.026 INFO:tasks.workunit.client.0.smithi138.stdout:3/698: write d5/d18/f9a [405423,23106] 0 2024-02-15T22:50:58.026 INFO:tasks.workunit.client.0.smithi138.stdout:3/699: stat d5/d18/f9a 0 2024-02-15T22:50:58.027 INFO:tasks.workunit.client.0.smithi138.stdout:7/767: unlink d1/d2/db/d25/f36 0 2024-02-15T22:50:58.028 INFO:tasks.workunit.client.0.smithi138.stdout:3/700: mkdir d5/d12/d23/d29/d5a/de5 0 2024-02-15T22:50:58.028 INFO:tasks.workunit.client.0.smithi138.stdout:3/701: fsync d5/d16/dc/f76 0 2024-02-15T22:50:58.029 INFO:tasks.workunit.client.0.smithi138.stdout:3/702: dread - d5/d16/d4d/fde zero size 2024-02-15T22:50:58.029 INFO:tasks.workunit.client.0.smithi138.stdout:7/768: creat d1/d5a/d97/dfc/f108 x:0 0 0 2024-02-15T22:50:58.029 INFO:tasks.workunit.client.0.smithi138.stdout:7/769: fdatasync d1/d2/db/d25/d41/f46 0 2024-02-15T22:50:58.030 INFO:tasks.workunit.client.0.smithi138.stdout:3/703: creat d5/fe6 x:0 0 0 2024-02-15T22:50:58.030 INFO:tasks.workunit.client.0.smithi138.stdout:3/704: chown d5/d18/d35/c9f 10 1 2024-02-15T22:50:58.032 INFO:tasks.workunit.client.0.smithi138.stdout:3/705: creat d5/d16/dc/dca/fe7 x:0 0 0 2024-02-15T22:50:58.032 INFO:tasks.workunit.client.0.smithi138.stdout:3/706: stat d5/d18/f24 0 2024-02-15T22:50:58.032 INFO:tasks.workunit.client.0.smithi138.stdout:3/707: read d5/d12/d23/d29/fad [1034642,117476] 0 2024-02-15T22:50:58.032 INFO:tasks.workunit.client.0.smithi138.stdout:3/708: creat d5/fe8 x:0 0 0 2024-02-15T22:50:58.033 INFO:tasks.workunit.client.0.smithi138.stdout:3/709: mknod d5/d12/d26/d2e/ce9 0 2024-02-15T22:50:58.034 INFO:tasks.workunit.client.0.smithi138.stdout:3/710: creat d5/d16/dc/d43/d47/d67/fea x:0 0 0 2024-02-15T22:50:58.036 INFO:tasks.workunit.client.0.smithi138.stdout:3/711: creat d5/d12/d23/d29/feb x:0 0 0 2024-02-15T22:50:58.036 INFO:tasks.workunit.client.0.smithi138.stdout:3/712: write d5/d18/d35/fc3 [466224,113398] 0 2024-02-15T22:50:58.038 INFO:tasks.workunit.client.0.smithi138.stdout:7/770: rename d1/d28/d7c to d1/d109 0 2024-02-15T22:50:58.040 INFO:tasks.workunit.client.0.smithi138.stdout:9/712: dwrite d0/de/d34/fe1 [0,4194304] 0 2024-02-15T22:50:58.040 INFO:tasks.workunit.client.0.smithi138.stdout:9/713: fdatasync d0/d1/faa 0 2024-02-15T22:50:58.042 INFO:tasks.workunit.client.0.smithi138.stdout:9/714: truncate d0/de/d14/f66 3087254 0 2024-02-15T22:50:58.042 INFO:tasks.workunit.client.0.smithi138.stdout:0/562: sync 2024-02-15T22:50:58.043 INFO:tasks.workunit.client.0.smithi138.stdout:0/563: chown d6/d10/d52/f97 50094716 1 2024-02-15T22:50:58.044 INFO:tasks.workunit.client.0.smithi138.stdout:9/715: rename d0/df/c8e to d0/de/d33/d57/cf3 0 2024-02-15T22:50:58.045 INFO:tasks.workunit.client.0.smithi138.stdout:9/716: chown d0/de/d14/f58 801 1 2024-02-15T22:50:58.045 INFO:tasks.workunit.client.0.smithi138.stdout:3/713: read d5/d16/dc/f1a [2207842,31094] 0 2024-02-15T22:50:58.045 INFO:tasks.workunit.client.0.smithi138.stdout:3/714: chown d5/d16/lc5 24431103 1 2024-02-15T22:50:58.046 INFO:tasks.workunit.client.0.smithi138.stdout:0/564: creat d6/d10/d52/d6f/d85/fc7 x:0 0 0 2024-02-15T22:50:58.048 INFO:tasks.workunit.client.0.smithi138.stdout:9/717: link d0/d4/l8d d0/d1/db8/lf4 0 2024-02-15T22:50:58.053 INFO:tasks.workunit.client.0.smithi138.stdout:0/565: mknod d6/d10/d18/d1b/cc8 0 2024-02-15T22:50:58.053 INFO:tasks.workunit.client.0.smithi138.stdout:0/566: chown d6/d10/d13/c89 7 1 2024-02-15T22:50:58.053 INFO:tasks.workunit.client.0.smithi138.stdout:0/567: chown d6/d10/d64/faf 2 1 2024-02-15T22:50:58.054 INFO:tasks.workunit.client.0.smithi138.stdout:7/771: dwrite d1/f12 [4194304,4194304] 0 2024-02-15T22:50:58.054 INFO:tasks.workunit.client.0.smithi138.stdout:7/772: write d1/d2/f8d [1027551,100311] 0 2024-02-15T22:50:58.056 INFO:tasks.workunit.client.0.smithi138.stdout:0/568: unlink d6/d10/d18/f60 0 2024-02-15T22:50:58.059 INFO:tasks.workunit.client.0.smithi138.stdout:7/773: mkdir d1/d79/d84/d8c/d10a 0 2024-02-15T22:50:58.060 INFO:tasks.workunit.client.0.smithi138.stdout:0/569: creat d6/d10/d64/fc9 x:0 0 0 2024-02-15T22:50:58.060 INFO:tasks.workunit.client.0.smithi138.stdout:0/570: chown d6/d10/d52/d72/f8c 449809332 1 2024-02-15T22:50:58.062 INFO:tasks.workunit.client.0.smithi138.stdout:0/571: write d6/d10/d34/f66 [87466,122107] 0 2024-02-15T22:50:58.062 INFO:tasks.workunit.client.0.smithi138.stdout:7/774: creat d1/d2/db/d25/df6/f10b x:0 0 0 2024-02-15T22:50:58.062 INFO:tasks.workunit.client.0.smithi138.stdout:7/775: stat d1/f12 0 2024-02-15T22:50:58.063 INFO:tasks.workunit.client.0.smithi138.stdout:3/715: dwrite d5/d12/f1d [4194304,4194304] 0 2024-02-15T22:50:58.063 INFO:tasks.workunit.client.0.smithi138.stdout:3/716: dread - d5/fe6 zero size 2024-02-15T22:50:58.063 INFO:tasks.workunit.client.0.smithi138.stdout:3/717: readlink d5/d16/d4d/l7a 0 2024-02-15T22:50:58.064 INFO:tasks.workunit.client.0.smithi138.stdout:0/572: mknod d6/d10/d52/d6f/cca 0 2024-02-15T22:50:58.064 INFO:tasks.workunit.client.0.smithi138.stdout:0/573: write d6/d10/d13/d3d/f71 [1703909,18127] 0 2024-02-15T22:50:58.066 INFO:tasks.workunit.client.0.smithi138.stdout:7/776: unlink d1/f42 0 2024-02-15T22:50:58.071 INFO:tasks.workunit.client.0.smithi138.stdout:3/718: rmdir d5/d12/d23/d29/d5a/de5 0 2024-02-15T22:50:58.075 INFO:tasks.workunit.client.0.smithi138.stdout:0/574: rename d6/d10/d40/caa to d6/d10/d13/ccb 0 2024-02-15T22:50:58.076 INFO:tasks.workunit.client.0.smithi138.stdout:9/718: dwrite d0/d55/d59/f87 [0,4194304] 0 2024-02-15T22:50:58.076 INFO:tasks.workunit.client.0.smithi138.stdout:9/719: write d0/de/d34/d89/d90/ff1 [9436096,70312] 0 2024-02-15T22:50:58.084 INFO:tasks.workunit.client.0.smithi138.stdout:7/777: creat d1/d79/d84/f10c x:0 0 0 2024-02-15T22:50:58.086 INFO:tasks.workunit.client.0.smithi138.stdout:3/719: mknod d5/d16/dc/d43/da2/dc6/dd2/cec 0 2024-02-15T22:50:58.091 INFO:tasks.workunit.client.0.smithi138.stdout:0/575: rmdir d6/d10 39 2024-02-15T22:50:58.092 INFO:tasks.workunit.client.0.smithi138.stdout:3/720: creat d5/d16/d4d/de4/fed x:0 0 0 2024-02-15T22:50:58.093 INFO:tasks.workunit.client.0.smithi138.stdout:9/720: dwrite d0/de/d34/f75 [0,4194304] 0 2024-02-15T22:50:58.094 INFO:tasks.workunit.client.0.smithi138.stdout:0/576: mkdir d6/d10/d64/dbf/dcc 0 2024-02-15T22:50:58.095 INFO:tasks.workunit.client.0.smithi138.stdout:7/778: dread d1/d2/db/fe [0,4194304] 0 2024-02-15T22:50:58.096 INFO:tasks.workunit.client.0.smithi138.stdout:7/779: chown d1/c37 123212672 1 2024-02-15T22:50:58.096 INFO:tasks.workunit.client.0.smithi138.stdout:0/577: rename d6/d10/d13/l38 to d6/d10/d40/lcd 0 2024-02-15T22:50:58.097 INFO:tasks.workunit.client.0.smithi138.stdout:0/578: symlink d6/d10/d64/lce 0 2024-02-15T22:50:58.097 INFO:tasks.workunit.client.0.smithi138.stdout:0/579: readlink d6/d10/d52/d6f/lb9 0 2024-02-15T22:50:58.098 INFO:tasks.workunit.client.0.smithi138.stdout:0/580: mkdir d6/d10/d34/dcf 0 2024-02-15T22:50:58.099 INFO:tasks.workunit.client.0.smithi138.stdout:0/581: creat d6/d10/d18/d57/fd0 x:0 0 0 2024-02-15T22:50:58.102 INFO:tasks.workunit.client.0.smithi138.stdout:0/582: dread d6/d10/d64/f88 [0,4194304] 0 2024-02-15T22:50:58.104 INFO:tasks.workunit.client.0.smithi138.stdout:0/583: creat d6/d10/d13/d3d/dc6/fd1 x:0 0 0 2024-02-15T22:50:58.104 INFO:tasks.workunit.client.0.smithi138.stdout:0/584: read - d6/d10/d64/fc9 zero size 2024-02-15T22:50:58.105 INFO:tasks.workunit.client.0.smithi138.stdout:0/585: getdents d6/d10/d75/dbb 0 2024-02-15T22:50:58.105 INFO:tasks.workunit.client.0.smithi138.stdout:0/586: mkdir d6/d10/d13/d3d/dd2 0 2024-02-15T22:50:58.111 INFO:tasks.workunit.client.0.smithi138.stdout:3/721: dwrite d5/d16/dc/d43/d47/d67/fa3 [0,4194304] 0 2024-02-15T22:50:58.114 INFO:tasks.workunit.client.0.smithi138.stdout:9/721: dwrite d0/de/d14/d18/f49 [4194304,4194304] 0 2024-02-15T22:50:58.114 INFO:tasks.workunit.client.0.smithi138.stdout:3/722: unlink d5/d16/dc/d43/l98 0 2024-02-15T22:50:58.114 INFO:tasks.workunit.client.0.smithi138.stdout:3/723: fdatasync d5/d16/fc1 0 2024-02-15T22:50:58.115 INFO:tasks.workunit.client.0.smithi138.stdout:9/722: fsync d0/de/d14/d18/f62 0 2024-02-15T22:50:58.115 INFO:tasks.workunit.client.0.smithi138.stdout:9/723: fsync d0/de/d34/d89/fb1 0 2024-02-15T22:50:58.119 INFO:tasks.workunit.client.0.smithi138.stdout:7/780: dwrite d1/d79/d84/da0/fc2 [0,4194304] 0 2024-02-15T22:50:58.119 INFO:tasks.workunit.client.0.smithi138.stdout:7/781: stat d1/d2/fbb 0 2024-02-15T22:50:58.119 INFO:tasks.workunit.client.0.smithi138.stdout:7/782: dread - d1/d2/db/fb0 zero size 2024-02-15T22:50:58.119 INFO:tasks.workunit.client.0.smithi138.stdout:9/724: creat d0/de/d14/d18/ff5 x:0 0 0 2024-02-15T22:50:58.120 INFO:tasks.workunit.client.0.smithi138.stdout:3/724: symlink d5/lee 0 2024-02-15T22:50:58.123 INFO:tasks.workunit.client.0.smithi138.stdout:7/783: creat d1/d2/db/f10d x:0 0 0 2024-02-15T22:50:58.124 INFO:tasks.workunit.client.0.smithi138.stdout:9/725: mknod d0/de/cf6 0 2024-02-15T22:50:58.126 INFO:tasks.workunit.client.0.smithi138.stdout:0/587: dwrite d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:50:58.126 INFO:tasks.workunit.client.0.smithi138.stdout:9/726: rename d0/de/d14/da3/dc8/d71/d7b/d9e/cd5 to d0/de/d48/cf7 0 2024-02-15T22:50:58.127 INFO:tasks.workunit.client.0.smithi138.stdout:9/727: write d0/de/d14/d18/fef [974712,32558] 0 2024-02-15T22:50:58.127 INFO:tasks.workunit.client.0.smithi138.stdout:9/728: creat d0/de/d34/ff8 x:0 0 0 2024-02-15T22:50:58.128 INFO:tasks.workunit.client.0.smithi138.stdout:0/588: creat d6/d10/d52/d72/fd3 x:0 0 0 2024-02-15T22:50:58.130 INFO:tasks.workunit.client.0.smithi138.stdout:0/589: symlink d6/d10/d13/d3d/ld4 0 2024-02-15T22:50:58.131 INFO:tasks.workunit.client.0.smithi138.stdout:0/590: symlink d6/d10/d40/ld5 0 2024-02-15T22:50:58.131 INFO:tasks.workunit.client.0.smithi138.stdout:0/591: write d6/d10/d13/f69 [844043,112359] 0 2024-02-15T22:50:58.132 INFO:tasks.workunit.client.0.smithi138.stdout:0/592: mknod d6/d10/d64/cd6 0 2024-02-15T22:50:58.136 INFO:tasks.workunit.client.0.smithi138.stdout:9/729: truncate d0/de/d34/d89/d90/ff1 8405630 0 2024-02-15T22:50:58.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/784: dwrite d1/d79/ff3 [0,4194304] 0 2024-02-15T22:50:58.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/785: creat d1/d79/d84/f10e x:0 0 0 2024-02-15T22:50:58.141 INFO:tasks.workunit.client.0.smithi138.stdout:0/593: read d6/d10/d13/f16 [198409,119887] 0 2024-02-15T22:50:58.144 INFO:tasks.workunit.client.0.smithi138.stdout:7/786: dread d1/faa [0,4194304] 0 2024-02-15T22:50:58.146 INFO:tasks.workunit.client.0.smithi138.stdout:0/594: mkdir d6/d10/d64/dd7 0 2024-02-15T22:50:58.147 INFO:tasks.workunit.client.0.smithi138.stdout:7/787: rmdir d1/d79/d84/da0/ddf 39 2024-02-15T22:50:58.148 INFO:tasks.workunit.client.0.smithi138.stdout:7/788: readlink d1/d2/db/d3c/l54 0 2024-02-15T22:50:58.152 INFO:tasks.workunit.client.0.smithi138.stdout:9/730: dwrite d0/de/d33/f85 [0,4194304] 0 2024-02-15T22:50:58.155 INFO:tasks.workunit.client.0.smithi138.stdout:9/731: symlink d0/de/d14/da3/dc8/d71/d7b/d9e/da1/lf9 0 2024-02-15T22:50:58.156 INFO:tasks.workunit.client.0.smithi138.stdout:9/732: truncate d0/de/d33/d98/fbf 2974396 0 2024-02-15T22:50:58.157 INFO:tasks.workunit.client.0.smithi138.stdout:9/733: getdents d0/d55/d59 0 2024-02-15T22:50:58.158 INFO:tasks.workunit.client.0.smithi138.stdout:7/789: read d1/f6b [1301362,95346] 0 2024-02-15T22:50:58.158 INFO:tasks.workunit.client.0.smithi138.stdout:9/734: getdents d0/de/d14/da3/dc8 0 2024-02-15T22:50:58.158 INFO:tasks.workunit.client.0.smithi138.stdout:7/790: creat d1/d79/d84/da0/f10f x:0 0 0 2024-02-15T22:50:58.160 INFO:tasks.workunit.client.0.smithi138.stdout:7/791: read d1/d2/db/d3c/d4d/f52 [4550432,32648] 0 2024-02-15T22:50:58.162 INFO:tasks.workunit.client.0.smithi138.stdout:7/792: mknod d1/d2/c110 0 2024-02-15T22:50:58.162 INFO:tasks.workunit.client.0.smithi138.stdout:7/793: rmdir d1/d28 39 2024-02-15T22:50:58.164 INFO:tasks.workunit.client.0.smithi138.stdout:7/794: mkdir d1/d2/db/d25/d111 0 2024-02-15T22:50:58.165 INFO:tasks.workunit.client.0.smithi138.stdout:0/595: dwrite d6/d10/d64/f88 [0,4194304] 0 2024-02-15T22:50:58.168 INFO:tasks.workunit.client.0.smithi138.stdout:9/735: dread d0/de/d34/f75 [0,4194304] 0 2024-02-15T22:50:58.168 INFO:tasks.workunit.client.0.smithi138.stdout:9/736: chown d0/df/d11/c64 392245 1 2024-02-15T22:50:58.168 INFO:tasks.workunit.client.0.smithi138.stdout:9/737: dread - d0/de/d34/d89/ff0 zero size 2024-02-15T22:50:58.170 INFO:tasks.workunit.client.0.smithi138.stdout:9/738: link d0/de/d14/da3/dc8/fbb d0/d55/d59/ffa 0 2024-02-15T22:50:58.170 INFO:tasks.workunit.client.0.smithi138.stdout:9/739: readlink d0/d1/l4b 0 2024-02-15T22:50:58.171 INFO:tasks.workunit.client.0.smithi138.stdout:9/740: mknod d0/de/d34/dd3/dec/cfb 0 2024-02-15T22:50:58.181 INFO:tasks.workunit.client.0.smithi138.stdout:9/741: write d0/de/f9d [6115016,47420] 0 2024-02-15T22:50:58.181 INFO:tasks.workunit.client.0.smithi138.stdout:9/742: stat d0/de/d14/f44 0 2024-02-15T22:50:58.181 INFO:tasks.workunit.client.0.smithi138.stdout:9/743: fsync d0/de/d14/d18/fef 0 2024-02-15T22:50:58.181 INFO:tasks.workunit.client.0.smithi138.stdout:9/744: getdents d0/de/d14/dbd 0 2024-02-15T22:50:58.182 INFO:tasks.workunit.client.0.smithi138.stdout:9/745: creat d0/de/d14/d22/ffc x:0 0 0 2024-02-15T22:50:58.182 INFO:tasks.workunit.client.0.smithi138.stdout:9/746: write d0/de/d34/d89/fb1 [137902,125897] 0 2024-02-15T22:50:58.183 INFO:tasks.workunit.client.0.smithi138.stdout:9/747: mknod d0/df/d11/cfd 0 2024-02-15T22:50:58.184 INFO:tasks.workunit.client.0.smithi138.stdout:9/748: creat d0/d55/ffe x:0 0 0 2024-02-15T22:50:58.201 INFO:tasks.workunit.client.0.smithi138.stdout:9/749: dwrite d0/d1/faa [0,4194304] 0 2024-02-15T22:50:58.201 INFO:tasks.workunit.client.0.smithi138.stdout:9/750: chown d0/de/d14/d22/dc2/cca 154 1 2024-02-15T22:50:58.202 INFO:tasks.workunit.client.0.smithi138.stdout:9/751: creat d0/de/d14/dbd/fff x:0 0 0 2024-02-15T22:50:58.202 INFO:tasks.workunit.client.0.smithi138.stdout:9/752: chown d0/de/d14/da3/dc8/ccc 25935781 1 2024-02-15T22:50:58.202 INFO:tasks.workunit.client.0.smithi138.stdout:9/753: mknod d0/de/d33/d98/c100 0 2024-02-15T22:50:58.204 INFO:tasks.workunit.client.0.smithi138.stdout:9/754: link d0/d55/d59/c5d d0/de/d14/da3/dc8/d6a/c101 0 2024-02-15T22:50:58.204 INFO:tasks.workunit.client.0.smithi138.stdout:9/755: read - d0/de/d14/d18/ff5 zero size 2024-02-15T22:50:58.205 INFO:tasks.workunit.client.0.smithi138.stdout:9/756: unlink d0/df/f4e 0 2024-02-15T22:50:58.205 INFO:tasks.workunit.client.0.smithi138.stdout:9/757: truncate d0/d55/d59/dac/fd7 1764509 0 2024-02-15T22:50:58.206 INFO:tasks.workunit.client.0.smithi138.stdout:9/758: rename d0/de/d14/da3/dc8/l4d to d0/de/d14/d22/dc2/l102 0 2024-02-15T22:50:58.206 INFO:tasks.workunit.client.0.smithi138.stdout:9/759: write d0/df/d11/fdd [894086,100345] 0 2024-02-15T22:50:58.206 INFO:tasks.workunit.client.0.smithi138.stdout:9/760: stat d0/de/d14/dbd 0 2024-02-15T22:50:58.206 INFO:tasks.workunit.client.0.smithi138.stdout:9/761: chown d0/de 239742268 1 2024-02-15T22:50:58.207 INFO:tasks.workunit.client.0.smithi138.stdout:9/762: rename d0/de/d34/d89/fdb to d0/de/d48/f103 0 2024-02-15T22:50:58.216 INFO:tasks.workunit.client.0.smithi138.stdout:9/763: getdents d0/de/d34/d89 0 2024-02-15T22:50:58.218 INFO:tasks.workunit.client.0.smithi138.stdout:6/533: sync 2024-02-15T22:50:58.218 INFO:tasks.workunit.client.0.smithi138.stdout:5/531: sync 2024-02-15T22:50:58.219 INFO:tasks.workunit.client.0.smithi138.stdout:6/534: dread - dc/d24/d34/f63 zero size 2024-02-15T22:50:58.219 INFO:tasks.workunit.client.0.smithi138.stdout:5/532: rmdir df/d18/d3e/d8a 39 2024-02-15T22:50:58.219 INFO:tasks.workunit.client.0.smithi138.stdout:5/533: dread - df/d18/f97 zero size 2024-02-15T22:50:58.220 INFO:tasks.workunit.client.0.smithi138.stdout:5/534: mknod df/d18/d3e/d60/d65/d7f/ca9 0 2024-02-15T22:50:58.221 INFO:tasks.workunit.client.0.smithi138.stdout:5/535: mknod df/d18/caa 0 2024-02-15T22:50:58.222 INFO:tasks.workunit.client.0.smithi138.stdout:5/536: link df/d18/d2b/f47 df/d18/d77/fab 0 2024-02-15T22:50:58.223 INFO:tasks.workunit.client.0.smithi138.stdout:5/537: rmdir df/d18/d77 39 2024-02-15T22:50:58.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:57 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi170 to 2240M 2024-02-15T22:50:58.243 INFO:tasks.workunit.client.0.smithi138.stdout:9/764: dwrite d0/de/d14/d18/f62 [4194304,4194304] 0 2024-02-15T22:50:58.243 INFO:tasks.workunit.client.0.smithi138.stdout:6/535: dwrite dc/d24/d34/f5c [0,4194304] 0 2024-02-15T22:50:58.243 INFO:tasks.workunit.client.0.smithi138.stdout:5/538: dwrite df/d18/d3e/d60/d65/d7f/d90/f92 [0,4194304] 0 2024-02-15T22:50:58.245 INFO:tasks.workunit.client.0.smithi138.stdout:9/765: unlink d0/de/d14/da3/dc8/d71/l84 0 2024-02-15T22:50:58.247 INFO:tasks.workunit.client.0.smithi138.stdout:6/536: mkdir dc/d4b/dba 0 2024-02-15T22:50:58.250 INFO:tasks.workunit.client.0.smithi138.stdout:5/539: mknod df/d18/d3e/d60/d65/cac 0 2024-02-15T22:50:58.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/766: link d0/d2e/c99 d0/de/d34/c104 0 2024-02-15T22:50:58.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/540: mkdir df/d18/d3e/d60/d65/d7c/dad 0 2024-02-15T22:50:58.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/541: chown df/d18/d2b/f47 244 1 2024-02-15T22:50:58.253 INFO:tasks.workunit.client.0.smithi138.stdout:5/542: write df/f44 [316578,114045] 0 2024-02-15T22:50:58.253 INFO:tasks.workunit.client.0.smithi138.stdout:5/543: fdatasync df/d18/d3e/d60/f99 0 2024-02-15T22:50:58.253 INFO:tasks.workunit.client.0.smithi138.stdout:9/767: link d0/d55/d59/ffa d0/d4/f105 0 2024-02-15T22:50:58.255 INFO:tasks.workunit.client.0.smithi138.stdout:5/544: mkdir df/d18/d56/dae 0 2024-02-15T22:50:58.255 INFO:tasks.workunit.client.0.smithi138.stdout:5/545: truncate df/d18/d3e/d60/d65/f73 1364171 0 2024-02-15T22:50:58.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/546: write df/d18/d3e/f41 [4242946,8606] 0 2024-02-15T22:50:58.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/547: chown df/l1d 137262068 1 2024-02-15T22:50:58.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/548: chown df/d18/d56/f5a 372 1 2024-02-15T22:50:58.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/549: mkdir df/d18/d2b/d9c/daf 0 2024-02-15T22:50:58.258 INFO:tasks.workunit.client.0.smithi138.stdout:5/550: creat df/d18/d3e/d60/d65/d7c/fb0 x:0 0 0 2024-02-15T22:50:58.259 INFO:tasks.workunit.client.0.smithi138.stdout:5/551: mknod df/d18/d3e/d60/d65/cb1 0 2024-02-15T22:50:58.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:57 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi170 to 2240M 2024-02-15T22:50:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:6/537: dwrite dc/f40 [0,4194304] 0 2024-02-15T22:50:58.268 INFO:tasks.workunit.client.0.smithi138.stdout:6/538: creat dc/d4b/d7b/fbb x:0 0 0 2024-02-15T22:50:58.272 INFO:tasks.workunit.client.0.smithi138.stdout:9/768: dwrite d0/de/d33/d98/da6/fed [0,4194304] 0 2024-02-15T22:50:58.272 INFO:tasks.workunit.client.0.smithi138.stdout:9/769: readlink d0/d1/l4b 0 2024-02-15T22:50:58.273 INFO:tasks.workunit.client.0.smithi138.stdout:9/770: truncate d0/d4/f80 83263 0 2024-02-15T22:50:58.273 INFO:tasks.workunit.client.0.smithi138.stdout:9/771: write d0/d2e/fcf [886115,3224] 0 2024-02-15T22:50:58.274 INFO:tasks.workunit.client.0.smithi138.stdout:9/772: mkdir d0/d55/d59/d106 0 2024-02-15T22:50:58.274 INFO:tasks.workunit.client.0.smithi138.stdout:9/773: truncate d0/de/d33/f7a 290847 0 2024-02-15T22:50:58.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/774: creat d0/de/d34/dd3/f107 x:0 0 0 2024-02-15T22:50:58.275 INFO:tasks.workunit.client.0.smithi138.stdout:9/775: chown d0/de/d14/f30 0 1 2024-02-15T22:50:58.276 INFO:tasks.workunit.client.0.smithi138.stdout:9/776: link d0/de/d33/f7a d0/d2e/f108 0 2024-02-15T22:50:58.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/552: dread df/f44 [0,4194304] 0 2024-02-15T22:50:58.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/553: readlink df/d18/d3e/d66/l69 0 2024-02-15T22:50:58.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/554: chown c1 39 1 2024-02-15T22:50:58.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/539: read dc/d24/d34/f5c [439632,39536] 0 2024-02-15T22:50:58.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/540: write dc/ff [2262074,26733] 0 2024-02-15T22:50:58.283 INFO:tasks.workunit.client.0.smithi138.stdout:9/777: symlink d0/de/d14/da3/dc8/d71/d7b/d9e/da1/l109 0 2024-02-15T22:50:58.284 INFO:tasks.workunit.client.0.smithi138.stdout:6/541: mkdir dc/d24/d6c/dbc 0 2024-02-15T22:50:58.298 INFO:tasks.workunit.client.0.smithi138.stdout:5/555: dwrite df/d18/d3e/f4e [0,4194304] 0 2024-02-15T22:50:58.299 INFO:tasks.workunit.client.0.smithi138.stdout:5/556: stat df/l12 0 2024-02-15T22:50:58.324 INFO:tasks.workunit.client.0.smithi138.stdout:4/754: sync 2024-02-15T22:50:58.326 INFO:tasks.workunit.client.0.smithi138.stdout:4/755: symlink d17/d1e/d2d/d36/dca/lf7 0 2024-02-15T22:50:58.326 INFO:tasks.workunit.client.0.smithi138.stdout:4/756: dread - d17/d1e/d2d/d8c/fea zero size 2024-02-15T22:50:58.335 INFO:tasks.workunit.client.0.smithi138.stdout:4/757: dread d17/d1e/f1f [0,4194304] 0 2024-02-15T22:50:58.335 INFO:tasks.workunit.client.0.smithi138.stdout:9/778: dwrite d0/d2e/f8f [0,4194304] 0 2024-02-15T22:50:58.336 INFO:tasks.workunit.client.0.smithi138.stdout:9/779: fsync d0/d4/fd 0 2024-02-15T22:50:58.336 INFO:tasks.workunit.client.0.smithi138.stdout:9/780: creat d0/de/d14/d22/f10a x:0 0 0 2024-02-15T22:50:58.336 INFO:tasks.workunit.client.0.smithi138.stdout:9/781: chown d0/d55/d59/fb3 1 1 2024-02-15T22:50:58.337 INFO:tasks.workunit.client.0.smithi138.stdout:4/758: rename d17/d2b/fe2 to d17/d2b/dd8/ff8 0 2024-02-15T22:50:58.341 INFO:tasks.workunit.client.0.smithi138.stdout:9/782: link d0/de/d14/f66 d0/d1/db8/f10b 0 2024-02-15T22:50:58.346 INFO:tasks.workunit.client.0.smithi138.stdout:4/759: dread d17/d1e/db8/fe9 [0,4194304] 0 2024-02-15T22:50:58.346 INFO:tasks.workunit.client.0.smithi138.stdout:4/760: readlink d17/d1e/la8 0 2024-02-15T22:50:58.346 INFO:tasks.workunit.client.0.smithi138.stdout:4/761: fdatasync d17/d1e/d2d/d36/f6e 0 2024-02-15T22:50:58.347 INFO:tasks.workunit.client.0.smithi138.stdout:4/762: creat d17/d1e/d2d/d36/dca/da3/dbf/ff9 x:0 0 0 2024-02-15T22:50:58.348 INFO:tasks.workunit.client.0.smithi138.stdout:4/763: write d17/f6a [2498736,104489] 0 2024-02-15T22:50:58.384 INFO:tasks.workunit.client.0.smithi138.stdout:6/542: dwrite dc/d76/fac [0,4194304] 0 2024-02-15T22:50:58.384 INFO:tasks.workunit.client.0.smithi138.stdout:6/543: write dc/d4b/d98/fb2 [437533,14682] 0 2024-02-15T22:50:58.384 INFO:tasks.workunit.client.0.smithi138.stdout:6/544: chown dc/f1a 43693735 1 2024-02-15T22:50:58.389 INFO:tasks.workunit.client.0.smithi138.stdout:9/783: dwrite d0/de/d33/d98/fbf [0,4194304] 0 2024-02-15T22:50:58.389 INFO:tasks.workunit.client.0.smithi138.stdout:9/784: write d0/d1/db8/f10b [553793,49445] 0 2024-02-15T22:50:58.390 INFO:tasks.workunit.client.0.smithi138.stdout:9/785: rename d0/df/f93 to d0/df/d11/f10c 0 2024-02-15T22:50:58.392 INFO:tasks.workunit.client.0.smithi138.stdout:9/786: mkdir d0/de/d14/d18/d10d 0 2024-02-15T22:50:58.392 INFO:tasks.workunit.client.0.smithi138.stdout:9/787: symlink d0/de/d14/da3/dc8/l10e 0 2024-02-15T22:50:58.393 INFO:tasks.workunit.client.0.smithi138.stdout:9/788: symlink d0/de/d33/d98/l10f 0 2024-02-15T22:50:58.394 INFO:tasks.workunit.client.0.smithi138.stdout:9/789: link d0/dc7/fd2 d0/de/d14/da3/dc8/d6a/f110 0 2024-02-15T22:50:58.397 INFO:tasks.workunit.client.0.smithi138.stdout:6/545: dwrite dc/d24/d34/d3b/d68/fa3 [0,4194304] 0 2024-02-15T22:50:58.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/546: rename dc/d24/d34/d3b/d7c/f83 to dc/d76/d96/fbd 0 2024-02-15T22:50:58.399 INFO:tasks.workunit.client.0.smithi138.stdout:6/547: stat dc/d24/d34/c50 0 2024-02-15T22:50:58.400 INFO:tasks.workunit.client.0.smithi138.stdout:6/548: symlink dc/d24/lbe 0 2024-02-15T22:50:58.403 INFO:tasks.workunit.client.0.smithi138.stdout:9/790: dread d0/de/d14/d18/f49 [4194304,4194304] 0 2024-02-15T22:50:58.403 INFO:tasks.workunit.client.0.smithi138.stdout:9/791: symlink d0/de/d48/l111 0 2024-02-15T22:50:58.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/792: creat d0/d1/db8/f112 x:0 0 0 2024-02-15T22:50:58.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/793: fdatasync d0/de/d34/d89/ff0 0 2024-02-15T22:50:58.406 INFO:tasks.workunit.client.0.smithi138.stdout:9/794: rename d0/de/f47 to d0/de/d14/d22/f113 0 2024-02-15T22:50:58.408 INFO:tasks.workunit.client.0.smithi138.stdout:6/549: read dc/d24/fb0 [456155,29644] 0 2024-02-15T22:50:58.408 INFO:tasks.workunit.client.0.smithi138.stdout:9/795: symlink d0/de/d34/dd3/l114 0 2024-02-15T22:50:58.458 INFO:tasks.workunit.client.0.smithi138.stdout:6/550: creat dc/d24/d34/d3b/d7c/da8/fbf x:0 0 0 2024-02-15T22:50:58.459 INFO:tasks.workunit.client.0.smithi138.stdout:9/796: truncate d0/f27 1414216 0 2024-02-15T22:50:58.463 INFO:tasks.workunit.client.0.smithi138.stdout:6/551: unlink dc/d24/l3f 0 2024-02-15T22:50:58.478 INFO:tasks.workunit.client.0.smithi138.stdout:9/797: dwrite d0/d4/fd [0,4194304] 0 2024-02-15T22:50:58.479 INFO:tasks.workunit.client.0.smithi138.stdout:9/798: creat d0/de/d14/d18/f115 x:0 0 0 2024-02-15T22:50:58.480 INFO:tasks.workunit.client.0.smithi138.stdout:9/799: mkdir d0/de/d14/d18/d10d/d116 0 2024-02-15T22:50:58.482 INFO:tasks.workunit.client.0.smithi138.stdout:6/552: dwrite dc/d24/f56 [4194304,4194304] 0 2024-02-15T22:50:58.483 INFO:tasks.workunit.client.0.smithi138.stdout:6/553: chown dc/d24/c35 0 1 2024-02-15T22:50:58.483 INFO:tasks.workunit.client.0.smithi138.stdout:6/554: fdatasync dc/d24/f47 0 2024-02-15T22:50:58.486 INFO:tasks.workunit.client.0.smithi138.stdout:9/800: dread d0/d55/d59/fb3 [4194304,4194304] 0 2024-02-15T22:50:58.487 INFO:tasks.workunit.client.0.smithi138.stdout:9/801: mkdir d0/de/d34/d89/d117 0 2024-02-15T22:50:58.487 INFO:tasks.workunit.client.0.smithi138.stdout:9/802: truncate d0/de/d14/f2a 1422892 0 2024-02-15T22:50:58.488 INFO:tasks.workunit.client.0.smithi138.stdout:9/803: mknod d0/de/d48/d70/c118 0 2024-02-15T22:50:58.489 INFO:tasks.workunit.client.0.smithi138.stdout:9/804: mkdir d0/de/d34/d89/d119 0 2024-02-15T22:50:58.489 INFO:tasks.workunit.client.0.smithi138.stdout:9/805: truncate d0/d4/f2b 1041199 0 2024-02-15T22:50:58.492 INFO:tasks.workunit.client.0.smithi138.stdout:8/661: sync 2024-02-15T22:50:58.492 INFO:tasks.workunit.client.0.smithi138.stdout:2/553: sync 2024-02-15T22:50:58.492 INFO:tasks.workunit.client.0.smithi138.stdout:2/554: read d0/f87 [3675239,54679] 0 2024-02-15T22:50:58.492 INFO:tasks.workunit.client.0.smithi138.stdout:2/555: dread - d0/da/d19/d53/d5d/d83/fc0 zero size 2024-02-15T22:50:58.493 INFO:tasks.workunit.client.0.smithi138.stdout:6/555: dread f0 [0,4194304] 0 2024-02-15T22:50:58.493 INFO:tasks.workunit.client.0.smithi138.stdout:6/556: creat dc/d24/d34/d3b/d7c/da8/fc0 x:0 0 0 2024-02-15T22:50:58.493 INFO:tasks.workunit.client.0.smithi138.stdout:6/557: readlink dc/l5f 0 2024-02-15T22:50:58.494 INFO:tasks.workunit.client.0.smithi138.stdout:8/662: mkdir db/d15/d70/dda 0 2024-02-15T22:50:58.494 INFO:tasks.workunit.client.0.smithi138.stdout:8/663: creat db/d95/fdb x:0 0 0 2024-02-15T22:50:58.499 INFO:tasks.workunit.client.0.smithi138.stdout:2/556: link d0/da/d19/d3f/fa8 d0/da/d19/d3f/fc8 0 2024-02-15T22:50:58.499 INFO:tasks.workunit.client.0.smithi138.stdout:8/664: write db/dd/f3e [996666,109793] 0 2024-02-15T22:50:58.500 INFO:tasks.workunit.client.0.smithi138.stdout:8/665: fsync db/f3d 0 2024-02-15T22:50:58.500 INFO:tasks.workunit.client.0.smithi138.stdout:2/557: dread d0/dd/d15/f8c [0,4194304] 0 2024-02-15T22:50:58.500 INFO:tasks.workunit.client.0.smithi138.stdout:6/558: symlink dc/d76/lc1 0 2024-02-15T22:50:58.502 INFO:tasks.workunit.client.0.smithi138.stdout:8/666: link db/dd/d13/d19/l37 db/dd/d13/d77/d8f/ldc 0 2024-02-15T22:50:58.502 INFO:tasks.workunit.client.0.smithi138.stdout:8/667: chown db/d15/f5f 167747 1 2024-02-15T22:50:58.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/558: creat d0/da/d19/d53/d5d/fc9 x:0 0 0 2024-02-15T22:50:58.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/559: write d0/da/d19/f55 [3681521,10958] 0 2024-02-15T22:50:58.504 INFO:tasks.workunit.client.0.smithi138.stdout:2/560: stat d0/da/d19/d53/d5d/d83/d8a/dc2 0 2024-02-15T22:50:58.505 INFO:tasks.workunit.client.0.smithi138.stdout:2/561: mkdir d0/da/dca 0 2024-02-15T22:50:58.505 INFO:tasks.workunit.client.0.smithi138.stdout:2/562: readlink d0/da/lb7 0 2024-02-15T22:50:58.505 INFO:tasks.workunit.client.0.smithi138.stdout:2/563: readlink d0/da/d19/d53/d5d/d74/d79/l91 0 2024-02-15T22:50:58.505 INFO:tasks.workunit.client.0.smithi138.stdout:2/564: fdatasync d0/dd/d15/d65/f76 0 2024-02-15T22:50:58.508 INFO:tasks.workunit.client.0.smithi138.stdout:9/806: dwrite d0/de/d33/f7a [0,4194304] 0 2024-02-15T22:50:58.510 INFO:tasks.workunit.client.0.smithi138.stdout:9/807: truncate d0/de/d14/d18/f62 6494269 0 2024-02-15T22:50:58.517 INFO:tasks.workunit.client.0.smithi138.stdout:6/559: dwrite dc/d24/d34/d3b/d7c/f93 [0,4194304] 0 2024-02-15T22:50:58.517 INFO:tasks.workunit.client.0.smithi138.stdout:6/560: creat dc/d24/d34/d3b/d68/fc2 x:0 0 0 2024-02-15T22:50:58.518 INFO:tasks.workunit.client.0.smithi138.stdout:6/561: chown dc/d24/f47 25 1 2024-02-15T22:50:58.522 INFO:tasks.workunit.client.0.smithi138.stdout:6/562: creat dc/d24/d6c/dbc/fc3 x:0 0 0 2024-02-15T22:50:58.523 INFO:tasks.workunit.client.0.smithi138.stdout:9/808: dread d0/de/d34/d89/fb1 [0,4194304] 0 2024-02-15T22:50:58.526 INFO:tasks.workunit.client.0.smithi138.stdout:9/809: mkdir d0/de/d14/da3/dc8/d71/d7b/d9e/da1/d11a 0 2024-02-15T22:50:58.526 INFO:tasks.workunit.client.0.smithi138.stdout:8/668: dwrite db/f99 [0,4194304] 0 2024-02-15T22:50:58.526 INFO:tasks.workunit.client.0.smithi138.stdout:8/669: write db/dd/fa8 [929683,10503] 0 2024-02-15T22:50:58.527 INFO:tasks.workunit.client.0.smithi138.stdout:6/563: rmdir dc/d24/d34/d3b/d7c 39 2024-02-15T22:50:58.527 INFO:tasks.workunit.client.0.smithi138.stdout:9/810: write d0/d55/d59/dac/fd7 [65310,33875] 0 2024-02-15T22:50:58.528 INFO:tasks.workunit.client.0.smithi138.stdout:9/811: creat d0/d1/db8/f11b x:0 0 0 2024-02-15T22:50:58.529 INFO:tasks.workunit.client.0.smithi138.stdout:8/670: unlink db/f28 0 2024-02-15T22:50:58.529 INFO:tasks.workunit.client.0.smithi138.stdout:2/565: dwrite d0/da/f9c [0,4194304] 0 2024-02-15T22:50:58.530 INFO:tasks.workunit.client.0.smithi138.stdout:6/564: mkdir dc/d24/d34/d99/dc4 0 2024-02-15T22:50:58.532 INFO:tasks.workunit.client.0.smithi138.stdout:9/812: creat d0/de/d34/dd3/dec/f11c x:0 0 0 2024-02-15T22:50:58.532 INFO:tasks.workunit.client.0.smithi138.stdout:9/813: dread - d0/d1/db8/f11b zero size 2024-02-15T22:50:58.532 INFO:tasks.workunit.client.0.smithi138.stdout:9/814: chown d0/de/d14/f66 83826165 1 2024-02-15T22:50:58.533 INFO:tasks.workunit.client.0.smithi138.stdout:8/671: mknod db/dd/d13/d19/cdd 0 2024-02-15T22:50:58.534 INFO:tasks.workunit.client.0.smithi138.stdout:8/672: fdatasync db/dd/d13/f31 0 2024-02-15T22:50:58.534 INFO:tasks.workunit.client.0.smithi138.stdout:8/673: write db/f58 [1160418,45921] 0 2024-02-15T22:50:58.543 INFO:tasks.workunit.client.0.smithi138.stdout:2/566: creat d0/da/d19/d53/d80/dba/fcb x:0 0 0 2024-02-15T22:50:58.545 INFO:tasks.workunit.client.0.smithi138.stdout:9/815: write d0/df/d11/f32 [517089,113202] 0 2024-02-15T22:50:58.546 INFO:tasks.workunit.client.0.smithi138.stdout:2/567: mkdir d0/da/d19/d53/d5d/dcc 0 2024-02-15T22:50:58.546 INFO:tasks.workunit.client.0.smithi138.stdout:2/568: readlink d0/da/d19/d3f/l84 0 2024-02-15T22:50:58.547 INFO:tasks.workunit.client.0.smithi138.stdout:9/816: creat d0/de/d48/d70/f11d x:0 0 0 2024-02-15T22:50:58.549 INFO:tasks.workunit.client.0.smithi138.stdout:2/569: rename d0/da/d19/d3f/fc8 to d0/dd/d15/d65/fcd 0 2024-02-15T22:50:58.552 INFO:tasks.workunit.client.0.smithi138.stdout:2/570: mkdir d0/dd/d15/d72/dbd/dce 0 2024-02-15T22:50:58.552 INFO:tasks.workunit.client.0.smithi138.stdout:2/571: chown d0/dd/d15/f71 231 1 2024-02-15T22:50:58.554 INFO:tasks.workunit.client.0.smithi138.stdout:1/421: sync 2024-02-15T22:50:58.555 INFO:tasks.workunit.client.0.smithi138.stdout:6/565: dwrite dc/d4b/d7b/f94 [0,4194304] 0 2024-02-15T22:50:58.555 INFO:tasks.workunit.client.0.smithi138.stdout:6/566: fdatasync dc/d24/d34/d3b/f90 0 2024-02-15T22:50:58.558 INFO:tasks.workunit.client.0.smithi138.stdout:6/567: creat dc/d24/d34/d3b/d7c/da8/fc5 x:0 0 0 2024-02-15T22:50:58.558 INFO:tasks.workunit.client.0.smithi138.stdout:8/674: dwrite f3 [0,4194304] 0 2024-02-15T22:50:58.559 INFO:tasks.workunit.client.0.smithi138.stdout:6/568: read dc/d4b/d98/fb2 [191306,69188] 0 2024-02-15T22:50:58.559 INFO:tasks.workunit.client.0.smithi138.stdout:6/569: dread - dc/d4b/fb1 zero size 2024-02-15T22:50:58.563 INFO:tasks.workunit.client.0.smithi138.stdout:8/675: unlink db/dd/d4d/f9a 0 2024-02-15T22:50:58.563 INFO:tasks.workunit.client.0.smithi138.stdout:8/676: getdents db/dd/d4d/dd6 0 2024-02-15T22:50:58.564 INFO:tasks.workunit.client.0.smithi138.stdout:6/570: unlink dc/d24/f27 0 2024-02-15T22:50:58.566 INFO:tasks.workunit.client.0.smithi138.stdout:1/422: dread df/d1b/f4c [0,4194304] 0 2024-02-15T22:50:58.566 INFO:tasks.workunit.client.0.smithi138.stdout:9/817: dwrite d0/d55/ffe [0,4194304] 0 2024-02-15T22:50:58.567 INFO:tasks.workunit.client.0.smithi138.stdout:6/571: truncate dc/f40 1390643 0 2024-02-15T22:50:58.567 INFO:tasks.workunit.client.0.smithi138.stdout:6/572: truncate f1 1981563 0 2024-02-15T22:50:58.574 INFO:tasks.workunit.client.0.smithi138.stdout:7/795: sync 2024-02-15T22:50:58.574 INFO:tasks.workunit.client.0.smithi138.stdout:5/557: sync 2024-02-15T22:50:58.574 INFO:tasks.workunit.client.0.smithi138.stdout:7/796: creat d1/d79/d84/f112 x:0 0 0 2024-02-15T22:50:58.574 INFO:tasks.workunit.client.0.smithi138.stdout:7/797: creat d1/d79/d84/da0/f113 x:0 0 0 2024-02-15T22:50:58.574 INFO:tasks.workunit.client.0.smithi138.stdout:7/798: stat d1/d2/f9f 0 2024-02-15T22:50:58.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/764: sync 2024-02-15T22:50:58.575 INFO:tasks.workunit.client.0.smithi138.stdout:3/725: sync 2024-02-15T22:50:58.575 INFO:tasks.workunit.client.0.smithi138.stdout:0/596: sync 2024-02-15T22:50:58.575 INFO:tasks.workunit.client.0.smithi138.stdout:3/726: chown d5/d12/d23/l7e 1 1 2024-02-15T22:50:58.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/677: rmdir db 39 2024-02-15T22:50:58.580 INFO:tasks.workunit.client.0.smithi138.stdout:8/678: truncate db/da0/fb5 653535 0 2024-02-15T22:50:58.583 INFO:tasks.workunit.client.0.smithi138.stdout:6/573: dwrite dc/d24/d34/d3b/f4a [0,4194304] 0 2024-02-15T22:50:58.584 INFO:tasks.workunit.client.0.smithi138.stdout:9/818: rename d0/de/d14/d22/dc2/cca to d0/c11e 0 2024-02-15T22:50:58.586 INFO:tasks.workunit.client.0.smithi138.stdout:1/423: symlink df/d1b/d1d/d25/d2e/l8e 0 2024-02-15T22:50:58.587 INFO:tasks.workunit.client.0.smithi138.stdout:5/558: mkdir df/d18/d3e/d8a/db2 0 2024-02-15T22:50:58.588 INFO:tasks.workunit.client.0.smithi138.stdout:8/679: dread db/ff [4194304,4194304] 0 2024-02-15T22:50:58.588 INFO:tasks.workunit.client.0.smithi138.stdout:8/680: chown db/f39 356634366 1 2024-02-15T22:50:58.590 INFO:tasks.workunit.client.0.smithi138.stdout:8/681: dread db/d15/d70/d7c/d92/f60 [0,4194304] 0 2024-02-15T22:50:58.592 INFO:tasks.workunit.client.0.smithi138.stdout:7/799: mkdir d1/d2/db/d25/d41/dee/d114 0 2024-02-15T22:50:58.593 INFO:tasks.workunit.client.0.smithi138.stdout:7/800: dread d1/d5a/d97/fd6 [0,4194304] 0 2024-02-15T22:50:58.594 INFO:tasks.workunit.client.0.smithi138.stdout:7/801: readlink d1/l7a 0 2024-02-15T22:50:58.594 INFO:tasks.workunit.client.0.smithi138.stdout:7/802: chown d1/d2/d29/cb6 6867 1 2024-02-15T22:50:58.594 INFO:tasks.workunit.client.0.smithi138.stdout:4/765: mkdir d17/d2b/d78/dfa 0 2024-02-15T22:50:58.596 INFO:tasks.workunit.client.0.smithi138.stdout:3/727: link d5/d12/d26/d2e/f97 d5/d12/d23/d94/fef 0 2024-02-15T22:50:58.598 INFO:tasks.workunit.client.0.smithi138.stdout:9/819: mkdir d0/de/d34/d11f 0 2024-02-15T22:50:58.600 INFO:tasks.workunit.client.0.smithi138.stdout:0/597: write d6/f92 [4193127,103127] 0 2024-02-15T22:50:58.601 INFO:tasks.workunit.client.0.smithi138.stdout:6/574: rename dc/f1c to dc/d4b/d98/fc6 0 2024-02-15T22:50:58.602 INFO:tasks.workunit.client.0.smithi138.stdout:1/424: mknod df/d1b/d21/d4f/c8f 0 2024-02-15T22:50:58.603 INFO:tasks.workunit.client.0.smithi138.stdout:7/803: write d1/d79/d84/da0/fa5 [3398750,16793] 0 2024-02-15T22:50:58.603 INFO:tasks.workunit.client.0.smithi138.stdout:7/804: write d1/d2/db/d3c/d4d/f52 [5519758,48147] 0 2024-02-15T22:50:58.603 INFO:tasks.workunit.client.0.smithi138.stdout:7/805: write d1/d2/db/fb2 [412247,108176] 0 2024-02-15T22:50:58.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/559: symlink df/d18/d3e/d60/d65/d7f/d90/lb3 0 2024-02-15T22:50:58.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/560: write fb [5123333,36098] 0 2024-02-15T22:50:58.605 INFO:tasks.workunit.client.0.smithi138.stdout:8/682: creat db/dd/d13/d77/fde x:0 0 0 2024-02-15T22:50:58.605 INFO:tasks.workunit.client.0.smithi138.stdout:4/766: chown d17/d1a/l60 1950271387 1 2024-02-15T22:50:58.607 INFO:tasks.workunit.client.0.smithi138.stdout:9/820: dread d0/d4/f105 [0,4194304] 0 2024-02-15T22:50:58.609 INFO:tasks.workunit.client.0.smithi138.stdout:1/425: rename cb to df/d1b/d1d/c90 0 2024-02-15T22:50:58.609 INFO:tasks.workunit.client.0.smithi138.stdout:1/426: chown df/d1b/c7f 2036255383 1 2024-02-15T22:50:58.610 INFO:tasks.workunit.client.0.smithi138.stdout:7/806: link d1/d2/db/d3c/d4d/d5b/l5d d1/d2/db/d3c/d4d/d5b/l115 0 2024-02-15T22:50:58.611 INFO:tasks.workunit.client.0.smithi138.stdout:0/598: write d6/d10/d34/f3b [1104770,27995] 0 2024-02-15T22:50:58.612 INFO:tasks.workunit.client.0.smithi138.stdout:6/575: dread dc/d24/d34/d3b/d68/fa3 [0,4194304] 0 2024-02-15T22:50:58.612 INFO:tasks.workunit.client.0.smithi138.stdout:6/576: fdatasync dc/d24/f5e 0 2024-02-15T22:50:58.614 INFO:tasks.workunit.client.0.smithi138.stdout:5/561: symlink df/d18/d2b/lb4 0 2024-02-15T22:50:58.616 INFO:tasks.workunit.client.0.smithi138.stdout:8/683: creat db/dd/d13/d19/d45/fdf x:0 0 0 2024-02-15T22:50:58.616 INFO:tasks.workunit.client.0.smithi138.stdout:3/728: getdents d5/d16/dc/d43/d57/d5d/de2 0 2024-02-15T22:50:58.618 INFO:tasks.workunit.client.0.smithi138.stdout:9/821: mkdir d0/de/d34/dd3/dec/d120 0 2024-02-15T22:50:58.618 INFO:tasks.workunit.client.0.smithi138.stdout:9/822: write d0/d55/fce [259348,32316] 0 2024-02-15T22:50:58.620 INFO:tasks.workunit.client.0.smithi138.stdout:1/427: creat df/d1b/d1d/d25/d8d/f91 x:0 0 0 2024-02-15T22:50:58.621 INFO:tasks.workunit.client.0.smithi138.stdout:7/807: write d1/d2/db/d3c/f45 [2129453,74345] 0 2024-02-15T22:50:58.622 INFO:tasks.workunit.client.0.smithi138.stdout:4/767: rename d17/d1e/d2d/d36/d3e/ldc to d17/d2b/d78/dc0/lfb 0 2024-02-15T22:50:58.624 INFO:tasks.workunit.client.0.smithi138.stdout:1/428: write df/d1b/d1d/d25/d2e/d6c/f76 [994940,95785] 0 2024-02-15T22:50:58.625 INFO:tasks.workunit.client.0.smithi138.stdout:6/577: mknod dc/d24/d34/d3b/d66/cc7 0 2024-02-15T22:50:58.626 INFO:tasks.workunit.client.0.smithi138.stdout:8/684: creat db/d15/fe0 x:0 0 0 2024-02-15T22:50:58.628 INFO:tasks.workunit.client.0.smithi138.stdout:3/729: mknod d5/d12/d23/d94/cf0 0 2024-02-15T22:50:58.629 INFO:tasks.workunit.client.0.smithi138.stdout:9/823: getdents d0/de/d48 0 2024-02-15T22:50:58.632 INFO:tasks.workunit.client.0.smithi138.stdout:4/768: creat d17/d2b/ffc x:0 0 0 2024-02-15T22:50:58.633 INFO:tasks.workunit.client.0.smithi138.stdout:0/599: dwrite d6/d10/d18/f32 [0,4194304] 0 2024-02-15T22:50:58.635 INFO:tasks.workunit.client.0.smithi138.stdout:5/562: dwrite df/d18/d3e/d60/d65/d7f/fa7 [0,4194304] 0 2024-02-15T22:50:58.635 INFO:tasks.workunit.client.0.smithi138.stdout:5/563: chown df/d18/d3e/ca8 1426748 1 2024-02-15T22:50:58.635 INFO:tasks.workunit.client.0.smithi138.stdout:1/429: rename df/d1b/d1d/d24/c29 to df/c92 0 2024-02-15T22:50:58.635 INFO:tasks.workunit.client.0.smithi138.stdout:1/430: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 0 2024-02-15T22:50:58.636 INFO:tasks.workunit.client.0.smithi138.stdout:8/685: unlink db/dd/d13/d77/c93 0 2024-02-15T22:50:58.638 INFO:tasks.workunit.client.0.smithi138.stdout:3/730: creat d5/d12/d26/dd5/ff1 x:0 0 0 2024-02-15T22:50:58.643 INFO:tasks.workunit.client.0.smithi138.stdout:6/578: rename dc/cb3 to dc/d24/d34/d3b/cc8 0 2024-02-15T22:50:58.643 INFO:tasks.workunit.client.0.smithi138.stdout:8/686: chown db/d15/c32 33735289 1 2024-02-15T22:50:58.644 INFO:tasks.workunit.client.0.smithi138.stdout:3/731: symlink d5/d18/d35/lf2 0 2024-02-15T22:50:58.646 INFO:tasks.workunit.client.0.smithi138.stdout:0/600: getdents d6/d10/d13 0 2024-02-15T22:50:58.649 INFO:tasks.workunit.client.0.smithi138.stdout:4/769: dread f6 [0,4194304] 0 2024-02-15T22:50:58.649 INFO:tasks.workunit.client.0.smithi138.stdout:1/431: dread df/d1b/d1d/d24/f4d [0,4194304] 0 2024-02-15T22:50:58.649 INFO:tasks.workunit.client.0.smithi138.stdout:4/770: stat d17/d1e/l54 0 2024-02-15T22:50:58.649 INFO:tasks.workunit.client.0.smithi138.stdout:4/771: readlink d17/d1e/d2d/d36/d3e/d64/l6b 0 2024-02-15T22:50:58.650 INFO:tasks.workunit.client.0.smithi138.stdout:4/772: dread - d17/d2b/f80 zero size 2024-02-15T22:50:58.650 INFO:tasks.workunit.client.0.smithi138.stdout:5/564: dread df/d18/d3e/d60/d65/d7f/d90/f92 [0,4194304] 0 2024-02-15T22:50:58.650 INFO:tasks.workunit.client.0.smithi138.stdout:5/565: write df/d18/d2b/f3b [2185305,78550] 0 2024-02-15T22:50:58.653 INFO:tasks.workunit.client.0.smithi138.stdout:1/432: dread df/d1b/d1d/d24/d3a/f40 [0,4194304] 0 2024-02-15T22:50:58.657 INFO:tasks.workunit.client.0.smithi138.stdout:8/687: mknod db/ce1 0 2024-02-15T22:50:58.659 INFO:tasks.workunit.client.0.smithi138.stdout:5/566: mkdir df/db5 0 2024-02-15T22:50:58.662 INFO:tasks.workunit.client.0.smithi138.stdout:7/808: dwrite d1/d79/d84/da0/fa5 [0,4194304] 0 2024-02-15T22:50:58.668 INFO:tasks.workunit.client.0.smithi138.stdout:1/433: getdents df/d1b/d1d 0 2024-02-15T22:50:58.668 INFO:tasks.workunit.client.0.smithi138.stdout:1/434: chown df/d1b/d33/c36 47932 1 2024-02-15T22:50:58.668 INFO:tasks.workunit.client.0.smithi138.stdout:1/435: truncate df/d1b/d1d/d25/d2e/d5b/f67 1405342 0 2024-02-15T22:50:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:8/688: stat db/dd/c68 0 2024-02-15T22:50:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:8/689: dread - db/dd/d22/f98 zero size 2024-02-15T22:50:58.672 INFO:tasks.workunit.client.0.smithi138.stdout:9/824: rename d0/de/d14/da3/dc8/d71 to d0/de/d14/d18/d10d/d116/d121 0 2024-02-15T22:50:58.673 INFO:tasks.workunit.client.0.smithi138.stdout:1/436: symlink df/l93 0 2024-02-15T22:50:58.674 INFO:tasks.workunit.client.0.smithi138.stdout:0/601: dwrite d6/d10/d13/fa5 [8388608,4194304] 0 2024-02-15T22:50:58.675 INFO:tasks.workunit.client.0.smithi138.stdout:8/690: mknod db/dd/d13/d19/d45/ce2 0 2024-02-15T22:50:58.675 INFO:tasks.workunit.client.0.smithi138.stdout:8/691: read db/d15/f62 [682192,27672] 0 2024-02-15T22:50:58.676 INFO:tasks.workunit.client.0.smithi138.stdout:8/692: stat db/d15/d70/c6a 0 2024-02-15T22:50:58.676 INFO:tasks.workunit.client.0.smithi138.stdout:9/825: rmdir d0/dc7 39 2024-02-15T22:50:58.679 INFO:tasks.workunit.client.0.smithi138.stdout:3/732: dwrite d5/d12/d26/d2e/fa9 [0,4194304] 0 2024-02-15T22:50:58.681 INFO:tasks.workunit.client.0.smithi138.stdout:6/579: dwrite dc/d24/d34/d3b/d68/f95 [4194304,4194304] 0 2024-02-15T22:50:58.681 INFO:tasks.workunit.client.0.smithi138.stdout:6/580: write dc/d24/d34/d3b/d7c/fad [1033282,55931] 0 2024-02-15T22:50:58.682 INFO:tasks.workunit.client.0.smithi138.stdout:0/602: unlink d6/d10/d34/c77 0 2024-02-15T22:50:58.682 INFO:tasks.workunit.client.0.smithi138.stdout:0/603: chown d6/f92 11802 1 2024-02-15T22:50:58.685 INFO:tasks.workunit.client.0.smithi138.stdout:8/693: mknod db/d15/d70/ce3 0 2024-02-15T22:50:58.685 INFO:tasks.workunit.client.0.smithi138.stdout:9/826: truncate d0/de/d33/f7f 7305685 0 2024-02-15T22:50:58.693 INFO:tasks.workunit.client.0.smithi138.stdout:0/604: unlink d6/d10/d18/d57/f63 0 2024-02-15T22:50:58.693 INFO:tasks.workunit.client.0.smithi138.stdout:0/605: truncate d6/d10/d40/f74 1490918 0 2024-02-15T22:50:58.694 INFO:tasks.workunit.client.0.smithi138.stdout:8/694: mkdir db/d15/d70/dda/de4 0 2024-02-15T22:50:58.694 INFO:tasks.workunit.client.0.smithi138.stdout:5/567: dwrite df/d18/d3e/d60/f64 [0,4194304] 0 2024-02-15T22:50:58.695 INFO:tasks.workunit.client.0.smithi138.stdout:9/827: unlink d0/d4/f5 0 2024-02-15T22:50:58.695 INFO:tasks.workunit.client.0.smithi138.stdout:9/828: truncate d0/d55/fb7 814318 0 2024-02-15T22:50:58.696 INFO:tasks.workunit.client.0.smithi138.stdout:0/606: getdents d6/d10/d75/db1 0 2024-02-15T22:50:58.696 INFO:tasks.workunit.client.0.smithi138.stdout:8/695: rmdir db 39 2024-02-15T22:50:58.698 INFO:tasks.workunit.client.0.smithi138.stdout:7/809: dwrite d1/d2/db/d3c/feb [0,4194304] 0 2024-02-15T22:50:58.698 INFO:tasks.workunit.client.0.smithi138.stdout:4/773: dwrite d17/d1e/d2d/d8c/fa2 [0,4194304] 0 2024-02-15T22:50:58.699 INFO:tasks.workunit.client.0.smithi138.stdout:5/568: rename df/d18/d3e/d60/d72/l9b to df/d18/d3e/d60/d65/lb6 0 2024-02-15T22:50:58.700 INFO:tasks.workunit.client.0.smithi138.stdout:9/829: symlink d0/de/d14/d18/d10d/l122 0 2024-02-15T22:50:58.700 INFO:tasks.workunit.client.0.smithi138.stdout:9/830: fdatasync d0/d2e/fc6 0 2024-02-15T22:50:58.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/569: dread fc [4194304,4194304] 0 2024-02-15T22:50:58.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/570: chown df/f11 1153122 1 2024-02-15T22:50:58.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/571: write df/d18/f4c [555096,19498] 0 2024-02-15T22:50:58.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/572: creat df/d18/d3e/d60/d65/d7c/fb7 x:0 0 0 2024-02-15T22:50:58.704 INFO:tasks.workunit.client.0.smithi138.stdout:4/774: mkdir d17/d1e/d2d/d36/dca/da3/dfd 0 2024-02-15T22:50:58.704 INFO:tasks.workunit.client.0.smithi138.stdout:4/775: write f6 [4266340,29191] 0 2024-02-15T22:50:58.706 INFO:tasks.workunit.client.0.smithi138.stdout:7/810: mknod d1/d2/db/d25/df6/c116 0 2024-02-15T22:50:58.708 INFO:tasks.workunit.client.0.smithi138.stdout:5/573: symlink df/d18/d3e/d8a/db2/lb8 0 2024-02-15T22:50:58.708 INFO:tasks.workunit.client.0.smithi138.stdout:5/574: fdatasync df/d18/d2b/f4b 0 2024-02-15T22:50:58.709 INFO:tasks.workunit.client.0.smithi138.stdout:4/776: rmdir d17/d1e/d2d/d36/dca/da3 39 2024-02-15T22:50:58.711 INFO:tasks.workunit.client.0.smithi138.stdout:5/575: mknod df/d18/d3e/cb9 0 2024-02-15T22:50:58.712 INFO:tasks.workunit.client.0.smithi138.stdout:0/607: dread d6/d10/d18/fa7 [0,4194304] 0 2024-02-15T22:50:58.712 INFO:tasks.workunit.client.0.smithi138.stdout:0/608: write d6/d10/d18/d57/fd0 [177984,69670] 0 2024-02-15T22:50:58.713 INFO:tasks.workunit.client.0.smithi138.stdout:5/576: mknod df/d18/d3e/d8a/cba 0 2024-02-15T22:50:58.713 INFO:tasks.workunit.client.0.smithi138.stdout:5/577: dread - df/d18/f97 zero size 2024-02-15T22:50:58.713 INFO:tasks.workunit.client.0.smithi138.stdout:5/578: chown df/d18/d3e/d60/d65/d7f/d90/la3 118451 1 2024-02-15T22:50:58.714 INFO:tasks.workunit.client.0.smithi138.stdout:8/696: dread db/d15/d70/f5b [0,4194304] 0 2024-02-15T22:50:58.715 INFO:tasks.workunit.client.0.smithi138.stdout:8/697: fsync db/dd/d4d/fa4 0 2024-02-15T22:50:58.715 INFO:tasks.workunit.client.0.smithi138.stdout:8/698: write db/dd/d22/fd4 [968043,115970] 0 2024-02-15T22:50:58.715 INFO:tasks.workunit.client.0.smithi138.stdout:8/699: write db/dd/d13/f64 [997046,33994] 0 2024-02-15T22:50:58.715 INFO:tasks.workunit.client.0.smithi138.stdout:5/579: mknod df/d18/d56/cbb 0 2024-02-15T22:50:58.716 INFO:tasks.workunit.client.0.smithi138.stdout:0/609: getdents d6/d10/d13/d3d 0 2024-02-15T22:50:58.718 INFO:tasks.workunit.client.0.smithi138.stdout:5/580: creat df/d18/d56/dae/fbc x:0 0 0 2024-02-15T22:50:58.719 INFO:tasks.workunit.client.0.smithi138.stdout:1/437: dwrite df/d1b/d33/f55 [0,4194304] 0 2024-02-15T22:50:58.720 INFO:tasks.workunit.client.0.smithi138.stdout:3/733: dwrite d5/d16/dc/d43/da2/fe0 [0,4194304] 0 2024-02-15T22:50:58.720 INFO:tasks.workunit.client.0.smithi138.stdout:9/831: dwrite d0/df/d11/fdd [0,4194304] 0 2024-02-15T22:50:58.720 INFO:tasks.workunit.client.0.smithi138.stdout:9/832: write d0/de/d33/f7a [4400701,24353] 0 2024-02-15T22:50:58.720 INFO:tasks.workunit.client.0.smithi138.stdout:0/610: rmdir d6/d10/d75/dbb 39 2024-02-15T22:50:58.720 INFO:tasks.workunit.client.0.smithi138.stdout:0/611: dread - d6/d10/d52/d72/fd3 zero size 2024-02-15T22:50:58.721 INFO:tasks.workunit.client.0.smithi138.stdout:6/581: dwrite dc/f15 [0,4194304] 0 2024-02-15T22:50:58.724 INFO:tasks.workunit.client.0.smithi138.stdout:4/777: dread d17/d1a/f50 [0,4194304] 0 2024-02-15T22:50:58.724 INFO:tasks.workunit.client.0.smithi138.stdout:7/811: dread d1/d2/db/fb2 [0,4194304] 0 2024-02-15T22:50:58.724 INFO:tasks.workunit.client.0.smithi138.stdout:7/812: chown d1/d5a/f6d 431 1 2024-02-15T22:50:58.724 INFO:tasks.workunit.client.0.smithi138.stdout:5/581: unlink df/c34 0 2024-02-15T22:50:58.727 INFO:tasks.workunit.client.0.smithi138.stdout:1/438: rename df/d1b/d21/f88 to df/d1b/d1d/d25/d2e/d6c/f94 0 2024-02-15T22:50:58.737 INFO:tasks.workunit.client.0.smithi138.stdout:1/439: read df/d1b/d1d/d25/d2e/d5b/f6d [2234290,104018] 0 2024-02-15T22:50:58.737 INFO:tasks.workunit.client.0.smithi138.stdout:9/833: creat d0/de/d14/f123 x:0 0 0 2024-02-15T22:50:58.740 INFO:tasks.workunit.client.0.smithi138.stdout:0/612: unlink d6/d10/d34/fb8 0 2024-02-15T22:50:58.740 INFO:tasks.workunit.client.0.smithi138.stdout:0/613: creat d6/d10/d52/d6f/fd8 x:0 0 0 2024-02-15T22:50:58.740 INFO:tasks.workunit.client.0.smithi138.stdout:8/700: dwrite db/dd/d13/d19/d45/fdf [0,4194304] 0 2024-02-15T22:50:58.742 INFO:tasks.workunit.client.0.smithi138.stdout:1/440: dread df/d1b/d1d/d24/f4d [0,4194304] 0 2024-02-15T22:50:58.752 INFO:tasks.workunit.client.0.smithi138.stdout:1/441: write df/d1b/d1d/d24/d3a/f77 [748213,26738] 0 2024-02-15T22:50:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/582: creat dc/d24/d6c/fc9 x:0 0 0 2024-02-15T22:50:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/583: chown dc/d24/d34/c6d 3544719 1 2024-02-15T22:50:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/584: chown dc/d24/d34/f6a 51181 1 2024-02-15T22:50:58.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/585: creat dc/d24/d34/d3b/fca x:0 0 0 2024-02-15T22:50:58.763 INFO:tasks.workunit.client.0.smithi138.stdout:6/586: fsync dc/fb6 0 2024-02-15T22:50:58.763 INFO:tasks.workunit.client.0.smithi138.stdout:7/813: truncate d1/d2/db/f7b 7273305 0 2024-02-15T22:50:58.764 INFO:tasks.workunit.client.0.smithi138.stdout:4/778: mknod d17/d1e/d2d/d52/cfe 0 2024-02-15T22:50:58.765 INFO:tasks.workunit.client.0.smithi138.stdout:6/587: dread dc/d24/d34/d3b/d7c/fad [0,4194304] 0 2024-02-15T22:50:58.765 INFO:tasks.workunit.client.0.smithi138.stdout:6/588: write dc/f3a [4915187,22001] 0 2024-02-15T22:50:58.768 INFO:tasks.workunit.client.0.smithi138.stdout:0/614: rename d6/d10/f4e to d6/d10/d75/dbb/fd9 0 2024-02-15T22:50:58.771 INFO:tasks.workunit.client.0.smithi138.stdout:7/814: write d1/d2/db/fc0 [407205,53957] 0 2024-02-15T22:50:58.773 INFO:tasks.workunit.client.0.smithi138.stdout:8/701: mkdir db/dd/d4d/de5 0 2024-02-15T22:50:58.774 INFO:tasks.workunit.client.0.smithi138.stdout:1/442: symlink df/d1b/d1d/d25/d2e/d5b/d65/l95 0 2024-02-15T22:50:58.776 INFO:tasks.workunit.client.0.smithi138.stdout:4/779: chown d17/c43 3540427 1 2024-02-15T22:50:58.776 INFO:tasks.workunit.client.0.smithi138.stdout:4/780: getdents d17/d1e/d2d/d36/dca/da3/dfd 0 2024-02-15T22:50:58.778 INFO:tasks.workunit.client.0.smithi138.stdout:6/589: creat dc/d4b/dba/fcb x:0 0 0 2024-02-15T22:50:58.778 INFO:tasks.workunit.client.0.smithi138.stdout:6/590: truncate dc/f79 5153398 0 2024-02-15T22:50:58.781 INFO:tasks.workunit.client.0.smithi138.stdout:0/615: mknod d6/d10/d52/d72/cda 0 2024-02-15T22:50:58.781 INFO:tasks.workunit.client.0.smithi138.stdout:0/616: fdatasync d6/d10/d75/dbb/fd9 0 2024-02-15T22:50:58.782 INFO:tasks.workunit.client.0.smithi138.stdout:7/815: mknod d1/d79/d84/c117 0 2024-02-15T22:50:58.782 INFO:tasks.workunit.client.0.smithi138.stdout:7/816: fdatasync d1/d109/fc8 0 2024-02-15T22:50:58.784 INFO:tasks.workunit.client.0.smithi138.stdout:0/617: truncate d6/d10/d13/f2b 57058 0 2024-02-15T22:50:58.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/817: rename d1/d79/d84/da0/cb3 to d1/d2/db/d3c/d4d/d63/c118 0 2024-02-15T22:50:58.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/818: write d1/d79/d84/da0/ddf/fce [979642,53529] 0 2024-02-15T22:50:58.787 INFO:tasks.workunit.client.0.smithi138.stdout:7/819: truncate d1/d2/db/d25/ff5 1521282 0 2024-02-15T22:50:58.791 INFO:tasks.workunit.client.0.smithi138.stdout:6/591: dread dc/d24/d34/d3b/d7c/fad [0,4194304] 0 2024-02-15T22:50:58.798 INFO:tasks.workunit.client.0.smithi138.stdout:2/572: sync 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:8/702: dwrite db/dd/d13/f79 [4194304,4194304] 0 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:8/703: fdatasync db/d15/f17 0 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:1/443: dwrite df/d1b/d1d/d24/d3a/f71 [0,4194304] 0 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:1/444: write df/d1b/f1f [1432688,125011] 0 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:4/781: dwrite d17/d1e/d2d/fbe [0,4194304] 0 2024-02-15T22:50:58.803 INFO:tasks.workunit.client.0.smithi138.stdout:4/782: write d17/d1a/f23 [396680,62597] 0 2024-02-15T22:50:58.804 INFO:tasks.workunit.client.0.smithi138.stdout:6/592: write dc/d76/fac [3354376,20135] 0 2024-02-15T22:50:58.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/618: write d6/d10/f30 [2403670,129030] 0 2024-02-15T22:50:58.820 INFO:tasks.workunit.client.0.smithi138.stdout:2/573: dwrite d0/da/d19/d53/d5d/d83/faf [0,4194304] 0 2024-02-15T22:50:58.820 INFO:tasks.workunit.client.0.smithi138.stdout:2/574: fdatasync d0/dd/d15/f57 0 2024-02-15T22:50:58.824 INFO:tasks.workunit.client.0.smithi138.stdout:8/704: dwrite db/dd/f14 [0,4194304] 0 2024-02-15T22:50:58.824 INFO:tasks.workunit.client.0.smithi138.stdout:1/445: unlink df/d1b/d1d/d24/f4d 0 2024-02-15T22:50:58.825 INFO:tasks.workunit.client.0.smithi138.stdout:4/783: creat d17/d1e/d2d/d36/d3e/daf/fff x:0 0 0 2024-02-15T22:50:58.825 INFO:tasks.workunit.client.0.smithi138.stdout:4/784: fsync d17/d1e/d2d/dd5/fde 0 2024-02-15T22:50:58.825 INFO:tasks.workunit.client.0.smithi138.stdout:4/785: fsync d17/f90 0 2024-02-15T22:50:58.835 INFO:tasks.workunit.client.0.smithi138.stdout:1/446: symlink df/d1b/d1d/d25/d2e/d5b/d7b/l96 0 2024-02-15T22:50:58.837 INFO:tasks.workunit.client.0.smithi138.stdout:0/619: link d6/c5f d6/d10/d64/cdb 0 2024-02-15T22:50:58.837 INFO:tasks.workunit.client.0.smithi138.stdout:0/620: dread - d6/d10/d75/dbb/fd9 zero size 2024-02-15T22:50:58.838 INFO:tasks.workunit.client.0.smithi138.stdout:1/447: rmdir df/d1b/d1d/d25 39 2024-02-15T22:50:58.841 INFO:tasks.workunit.client.0.smithi138.stdout:1/448: mknod df/d1b/d1d/d25/d2e/d5b/d65/c97 0 2024-02-15T22:50:58.841 INFO:tasks.workunit.client.0.smithi138.stdout:1/449: fdatasync df/d1b/d1d/d24/d3a/f71 0 2024-02-15T22:50:58.841 INFO:tasks.workunit.client.0.smithi138.stdout:2/575: dwrite d0/dd/d15/d65/fcd [0,4194304] 0 2024-02-15T22:50:58.841 INFO:tasks.workunit.client.0.smithi138.stdout:2/576: chown d0/dd/f4f 63935 1 2024-02-15T22:50:58.842 INFO:tasks.workunit.client.0.smithi138.stdout:2/577: write d0/da/d19/fc7 [731427,19597] 0 2024-02-15T22:50:58.845 INFO:tasks.workunit.client.0.smithi138.stdout:1/450: mknod df/d1b/d33/c98 0 2024-02-15T22:50:58.847 INFO:tasks.workunit.client.0.smithi138.stdout:8/705: dwrite db/dd/d13/d19/d7d/fc8 [4194304,4194304] 0 2024-02-15T22:50:58.849 INFO:tasks.workunit.client.0.smithi138.stdout:1/451: mknod df/d1b/d1d/d24/d3a/c99 0 2024-02-15T22:50:58.851 INFO:tasks.workunit.client.0.smithi138.stdout:1/452: chown df/d1b/d1d/d25/d2e/d6c/f94 504099424 1 2024-02-15T22:50:58.853 INFO:tasks.workunit.client.0.smithi138.stdout:8/706: rename db/d95 to db/d15/d70/d7c/d92/de6 0 2024-02-15T22:50:58.853 INFO:tasks.workunit.client.0.smithi138.stdout:8/707: truncate db/dd/d22/f98 379650 0 2024-02-15T22:50:58.853 INFO:tasks.workunit.client.0.smithi138.stdout:8/708: fsync db/f90 0 2024-02-15T22:50:58.854 INFO:tasks.workunit.client.0.smithi138.stdout:8/709: dread db/da0/fb5 [0,4194304] 0 2024-02-15T22:50:58.857 INFO:tasks.workunit.client.0.smithi138.stdout:1/453: rename df/d1b/d1d/d60 to df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a 0 2024-02-15T22:50:58.859 INFO:tasks.workunit.client.0.smithi138.stdout:0/621: dwrite d6/d10/d40/f5c [4194304,4194304] 0 2024-02-15T22:50:58.860 INFO:tasks.workunit.client.0.smithi138.stdout:2/578: dwrite d0/da/d19/d3f/f4a [0,4194304] 0 2024-02-15T22:50:58.860 INFO:tasks.workunit.client.0.smithi138.stdout:8/710: unlink db/d15/d70/d7c/d92/f4a 0 2024-02-15T22:50:58.860 INFO:tasks.workunit.client.0.smithi138.stdout:8/711: chown db/d15/d70/fc3 58134490 1 2024-02-15T22:50:58.865 INFO:tasks.workunit.client.0.smithi138.stdout:0/622: creat d6/d10/d34/fdc x:0 0 0 2024-02-15T22:50:58.865 INFO:tasks.workunit.client.0.smithi138.stdout:0/623: truncate d6/d10/d18/f4b 5174819 0 2024-02-15T22:50:58.865 INFO:tasks.workunit.client.0.smithi138.stdout:0/624: readlink d6/d10/d64/lac 0 2024-02-15T22:50:58.867 INFO:tasks.workunit.client.0.smithi138.stdout:1/454: getdents df/d1b/d1d 0 2024-02-15T22:50:58.871 INFO:tasks.workunit.client.0.smithi138.stdout:2/579: mknod d0/da/d19/d53/d5d/d83/d8a/dc2/ccf 0 2024-02-15T22:50:58.871 INFO:tasks.workunit.client.0.smithi138.stdout:2/580: write d0/da/d19/f2d [4691869,78175] 0 2024-02-15T22:50:58.871 INFO:tasks.workunit.client.0.smithi138.stdout:0/625: symlink d6/d10/d52/d72/ldd 0 2024-02-15T22:50:58.872 INFO:tasks.workunit.client.0.smithi138.stdout:0/626: mknod d6/d10/d52/cde 0 2024-02-15T22:50:58.874 INFO:tasks.workunit.client.0.smithi138.stdout:0/627: creat d6/d10/d75/db1/fdf x:0 0 0 2024-02-15T22:50:58.877 INFO:tasks.workunit.client.0.smithi138.stdout:8/712: dwrite db/dd/d13/d19/f43 [0,4194304] 0 2024-02-15T22:50:58.877 INFO:tasks.workunit.client.0.smithi138.stdout:8/713: chown db/dd/f3e 458060 1 2024-02-15T22:50:58.881 INFO:tasks.workunit.client.0.smithi138.stdout:8/714: creat db/dd/d13/d19/d6b/dba/fe7 x:0 0 0 2024-02-15T22:50:58.881 INFO:tasks.workunit.client.0.smithi138.stdout:8/715: truncate db/dd/d13/d19/fa3 1026092 0 2024-02-15T22:50:58.883 INFO:tasks.workunit.client.0.smithi138.stdout:8/716: mkdir db/da0/de8 0 2024-02-15T22:50:58.883 INFO:tasks.workunit.client.0.smithi138.stdout:8/717: write db/dd/d13/d19/d7d/db2/fca [417809,109261] 0 2024-02-15T22:50:58.884 INFO:tasks.workunit.client.0.smithi138.stdout:8/718: getdents db/dd/d4d 0 2024-02-15T22:50:58.885 INFO:tasks.workunit.client.0.smithi138.stdout:8/719: creat db/dd/d13/fe9 x:0 0 0 2024-02-15T22:50:58.885 INFO:tasks.workunit.client.0.smithi138.stdout:8/720: symlink db/dd/d13/d19/d6b/lea 0 2024-02-15T22:50:58.886 INFO:tasks.workunit.client.0.smithi138.stdout:8/721: creat db/d15/d70/d7c/feb x:0 0 0 2024-02-15T22:50:58.887 INFO:tasks.workunit.client.0.smithi138.stdout:8/722: symlink db/d15/d70/dda/de4/lec 0 2024-02-15T22:50:58.887 INFO:tasks.workunit.client.0.smithi138.stdout:8/723: write db/dd/d22/f73 [1113337,42955] 0 2024-02-15T22:50:58.887 INFO:tasks.workunit.client.0.smithi138.stdout:8/724: write db/dd/d22/f8b [44766,72986] 0 2024-02-15T22:50:58.887 INFO:tasks.workunit.client.0.smithi138.stdout:8/725: write db/dd/f3e [350373,117305] 0 2024-02-15T22:50:58.888 INFO:tasks.workunit.client.0.smithi138.stdout:8/726: mknod db/da0/de8/ced 0 2024-02-15T22:50:58.889 INFO:tasks.workunit.client.0.smithi138.stdout:8/727: creat db/d15/d70/d7c/d92/fee x:0 0 0 2024-02-15T22:50:58.890 INFO:tasks.workunit.client.0.smithi138.stdout:8/728: link db/d15/d70/d7c/d92/de6/fdb db/d15/d70/dda/de4/fef 0 2024-02-15T22:50:58.891 INFO:tasks.workunit.client.0.smithi138.stdout:8/729: mkdir db/d15/daa/df0 0 2024-02-15T22:50:58.900 INFO:tasks.workunit.client.0.smithi138.stdout:0/628: dwrite d6/d10/d18/fa7 [4194304,4194304] 0 2024-02-15T22:50:58.900 INFO:tasks.workunit.client.0.smithi138.stdout:2/581: dwrite d0/da/d19/d53/d80/fb0 [0,4194304] 0 2024-02-15T22:50:58.900 INFO:tasks.workunit.client.0.smithi138.stdout:2/582: rename d0/dd to d0/dd/dd0 22 2024-02-15T22:50:58.900 INFO:tasks.workunit.client.0.smithi138.stdout:1/455: dwrite df/d1b/d1d/d24/d3a/f40 [0,4194304] 0 2024-02-15T22:50:58.902 INFO:tasks.workunit.client.0.smithi138.stdout:2/583: write d0/f37 [989740,12789] 0 2024-02-15T22:50:58.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/584: link d0/da/d19/d53/f68 d0/da/d19/d53/fd1 0 2024-02-15T22:50:58.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/585: write d0/da/d19/f55 [329873,106856] 0 2024-02-15T22:50:58.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/586: rmdir d0/dd/d15/d65 39 2024-02-15T22:50:58.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/587: write d0/da/d19/d53/d80/fbb [445624,108348] 0 2024-02-15T22:50:58.909 INFO:tasks.workunit.client.0.smithi138.stdout:2/588: chown d0/dd/d15/d72/c82 1 1 2024-02-15T22:50:58.910 INFO:tasks.workunit.client.0.smithi138.stdout:2/589: stat d0/dd/f4f 0 2024-02-15T22:50:58.910 INFO:tasks.workunit.client.0.smithi138.stdout:2/590: stat d0/da/d19/f39 0 2024-02-15T22:50:58.910 INFO:tasks.workunit.client.0.smithi138.stdout:0/629: write d6/d10/d13/f1e [90699,57225] 0 2024-02-15T22:50:58.910 INFO:tasks.workunit.client.0.smithi138.stdout:0/630: chown d6/d10/d75/fc5 189 1 2024-02-15T22:50:58.910 INFO:tasks.workunit.client.0.smithi138.stdout:2/591: getdents d0/dd/d15 0 2024-02-15T22:50:58.913 INFO:tasks.workunit.client.0.smithi138.stdout:8/730: dread db/d15/d70/d7c/d92/f2c [0,4194304] 0 2024-02-15T22:50:58.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/731: mknod db/dd/d4d/de5/cf1 0 2024-02-15T22:50:58.914 INFO:tasks.workunit.client.0.smithi138.stdout:8/732: stat db/dd/c41 0 2024-02-15T22:50:58.919 INFO:tasks.workunit.client.0.smithi138.stdout:0/631: dread d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:58.921 INFO:tasks.workunit.client.0.smithi138.stdout:0/632: readlink d6/d10/d18/d6e/l84 0 2024-02-15T22:50:58.922 INFO:tasks.workunit.client.0.smithi138.stdout:2/592: dread d0/da/d19/d53/d5d/d83/faf [0,4194304] 0 2024-02-15T22:50:58.923 INFO:tasks.workunit.client.0.smithi138.stdout:1/456: dwrite df/d1b/d1d/d25/d2e/d37/f81 [0,4194304] 0 2024-02-15T22:50:58.923 INFO:tasks.workunit.client.0.smithi138.stdout:0/633: creat d6/d10/d34/dcf/fe0 x:0 0 0 2024-02-15T22:50:58.925 INFO:tasks.workunit.client.0.smithi138.stdout:8/733: rename db/dd to db/d15/db6/df2 0 2024-02-15T22:50:58.929 INFO:tasks.workunit.client.0.smithi138.stdout:2/593: mkdir d0/dd/dd2 0 2024-02-15T22:50:58.929 INFO:tasks.workunit.client.0.smithi138.stdout:2/594: fdatasync d0/da/d19/d53/d5d/d6d/f7c 0 2024-02-15T22:50:58.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/634: unlink d6/d10/d13/f25 0 2024-02-15T22:50:58.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/635: write d6/d10/d18/d57/fd0 [374756,105798] 0 2024-02-15T22:50:58.931 INFO:tasks.workunit.client.0.smithi138.stdout:1/457: dread df/d1b/d1d/d25/d2e/d37/f3e [0,4194304] 0 2024-02-15T22:50:58.931 INFO:tasks.workunit.client.0.smithi138.stdout:1/458: readlink df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/l5f 0 2024-02-15T22:50:58.934 INFO:tasks.workunit.client.0.smithi138.stdout:8/734: read db/d15/db6/df2/d13/d19/f76 [3548213,119251] 0 2024-02-15T22:50:58.937 INFO:tasks.workunit.client.0.smithi138.stdout:0/636: rename d6/d10/d34/c83 to d6/d10/d18/d6e/ce1 0 2024-02-15T22:50:58.938 INFO:tasks.workunit.client.0.smithi138.stdout:1/459: creat df/d1b/d1d/d24/d3a/f9b x:0 0 0 2024-02-15T22:50:58.938 INFO:tasks.workunit.client.0.smithi138.stdout:1/460: write df/d1b/d1d/d25/d2e/d37/f4b [1431276,80687] 0 2024-02-15T22:50:58.944 INFO:tasks.workunit.client.0.smithi138.stdout:2/595: getdents d0/da/d19/d53/d5d 0 2024-02-15T22:50:58.946 INFO:tasks.workunit.client.0.smithi138.stdout:0/637: rename d6/d10/d13/c96 to d6/d10/d18/d6e/ce2 0 2024-02-15T22:50:58.947 INFO:tasks.workunit.client.0.smithi138.stdout:1/461: truncate df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f64 2036 0 2024-02-15T22:50:58.949 INFO:tasks.workunit.client.0.smithi138.stdout:1/462: creat df/d1b/d1d/d25/d2e/d37/f9c x:0 0 0 2024-02-15T22:50:58.949 INFO:tasks.workunit.client.0.smithi138.stdout:1/463: chown df/d1b/d1d/d24/d3a/l50 0 1 2024-02-15T22:50:58.949 INFO:tasks.workunit.client.0.smithi138.stdout:1/464: creat df/d1b/d33/f9d x:0 0 0 2024-02-15T22:50:58.950 INFO:tasks.workunit.client.0.smithi138.stdout:0/638: mknod d6/d10/d18/d1b/ce3 0 2024-02-15T22:50:58.950 INFO:tasks.workunit.client.0.smithi138.stdout:0/639: creat d6/d10/d34/fe4 x:0 0 0 2024-02-15T22:50:58.952 INFO:tasks.workunit.client.0.smithi138.stdout:1/465: truncate df/d1b/d1d/d25/f42 175239 0 2024-02-15T22:50:58.952 INFO:tasks.workunit.client.0.smithi138.stdout:1/466: fsync df/d1b/d33/f75 0 2024-02-15T22:50:58.954 INFO:tasks.workunit.client.0.smithi138.stdout:0/640: creat d6/d10/d75/dbb/fe5 x:0 0 0 2024-02-15T22:50:58.954 INFO:tasks.workunit.client.0.smithi138.stdout:1/467: fsync df/d1b/d1d/d25/d2e/d37/f4b 0 2024-02-15T22:50:58.955 INFO:tasks.workunit.client.0.smithi138.stdout:1/468: write f8 [4172841,76058] 0 2024-02-15T22:50:58.956 INFO:tasks.workunit.client.0.smithi138.stdout:0/641: symlink d6/d10/d52/le6 0 2024-02-15T22:50:58.959 INFO:tasks.workunit.client.0.smithi138.stdout:0/642: rmdir d6/d10 39 2024-02-15T22:50:58.962 INFO:tasks.workunit.client.0.smithi138.stdout:2/596: dwrite d0/da/f9c [0,4194304] 0 2024-02-15T22:50:58.964 INFO:tasks.workunit.client.0.smithi138.stdout:0/643: creat d6/d10/d18/d1b/fe7 x:0 0 0 2024-02-15T22:50:58.964 INFO:tasks.workunit.client.0.smithi138.stdout:0/644: fdatasync d6/d10/d18/f4b 0 2024-02-15T22:50:58.965 INFO:tasks.workunit.client.0.smithi138.stdout:2/597: dread d0/da/f33 [0,4194304] 0 2024-02-15T22:50:58.968 INFO:tasks.workunit.client.0.smithi138.stdout:2/598: truncate d0/f1 3708267 0 2024-02-15T22:50:58.968 INFO:tasks.workunit.client.0.smithi138.stdout:2/599: readlink d0/da/d19/d53/d5d/d6d/d7b/lb3 0 2024-02-15T22:50:58.968 INFO:tasks.workunit.client.0.smithi138.stdout:2/600: readlink d0/dd/d15/l4d 0 2024-02-15T22:50:58.968 INFO:tasks.workunit.client.0.smithi138.stdout:2/601: readlink d0/dd/d15/l1c 0 2024-02-15T22:50:58.970 INFO:tasks.workunit.client.0.smithi138.stdout:1/469: dwrite df/d1b/d1d/d25/d2e/d37/f3e [0,4194304] 0 2024-02-15T22:50:58.971 INFO:tasks.workunit.client.0.smithi138.stdout:1/470: truncate df/d1b/d1d/d24/d3a/f40 3008209 0 2024-02-15T22:50:58.975 INFO:tasks.workunit.client.0.smithi138.stdout:1/471: unlink df/d1b/d33/c98 0 2024-02-15T22:50:58.975 INFO:tasks.workunit.client.0.smithi138.stdout:1/472: write df/f14 [3860597,15629] 0 2024-02-15T22:50:58.975 INFO:tasks.workunit.client.0.smithi138.stdout:1/473: readlink df/d1b/l1e 0 2024-02-15T22:50:58.976 INFO:tasks.workunit.client.0.smithi138.stdout:1/474: mknod df/d1b/d1d/d25/d2e/d37/c9e 0 2024-02-15T22:50:58.976 INFO:tasks.workunit.client.0.smithi138.stdout:1/475: truncate df/d1b/f27 912252 0 2024-02-15T22:50:58.976 INFO:tasks.workunit.client.0.smithi138.stdout:1/476: creat df/d1b/d21/d4f/f9f x:0 0 0 2024-02-15T22:50:58.978 INFO:tasks.workunit.client.0.smithi138.stdout:1/477: unlink df/d1b/d1d/d25/d2e/f4e 0 2024-02-15T22:50:58.979 INFO:tasks.workunit.client.0.smithi138.stdout:1/478: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d86/da0 0 2024-02-15T22:50:58.980 INFO:tasks.workunit.client.0.smithi138.stdout:1/479: fdatasync df/d1b/d1d/d24/d3a/f71 0 2024-02-15T22:50:58.980 INFO:tasks.workunit.client.0.smithi138.stdout:1/480: stat df/d1b/l8b 0 2024-02-15T22:50:58.986 INFO:tasks.workunit.client.0.smithi138.stdout:0/645: dwrite d6/d10/d52/f97 [0,4194304] 0 2024-02-15T22:50:58.989 INFO:tasks.workunit.client.0.smithi138.stdout:0/646: rename d6/d10/d40/cc0 to d6/d10/d18/d1b/ce8 0 2024-02-15T22:50:58.990 INFO:tasks.workunit.client.0.smithi138.stdout:1/481: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f66 [4088739,13023] 0 2024-02-15T22:50:58.990 INFO:tasks.workunit.client.0.smithi138.stdout:1/482: chown df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f66 140 1 2024-02-15T22:50:58.990 INFO:tasks.workunit.client.0.smithi138.stdout:0/647: mknod d6/d10/d34/ce9 0 2024-02-15T22:50:58.994 INFO:tasks.workunit.client.0.smithi138.stdout:0/648: getdents d6/d10/d18 0 2024-02-15T22:50:58.995 INFO:tasks.workunit.client.0.smithi138.stdout:0/649: symlink d6/d10/d13/d3d/lea 0 2024-02-15T22:50:58.995 INFO:tasks.workunit.client.0.smithi138.stdout:0/650: chown d6/d10/d40/f74 701858103 1 2024-02-15T22:50:59.001 INFO:tasks.workunit.client.0.smithi138.stdout:0/651: dread d6/d10/d13/f41 [0,4194304] 0 2024-02-15T22:50:59.002 INFO:tasks.workunit.client.0.smithi138.stdout:0/652: creat d6/d10/d18/d1b/feb x:0 0 0 2024-02-15T22:50:59.002 INFO:tasks.workunit.client.0.smithi138.stdout:0/653: fsync d6/d10/d75/db1/fdf 0 2024-02-15T22:50:59.003 INFO:tasks.workunit.client.0.smithi138.stdout:0/654: mknod d6/dba/cec 0 2024-02-15T22:50:59.004 INFO:tasks.workunit.client.0.smithi138.stdout:0/655: rename d6/c21 to d6/d10/d75/ced 0 2024-02-15T22:50:59.005 INFO:tasks.workunit.client.0.smithi138.stdout:0/656: fdatasync d6/f92 0 2024-02-15T22:50:59.007 INFO:tasks.workunit.client.0.smithi138.stdout:1/483: dwrite df/d1b/d1d/d24/d3a/f70 [0,4194304] 0 2024-02-15T22:50:59.007 INFO:tasks.workunit.client.0.smithi138.stdout:1/484: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 [1127402,18769] 0 2024-02-15T22:50:59.007 INFO:tasks.workunit.client.0.smithi138.stdout:1/485: write df/d1b/d1d/d25/d2e/d37/f81 [4759840,75751] 0 2024-02-15T22:50:59.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:58 smithi170 ceph-mon[35248]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:59.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:50:58 smithi170 ceph-mon[35248]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 135 MiB/s rd, 161 MiB/s wr, 347 op/s 2024-02-15T22:50:59.015 INFO:tasks.workunit.client.0.smithi138.stdout:0/657: write d6/d10/d52/d72/f8c [3883909,76584] 0 2024-02-15T22:50:59.015 INFO:tasks.workunit.client.0.smithi138.stdout:0/658: write d6/d10/d52/d72/fd3 [442413,31172] 0 2024-02-15T22:50:59.015 INFO:tasks.workunit.client.0.smithi138.stdout:0/659: readlink d6/d10/d64/lb3 0 2024-02-15T22:50:59.016 INFO:tasks.workunit.client.0.smithi138.stdout:0/660: symlink d6/d10/d18/d57/lee 0 2024-02-15T22:50:59.016 INFO:tasks.workunit.client.0.smithi138.stdout:0/661: stat d6/d10/d52/d6f/d85/lad 0 2024-02-15T22:50:59.016 INFO:tasks.workunit.client.0.smithi138.stdout:0/662: fsync d6/d10/d40/f91 0 2024-02-15T22:50:59.026 INFO:tasks.workunit.client.0.smithi138.stdout:1/486: dwrite df/d1b/d1d/d24/f38 [0,4194304] 0 2024-02-15T22:50:59.026 INFO:tasks.workunit.client.0.smithi138.stdout:1/487: truncate df/d1b/d33/f9d 1024699 0 2024-02-15T22:50:59.026 INFO:tasks.workunit.client.0.smithi138.stdout:1/488: write df/d1b/f69 [301382,34038] 0 2024-02-15T22:50:59.030 INFO:tasks.workunit.client.0.smithi138.stdout:1/489: getdents df/d1b/d1d/d25/d2e 0 2024-02-15T22:50:59.032 INFO:tasks.workunit.client.0.smithi138.stdout:1/490: fsync df/f14 0 2024-02-15T22:50:59.032 INFO:tasks.workunit.client.0.smithi138.stdout:0/663: dwrite d6/d10/d52/f97 [0,4194304] 0 2024-02-15T22:50:59.033 INFO:tasks.workunit.client.0.smithi138.stdout:1/491: link df/d1b/d1d/d25/d2e/l8e df/d1b/d1d/d25/la1 0 2024-02-15T22:50:59.034 INFO:tasks.workunit.client.0.smithi138.stdout:0/664: creat d6/d10/d64/dbf/dcc/fef x:0 0 0 2024-02-15T22:50:59.034 INFO:tasks.workunit.client.0.smithi138.stdout:0/665: truncate d6/d10/d34/fe4 453892 0 2024-02-15T22:50:59.035 INFO:tasks.workunit.client.0.smithi138.stdout:0/666: write d6/d10/d34/dcf/fe0 [234829,112975] 0 2024-02-15T22:50:59.035 INFO:tasks.workunit.client.0.smithi138.stdout:1/492: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 0 2024-02-15T22:50:59.035 INFO:tasks.workunit.client.0.smithi138.stdout:1/493: stat df/c63 0 2024-02-15T22:50:59.035 INFO:tasks.workunit.client.0.smithi138.stdout:0/667: creat d6/d10/d13/ff0 x:0 0 0 2024-02-15T22:50:59.036 INFO:tasks.workunit.client.0.smithi138.stdout:0/668: dread - d6/d10/d75/dbb/fe5 zero size 2024-02-15T22:50:59.036 INFO:tasks.workunit.client.0.smithi138.stdout:1/494: getdents df/d1b/d1d/d25/d2e/d5b/d65/d86 0 2024-02-15T22:50:59.037 INFO:tasks.workunit.client.0.smithi138.stdout:0/669: link d6/d10/d18/d57/lee d6/d10/d75/dbb/lf1 0 2024-02-15T22:50:59.038 INFO:tasks.workunit.client.0.smithi138.stdout:0/670: readlink d6/d10/d18/d57/lee 0 2024-02-15T22:50:59.038 INFO:tasks.workunit.client.0.smithi138.stdout:0/671: symlink d6/d10/lf2 0 2024-02-15T22:50:59.039 INFO:tasks.workunit.client.0.smithi138.stdout:0/672: getdents d6/dba 0 2024-02-15T22:50:59.039 INFO:tasks.workunit.client.0.smithi138.stdout:0/673: write d6/d10/d34/fe4 [749475,37945] 0 2024-02-15T22:50:59.049 INFO:tasks.workunit.client.0.smithi138.stdout:0/674: dread d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:50:59.049 INFO:tasks.workunit.client.0.smithi138.stdout:0/675: dread - d6/d10/d52/d6f/d85/fc7 zero size 2024-02-15T22:50:59.054 INFO:tasks.workunit.client.0.smithi138.stdout:1/495: dwrite fa [0,4194304] 0 2024-02-15T22:50:59.056 INFO:tasks.workunit.client.0.smithi138.stdout:1/496: dread df/d1b/d21/f32 [0,4194304] 0 2024-02-15T22:50:59.091 INFO:tasks.workunit.client.0.smithi138.stdout:0/676: creat d6/d10/d64/dbf/ff3 x:0 0 0 2024-02-15T22:50:59.093 INFO:tasks.workunit.client.0.smithi138.stdout:1/497: mknod df/d1b/d1d/d24/ca2 0 2024-02-15T22:50:59.096 INFO:tasks.workunit.client.0.smithi138.stdout:1/498: rmdir df/d1b/d1d/d25/d2e 39 2024-02-15T22:50:59.096 INFO:tasks.workunit.client.0.smithi138.stdout:1/499: creat df/d1b/d33/fa3 x:0 0 0 2024-02-15T22:50:59.096 INFO:tasks.workunit.client.0.smithi138.stdout:1/500: chown df/c7e 767326704 1 2024-02-15T22:50:59.116 INFO:tasks.workunit.client.0.smithi138.stdout:1/501: dwrite df/d1b/d1d/d25/d2e/d5b/f6d [0,4194304] 0 2024-02-15T22:50:59.118 INFO:tasks.workunit.client.0.smithi138.stdout:1/502: symlink df/d1b/d21/la4 0 2024-02-15T22:50:59.134 INFO:tasks.workunit.client.0.smithi138.stdout:1/503: dwrite df/f12 [0,4194304] 0 2024-02-15T22:50:59.135 INFO:tasks.workunit.client.0.smithi138.stdout:1/504: chown df/d1b/d1d/d25/la1 7 1 2024-02-15T22:50:59.136 INFO:tasks.workunit.client.0.smithi138.stdout:1/505: symlink df/d1b/d1d/d25/d2e/d6c/la5 0 2024-02-15T22:50:59.143 INFO:tasks.workunit.client.0.smithi138.stdout:3/734: sync 2024-02-15T22:50:59.159 INFO:tasks.workunit.client.0.smithi138.stdout:3/735: dwrite d5/d12/d26/dd5/ff1 [0,4194304] 0 2024-02-15T22:50:59.159 INFO:tasks.workunit.client.0.smithi138.stdout:3/736: readlink d5/d12/d26/da6/lb9 0 2024-02-15T22:50:59.159 INFO:tasks.workunit.client.0.smithi138.stdout:3/737: write d5/d12/d23/d29/d5a/dc2/fd4 [316827,112038] 0 2024-02-15T22:50:59.159 INFO:tasks.workunit.client.0.smithi138.stdout:3/738: write d5/d12/d23/d29/d4f/fc4 [609040,15666] 0 2024-02-15T22:50:59.160 INFO:tasks.workunit.client.0.smithi138.stdout:3/739: write d5/d12/d26/d2e/fba [604431,39672] 0 2024-02-15T22:50:59.160 INFO:tasks.workunit.client.0.smithi138.stdout:3/740: truncate d5/d12/d23/d29/d4f/fc4 1121267 0 2024-02-15T22:50:59.182 INFO:tasks.workunit.client.0.smithi138.stdout:3/741: dwrite d5/d16/dc/dca/fe7 [0,4194304] 0 2024-02-15T22:50:59.182 INFO:tasks.workunit.client.0.smithi138.stdout:3/742: dread - d5/d16/dc/d43/f83 zero size 2024-02-15T22:50:59.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:58 smithi138 ceph-mon[29229]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:50:59.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:50:58 smithi138 ceph-mon[29229]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 135 MiB/s rd, 161 MiB/s wr, 347 op/s 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:6/593: sync 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/834: sync 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:5/582: sync 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/820: sync 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/835: chown d0/de/d34/d89/d117 6 1 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/836: chown d0/de/d14/d18 51 1 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/821: write d1/d2/db/d3c/f45 [4545022,88195] 0 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/822: write d1/d2/db/d3c/f45 [4367646,2952] 0 2024-02-15T22:50:59.294 INFO:tasks.workunit.client.0.smithi138.stdout:7/823: creat d1/d2/db/d25/f119 x:0 0 0 2024-02-15T22:50:59.295 INFO:tasks.workunit.client.0.smithi138.stdout:5/583: truncate df/d18/f20 2759631 0 2024-02-15T22:50:59.296 INFO:tasks.workunit.client.0.smithi138.stdout:6/594: symlink dc/d24/d34/lcc 0 2024-02-15T22:50:59.296 INFO:tasks.workunit.client.0.smithi138.stdout:5/584: write df/d18/d2b/f4d [574686,118768] 0 2024-02-15T22:50:59.296 INFO:tasks.workunit.client.0.smithi138.stdout:5/585: creat df/d18/d3e/d60/d72/fbd x:0 0 0 2024-02-15T22:50:59.296 INFO:tasks.workunit.client.0.smithi138.stdout:5/586: stat df/d18/d3e/d51/f55 0 2024-02-15T22:50:59.297 INFO:tasks.workunit.client.0.smithi138.stdout:9/837: creat d0/d55/d59/d106/f124 x:0 0 0 2024-02-15T22:50:59.299 INFO:tasks.workunit.client.0.smithi138.stdout:9/838: write d0/de/d14/d18/fef [965392,36559] 0 2024-02-15T22:50:59.301 INFO:tasks.workunit.client.0.smithi138.stdout:6/595: symlink dc/d24/d34/d99/dc4/lcd 0 2024-02-15T22:50:59.301 INFO:tasks.workunit.client.0.smithi138.stdout:6/596: creat dc/d4b/d7b/fce x:0 0 0 2024-02-15T22:50:59.303 INFO:tasks.workunit.client.0.smithi138.stdout:5/587: rename df/d18/d3e/d51/f55 to df/d18/d2b/d9c/daf/fbe 0 2024-02-15T22:50:59.303 INFO:tasks.workunit.client.0.smithi138.stdout:9/839: rmdir d0/de/d34/d89/d90 39 2024-02-15T22:50:59.304 INFO:tasks.workunit.client.0.smithi138.stdout:9/840: creat d0/de/d34/dd3/dec/f125 x:0 0 0 2024-02-15T22:50:59.305 INFO:tasks.workunit.client.0.smithi138.stdout:6/597: mknod dc/d24/d34/d3b/d7c/ccf 0 2024-02-15T22:50:59.306 INFO:tasks.workunit.client.0.smithi138.stdout:9/841: mkdir d0/d1/db8/d126 0 2024-02-15T22:50:59.306 INFO:tasks.workunit.client.0.smithi138.stdout:9/842: truncate d0/de/d14/f123 900985 0 2024-02-15T22:50:59.306 INFO:tasks.workunit.client.0.smithi138.stdout:9/843: creat d0/de/d34/f127 x:0 0 0 2024-02-15T22:50:59.307 INFO:tasks.workunit.client.0.smithi138.stdout:6/598: rename dc/d24/d34/d3b/d7c/c88 to dc/d24/d34/d99/dc4/cd0 0 2024-02-15T22:50:59.312 INFO:tasks.workunit.client.0.smithi138.stdout:6/599: mkdir dc/d24/d34/d99/dc4/dd1 0 2024-02-15T22:50:59.314 INFO:tasks.workunit.client.0.smithi138.stdout:7/824: dwrite d1/d28/fe9 [4194304,4194304] 0 2024-02-15T22:50:59.316 INFO:tasks.workunit.client.0.smithi138.stdout:5/588: dread df/f27 [0,4194304] 0 2024-02-15T22:50:59.316 INFO:tasks.workunit.client.0.smithi138.stdout:7/825: rmdir d1/d79/d84/da0/ddf 39 2024-02-15T22:50:59.319 INFO:tasks.workunit.client.0.smithi138.stdout:5/589: mknod df/d18/d3e/d66/d82/cbf 0 2024-02-15T22:50:59.319 INFO:tasks.workunit.client.0.smithi138.stdout:5/590: stat df/d18/f20 0 2024-02-15T22:50:59.319 INFO:tasks.workunit.client.0.smithi138.stdout:7/826: creat d1/f11a x:0 0 0 2024-02-15T22:50:59.320 INFO:tasks.workunit.client.0.smithi138.stdout:5/591: symlink df/d18/d3e/d51/lc0 0 2024-02-15T22:50:59.322 INFO:tasks.workunit.client.0.smithi138.stdout:7/827: mknod d1/d2/db/d25/d41/dfb/c11b 0 2024-02-15T22:50:59.326 INFO:tasks.workunit.client.0.smithi138.stdout:5/592: rename df/d18/d2b/f47 to df/d18/d3e/d60/d72/da5/fc1 0 2024-02-15T22:50:59.328 INFO:tasks.workunit.client.0.smithi138.stdout:7/828: symlink d1/d2/l11c 0 2024-02-15T22:50:59.329 INFO:tasks.workunit.client.0.smithi138.stdout:5/593: mkdir df/d18/d3e/d60/d65/dc2 0 2024-02-15T22:50:59.329 INFO:tasks.workunit.client.0.smithi138.stdout:5/594: creat df/d18/d3e/d60/d65/d7f/fc3 x:0 0 0 2024-02-15T22:50:59.330 INFO:tasks.workunit.client.0.smithi138.stdout:7/829: creat d1/d2/f11d x:0 0 0 2024-02-15T22:50:59.332 INFO:tasks.workunit.client.0.smithi138.stdout:5/595: rename df/d18/d3e/d60/d65/cb1 to df/d18/d3e/d60/d65/d7c/cc4 0 2024-02-15T22:50:59.332 INFO:tasks.workunit.client.0.smithi138.stdout:5/596: write df/d18/d3e/d66/f93 [1307232,41371] 0 2024-02-15T22:50:59.336 INFO:tasks.workunit.client.0.smithi138.stdout:6/600: dwrite dc/fb6 [0,4194304] 0 2024-02-15T22:50:59.339 INFO:tasks.workunit.client.0.smithi138.stdout:6/601: symlink dc/d24/d34/d3b/d7c/da8/ld2 0 2024-02-15T22:50:59.339 INFO:tasks.workunit.client.0.smithi138.stdout:6/602: creat dc/fd3 x:0 0 0 2024-02-15T22:50:59.340 INFO:tasks.workunit.client.0.smithi138.stdout:9/844: dwrite d0/d2e/f8f [0,4194304] 0 2024-02-15T22:50:59.340 INFO:tasks.workunit.client.0.smithi138.stdout:7/830: dread d1/d5a/f6d [0,4194304] 0 2024-02-15T22:50:59.340 INFO:tasks.workunit.client.0.smithi138.stdout:7/831: dread - d1/d2/db/d25/d41/f46 zero size 2024-02-15T22:50:59.341 INFO:tasks.workunit.client.0.smithi138.stdout:7/832: write d1/d79/d84/f10c [82677,41009] 0 2024-02-15T22:50:59.342 INFO:tasks.workunit.client.0.smithi138.stdout:5/597: dread df/f17 [0,4194304] 0 2024-02-15T22:50:59.343 INFO:tasks.workunit.client.0.smithi138.stdout:9/845: creat d0/de/d34/d89/d117/f128 x:0 0 0 2024-02-15T22:50:59.343 INFO:tasks.workunit.client.0.smithi138.stdout:9/846: chown d0/dc7/fd2 93422053 1 2024-02-15T22:50:59.347 INFO:tasks.workunit.client.0.smithi138.stdout:5/598: unlink df/d18/d3e/d66/f6e 0 2024-02-15T22:50:59.348 INFO:tasks.workunit.client.0.smithi138.stdout:9/847: mknod d0/de/d34/dd3/dec/d120/c129 0 2024-02-15T22:50:59.348 INFO:tasks.workunit.client.0.smithi138.stdout:9/848: dread - d0/de/d48/d70/f11d zero size 2024-02-15T22:50:59.349 INFO:tasks.workunit.client.0.smithi138.stdout:7/833: dread d1/d79/d84/da0/fdb [0,4194304] 0 2024-02-15T22:50:59.349 INFO:tasks.workunit.client.0.smithi138.stdout:5/599: truncate df/d18/d3e/d60/f64 732332 0 2024-02-15T22:50:59.351 INFO:tasks.workunit.client.0.smithi138.stdout:7/834: symlink d1/d79/d84/d8c/d10a/l11e 0 2024-02-15T22:50:59.352 INFO:tasks.workunit.client.0.smithi138.stdout:5/600: symlink df/d18/d3e/d66/d82/lc5 0 2024-02-15T22:50:59.356 INFO:tasks.workunit.client.0.smithi138.stdout:9/849: dread d0/de/d14/f41 [0,4194304] 0 2024-02-15T22:50:59.356 INFO:tasks.workunit.client.0.smithi138.stdout:7/835: dread d1/d2/db/d3c/d4d/d5b/f76 [0,4194304] 0 2024-02-15T22:50:59.357 INFO:tasks.workunit.client.0.smithi138.stdout:7/836: fsync d1/d2/f44 0 2024-02-15T22:50:59.357 INFO:tasks.workunit.client.0.smithi138.stdout:7/837: creat d1/d5a/d97/dfc/f11f x:0 0 0 2024-02-15T22:50:59.357 INFO:tasks.workunit.client.0.smithi138.stdout:7/838: truncate d1/d2/db/f1c 8696501 0 2024-02-15T22:50:59.357 INFO:tasks.workunit.client.0.smithi138.stdout:9/850: read d0/d2e/fcf [623431,116539] 0 2024-02-15T22:50:59.359 INFO:tasks.workunit.client.0.smithi138.stdout:7/839: symlink d1/d2/db/d3c/d4d/d5b/d103/l120 0 2024-02-15T22:50:59.359 INFO:tasks.workunit.client.0.smithi138.stdout:7/840: write d1/d2/d29/fd9 [4566048,77170] 0 2024-02-15T22:50:59.359 INFO:tasks.workunit.client.0.smithi138.stdout:7/841: chown d1/d2/db/d25/f119 166340 1 2024-02-15T22:50:59.359 INFO:tasks.workunit.client.0.smithi138.stdout:7/842: chown d1/l13 11225 1 2024-02-15T22:50:59.363 INFO:tasks.workunit.client.0.smithi138.stdout:9/851: symlink d0/de/d14/da3/dc8/l12a 0 2024-02-15T22:50:59.366 INFO:tasks.workunit.client.0.smithi138.stdout:7/843: link d1/d28/fe9 d1/d2/db/d25/f121 0 2024-02-15T22:50:59.366 INFO:tasks.workunit.client.0.smithi138.stdout:7/844: chown d1/f12 682925 1 2024-02-15T22:50:59.366 INFO:tasks.workunit.client.0.smithi138.stdout:7/845: chown d1/d2/db/d25/d111 5645 1 2024-02-15T22:50:59.366 INFO:tasks.workunit.client.0.smithi138.stdout:7/846: symlink d1/d79/d84/da0/l122 0 2024-02-15T22:50:59.371 INFO:tasks.workunit.client.0.smithi138.stdout:7/847: dread d1/d79/d84/d8c/fc1 [0,4194304] 0 2024-02-15T22:50:59.371 INFO:tasks.workunit.client.0.smithi138.stdout:7/848: read - d1/d79/d84/f10e zero size 2024-02-15T22:50:59.371 INFO:tasks.workunit.client.0.smithi138.stdout:7/849: truncate d1/d2/db/fe 4728319 0 2024-02-15T22:50:59.372 INFO:tasks.workunit.client.0.smithi138.stdout:7/850: getdents d1/d79/d84/d8c 0 2024-02-15T22:50:59.373 INFO:tasks.workunit.client.0.smithi138.stdout:9/852: write d0/d55/d59/f5f [48988,37741] 0 2024-02-15T22:50:59.374 INFO:tasks.workunit.client.0.smithi138.stdout:7/851: dread d1/d79/d84/f8e [0,4194304] 0 2024-02-15T22:50:59.375 INFO:tasks.workunit.client.0.smithi138.stdout:9/853: dread d0/de/d14/f58 [0,4194304] 0 2024-02-15T22:50:59.375 INFO:tasks.workunit.client.0.smithi138.stdout:9/854: chown d0/de/d48 1973685 1 2024-02-15T22:50:59.376 INFO:tasks.workunit.client.0.smithi138.stdout:7/852: creat d1/d2/db/d25/d41/f123 x:0 0 0 2024-02-15T22:50:59.376 INFO:tasks.workunit.client.0.smithi138.stdout:7/853: readlink d1/d28/la1 0 2024-02-15T22:50:59.376 INFO:tasks.workunit.client.0.smithi138.stdout:7/854: chown d1/d2/db/lcd 933047 1 2024-02-15T22:50:59.376 INFO:tasks.workunit.client.0.smithi138.stdout:7/855: chown d1/d79/d84/da0/ddf/cf1 2 1 2024-02-15T22:50:59.384 INFO:tasks.workunit.client.0.smithi138.stdout:7/856: dread d1/d2/f1d [0,4194304] 0 2024-02-15T22:50:59.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/857: rename d1/d2/f9f to d1/d2/d29/f124 0 2024-02-15T22:50:59.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/858: dread - d1/d79/d84/d8c/fa7 zero size 2024-02-15T22:50:59.386 INFO:tasks.workunit.client.0.smithi138.stdout:7/859: dread - d1/d5a/d97/dfc/f108 zero size 2024-02-15T22:50:59.387 INFO:tasks.workunit.client.0.smithi138.stdout:7/860: symlink d1/d2/l125 0 2024-02-15T22:50:59.387 INFO:tasks.workunit.client.0.smithi138.stdout:7/861: creat d1/d2/db/f126 x:0 0 0 2024-02-15T22:50:59.390 INFO:tasks.workunit.client.0.smithi138.stdout:7/862: rename d1/d5a/d97/dfc to d1/d79/d127 0 2024-02-15T22:50:59.391 INFO:tasks.workunit.client.0.smithi138.stdout:9/855: dwrite d0/de/d48/d70/f11d [0,4194304] 0 2024-02-15T22:50:59.391 INFO:tasks.workunit.client.0.smithi138.stdout:7/863: mkdir d1/d2/d128 0 2024-02-15T22:50:59.391 INFO:tasks.workunit.client.0.smithi138.stdout:7/864: write d1/d2/db/f16 [1572523,89597] 0 2024-02-15T22:50:59.395 INFO:tasks.workunit.client.0.smithi138.stdout:9/856: symlink d0/de/d34/d89/l12b 0 2024-02-15T22:50:59.396 INFO:tasks.workunit.client.0.smithi138.stdout:9/857: fdatasync d0/d4/f80 0 2024-02-15T22:50:59.396 INFO:tasks.workunit.client.0.smithi138.stdout:9/858: truncate d0/de/d14/d18/d10d/d116/d121/f86 400526 0 2024-02-15T22:50:59.396 INFO:tasks.workunit.client.0.smithi138.stdout:9/859: chown d0/df/d11/f10c 162107575 1 2024-02-15T22:50:59.414 INFO:tasks.workunit.client.0.smithi138.stdout:7/865: dwrite d1/f40 [0,4194304] 0 2024-02-15T22:50:59.414 INFO:tasks.workunit.client.0.smithi138.stdout:7/866: creat d1/f129 x:0 0 0 2024-02-15T22:50:59.415 INFO:tasks.workunit.client.0.smithi138.stdout:7/867: truncate d1/d79/d84/f10c 951469 0 2024-02-15T22:50:59.415 INFO:tasks.workunit.client.0.smithi138.stdout:9/860: dwrite d0/de/d33/f7f [0,4194304] 0 2024-02-15T22:50:59.417 INFO:tasks.workunit.client.0.smithi138.stdout:9/861: getdents d0/de/d14/dbd 0 2024-02-15T22:50:59.419 INFO:tasks.workunit.client.0.smithi138.stdout:9/862: symlink d0/de/d34/dd3/dec/d120/l12c 0 2024-02-15T22:50:59.419 INFO:tasks.workunit.client.0.smithi138.stdout:9/863: mknod d0/de/d14/d22/c12d 0 2024-02-15T22:50:59.419 INFO:tasks.workunit.client.0.smithi138.stdout:9/864: write d0/df/f56 [581647,126399] 0 2024-02-15T22:50:59.421 INFO:tasks.workunit.client.0.smithi138.stdout:9/865: unlink d0/de/d34/dd3/f107 0 2024-02-15T22:50:59.421 INFO:tasks.workunit.client.0.smithi138.stdout:9/866: read - d0/d1/db8/f112 zero size 2024-02-15T22:50:59.421 INFO:tasks.workunit.client.0.smithi138.stdout:9/867: chown d0/de/d34/f75 0 1 2024-02-15T22:50:59.421 INFO:tasks.workunit.client.0.smithi138.stdout:9/868: write d0/f27 [724458,116514] 0 2024-02-15T22:50:59.422 INFO:tasks.workunit.client.0.smithi138.stdout:9/869: fsync d0/de/d48/d70/fa7 0 2024-02-15T22:50:59.422 INFO:tasks.workunit.client.0.smithi138.stdout:9/870: dread - d0/df/d11/f10c zero size 2024-02-15T22:50:59.422 INFO:tasks.workunit.client.0.smithi138.stdout:9/871: symlink d0/de/d14/d22/l12e 0 2024-02-15T22:50:59.443 INFO:tasks.workunit.client.0.smithi138.stdout:9/872: dwrite d0/de/d14/d22/ffc [0,4194304] 0 2024-02-15T22:50:59.444 INFO:tasks.workunit.client.0.smithi138.stdout:7/868: dwrite d1/d2/fc3 [0,4194304] 0 2024-02-15T22:50:59.444 INFO:tasks.workunit.client.0.smithi138.stdout:7/869: write d1/d79/ff3 [4927423,48396] 0 2024-02-15T22:50:59.447 INFO:tasks.workunit.client.0.smithi138.stdout:7/870: mkdir d1/d12a 0 2024-02-15T22:50:59.448 INFO:tasks.workunit.client.0.smithi138.stdout:7/871: getdents d1/d79/d84/da0 0 2024-02-15T22:50:59.450 INFO:tasks.workunit.client.0.smithi138.stdout:7/872: truncate d1/d79/d84/da0/ddf/fce 954911 0 2024-02-15T22:50:59.450 INFO:tasks.workunit.client.0.smithi138.stdout:7/873: truncate d1/d2/db/fb0 906564 0 2024-02-15T22:50:59.452 INFO:tasks.workunit.client.0.smithi138.stdout:7/874: rmdir d1/d12a 0 2024-02-15T22:50:59.455 INFO:tasks.workunit.client.0.smithi138.stdout:7/875: creat d1/d79/d84/d8c/f12b x:0 0 0 2024-02-15T22:50:59.455 INFO:tasks.workunit.client.0.smithi138.stdout:7/876: chown d1/d2/l11c 182 1 2024-02-15T22:50:59.459 INFO:tasks.workunit.client.0.smithi138.stdout:7/877: mkdir d1/d5a/d12c 0 2024-02-15T22:50:59.465 INFO:tasks.workunit.client.0.smithi138.stdout:7/878: truncate d1/d2/db/d3c/d4d/f52 4295976 0 2024-02-15T22:50:59.467 INFO:tasks.workunit.client.0.smithi138.stdout:9/873: dwrite d0/de/d14/dbd/fe3 [0,4194304] 0 2024-02-15T22:50:59.469 INFO:tasks.workunit.client.0.smithi138.stdout:9/874: truncate d0/de/d14/d18/fef 878069 0 2024-02-15T22:50:59.483 INFO:tasks.workunit.client.0.smithi138.stdout:7/879: dwrite d1/d2/db/f1c [0,4194304] 0 2024-02-15T22:50:59.484 INFO:tasks.workunit.client.0.smithi138.stdout:7/880: rmdir d1/d79/d127 39 2024-02-15T22:50:59.485 INFO:tasks.workunit.client.0.smithi138.stdout:7/881: stat d1/d2/d29/l66 0 2024-02-15T22:50:59.485 INFO:tasks.workunit.client.0.smithi138.stdout:7/882: fdatasync d1/d109/fc8 0 2024-02-15T22:50:59.486 INFO:tasks.workunit.client.0.smithi138.stdout:7/883: getdents d1/d79/d84/da0/ddf 0 2024-02-15T22:50:59.486 INFO:tasks.workunit.client.0.smithi138.stdout:7/884: readlink d1/d2/db/d25/l4b 0 2024-02-15T22:50:59.488 INFO:tasks.workunit.client.0.smithi138.stdout:7/885: rmdir d1/d2/d29 39 2024-02-15T22:50:59.488 INFO:tasks.workunit.client.0.smithi138.stdout:7/886: truncate d1/d2/db/d3c/d4d/d5b/f89 719302 0 2024-02-15T22:50:59.489 INFO:tasks.workunit.client.0.smithi138.stdout:9/875: dwrite d0/d55/d59/f5f [0,4194304] 0 2024-02-15T22:50:59.489 INFO:tasks.workunit.client.0.smithi138.stdout:9/876: creat d0/de/d34/d89/d117/f12f x:0 0 0 2024-02-15T22:50:59.489 INFO:tasks.workunit.client.0.smithi138.stdout:7/887: symlink d1/d2/db/d3c/d4d/l12d 0 2024-02-15T22:50:59.492 INFO:tasks.workunit.client.0.smithi138.stdout:9/877: unlink d0/de/d48/d70/f11d 0 2024-02-15T22:50:59.493 INFO:tasks.workunit.client.0.smithi138.stdout:7/888: symlink d1/d5a/d97/l12e 0 2024-02-15T22:50:59.501 INFO:tasks.workunit.client.0.smithi138.stdout:9/878: write d0/d1/faa [3454636,76963] 0 2024-02-15T22:50:59.501 INFO:tasks.workunit.client.0.smithi138.stdout:4/786: sync 2024-02-15T22:50:59.502 INFO:tasks.workunit.client.0.smithi138.stdout:9/879: dread d0/d4/f2b [0,4194304] 0 2024-02-15T22:50:59.502 INFO:tasks.workunit.client.0.smithi138.stdout:4/787: mknod d17/d1e/d2d/d36/dca/c100 0 2024-02-15T22:50:59.503 INFO:tasks.workunit.client.0.smithi138.stdout:9/880: mknod d0/dc7/c130 0 2024-02-15T22:50:59.504 INFO:tasks.workunit.client.0.smithi138.stdout:4/788: symlink d17/d1e/d2d/d36/d3e/d64/l101 0 2024-02-15T22:50:59.504 INFO:tasks.workunit.client.0.smithi138.stdout:4/789: chown d17/d1e/d2d/d36/d3e/d64 2029 1 2024-02-15T22:50:59.504 INFO:tasks.workunit.client.0.smithi138.stdout:9/881: symlink d0/de/d34/d11f/l131 0 2024-02-15T22:50:59.505 INFO:tasks.workunit.client.0.smithi138.stdout:4/790: rename d17/fc1 to d17/d1e/d2d/dc7/f102 0 2024-02-15T22:50:59.507 INFO:tasks.workunit.client.0.smithi138.stdout:4/791: rename d17/d1e/d2d/d36/dca/led to d17/d2b/dd8/l103 0 2024-02-15T22:50:59.510 INFO:tasks.workunit.client.0.smithi138.stdout:7/889: dwrite d1/d2/d29/fd9 [0,4194304] 0 2024-02-15T22:50:59.510 INFO:tasks.workunit.client.0.smithi138.stdout:9/882: dread d0/f27 [0,4194304] 0 2024-02-15T22:50:59.512 INFO:tasks.workunit.client.0.smithi138.stdout:9/883: rename d0/de/d14/l21 to d0/de/d34/d89/d117/l132 0 2024-02-15T22:50:59.513 INFO:tasks.workunit.client.0.smithi138.stdout:9/884: creat d0/dc7/f133 x:0 0 0 2024-02-15T22:50:59.513 INFO:tasks.workunit.client.0.smithi138.stdout:9/885: write d0/de/d34/d89/f7e [1002400,33186] 0 2024-02-15T22:50:59.513 INFO:tasks.workunit.client.0.smithi138.stdout:9/886: dread - d0/de/d14/d22/f10a zero size 2024-02-15T22:50:59.516 INFO:tasks.workunit.client.0.smithi138.stdout:4/792: dread d17/d1e/d2d/d36/fe4 [0,4194304] 0 2024-02-15T22:50:59.517 INFO:tasks.workunit.client.0.smithi138.stdout:4/793: mknod d17/d2b/c104 0 2024-02-15T22:50:59.518 INFO:tasks.workunit.client.0.smithi138.stdout:7/890: write d1/d2/d29/f124 [2935974,24712] 0 2024-02-15T22:50:59.518 INFO:tasks.workunit.client.0.smithi138.stdout:4/794: link d17/d2b/ffc d17/d2b/d78/dc0/f105 0 2024-02-15T22:50:59.518 INFO:tasks.workunit.client.0.smithi138.stdout:4/795: readlink d17/d2b/d78/dc0/lfb 0 2024-02-15T22:50:59.518 INFO:tasks.workunit.client.0.smithi138.stdout:4/796: dread - d17/d1e/fcd zero size 2024-02-15T22:50:59.519 INFO:tasks.workunit.client.0.smithi138.stdout:4/797: readlink d17/d1e/d2d/d36/d3e/d64/l57 0 2024-02-15T22:50:59.519 INFO:tasks.workunit.client.0.smithi138.stdout:7/891: truncate d1/d2/f1d 249576 0 2024-02-15T22:50:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:7/892: creat d1/d2/db/d3c/d4d/d63/f12f x:0 0 0 2024-02-15T22:50:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:7/893: creat d1/d2/db/d25/d41/f130 x:0 0 0 2024-02-15T22:50:59.523 INFO:tasks.workunit.client.0.smithi138.stdout:9/887: rename d0/de/d48 to d0/de/d14/d18/d10d/d116/d121/d7b/d9e/da1/d134 0 2024-02-15T22:50:59.526 INFO:tasks.workunit.client.0.smithi138.stdout:9/888: truncate d0/de/d14/f66 1890213 0 2024-02-15T22:50:59.526 INFO:tasks.workunit.client.0.smithi138.stdout:9/889: stat d0/de/d14/da3/dc8 0 2024-02-15T22:50:59.535 INFO:tasks.workunit.client.0.smithi138.stdout:9/890: unlink d0/d1/db8/f10b 0 2024-02-15T22:50:59.539 INFO:tasks.workunit.client.0.smithi138.stdout:9/891: mknod d0/de/d14/d18/d10d/c135 0 2024-02-15T22:50:59.541 INFO:tasks.workunit.client.0.smithi138.stdout:9/892: link d0/de/d34/d89/l6f d0/l136 0 2024-02-15T22:50:59.541 INFO:tasks.workunit.client.0.smithi138.stdout:9/893: chown d0/fe8 76499601 1 2024-02-15T22:50:59.542 INFO:tasks.workunit.client.0.smithi138.stdout:9/894: creat d0/de/d14/d18/d10d/d116/f137 x:0 0 0 2024-02-15T22:50:59.543 INFO:tasks.workunit.client.0.smithi138.stdout:9/895: link d0/de/d34/fe1 d0/d1/db8/d126/f138 0 2024-02-15T22:50:59.544 INFO:tasks.workunit.client.0.smithi138.stdout:9/896: mkdir d0/d55/d139 0 2024-02-15T22:50:59.545 INFO:tasks.workunit.client.0.smithi138.stdout:9/897: rename d0/de/d33/d98/da6/cd9 to d0/de/d34/d89/c13a 0 2024-02-15T22:50:59.545 INFO:tasks.workunit.client.0.smithi138.stdout:9/898: readlink d0/d4/l73 0 2024-02-15T22:50:59.551 INFO:tasks.workunit.client.0.smithi138.stdout:9/899: write d0/fe8 [4031293,87377] 0 2024-02-15T22:50:59.553 INFO:tasks.workunit.client.0.smithi138.stdout:9/900: unlink d0/de/d14/da3/dc8/d6a/l92 0 2024-02-15T22:50:59.631 INFO:tasks.workunit.client.0.smithi138.stdout:0/677: sync 2024-02-15T22:50:59.631 INFO:tasks.workunit.client.0.smithi138.stdout:8/735: sync 2024-02-15T22:50:59.631 INFO:tasks.workunit.client.0.smithi138.stdout:0/678: mknod d6/d10/d34/dcf/cf4 0 2024-02-15T22:50:59.647 INFO:tasks.workunit.client.0.smithi138.stdout:0/679: dwrite d6/d10/d52/d6f/fbd [0,4194304] 0 2024-02-15T22:50:59.649 INFO:tasks.workunit.client.0.smithi138.stdout:0/680: rmdir d6/d10/d34 39 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:6/603: sync 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:2/602: sync 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:3/743: sync 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:1/506: sync 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:5/601: sync 2024-02-15T22:50:59.687 INFO:tasks.workunit.client.0.smithi138.stdout:5/602: fsync df/d18/f6f 0 2024-02-15T22:50:59.688 INFO:tasks.workunit.client.0.smithi138.stdout:6/604: dread - dc/d24/d34/d3b/d7d/fae zero size 2024-02-15T22:50:59.688 INFO:tasks.workunit.client.0.smithi138.stdout:3/744: read - d5/d16/dc/d43/fd3 zero size 2024-02-15T22:50:59.688 INFO:tasks.workunit.client.0.smithi138.stdout:6/605: chown dc/d4b/d98/fb2 34938 1 2024-02-15T22:50:59.688 INFO:tasks.workunit.client.0.smithi138.stdout:2/603: write d0/f51 [235287,80775] 0 2024-02-15T22:50:59.692 INFO:tasks.workunit.client.0.smithi138.stdout:5/603: dread f5 [0,4194304] 0 2024-02-15T22:50:59.692 INFO:tasks.workunit.client.0.smithi138.stdout:5/604: write fb [5531963,22575] 0 2024-02-15T22:50:59.692 INFO:tasks.workunit.client.0.smithi138.stdout:5/605: fsync df/d18/f97 0 2024-02-15T22:50:59.693 INFO:tasks.workunit.client.0.smithi138.stdout:5/606: write df/f13 [942260,43203] 0 2024-02-15T22:50:59.697 INFO:tasks.workunit.client.0.smithi138.stdout:2/604: dread d0/da/d19/d53/fd1 [0,4194304] 0 2024-02-15T22:50:59.702 INFO:tasks.workunit.client.0.smithi138.stdout:2/605: dread d0/da/f8 [0,4194304] 0 2024-02-15T22:50:59.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/606: truncate d0/da/d19/d53/d5d/d6d/d97/f99 331388 0 2024-02-15T22:50:59.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/607: creat d0/da/d19/d53/d5d/d74/d79/fd3 x:0 0 0 2024-02-15T22:50:59.703 INFO:tasks.workunit.client.0.smithi138.stdout:2/608: write d0/da/d19/d53/d5d/d6d/d7b/fac [815224,66686] 0 2024-02-15T22:50:59.709 INFO:tasks.workunit.client.0.smithi138.stdout:1/507: link df/f53 df/d1b/d1d/d25/fa6 0 2024-02-15T22:50:59.710 INFO:tasks.workunit.client.0.smithi138.stdout:1/508: readlink df/d1b/d1d/d25/d2e/d6c/la5 0 2024-02-15T22:50:59.712 INFO:tasks.workunit.client.0.smithi138.stdout:3/745: rename d5/d16/dc/d43/d47/l74 to d5/d12/d23/d94/lf3 0 2024-02-15T22:50:59.712 INFO:tasks.workunit.client.0.smithi138.stdout:3/746: chown d5/d12/d26/c5f 456120 1 2024-02-15T22:50:59.715 INFO:tasks.workunit.client.0.smithi138.stdout:5/607: truncate fc 2791151 0 2024-02-15T22:50:59.716 INFO:tasks.workunit.client.0.smithi138.stdout:5/608: write df/d18/d3e/d60/d65/fa6 [126311,60283] 0 2024-02-15T22:50:59.716 INFO:tasks.workunit.client.0.smithi138.stdout:2/609: chown d0/c29 482631 1 2024-02-15T22:50:59.716 INFO:tasks.workunit.client.0.smithi138.stdout:2/610: chown d0/da/d19/d53/d5d/d6d/c77 66911807 1 2024-02-15T22:50:59.720 INFO:tasks.workunit.client.0.smithi138.stdout:1/509: symlink df/d1b/d1d/d25/d2e/d5b/d65/d86/la7 0 2024-02-15T22:50:59.720 INFO:tasks.workunit.client.0.smithi138.stdout:1/510: write df/d1b/d1d/d24/d3a/f89 [998702,91241] 0 2024-02-15T22:50:59.720 INFO:tasks.workunit.client.0.smithi138.stdout:1/511: write df/d1b/d33/f9d [1808449,120728] 0 2024-02-15T22:50:59.721 INFO:tasks.workunit.client.0.smithi138.stdout:6/606: rmdir dc/d24/d6c 39 2024-02-15T22:50:59.721 INFO:tasks.workunit.client.0.smithi138.stdout:6/607: dread - dc/d24/d34/d3b/d7c/da8/fbf zero size 2024-02-15T22:50:59.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/747: creat d5/d16/dc/d43/d57/d5d/ff4 x:0 0 0 2024-02-15T22:50:59.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/748: stat d5/d12/d23/d29/d4f/f92 0 2024-02-15T22:50:59.723 INFO:tasks.workunit.client.0.smithi138.stdout:3/749: fdatasync d5/d16/dc/d43/d47/d67/f87 0 2024-02-15T22:50:59.724 INFO:tasks.workunit.client.0.smithi138.stdout:3/750: write d5/d12/d23/da1/fdd [740714,42533] 0 2024-02-15T22:50:59.724 INFO:tasks.workunit.client.0.smithi138.stdout:5/609: rmdir df/d18/d77 39 2024-02-15T22:50:59.724 INFO:tasks.workunit.client.0.smithi138.stdout:1/512: rmdir df/d1b/d1d/d25/d2e/d6c 39 2024-02-15T22:50:59.728 INFO:tasks.workunit.client.0.smithi138.stdout:6/608: symlink dc/d4b/d7b/ld4 0 2024-02-15T22:50:59.728 INFO:tasks.workunit.client.0.smithi138.stdout:3/751: symlink d5/d16/dc/d43/da2/dc6/lf5 0 2024-02-15T22:50:59.729 INFO:tasks.workunit.client.0.smithi138.stdout:1/513: link df/d1b/d1d/d25/d2e/d6c/f94 df/d1b/d1d/d25/d2e/d5b/d65/d80/fa8 0 2024-02-15T22:50:59.729 INFO:tasks.workunit.client.0.smithi138.stdout:6/609: symlink dc/d24/d6c/dbc/ld5 0 2024-02-15T22:50:59.729 INFO:tasks.workunit.client.0.smithi138.stdout:3/752: symlink d5/d16/dc/d43/d47/d67/lf6 0 2024-02-15T22:50:59.730 INFO:tasks.workunit.client.0.smithi138.stdout:2/611: dwrite d0/da/fb4 [0,4194304] 0 2024-02-15T22:50:59.730 INFO:tasks.workunit.client.0.smithi138.stdout:1/514: link df/d1b/d21/la4 df/d1b/d1d/d25/d2e/d5b/la9 0 2024-02-15T22:50:59.731 INFO:tasks.workunit.client.0.smithi138.stdout:1/515: write df/d1b/d1d/d25/d2e/d37/f45 [588545,17490] 0 2024-02-15T22:50:59.733 INFO:tasks.workunit.client.0.smithi138.stdout:2/612: mkdir d0/da/d19/d53/d80/dd4 0 2024-02-15T22:50:59.735 INFO:tasks.workunit.client.0.smithi138.stdout:1/516: mknod df/d1b/d1d/caa 0 2024-02-15T22:50:59.735 INFO:tasks.workunit.client.0.smithi138.stdout:1/517: creat df/d1b/d1d/d25/d8d/fab x:0 0 0 2024-02-15T22:50:59.736 INFO:tasks.workunit.client.0.smithi138.stdout:5/610: dread df/d18/d2b/f49 [0,4194304] 0 2024-02-15T22:50:59.736 INFO:tasks.workunit.client.0.smithi138.stdout:2/613: truncate d0/da/d19/f54 3436334 0 2024-02-15T22:50:59.740 INFO:tasks.workunit.client.0.smithi138.stdout:1/518: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a 0 2024-02-15T22:50:59.742 INFO:tasks.workunit.client.0.smithi138.stdout:6/610: dread dc/d24/f26 [4194304,4194304] 0 2024-02-15T22:50:59.742 INFO:tasks.workunit.client.0.smithi138.stdout:2/614: creat d0/dd/d9d/fd5 x:0 0 0 2024-02-15T22:50:59.744 INFO:tasks.workunit.client.0.smithi138.stdout:1/519: link df/d1b/d1d/l82 df/d1b/d1d/d25/d2e/d37/lac 0 2024-02-15T22:50:59.744 INFO:tasks.workunit.client.0.smithi138.stdout:1/520: fsync df/d1b/d1d/d25/d2e/d37/f81 0 2024-02-15T22:50:59.746 INFO:tasks.workunit.client.0.smithi138.stdout:6/611: mkdir dc/d4b/d98/dd6 0 2024-02-15T22:50:59.746 INFO:tasks.workunit.client.0.smithi138.stdout:6/612: write dc/d4b/d7b/fbb [555365,20982] 0 2024-02-15T22:50:59.751 INFO:tasks.workunit.client.0.smithi138.stdout:2/615: write d0/da/fb4 [1614144,108247] 0 2024-02-15T22:50:59.752 INFO:tasks.workunit.client.0.smithi138.stdout:2/616: fdatasync d0/dd/d15/f4b 0 2024-02-15T22:50:59.752 INFO:tasks.workunit.client.0.smithi138.stdout:2/617: fsync d0/da/d19/d3f/fa8 0 2024-02-15T22:50:59.752 INFO:tasks.workunit.client.0.smithi138.stdout:2/618: creat d0/da/d19/d53/d5d/d83/fd6 x:0 0 0 2024-02-15T22:50:59.753 INFO:tasks.workunit.client.0.smithi138.stdout:2/619: mknod d0/da/d19/cd7 0 2024-02-15T22:50:59.753 INFO:tasks.workunit.client.0.smithi138.stdout:2/620: write d0/dd/d9d/fd5 [33669,112861] 0 2024-02-15T22:50:59.755 INFO:tasks.workunit.client.0.smithi138.stdout:2/621: mkdir d0/da/d19/d53/d5d/d6d/dd8 0 2024-02-15T22:50:59.755 INFO:tasks.workunit.client.0.smithi138.stdout:2/622: chown d0/da/d19/d53/d5d/d6d/d97/f9a 184592 1 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:2/623: rename d0/da/d19/f81 to d0/dd/fd9 0 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:3/753: dwrite d5/d12/d23/f51 [4194304,4194304] 0 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:2/624: write d0/f87 [2133496,105284] 0 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:1/521: read df/d1b/d1d/d24/f38 [1039146,123924] 0 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:1/522: chown df/d1b/d21/f32 8744508 1 2024-02-15T22:50:59.757 INFO:tasks.workunit.client.0.smithi138.stdout:1/523: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f 0 2024-02-15T22:50:59.758 INFO:tasks.workunit.client.0.smithi138.stdout:5/611: dwrite df/d18/d3e/d60/f8f [0,4194304] 0 2024-02-15T22:50:59.759 INFO:tasks.workunit.client.0.smithi138.stdout:3/754: mknod d5/d95/cf7 0 2024-02-15T22:50:59.762 INFO:tasks.workunit.client.0.smithi138.stdout:2/625: truncate d0/da/d19/f39 3568878 0 2024-02-15T22:50:59.762 INFO:tasks.workunit.client.0.smithi138.stdout:2/626: write d0/f37 [3886973,127682] 0 2024-02-15T22:50:59.762 INFO:tasks.workunit.client.0.smithi138.stdout:1/524: dread df/f14 [0,4194304] 0 2024-02-15T22:50:59.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/612: mkdir df/d18/d56/dc6 0 2024-02-15T22:50:59.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/613: read - df/d18/d56/dae/fbc zero size 2024-02-15T22:50:59.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/614: write df/d18/d3e/f3f [335782,22408] 0 2024-02-15T22:50:59.768 INFO:tasks.workunit.client.0.smithi138.stdout:3/755: creat d5/d12/d23/d29/d4f/ff8 x:0 0 0 2024-02-15T22:50:59.769 INFO:tasks.workunit.client.0.smithi138.stdout:3/756: creat d5/d16/dc/d43/d57/d5d/ff9 x:0 0 0 2024-02-15T22:50:59.770 INFO:tasks.workunit.client.0.smithi138.stdout:5/615: stat df/d18/d3e/d51/l80 0 2024-02-15T22:50:59.771 INFO:tasks.workunit.client.0.smithi138.stdout:3/757: creat d5/d16/dc/d43/d57/ffa x:0 0 0 2024-02-15T22:50:59.818 INFO:tasks.workunit.client.0.smithi138.stdout:1/525: rmdir df/d1b/d1d/d24 39 2024-02-15T22:50:59.818 INFO:tasks.workunit.client.0.smithi138.stdout:1/526: stat df/d1b/d1d/d24/d3a/f40 0 2024-02-15T22:50:59.819 INFO:tasks.workunit.client.0.smithi138.stdout:5/616: creat df/d18/d3e/d60/d72/da5/fc7 x:0 0 0 2024-02-15T22:50:59.821 INFO:tasks.workunit.client.0.smithi138.stdout:1/527: creat df/d1b/d1d/d25/d2e/d5b/d65/fad x:0 0 0 2024-02-15T22:50:59.822 INFO:tasks.workunit.client.0.smithi138.stdout:1/528: dread - df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e zero size 2024-02-15T22:50:59.822 INFO:tasks.workunit.client.0.smithi138.stdout:1/529: truncate df/d1b/d1d/d24/d3a/f44 4226960 0 2024-02-15T22:50:59.822 INFO:tasks.workunit.client.0.smithi138.stdout:5/617: creat df/d18/d3e/d60/d65/d7f/d90/fc8 x:0 0 0 2024-02-15T22:50:59.827 INFO:tasks.workunit.client.0.smithi138.stdout:2/627: truncate d0/f37 969717 0 2024-02-15T22:50:59.828 INFO:tasks.workunit.client.0.smithi138.stdout:5/618: rename df/d18/d2b to df/d18/d3e/d51/dc9 0 2024-02-15T22:50:59.829 INFO:tasks.workunit.client.0.smithi138.stdout:2/628: getdents d0/da/d19/d53/d5d/d6d 0 2024-02-15T22:50:59.831 INFO:tasks.workunit.client.0.smithi138.stdout:5/619: creat df/d18/d77/fca x:0 0 0 2024-02-15T22:50:59.831 INFO:tasks.workunit.client.0.smithi138.stdout:5/620: chown df/d18/d3e/d51/dc9/c40 969 1 2024-02-15T22:50:59.831 INFO:tasks.workunit.client.0.smithi138.stdout:5/621: fdatasync df/d18/d3e/f4e 0 2024-02-15T22:50:59.831 INFO:tasks.workunit.client.0.smithi138.stdout:5/622: write df/d18/d56/f5d [1818585,129781] 0 2024-02-15T22:50:59.832 INFO:tasks.workunit.client.0.smithi138.stdout:2/629: unlink d0/dd/d15/l4d 0 2024-02-15T22:50:59.832 INFO:tasks.workunit.client.0.smithi138.stdout:2/630: stat d0/da/f9c 0 2024-02-15T22:50:59.834 INFO:tasks.workunit.client.0.smithi138.stdout:5/623: rename df/d18/d3e/d60/d65/f88 to df/d18/d56/dae/fcb 0 2024-02-15T22:50:59.835 INFO:tasks.workunit.client.0.smithi138.stdout:4/798: sync 2024-02-15T22:50:59.835 INFO:tasks.workunit.client.0.smithi138.stdout:4/799: truncate d17/d1e/d2d/dd5/ff5 916913 0 2024-02-15T22:50:59.835 INFO:tasks.workunit.client.0.smithi138.stdout:4/800: read - d17/d1e/d2d/d52/fe8 zero size 2024-02-15T22:50:59.837 INFO:tasks.workunit.client.0.smithi138.stdout:2/631: dread d0/dd/d15/d65/f76 [0,4194304] 0 2024-02-15T22:50:59.839 INFO:tasks.workunit.client.0.smithi138.stdout:4/801: getdents d17/d2b/d78 0 2024-02-15T22:50:59.839 INFO:tasks.workunit.client.0.smithi138.stdout:4/802: write d17/d1e/d2d/d36/d3e/d64/fd3 [850936,63822] 0 2024-02-15T22:50:59.841 INFO:tasks.workunit.client.0.smithi138.stdout:2/632: rmdir d0/da/d19/d53/d5d/d6d/d7b 39 2024-02-15T22:50:59.844 INFO:tasks.workunit.client.0.smithi138.stdout:4/803: unlink d17/d1a/l8f 0 2024-02-15T22:50:59.846 INFO:tasks.workunit.client.0.smithi138.stdout:2/633: rename d0/f37 to d0/da/d19/d53/d5d/d6d/d7b/fda 0 2024-02-15T22:50:59.847 INFO:tasks.workunit.client.0.smithi138.stdout:4/804: readlink d17/lad 0 2024-02-15T22:50:59.848 INFO:tasks.workunit.client.0.smithi138.stdout:2/634: link d0/dd/d15/c41 d0/dd/d9d/cdb 0 2024-02-15T22:50:59.850 INFO:tasks.workunit.client.0.smithi138.stdout:4/805: creat d17/d1e/d2d/d36/d3e/f106 x:0 0 0 2024-02-15T22:50:59.851 INFO:tasks.workunit.client.0.smithi138.stdout:4/806: mkdir d17/d2b/dd8/d107 0 2024-02-15T22:50:59.851 INFO:tasks.workunit.client.0.smithi138.stdout:4/807: readlink d17/d1e/d2d/d36/l40 0 2024-02-15T22:50:59.857 INFO:tasks.workunit.client.0.smithi138.stdout:2/635: write d0/dd/fd9 [1213918,73279] 0 2024-02-15T22:50:59.857 INFO:tasks.workunit.client.0.smithi138.stdout:2/636: fsync d0/da/d19/d53/d5d/d74/d79/f89 0 2024-02-15T22:50:59.858 INFO:tasks.workunit.client.0.smithi138.stdout:2/637: mknod d0/da/d19/d53/d5d/dcc/cdc 0 2024-02-15T22:50:59.858 INFO:tasks.workunit.client.0.smithi138.stdout:2/638: stat d0/dd/d15/c1e 0 2024-02-15T22:50:59.859 INFO:tasks.workunit.client.0.smithi138.stdout:2/639: creat d0/da/d19/d53/d5d/d6d/d7b/fdd x:0 0 0 2024-02-15T22:50:59.861 INFO:tasks.workunit.client.0.smithi138.stdout:2/640: rmdir d0/dd/d15/d72/dbd/dce 0 2024-02-15T22:50:59.861 INFO:tasks.workunit.client.0.smithi138.stdout:2/641: fdatasync d0/d3/f5e 0 2024-02-15T22:50:59.861 INFO:tasks.workunit.client.0.smithi138.stdout:4/808: dread d17/d1e/d2d/d36/d3e/d64/f41 [0,4194304] 0 2024-02-15T22:50:59.861 INFO:tasks.workunit.client.0.smithi138.stdout:4/809: chown d17/d2b/d78/cd0 39854037 1 2024-02-15T22:50:59.862 INFO:tasks.workunit.client.0.smithi138.stdout:2/642: mkdir d0/da/d19/d53/d80/dd4/dde 0 2024-02-15T22:50:59.862 INFO:tasks.workunit.client.0.smithi138.stdout:4/810: creat d17/d2b/d78/dc0/f108 x:0 0 0 2024-02-15T22:50:59.863 INFO:tasks.workunit.client.0.smithi138.stdout:2/643: mkdir d0/dd/d15/ddf 0 2024-02-15T22:50:59.863 INFO:tasks.workunit.client.0.smithi138.stdout:2/644: write d0/da/d95/fa1 [668857,85044] 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:4/811: mknod d17/d1e/d2d/d8c/c109 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/624: dwrite df/f83 [0,4194304] 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/625: fdatasync df/d18/d3e/d60/d65/d7f/d90/fc8 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/626: read df/d18/d3e/d66/f79 [2780091,126264] 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/627: write df/d18/d3e/d51/dc9/f4d [1223829,121183] 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:1/530: dwrite df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f64 [0,4194304] 0 2024-02-15T22:50:59.865 INFO:tasks.workunit.client.0.smithi138.stdout:1/531: write df/d1b/d1d/d25/d2e/d5b/d65/d80/fa8 [533638,124330] 0 2024-02-15T22:50:59.867 INFO:tasks.workunit.client.0.smithi138.stdout:4/812: rename d17/d1e/d2d/d8c/f8e to d17/d1e/d2d/d36/dca/f10a 0 2024-02-15T22:50:59.869 INFO:tasks.workunit.client.0.smithi138.stdout:5/628: symlink df/d18/d77/lcc 0 2024-02-15T22:50:59.874 INFO:tasks.workunit.client.0.smithi138.stdout:4/813: mknod d17/d2b/dd8/d107/c10b 0 2024-02-15T22:50:59.875 INFO:tasks.workunit.client.0.smithi138.stdout:5/629: getdents df/d18/d3e/d8a 0 2024-02-15T22:50:59.882 INFO:tasks.workunit.client.0.smithi138.stdout:4/814: read d17/d1a/fd1 [945874,73879] 0 2024-02-15T22:50:59.882 INFO:tasks.workunit.client.0.smithi138.stdout:1/532: dwrite df/d1b/d1d/d24/d3a/f70 [0,4194304] 0 2024-02-15T22:50:59.884 INFO:tasks.workunit.client.0.smithi138.stdout:4/815: mknod d17/d1e/d2d/dd5/c10c 0 2024-02-15T22:50:59.885 INFO:tasks.workunit.client.0.smithi138.stdout:1/533: creat df/d1b/d1d/fae x:0 0 0 2024-02-15T22:50:59.886 INFO:tasks.workunit.client.0.smithi138.stdout:4/816: write d17/d1e/fd9 [8149,129477] 0 2024-02-15T22:50:59.887 INFO:tasks.workunit.client.0.smithi138.stdout:4/817: write d17/d1e/d2d/dc7/f102 [512507,47312] 0 2024-02-15T22:50:59.887 INFO:tasks.workunit.client.0.smithi138.stdout:4/818: chown d17/d1e/d2d/d36/l95 46107355 1 2024-02-15T22:50:59.895 INFO:tasks.workunit.client.0.smithi138.stdout:5/630: dwrite fb [0,4194304] 0 2024-02-15T22:50:59.895 INFO:tasks.workunit.client.0.smithi138.stdout:5/631: fsync df/d18/d56/f5a 0 2024-02-15T22:50:59.901 INFO:tasks.workunit.client.0.smithi138.stdout:1/534: dread df/d1b/d1d/d25/d2e/d5b/f6d [0,4194304] 0 2024-02-15T22:50:59.902 INFO:tasks.workunit.client.0.smithi138.stdout:1/535: mknod df/d1b/d1d/d25/d2e/d5b/d7b/caf 0 2024-02-15T22:50:59.903 INFO:tasks.workunit.client.0.smithi138.stdout:1/536: write df/d1b/d1d/d25/f42 [564143,86089] 0 2024-02-15T22:50:59.903 INFO:tasks.workunit.client.0.smithi138.stdout:7/894: sync 2024-02-15T22:50:59.903 INFO:tasks.workunit.client.0.smithi138.stdout:9/901: sync 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:5/632: write df/d18/f4a [3576016,20259] 0 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:5/633: creat df/d18/d56/dae/fcd x:0 0 0 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:5/634: dread - df/d18/d3e/d60/f99 zero size 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:9/902: mkdir d0/de/d14/d18/d10d/d116/d121/d13b 0 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:1/537: dread df/d1b/d33/f75 [0,4194304] 0 2024-02-15T22:50:59.905 INFO:tasks.workunit.client.0.smithi138.stdout:1/538: write df/d1b/d1d/fae [864396,19405] 0 2024-02-15T22:50:59.907 INFO:tasks.workunit.client.0.smithi138.stdout:5/635: truncate df/d18/d3e/d51/dc9/f4b 3516793 0 2024-02-15T22:50:59.908 INFO:tasks.workunit.client.0.smithi138.stdout:9/903: write d0/de/d14/d18/f49 [5013168,62611] 0 2024-02-15T22:50:59.908 INFO:tasks.workunit.client.0.smithi138.stdout:9/904: stat d0/de/d14/d18/d10d/d116/d121/d7b/d9e/da1/d134/d70/c118 0 2024-02-15T22:50:59.908 INFO:tasks.workunit.client.0.smithi138.stdout:4/819: dwrite d17/d1e/d2d/dc7/f102 [0,4194304] 0 2024-02-15T22:50:59.908 INFO:tasks.workunit.client.0.smithi138.stdout:4/820: creat d17/d1e/d2d/d52/f10d x:0 0 0 2024-02-15T22:50:59.910 INFO:tasks.workunit.client.0.smithi138.stdout:1/539: creat df/d1b/d1d/d25/d2e/d5b/fb0 x:0 0 0 2024-02-15T22:50:59.911 INFO:tasks.workunit.client.0.smithi138.stdout:5/636: creat df/d18/d3e/d51/dc9/d9c/fce x:0 0 0 2024-02-15T22:50:59.914 INFO:tasks.workunit.client.0.smithi138.stdout:9/905: creat d0/d55/d59/f13c x:0 0 0 2024-02-15T22:50:59.916 INFO:tasks.workunit.client.0.smithi138.stdout:4/821: mknod d17/d1e/d56/c10e 0 2024-02-15T22:50:59.916 INFO:tasks.workunit.client.0.smithi138.stdout:4/822: write d17/d2b/f80 [635935,12223] 0 2024-02-15T22:50:59.917 INFO:tasks.workunit.client.0.smithi138.stdout:1/540: rename df/d1b/d1d/d25/d2e/d5b/d65/fad to df/d1b/d33/fb1 0 2024-02-15T22:50:59.919 INFO:tasks.workunit.client.0.smithi138.stdout:9/906: creat d0/de/d14/d18/d10d/d116/d121/d7b/d9e/f13d x:0 0 0 2024-02-15T22:50:59.921 INFO:tasks.workunit.client.0.smithi138.stdout:4/823: mknod d17/d1e/db8/c10f 0 2024-02-15T22:50:59.922 INFO:tasks.workunit.client.0.smithi138.stdout:7/895: dwrite d1/d2/db/d3c/d4d/d63/f12f [0,4194304] 0 2024-02-15T22:50:59.922 INFO:tasks.workunit.client.0.smithi138.stdout:7/896: chown d1/d2/db/d3c/d4d/d5b/d103 942 1 2024-02-15T22:50:59.922 INFO:tasks.workunit.client.0.smithi138.stdout:1/541: mknod df/d1b/d1d/d25/d2e/cb2 0 2024-02-15T22:50:59.931 INFO:tasks.workunit.client.0.smithi138.stdout:5/637: rmdir df/d18/d3e/d60 39 2024-02-15T22:50:59.933 INFO:tasks.workunit.client.0.smithi138.stdout:4/824: symlink d17/d2b/dd8/d107/l110 0 2024-02-15T22:50:59.935 INFO:tasks.workunit.client.0.smithi138.stdout:5/638: symlink df/d18/d3e/d51/dc9/lcf 0 2024-02-15T22:50:59.937 INFO:tasks.workunit.client.0.smithi138.stdout:4/825: rename d17/d2b/dd8/d107/c10b to d17/d1e/d2d/d36/dca/da3/dfd/c111 0 2024-02-15T22:50:59.937 INFO:tasks.workunit.client.0.smithi138.stdout:5/639: symlink df/d18/d3e/ld0 0 2024-02-15T22:50:59.939 INFO:tasks.workunit.client.0.smithi138.stdout:5/640: creat df/d18/d56/dc6/fd1 x:0 0 0 2024-02-15T22:50:59.941 INFO:tasks.workunit.client.0.smithi138.stdout:1/542: dwrite f4 [4194304,4194304] 0 2024-02-15T22:50:59.941 INFO:tasks.workunit.client.0.smithi138.stdout:5/641: write df/f13 [201009,100466] 0 2024-02-15T22:50:59.941 INFO:tasks.workunit.client.0.smithi138.stdout:5/642: chown df/f83 74 1 2024-02-15T22:50:59.941 INFO:tasks.workunit.client.0.smithi138.stdout:5/643: chown df 38753254 1 2024-02-15T22:50:59.943 INFO:tasks.workunit.client.0.smithi138.stdout:1/543: mknod df/d1b/d21/d4f/cb3 0 2024-02-15T22:50:59.945 INFO:tasks.workunit.client.0.smithi138.stdout:1/544: rename df/d1b/d33/f55 to df/d1b/fb4 0 2024-02-15T22:50:59.945 INFO:tasks.workunit.client.0.smithi138.stdout:1/545: creat df/d1b/d1d/d25/d2e/d5b/d65/fb5 x:0 0 0 2024-02-15T22:50:59.947 INFO:tasks.workunit.client.0.smithi138.stdout:1/546: dread df/d1b/f69 [0,4194304] 0 2024-02-15T22:50:59.948 INFO:tasks.workunit.client.0.smithi138.stdout:7/897: dwrite d1/d79/d84/da0/f10f [0,4194304] 0 2024-02-15T22:50:59.950 INFO:tasks.workunit.client.0.smithi138.stdout:1/547: mknod df/d1b/d1d/d25/d2e/d5b/d65/d80/cb6 0 2024-02-15T22:50:59.953 INFO:tasks.workunit.client.0.smithi138.stdout:5/644: write df/f11 [3459001,59762] 0 2024-02-15T22:50:59.955 INFO:tasks.workunit.client.0.smithi138.stdout:4/826: dwrite d17/d1e/d2d/f2e [4194304,4194304] 0 2024-02-15T22:50:59.956 INFO:tasks.workunit.client.0.smithi138.stdout:5/645: creat df/d18/d3e/d60/d65/d7f/fd2 x:0 0 0 2024-02-15T22:50:59.962 INFO:tasks.workunit.client.0.smithi138.stdout:4/827: symlink d17/d2b/dd8/l112 0 2024-02-15T22:50:59.973 INFO:tasks.workunit.client.0.smithi138.stdout:7/898: dwrite d1/d79/d84/da0/ddf/fea [0,4194304] 0 2024-02-15T22:50:59.973 INFO:tasks.workunit.client.0.smithi138.stdout:1/548: dwrite df/d1b/d1d/d25/d2e/d37/f54 [0,4194304] 0 2024-02-15T22:50:59.977 INFO:tasks.workunit.client.0.smithi138.stdout:1/549: symlink df/d1b/d33/lb7 0 2024-02-15T22:50:59.985 INFO:tasks.workunit.client.0.smithi138.stdout:7/899: read d1/d79/d84/da0/fa5 [3302700,20871] 0 2024-02-15T22:50:59.988 INFO:tasks.workunit.client.0.smithi138.stdout:7/900: read d1/d2/db/d3c/f56 [990388,96150] 0 2024-02-15T22:50:59.997 INFO:tasks.workunit.client.0.smithi138.stdout:1/550: dwrite df/d1b/d1d/d25/d2e/d37/f81 [0,4194304] 0 2024-02-15T22:50:59.997 INFO:tasks.workunit.client.0.smithi138.stdout:1/551: rmdir df/d1b 39 2024-02-15T22:50:59.998 INFO:tasks.workunit.client.0.smithi138.stdout:1/552: mkdir df/d1b/d1d/d25/d2e/d5b/d65/db8 0 2024-02-15T22:50:59.998 INFO:tasks.workunit.client.0.smithi138.stdout:1/553: write df/d1b/f3d [1182547,32544] 0 2024-02-15T22:51:00.010 INFO:tasks.workunit.client.0.smithi138.stdout:7/901: dwrite d1/d2/db/fb2 [0,4194304] 0 2024-02-15T22:51:00.010 INFO:tasks.workunit.client.0.smithi138.stdout:1/554: dread df/d1b/d1d/d24/d3a/f71 [0,4194304] 0 2024-02-15T22:51:00.036 INFO:tasks.workunit.client.0.smithi138.stdout:7/902: dwrite d1/d28/fe9 [0,4194304] 0 2024-02-15T22:51:00.036 INFO:tasks.workunit.client.0.smithi138.stdout:7/903: write d1/d79/d84/f10e [571324,14329] 0 2024-02-15T22:51:00.038 INFO:tasks.workunit.client.0.smithi138.stdout:7/904: link d1/d79/d84/da0/fe1 d1/d2/db/d3c/d4d/d5b/f131 0 2024-02-15T22:51:00.051 INFO:tasks.workunit.client.0.smithi138.stdout:7/905: dread d1/f6b [4194304,4194304] 0 2024-02-15T22:51:00.062 INFO:tasks.workunit.client.0.smithi138.stdout:3/758: sync 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:0/681: sync 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:0/682: dread - d6/d10/d13/ff0 zero size 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:3/759: read d5/d12/d23/d29/fad [159731,75319] 0 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:8/736: sync 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:6/613: sync 2024-02-15T22:51:00.063 INFO:tasks.workunit.client.0.smithi138.stdout:6/614: readlink dc/d24/d34/l8b 0 2024-02-15T22:51:00.067 INFO:tasks.workunit.client.0.smithi138.stdout:3/760: truncate d5/d12/d23/d29/fad 773200 0 2024-02-15T22:51:00.067 INFO:tasks.workunit.client.0.smithi138.stdout:3/761: chown d5/d16/dc/d43/da2/dc6 33462 1 2024-02-15T22:51:00.070 INFO:tasks.workunit.client.0.smithi138.stdout:8/737: mknod db/d15/daa/cf3 0 2024-02-15T22:51:00.072 INFO:tasks.workunit.client.0.smithi138.stdout:3/762: mkdir d5/d16/dfb 0 2024-02-15T22:51:00.072 INFO:tasks.workunit.client.0.smithi138.stdout:3/763: chown d5/d16 7737966 1 2024-02-15T22:51:00.073 INFO:tasks.workunit.client.0.smithi138.stdout:3/764: fdatasync d5/d18/fbe 0 2024-02-15T22:51:00.073 INFO:tasks.workunit.client.0.smithi138.stdout:8/738: truncate db/d15/db6/df2/d13/d19/d45/fdf 2009231 0 2024-02-15T22:51:00.074 INFO:tasks.workunit.client.0.smithi138.stdout:8/739: truncate db/d15/db6/df2/d22/f7f 208980 0 2024-02-15T22:51:00.074 INFO:tasks.workunit.client.0.smithi138.stdout:8/740: write db/d15/db6/df2/fa8 [1895564,58013] 0 2024-02-15T22:51:00.085 INFO:tasks.workunit.client.0.smithi138.stdout:7/906: dwrite d1/d2/db/d3c/f45 [4194304,4194304] 0 2024-02-15T22:51:00.086 INFO:tasks.workunit.client.0.smithi138.stdout:8/741: dread db/d15/db6/df2/d13/d19/d7d/f89 [0,4194304] 0 2024-02-15T22:51:00.087 INFO:tasks.workunit.client.0.smithi138.stdout:3/765: dread d5/d16/dc/d43/d47/d67/fa3 [0,4194304] 0 2024-02-15T22:51:00.087 INFO:tasks.workunit.client.0.smithi138.stdout:6/615: dwrite f1 [0,4194304] 0 2024-02-15T22:51:00.088 INFO:tasks.workunit.client.0.smithi138.stdout:0/683: dwrite d6/f7a [0,4194304] 0 2024-02-15T22:51:00.088 INFO:tasks.workunit.client.0.smithi138.stdout:7/907: rename d1/l13 to d1/d2/db/d3c/d4d/d5b/l132 0 2024-02-15T22:51:00.093 INFO:tasks.workunit.client.0.smithi138.stdout:0/684: mknod d6/d10/d64/dbf/cf5 0 2024-02-15T22:51:00.094 INFO:tasks.workunit.client.0.smithi138.stdout:7/908: stat d1/d2/db/cc9 0 2024-02-15T22:51:00.097 INFO:tasks.workunit.client.0.smithi138.stdout:3/766: read d5/d18/d35/fb7 [2755102,68091] 0 2024-02-15T22:51:00.097 INFO:tasks.workunit.client.0.smithi138.stdout:3/767: stat d5/d16/f77 0 2024-02-15T22:51:00.098 INFO:tasks.workunit.client.0.smithi138.stdout:6/616: dread dc/f3a [0,4194304] 0 2024-02-15T22:51:00.099 INFO:tasks.workunit.client.0.smithi138.stdout:3/768: link d5/d12/d26/c5f d5/d12/d26/d2f/cfc 0 2024-02-15T22:51:00.099 INFO:tasks.workunit.client.0.smithi138.stdout:3/769: chown d5/d16/dc/d43/d47/d67/faf 1975 1 2024-02-15T22:51:00.102 INFO:tasks.workunit.client.0.smithi138.stdout:7/909: rmdir d1/d79/d84 39 2024-02-15T22:51:00.102 INFO:tasks.workunit.client.0.smithi138.stdout:7/910: creat d1/d2/f133 x:0 0 0 2024-02-15T22:51:00.104 INFO:tasks.workunit.client.0.smithi138.stdout:0/685: rename d6/d10/d75/dbb to d6/d10/d34/df6 0 2024-02-15T22:51:00.105 INFO:tasks.workunit.client.0.smithi138.stdout:3/770: mknod d5/d12/d23/da1/cfd 0 2024-02-15T22:51:00.107 INFO:tasks.workunit.client.0.smithi138.stdout:7/911: link d1/d2/c110 d1/d79/d84/c134 0 2024-02-15T22:51:00.108 INFO:tasks.workunit.client.0.smithi138.stdout:0/686: symlink d6/d10/d64/dbf/lf7 0 2024-02-15T22:51:00.109 INFO:tasks.workunit.client.0.smithi138.stdout:0/687: mkdir d6/d10/d18/d6e/df8 0 2024-02-15T22:51:00.112 INFO:tasks.workunit.client.0.smithi138.stdout:6/617: write dc/f1e [431933,60653] 0 2024-02-15T22:51:00.112 INFO:tasks.workunit.client.0.smithi138.stdout:6/618: chown dc/d24/d34/f49 464 1 2024-02-15T22:51:00.114 INFO:tasks.workunit.client.0.smithi138.stdout:6/619: creat dc/d24/fd7 x:0 0 0 2024-02-15T22:51:00.115 INFO:tasks.workunit.client.0.smithi138.stdout:3/771: dread d5/d16/dc/d43/d47/d67/f8d [0,4194304] 0 2024-02-15T22:51:00.115 INFO:tasks.workunit.client.0.smithi138.stdout:8/742: dwrite db/d15/d70/d7c/d92/f2c [0,4194304] 0 2024-02-15T22:51:00.116 INFO:tasks.workunit.client.0.smithi138.stdout:6/620: mkdir dc/d24/d34/d3b/d68/dd8 0 2024-02-15T22:51:00.117 INFO:tasks.workunit.client.0.smithi138.stdout:3/772: mknod d5/d12/d26/cfe 0 2024-02-15T22:51:00.117 INFO:tasks.workunit.client.0.smithi138.stdout:8/743: mkdir db/d15/db6/df4 0 2024-02-15T22:51:00.117 INFO:tasks.workunit.client.0.smithi138.stdout:8/744: chown db/d15/d70/d7c/d92/de6 5305809 1 2024-02-15T22:51:00.118 INFO:tasks.workunit.client.0.smithi138.stdout:6/621: symlink dc/ld9 0 2024-02-15T22:51:00.118 INFO:tasks.workunit.client.0.smithi138.stdout:7/912: write d1/d2/db/f1c [570333,41183] 0 2024-02-15T22:51:00.118 INFO:tasks.workunit.client.0.smithi138.stdout:0/688: dread d6/fb [0,4194304] 0 2024-02-15T22:51:00.119 INFO:tasks.workunit.client.0.smithi138.stdout:3/773: mkdir d5/d16/dc/d43/da2/dff 0 2024-02-15T22:51:00.119 INFO:tasks.workunit.client.0.smithi138.stdout:3/774: stat d5/d95/cf7 0 2024-02-15T22:51:00.120 INFO:tasks.workunit.client.0.smithi138.stdout:6/622: truncate dc/f15 3200623 0 2024-02-15T22:51:00.120 INFO:tasks.workunit.client.0.smithi138.stdout:6/623: read dc/d4b/d98/fb2 [308294,107615] 0 2024-02-15T22:51:00.120 INFO:tasks.workunit.client.0.smithi138.stdout:6/624: write dc/fd3 [566543,111839] 0 2024-02-15T22:51:00.120 INFO:tasks.workunit.client.0.smithi138.stdout:7/913: truncate d1/d2/db/f7b 6430952 0 2024-02-15T22:51:00.124 INFO:tasks.workunit.client.0.smithi138.stdout:0/689: mkdir d6/d10/d52/d6f/df9 0 2024-02-15T22:51:00.135 INFO:tasks.workunit.client.0.smithi138.stdout:7/914: fsync d1/d2/db/f7b 0 2024-02-15T22:51:00.137 INFO:tasks.workunit.client.0.smithi138.stdout:7/915: creat d1/d79/d84/da0/ddf/f135 x:0 0 0 2024-02-15T22:51:00.137 INFO:tasks.workunit.client.0.smithi138.stdout:7/916: dread - d1/d79/d84/d8c/f12b zero size 2024-02-15T22:51:00.138 INFO:tasks.workunit.client.0.smithi138.stdout:7/917: symlink d1/l136 0 2024-02-15T22:51:00.138 INFO:tasks.workunit.client.0.smithi138.stdout:7/918: readlink d1/d2/db/d25/l4b 0 2024-02-15T22:51:00.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/919: creat d1/d2/db/d25/d41/dee/d114/f137 x:0 0 0 2024-02-15T22:51:00.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/920: creat d1/d79/d84/da0/ddf/f138 x:0 0 0 2024-02-15T22:51:00.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/921: fsync d1/d5a/d97/fd6 0 2024-02-15T22:51:00.139 INFO:tasks.workunit.client.0.smithi138.stdout:7/922: fdatasync d1/d5a/d97/f100 0 2024-02-15T22:51:00.140 INFO:tasks.workunit.client.0.smithi138.stdout:7/923: rmdir d1/d2/db/d25/d41/dfb 39 2024-02-15T22:51:00.140 INFO:tasks.workunit.client.0.smithi138.stdout:7/924: chown d1/d2/f11d 36 1 2024-02-15T22:51:00.142 INFO:tasks.workunit.client.0.smithi138.stdout:6/625: dwrite dc/d24/d34/d3b/d7c/f91 [0,4194304] 0 2024-02-15T22:51:00.142 INFO:tasks.workunit.client.0.smithi138.stdout:6/626: dread - dc/d24/d34/d99/fab zero size 2024-02-15T22:51:00.144 INFO:tasks.workunit.client.0.smithi138.stdout:6/627: mkdir dc/d24/d34/d3b/dda 0 2024-02-15T22:51:00.145 INFO:tasks.workunit.client.0.smithi138.stdout:6/628: mkdir dc/d24/d6c/ddb 0 2024-02-15T22:51:00.146 INFO:tasks.workunit.client.0.smithi138.stdout:6/629: creat dc/d24/d6c/ddb/fdc x:0 0 0 2024-02-15T22:51:00.146 INFO:tasks.workunit.client.0.smithi138.stdout:8/745: dwrite db/d15/d70/d7c/d92/f60 [0,4194304] 0 2024-02-15T22:51:00.148 INFO:tasks.workunit.client.0.smithi138.stdout:8/746: creat db/d15/db6/ff5 x:0 0 0 2024-02-15T22:51:00.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/630: getdents dc/d24 0 2024-02-15T22:51:00.150 INFO:tasks.workunit.client.0.smithi138.stdout:6/631: unlink dc/d24/d6c/dbc/fc3 0 2024-02-15T22:51:00.157 INFO:tasks.workunit.client.0.smithi138.stdout:8/747: write f3 [12254918,28267] 0 2024-02-15T22:51:00.158 INFO:tasks.workunit.client.0.smithi138.stdout:8/748: rename db/d15/db6/df2/d13/d19/f76 to db/d15/db6/df2/d13/d19/d7d/db2/ff6 0 2024-02-15T22:51:00.160 INFO:tasks.workunit.client.0.smithi138.stdout:8/749: unlink db/d15/d70/d7c/d92/laf 0 2024-02-15T22:51:00.161 INFO:tasks.workunit.client.0.smithi138.stdout:8/750: chown db/d15/db6/df2/d13/d19 216084267 1 2024-02-15T22:51:00.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/751: unlink db/d15/db6/df2/d13/d19/d45/c4f 0 2024-02-15T22:51:00.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/752: read db/d15/db6/df2/d22/f98 [168454,19869] 0 2024-02-15T22:51:00.167 INFO:tasks.workunit.client.0.smithi138.stdout:8/753: chown db/d15/db6/df2/d13/d77/d8f/ldc 4503 1 2024-02-15T22:51:00.169 INFO:tasks.workunit.client.0.smithi138.stdout:7/925: rmdir d1/d2/db/d25 39 2024-02-15T22:51:00.171 INFO:tasks.workunit.client.0.smithi138.stdout:3/775: dwrite d5/d16/dc/d43/d57/d5d/de2/fe3 [0,4194304] 0 2024-02-15T22:51:00.171 INFO:tasks.workunit.client.0.smithi138.stdout:3/776: write d5/d16/d4d/de4/fed [362048,68351] 0 2024-02-15T22:51:00.173 INFO:tasks.workunit.client.0.smithi138.stdout:6/632: dwrite dc/d24/d34/d3b/d7c/da8/fc5 [0,4194304] 0 2024-02-15T22:51:00.173 INFO:tasks.workunit.client.0.smithi138.stdout:6/633: write dc/d24/fb0 [1895391,45078] 0 2024-02-15T22:51:00.175 INFO:tasks.workunit.client.0.smithi138.stdout:3/777: link d5/d12/d23/d29/d4f/fc4 d5/d16/dc/d43/da2/f100 0 2024-02-15T22:51:00.175 INFO:tasks.workunit.client.0.smithi138.stdout:3/778: readlink d5/d12/d23/d29/d5a/la8 0 2024-02-15T22:51:00.180 INFO:tasks.workunit.client.0.smithi138.stdout:6/634: creat dc/d24/d6c/fdd x:0 0 0 2024-02-15T22:51:00.182 INFO:tasks.workunit.client.0.smithi138.stdout:3/779: rmdir d5/d16/dc/d43/da2/dff 0 2024-02-15T22:51:00.184 INFO:tasks.workunit.client.0.smithi138.stdout:6/635: mkdir dc/d24/d34/dde 0 2024-02-15T22:51:00.186 INFO:tasks.workunit.client.0.smithi138.stdout:8/754: dwrite db/d15/db6/df2/f3e [0,4194304] 0 2024-02-15T22:51:00.186 INFO:tasks.workunit.client.0.smithi138.stdout:3/780: creat d5/d16/dc/d43/d47/f101 x:0 0 0 2024-02-15T22:51:00.191 INFO:tasks.workunit.client.0.smithi138.stdout:3/781: mkdir d5/d12/d23/d29/d4f/d102 0 2024-02-15T22:51:00.193 INFO:tasks.workunit.client.0.smithi138.stdout:3/782: symlink d5/d16/dcf/l103 0 2024-02-15T22:51:00.194 INFO:tasks.workunit.client.0.smithi138.stdout:6/636: write dc/d24/d34/d3b/d7c/da8/fc5 [524699,73604] 0 2024-02-15T22:51:00.197 INFO:tasks.workunit.client.0.smithi138.stdout:8/755: read db/d15/d70/d7c/d92/f60 [2648276,28511] 0 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/756: write db/d15/d70/dda/de4/fef [83324,34811] 0 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:7/926: dwrite d1/d2/db/d25/f121 [0,4194304] 0 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/757: stat db/d15/db6/df2/d22/f8a 0 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/758: chown db/d15/db6/df2/d13/f64 1122661 1 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/759: write db/d15/db6/fb7 [3672030,84108] 0 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:8/760: chown db/d15/d70/d7c/d92/de6 1 1 2024-02-15T22:51:00.198 INFO:tasks.workunit.client.0.smithi138.stdout:6/637: mkdir dc/d24/d6c/ddb/ddf 0 2024-02-15T22:51:00.200 INFO:tasks.workunit.client.0.smithi138.stdout:7/927: mknod d1/d2/db/d3c/d4d/d5b/c139 0 2024-02-15T22:51:00.200 INFO:tasks.workunit.client.0.smithi138.stdout:7/928: stat d1/d2/db/d25/f106 0 2024-02-15T22:51:00.201 INFO:tasks.workunit.client.0.smithi138.stdout:7/929: mkdir d1/d2/db/d3c/d4d/d5b/d103/d13a 0 2024-02-15T22:51:00.201 INFO:tasks.workunit.client.0.smithi138.stdout:7/930: getdents d1/d2/db/d3c/d4d/d5b/dda 0 2024-02-15T22:51:00.201 INFO:tasks.workunit.client.0.smithi138.stdout:7/931: creat d1/d2/db/d3c/f13b x:0 0 0 2024-02-15T22:51:00.205 INFO:tasks.workunit.client.0.smithi138.stdout:3/783: dread d5/d16/dc/f76 [0,4194304] 0 2024-02-15T22:51:00.205 INFO:tasks.workunit.client.0.smithi138.stdout:3/784: fsync d5/d16/dc/d43/d47/d67/f6b 0 2024-02-15T22:51:00.205 INFO:tasks.workunit.client.0.smithi138.stdout:3/785: truncate d5/d16/dc/d43/fd3 870300 0 2024-02-15T22:51:00.205 INFO:tasks.workunit.client.0.smithi138.stdout:3/786: read d5/d16/d4d/f85 [5501,39815] 0 2024-02-15T22:51:00.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/932: link d1/d79/d84/da0/ca9 d1/d79/d127/c13c 0 2024-02-15T22:51:00.207 INFO:tasks.workunit.client.0.smithi138.stdout:7/933: chown d1/d79/d84/d8c 21 1 2024-02-15T22:51:00.207 INFO:tasks.workunit.client.0.smithi138.stdout:8/761: read db/d15/d70/f5b [623817,16134] 0 2024-02-15T22:51:00.207 INFO:tasks.workunit.client.0.smithi138.stdout:8/762: fsync db/d15/db6/df2/d13/d19/f83 0 2024-02-15T22:51:00.209 INFO:tasks.workunit.client.0.smithi138.stdout:3/787: creat d5/d16/dc/db8/f104 x:0 0 0 2024-02-15T22:51:00.210 INFO:tasks.workunit.client.0.smithi138.stdout:8/763: rmdir db/d15/db6/df2/d13/d77 39 2024-02-15T22:51:00.211 INFO:tasks.workunit.client.0.smithi138.stdout:8/764: mkdir db/d15/db6/df2/d13/d19/d6b/dba/df7 0 2024-02-15T22:51:00.213 INFO:tasks.workunit.client.0.smithi138.stdout:8/765: creat db/da0/de8/ff8 x:0 0 0 2024-02-15T22:51:00.214 INFO:tasks.workunit.client.0.smithi138.stdout:8/766: readlink db/l48 0 2024-02-15T22:51:00.215 INFO:tasks.workunit.client.0.smithi138.stdout:8/767: rename db/d15/d70/dda to db/d15/d70/df9 0 2024-02-15T22:51:00.215 INFO:tasks.workunit.client.0.smithi138.stdout:8/768: fsync db/d15/db6/df2/d13/f21 0 2024-02-15T22:51:00.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/788: dread d5/d12/d26/d2f/fcb [0,4194304] 0 2024-02-15T22:51:00.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/789: write d5/d12/d23/d29/d5a/fb6 [4232254,55711] 0 2024-02-15T22:51:00.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/790: dread - d5/fe6 zero size 2024-02-15T22:51:00.218 INFO:tasks.workunit.client.0.smithi138.stdout:3/791: creat d5/d16/dc/d43/da2/f105 x:0 0 0 2024-02-15T22:51:00.218 INFO:tasks.workunit.client.0.smithi138.stdout:6/638: dwrite dc/d24/d34/d3b/d68/fc2 [0,4194304] 0 2024-02-15T22:51:00.221 INFO:tasks.workunit.client.0.smithi138.stdout:3/792: mknod d5/d16/dc/d43/da2/c106 0 2024-02-15T22:51:00.224 INFO:tasks.workunit.client.0.smithi138.stdout:6/639: rename dc/d24/d34/d3b/d7d/f80 to dc/d24/d34/d3b/d7c/fe0 0 2024-02-15T22:51:00.231 INFO:tasks.workunit.client.0.smithi138.stdout:8/769: dwrite db/d15/d70/f5b [0,4194304] 0 2024-02-15T22:51:00.233 INFO:tasks.workunit.client.0.smithi138.stdout:8/770: write db/d15/f94 [199407,124141] 0 2024-02-15T22:51:00.234 INFO:tasks.workunit.client.0.smithi138.stdout:6/640: dread f1 [0,4194304] 0 2024-02-15T22:51:00.235 INFO:tasks.workunit.client.0.smithi138.stdout:3/793: rename d5/d16/dc/d43 to d5/d12/d26/da6/d107 0 2024-02-15T22:51:00.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/771: symlink db/d15/db6/df2/d13/d19/d6b/dba/df7/lfa 0 2024-02-15T22:51:00.237 INFO:tasks.workunit.client.0.smithi138.stdout:6/641: link dc/d24/d34/d3b/d7c/d9f/ca7 dc/d24/d34/ce1 0 2024-02-15T22:51:00.238 INFO:tasks.workunit.client.0.smithi138.stdout:6/642: chown dc/d24/f26 1 1 2024-02-15T22:51:00.238 INFO:tasks.workunit.client.0.smithi138.stdout:3/794: mknod d5/d12/d26/c108 0 2024-02-15T22:51:00.239 INFO:tasks.workunit.client.0.smithi138.stdout:8/772: creat db/d15/db6/df2/d13/d19/d6b/dba/ffb x:0 0 0 2024-02-15T22:51:00.240 INFO:tasks.workunit.client.0.smithi138.stdout:3/795: symlink d5/d12/d23/d29/d5a/dc2/l109 0 2024-02-15T22:51:00.242 INFO:tasks.workunit.client.0.smithi138.stdout:8/773: link db/d15/db6/df2/l27 db/d15/daa/df0/lfc 0 2024-02-15T22:51:00.246 INFO:tasks.workunit.client.0.smithi138.stdout:8/774: unlink db/d15/db6/df2/l8c 0 2024-02-15T22:51:00.247 INFO:tasks.workunit.client.0.smithi138.stdout:6/643: read dc/d24/fa9 [3371518,98970] 0 2024-02-15T22:51:00.247 INFO:tasks.workunit.client.0.smithi138.stdout:8/775: read db/da0/fb5 [224446,119228] 0 2024-02-15T22:51:00.248 INFO:tasks.workunit.client.0.smithi138.stdout:8/776: mkdir db/d15/db6/df2/d4d/dd6/dfd 0 2024-02-15T22:51:00.253 INFO:tasks.workunit.client.0.smithi138.stdout:3/796: dwrite d5/d12/d26/da6/d107/d47/d67/f6b [4194304,4194304] 0 2024-02-15T22:51:00.253 INFO:tasks.workunit.client.0.smithi138.stdout:3/797: truncate d5/d12/d26/da6/d107/d57/ffa 748217 0 2024-02-15T22:51:00.253 INFO:tasks.workunit.client.0.smithi138.stdout:3/798: write d5/d12/d23/d29/d4f/f53 [2448257,92661] 0 2024-02-15T22:51:00.253 INFO:tasks.workunit.client.0.smithi138.stdout:3/799: fsync d5/d12/d26/dd5/ff1 0 2024-02-15T22:51:00.254 INFO:tasks.workunit.client.0.smithi138.stdout:6/644: dread f2 [0,4194304] 0 2024-02-15T22:51:00.256 INFO:tasks.workunit.client.0.smithi138.stdout:2/645: sync 2024-02-15T22:51:00.257 INFO:tasks.workunit.client.0.smithi138.stdout:2/646: symlink d0/dd/d15/d65/le0 0 2024-02-15T22:51:00.257 INFO:tasks.workunit.client.0.smithi138.stdout:2/647: stat d0/da/d19/d53/d5d/d6d/d7b/fdd 0 2024-02-15T22:51:00.265 INFO:tasks.workunit.client.0.smithi138.stdout:6/645: write dc/d24/d34/f49 [3837341,130328] 0 2024-02-15T22:51:00.268 INFO:tasks.workunit.client.0.smithi138.stdout:6/646: creat dc/d24/d34/d3b/d7c/fe2 x:0 0 0 2024-02-15T22:51:00.270 INFO:tasks.workunit.client.0.smithi138.stdout:2/648: write d0/da/d19/d53/f7f [1784891,106527] 0 2024-02-15T22:51:00.270 INFO:tasks.workunit.client.0.smithi138.stdout:8/777: dwrite db/f29 [0,4194304] 0 2024-02-15T22:51:00.271 INFO:tasks.workunit.client.0.smithi138.stdout:3/800: dwrite d5/d12/d26/d2e/fba [0,4194304] 0 2024-02-15T22:51:00.271 INFO:tasks.workunit.client.0.smithi138.stdout:3/801: chown d5/d12/d26 131 1 2024-02-15T22:51:00.273 INFO:tasks.workunit.client.0.smithi138.stdout:6/647: rename dc/d76/fac to dc/d24/d34/d3b/fe3 0 2024-02-15T22:51:00.281 INFO:tasks.workunit.client.0.smithi138.stdout:3/802: write d5/d16/f3c [2116752,123334] 0 2024-02-15T22:51:00.281 INFO:tasks.workunit.client.0.smithi138.stdout:3/803: write d5/d12/d23/d29/fad [250555,65089] 0 2024-02-15T22:51:00.283 INFO:tasks.workunit.client.0.smithi138.stdout:6/648: read dc/d24/f26 [2776132,85586] 0 2024-02-15T22:51:00.286 INFO:tasks.workunit.client.0.smithi138.stdout:2/649: rename d0/da/d19/d3f/fb1 to d0/da/d19/d53/d5d/d83/d8a/fe1 0 2024-02-15T22:51:00.287 INFO:tasks.workunit.client.0.smithi138.stdout:8/778: rmdir db/d15/d70/d7c/d92 39 2024-02-15T22:51:00.288 INFO:tasks.workunit.client.0.smithi138.stdout:8/779: dread db/d15/db6/df2/d13/f4c [0,4194304] 0 2024-02-15T22:51:00.290 INFO:tasks.workunit.client.0.smithi138.stdout:6/649: truncate dc/d24/f47 1782959 0 2024-02-15T22:51:00.290 INFO:tasks.workunit.client.0.smithi138.stdout:6/650: chown dc/d24/l37 56 1 2024-02-15T22:51:00.290 INFO:tasks.workunit.client.0.smithi138.stdout:6/651: chown dc/d24/d34/d3b/l5b 609341728 1 2024-02-15T22:51:00.293 INFO:tasks.workunit.client.0.smithi138.stdout:2/650: creat d0/da/d19/d53/d5d/d6d/d97/fe2 x:0 0 0 2024-02-15T22:51:00.294 INFO:tasks.workunit.client.0.smithi138.stdout:8/780: mkdir db/d15/db6/df2/d13/d19/d6b/dba/dfe 0 2024-02-15T22:51:00.294 INFO:tasks.workunit.client.0.smithi138.stdout:8/781: chown db/d15/l65 9969141 1 2024-02-15T22:51:00.295 INFO:tasks.workunit.client.0.smithi138.stdout:3/804: dwrite d5/d12/d26/da6/d107/fac [0,4194304] 0 2024-02-15T22:51:00.295 INFO:tasks.workunit.client.0.smithi138.stdout:3/805: chown d5/d16/dc/db8 9228082 1 2024-02-15T22:51:00.295 INFO:tasks.workunit.client.0.smithi138.stdout:3/806: write d5/d18/fbe [519238,2093] 0 2024-02-15T22:51:00.295 INFO:tasks.workunit.client.0.smithi138.stdout:2/651: mkdir d0/dd/d15/de3 0 2024-02-15T22:51:00.296 INFO:tasks.workunit.client.0.smithi138.stdout:8/782: creat db/d15/db6/df2/d13/d77/d8f/fff x:0 0 0 2024-02-15T22:51:00.299 INFO:tasks.workunit.client.0.smithi138.stdout:3/807: mknod d5/d18/d35/c10a 0 2024-02-15T22:51:00.301 INFO:tasks.workunit.client.0.smithi138.stdout:2/652: creat d0/dd/fe4 x:0 0 0 2024-02-15T22:51:00.303 INFO:tasks.workunit.client.0.smithi138.stdout:8/783: creat db/d15/db6/df2/d13/d19/d6b/f100 x:0 0 0 2024-02-15T22:51:00.304 INFO:tasks.workunit.client.0.smithi138.stdout:3/808: truncate d5/d12/d26/d2e/f97 660655 0 2024-02-15T22:51:00.306 INFO:tasks.workunit.client.0.smithi138.stdout:2/653: symlink d0/da/d19/le5 0 2024-02-15T22:51:00.306 INFO:tasks.workunit.client.0.smithi138.stdout:2/654: dread - d0/da/d19/d53/d5d/d83/fc0 zero size 2024-02-15T22:51:00.307 INFO:tasks.workunit.client.0.smithi138.stdout:3/809: rmdir d5/d16/d4d 39 2024-02-15T22:51:00.307 INFO:tasks.workunit.client.0.smithi138.stdout:3/810: fsync d5/d16/dc/f76 0 2024-02-15T22:51:00.307 INFO:tasks.workunit.client.0.smithi138.stdout:3/811: write d5/d18/f93 [157336,53062] 0 2024-02-15T22:51:00.307 INFO:tasks.workunit.client.0.smithi138.stdout:3/812: chown d5/d18/c72 319837 1 2024-02-15T22:51:00.308 INFO:tasks.workunit.client.0.smithi138.stdout:2/655: creat d0/d3/fe6 x:0 0 0 2024-02-15T22:51:00.309 INFO:tasks.workunit.client.0.smithi138.stdout:8/784: getdents db/d15/db6/df2/d13/d77/d8f 0 2024-02-15T22:51:00.310 INFO:tasks.workunit.client.0.smithi138.stdout:2/656: dread d0/da/d19/d53/d80/fbb [0,4194304] 0 2024-02-15T22:51:00.310 INFO:tasks.workunit.client.0.smithi138.stdout:2/657: truncate d0/da/d19/d53/d80/dba/fcb 815000 0 2024-02-15T22:51:00.310 INFO:tasks.workunit.client.0.smithi138.stdout:2/658: dread - d0/da/d19/d53/d80/f90 zero size 2024-02-15T22:51:00.311 INFO:tasks.workunit.client.0.smithi138.stdout:3/813: unlink d5/d18/f93 0 2024-02-15T22:51:00.315 INFO:tasks.workunit.client.0.smithi138.stdout:3/814: creat d5/d12/d26/f10b x:0 0 0 2024-02-15T22:51:00.315 INFO:tasks.workunit.client.0.smithi138.stdout:3/815: creat d5/d12/d26/d2e/f10c x:0 0 0 2024-02-15T22:51:00.333 INFO:tasks.workunit.client.0.smithi138.stdout:2/659: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:51:00.334 INFO:tasks.workunit.client.0.smithi138.stdout:3/816: dwrite d5/d12/f1d [4194304,4194304] 0 2024-02-15T22:51:00.337 INFO:tasks.workunit.client.0.smithi138.stdout:2/660: rename d0/da/d19/f39 to d0/da/d19/d53/d5d/d6d/d7b/fe7 0 2024-02-15T22:51:00.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/817: creat d5/d12/d26/da6/d107/d47/f10d x:0 0 0 2024-02-15T22:51:00.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/818: fdatasync d5/d12/d26/d2e/fba 0 2024-02-15T22:51:00.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/819: write d5/d16/d4d/f85 [894853,79512] 0 2024-02-15T22:51:00.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/820: creat d5/d12/d26/da6/d107/d47/f10e x:0 0 0 2024-02-15T22:51:00.343 INFO:tasks.workunit.client.0.smithi138.stdout:2/661: creat d0/da/d19/d53/d5d/fe8 x:0 0 0 2024-02-15T22:51:00.344 INFO:tasks.workunit.client.0.smithi138.stdout:3/821: symlink d5/l10f 0 2024-02-15T22:51:00.347 INFO:tasks.workunit.client.0.smithi138.stdout:3/822: write d5/d12/d26/da6/d107/d47/d67/f8d [4025905,97508] 0 2024-02-15T22:51:00.349 INFO:tasks.workunit.client.0.smithi138.stdout:3/823: getdents d5/d12/d23/d29/d4f 0 2024-02-15T22:51:00.349 INFO:tasks.workunit.client.0.smithi138.stdout:3/824: creat d5/d12/d26/d2e/f110 x:0 0 0 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/825: symlink d5/d12/d26/da6/d107/da2/dc6/l111 0 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/826: chown d5/d16/dcf/ldb 0 1 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/827: stat d5/d18/f24 0 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/828: chown d5/d12/d26/da6/d107/d57 1604829 1 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/829: dread - d5/d18/fb5 zero size 2024-02-15T22:51:00.352 INFO:tasks.workunit.client.0.smithi138.stdout:3/830: chown d5/d12/c25 167386 1 2024-02-15T22:51:00.354 INFO:tasks.workunit.client.0.smithi138.stdout:3/831: mkdir d5/d12/d26/da6/d107/d112 0 2024-02-15T22:51:00.354 INFO:tasks.workunit.client.0.smithi138.stdout:3/832: mknod d5/d12/d23/d29/d5a/dc2/c113 0 2024-02-15T22:51:00.371 INFO:tasks.workunit.client.0.smithi138.stdout:3/833: dwrite d5/d12/d23/d94/f9c [0,4194304] 0 2024-02-15T22:51:00.372 INFO:tasks.workunit.client.0.smithi138.stdout:3/834: creat d5/d12/d23/f114 x:0 0 0 2024-02-15T22:51:00.373 INFO:tasks.workunit.client.0.smithi138.stdout:3/835: creat d5/d12/f115 x:0 0 0 2024-02-15T22:51:00.374 INFO:tasks.workunit.client.0.smithi138.stdout:3/836: creat d5/d12/d23/da1/f116 x:0 0 0 2024-02-15T22:51:00.374 INFO:tasks.workunit.client.0.smithi138.stdout:3/837: write d5/d12/d26/da6/d107/d47/d67/f8d [3539091,101752] 0 2024-02-15T22:51:00.387 INFO:tasks.workunit.client.0.smithi138.stdout:3/838: dwrite d5/d12/d23/d29/d4f/fc0 [0,4194304] 0 2024-02-15T22:51:00.389 INFO:tasks.workunit.client.0.smithi138.stdout:3/839: creat d5/d12/d26/da6/d107/d57/f117 x:0 0 0 2024-02-15T22:51:00.390 INFO:tasks.workunit.client.0.smithi138.stdout:3/840: creat d5/d95/f118 x:0 0 0 2024-02-15T22:51:00.391 INFO:tasks.workunit.client.0.smithi138.stdout:3/841: link d5/fb4 d5/d12/d23/f119 0 2024-02-15T22:51:00.391 INFO:tasks.workunit.client.0.smithi138.stdout:3/842: write d5/d16/d4d/f85 [1501221,40259] 0 2024-02-15T22:51:00.396 INFO:tasks.workunit.client.0.smithi138.stdout:3/843: read d5/d12/d26/d2f/fcb [3555112,105328] 0 2024-02-15T22:51:00.397 INFO:tasks.workunit.client.0.smithi138.stdout:3/844: write d5/d16/dc/db8/f104 [227622,81733] 0 2024-02-15T22:51:00.398 INFO:tasks.workunit.client.0.smithi138.stdout:9/907: sync 2024-02-15T22:51:00.398 INFO:tasks.workunit.client.0.smithi138.stdout:3/845: write d5/d12/d23/da1/fdd [723935,29552] 0 2024-02-15T22:51:00.398 INFO:tasks.workunit.client.0.smithi138.stdout:9/908: symlink d0/de/d14/da3/dc8/l13e 0 2024-02-15T22:51:00.399 INFO:tasks.workunit.client.0.smithi138.stdout:3/846: symlink d5/d12/d23/d29/d5a/l11a 0 2024-02-15T22:51:00.399 INFO:tasks.workunit.client.0.smithi138.stdout:3/847: write d5/d12/d26/d2e/f110 [349575,60536] 0 2024-02-15T22:51:00.399 INFO:tasks.workunit.client.0.smithi138.stdout:3/848: write d5/d18/d35/f8c [643788,69012] 0 2024-02-15T22:51:00.399 INFO:tasks.workunit.client.0.smithi138.stdout:3/849: truncate d5/d12/d23/d29/fd0 899273 0 2024-02-15T22:51:00.400 INFO:tasks.workunit.client.0.smithi138.stdout:9/909: truncate d0/d2e/fcd 2333797 0 2024-02-15T22:51:00.400 INFO:tasks.workunit.client.0.smithi138.stdout:3/850: read d5/d16/dc/f6d [236620,67702] 0 2024-02-15T22:51:00.401 INFO:tasks.workunit.client.0.smithi138.stdout:3/851: write d5/d12/d23/da1/fdd [1301585,18594] 0 2024-02-15T22:51:00.401 INFO:tasks.workunit.client.0.smithi138.stdout:9/910: truncate d0/d55/d59/fb3 1355912 0 2024-02-15T22:51:00.402 INFO:tasks.workunit.client.0.smithi138.stdout:3/852: creat d5/d12/d26/da6/d107/da2/dc6/dd2/f11b x:0 0 0 2024-02-15T22:51:00.403 INFO:tasks.workunit.client.0.smithi138.stdout:9/911: rename d0/d55/d59/c5d to d0/de/d34/d11f/c13f 0 2024-02-15T22:51:00.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/912: creat d0/de/d14/da3/f140 x:0 0 0 2024-02-15T22:51:00.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/913: write d0/d55/fce [1302405,42381] 0 2024-02-15T22:51:00.404 INFO:tasks.workunit.client.0.smithi138.stdout:9/914: write d0/de/d34/d89/fb1 [3708427,41269] 0 2024-02-15T22:51:00.405 INFO:tasks.workunit.client.0.smithi138.stdout:9/915: stat d0/de/d14/d18/d10d/d116/d121/d7b/d9e/da1/d134/l4a 0 2024-02-15T22:51:00.412 INFO:tasks.workunit.client.0.smithi138.stdout:3/853: read d5/fb4 [415400,22727] 0 2024-02-15T22:51:00.425 INFO:tasks.workunit.client.0.smithi138.stdout:3/854: dwrite d5/fe8 [0,4194304] 0 2024-02-15T22:51:00.438 INFO:tasks.workunit.client.0.smithi138.stdout:3/855: dwrite d5/d12/d26/da6/d107/d47/d67/f6b [4194304,4194304] 0 2024-02-15T22:51:00.439 INFO:tasks.workunit.client.0.smithi138.stdout:3/856: dread - d5/d12/d23/da1/f116 zero size 2024-02-15T22:51:00.439 INFO:tasks.workunit.client.0.smithi138.stdout:3/857: chown d5/d16/dc/dca 1092 1 2024-02-15T22:51:00.439 INFO:tasks.workunit.client.0.smithi138.stdout:3/858: rename d5/l64 to d5/d18/l11c 0 2024-02-15T22:51:00.456 INFO:tasks.workunit.client.0.smithi138.stdout:3/859: dwrite d5/d12/d23/f51 [4194304,4194304] 0 2024-02-15T22:51:00.476 INFO:tasks.workunit.client.0.smithi138.stdout:3/860: dwrite d5/d12/d23/d29/fad [0,4194304] 0 2024-02-15T22:51:00.476 INFO:tasks.workunit.client.0.smithi138.stdout:3/861: truncate d5/d16/dc/f76 5187305 0 2024-02-15T22:51:00.501 INFO:tasks.workunit.client.0.smithi138.stdout:3/862: dwrite d5/d12/d23/d29/feb [0,4194304] 0 2024-02-15T22:51:00.501 INFO:tasks.workunit.client.0.smithi138.stdout:3/863: getdents d5/d12/d23/d29/d4f/d102 0 2024-02-15T22:51:00.503 INFO:tasks.workunit.client.0.smithi138.stdout:3/864: mkdir d5/d18/d11d 0 2024-02-15T22:51:00.504 INFO:tasks.workunit.client.0.smithi138.stdout:3/865: truncate d5/d12/f1b 545158 0 2024-02-15T22:51:00.506 INFO:tasks.workunit.client.0.smithi138.stdout:3/866: rename d5/d12/d26/d2e/fa9 to d5/d12/d26/da6/d107/d47/d67/f11e 0 2024-02-15T22:51:00.506 INFO:tasks.workunit.client.0.smithi138.stdout:3/867: chown d5/d12 9027 1 2024-02-15T22:51:00.506 INFO:tasks.workunit.client.0.smithi138.stdout:3/868: readlink d5/d95/lcc 0 2024-02-15T22:51:00.522 INFO:tasks.workunit.client.0.smithi138.stdout:3/869: dwrite d5/d12/d26/d2e/f110 [0,4194304] 0 2024-02-15T22:51:00.522 INFO:tasks.workunit.client.0.smithi138.stdout:3/870: chown d5/d95/cab 122 1 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:1/555: sync 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:5/646: sync 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:4/828: sync 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:5/647: dread - df/d18/d3e/d51/dc9/fa0 zero size 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:1/556: creat df/d1b/d21/fb9 x:0 0 0 2024-02-15T22:51:00.528 INFO:tasks.workunit.client.0.smithi138.stdout:1/557: readlink df/d1b/d1d/d25/d2e/d37/l43 0 2024-02-15T22:51:00.529 INFO:tasks.workunit.client.0.smithi138.stdout:4/829: creat d17/d1e/f113 x:0 0 0 2024-02-15T22:51:00.529 INFO:tasks.workunit.client.0.smithi138.stdout:4/830: write d17/d2b/f55 [3640736,62792] 0 2024-02-15T22:51:00.529 INFO:tasks.workunit.client.0.smithi138.stdout:4/831: read d17/d2b/f77 [600580,77748] 0 2024-02-15T22:51:00.530 INFO:tasks.workunit.client.0.smithi138.stdout:3/871: write d5/d12/d26/da6/d107/d47/d67/f87 [221362,108775] 0 2024-02-15T22:51:00.530 INFO:tasks.workunit.client.0.smithi138.stdout:3/872: read d5/d16/f77 [77147,19403] 0 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:3/873: readlink d5/d12/d26/da6/d107/da2/dc6/l111 0 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:5/648: creat df/d18/d3e/d51/dc9/d9c/daf/fd3 x:0 0 0 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:5/649: chown df/d18/d3e/d60/d65/c86 19734962 1 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:5/650: dread - df/d18/d3e/d51/dc9/d9c/daf/fd3 zero size 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:1/558: mknod df/d41/cba 0 2024-02-15T22:51:00.531 INFO:tasks.workunit.client.0.smithi138.stdout:1/559: chown df/d1b/d1d/d24/d3a/f40 2 1 2024-02-15T22:51:00.533 INFO:tasks.workunit.client.0.smithi138.stdout:4/832: truncate d17/d1e/f4d 1795618 0 2024-02-15T22:51:00.534 INFO:tasks.workunit.client.0.smithi138.stdout:3/874: link d5/d12/d26/f5c d5/d12/d23/f11f 0 2024-02-15T22:51:00.534 INFO:tasks.workunit.client.0.smithi138.stdout:3/875: stat d5/l5e 0 2024-02-15T22:51:00.534 INFO:tasks.workunit.client.0.smithi138.stdout:3/876: chown d5/d16/c40 62971990 1 2024-02-15T22:51:00.536 INFO:tasks.workunit.client.0.smithi138.stdout:4/833: truncate d17/d1e/d2d/d36/d3e/d64/f41 2463309 0 2024-02-15T22:51:00.536 INFO:tasks.workunit.client.0.smithi138.stdout:4/834: readlink d17/d2b/dd8/d107/l110 0 2024-02-15T22:51:00.538 INFO:tasks.workunit.client.0.smithi138.stdout:3/877: write d5/d12/d23/d94/fef [100007,70239] 0 2024-02-15T22:51:00.539 INFO:tasks.workunit.client.0.smithi138.stdout:4/835: mknod d17/d1e/d2d/d52/c114 0 2024-02-15T22:51:00.539 INFO:tasks.workunit.client.0.smithi138.stdout:4/836: truncate d17/d1a/daa/fb9 456793 0 2024-02-15T22:51:00.540 INFO:tasks.workunit.client.0.smithi138.stdout:3/878: creat d5/d16/f120 x:0 0 0 2024-02-15T22:51:00.540 INFO:tasks.workunit.client.0.smithi138.stdout:3/879: creat d5/d12/d23/f121 x:0 0 0 2024-02-15T22:51:00.540 INFO:tasks.workunit.client.0.smithi138.stdout:5/651: dread df/d18/f29 [0,4194304] 0 2024-02-15T22:51:00.541 INFO:tasks.workunit.client.0.smithi138.stdout:4/837: mkdir d17/d2b/dd8/d107/d115 0 2024-02-15T22:51:00.547 INFO:tasks.workunit.client.0.smithi138.stdout:3/880: mkdir d5/d12/d23/d94/d122 0 2024-02-15T22:51:00.548 INFO:tasks.workunit.client.0.smithi138.stdout:5/652: mknod df/d18/d3e/d60/d65/cd4 0 2024-02-15T22:51:00.548 INFO:tasks.workunit.client.0.smithi138.stdout:1/560: dwrite df/f53 [4194304,4194304] 0 2024-02-15T22:51:00.548 INFO:tasks.workunit.client.0.smithi138.stdout:1/561: readlink df/d1b/d1d/d25/d2e/d5b/d7b/l96 0 2024-02-15T22:51:00.548 INFO:tasks.workunit.client.0.smithi138.stdout:3/881: rename d5/d16/lc5 to d5/d12/d26/da6/d107/d57/d5d/de2/l123 0 2024-02-15T22:51:00.549 INFO:tasks.workunit.client.0.smithi138.stdout:1/562: rmdir df/d41 39 2024-02-15T22:51:00.551 INFO:tasks.workunit.client.0.smithi138.stdout:3/882: mkdir d5/d12/d26/da6/d107/da2/dc6/dd2/d124 0 2024-02-15T22:51:00.551 INFO:tasks.workunit.client.0.smithi138.stdout:3/883: truncate d5/d12/d23/d94/fef 1611320 0 2024-02-15T22:51:00.552 INFO:tasks.workunit.client.0.smithi138.stdout:1/563: symlink df/d1b/d21/d4f/lbb 0 2024-02-15T22:51:00.561 INFO:tasks.workunit.client.0.smithi138.stdout:4/838: dwrite d17/d1e/f113 [0,4194304] 0 2024-02-15T22:51:00.562 INFO:tasks.workunit.client.0.smithi138.stdout:3/884: dread d5/d12/d26/da6/d107/da2/fe0 [0,4194304] 0 2024-02-15T22:51:00.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/839: truncate d17/ff0 3694430 0 2024-02-15T22:51:00.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/840: chown d17/d1e/d2d/d36/dca/da3/dbf/fe5 3 1 2024-02-15T22:51:00.564 INFO:tasks.workunit.client.0.smithi138.stdout:4/841: write d17/d1a/daa/fb6 [1046048,125957] 0 2024-02-15T22:51:00.565 INFO:tasks.workunit.client.0.smithi138.stdout:3/885: creat d5/d12/d26/da6/d107/d47/d67/f125 x:0 0 0 2024-02-15T22:51:00.567 INFO:tasks.workunit.client.0.smithi138.stdout:4/842: creat d17/d2b/dd8/d107/d115/f116 x:0 0 0 2024-02-15T22:51:00.568 INFO:tasks.workunit.client.0.smithi138.stdout:3/886: mknod d5/d12/d26/d2e/c126 0 2024-02-15T22:51:00.574 INFO:tasks.workunit.client.0.smithi138.stdout:3/887: dread d5/d12/d26/da6/d107/d47/f75 [0,4194304] 0 2024-02-15T22:51:00.575 INFO:tasks.workunit.client.0.smithi138.stdout:1/564: dwrite df/d1b/f69 [0,4194304] 0 2024-02-15T22:51:00.577 INFO:tasks.workunit.client.0.smithi138.stdout:5/653: dwrite df/d18/d3e/d60/f6b [4194304,4194304] 0 2024-02-15T22:51:00.577 INFO:tasks.workunit.client.0.smithi138.stdout:5/654: write df/d18/d3e/d51/dc9/d9c/daf/fbe [2363083,6624] 0 2024-02-15T22:51:00.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/565: mknod df/cbc 0 2024-02-15T22:51:00.579 INFO:tasks.workunit.client.0.smithi138.stdout:1/566: getdents df/d1b/d1d/d25/d2e/d5b/d65/d86/da0 0 2024-02-15T22:51:00.580 INFO:tasks.workunit.client.0.smithi138.stdout:5/655: creat df/d18/d56/fd5 x:0 0 0 2024-02-15T22:51:00.580 INFO:tasks.workunit.client.0.smithi138.stdout:5/656: getdents df/d18/d3e/d60/d65/dc2 0 2024-02-15T22:51:00.580 INFO:tasks.workunit.client.0.smithi138.stdout:5/657: chown df/d18/d3e/d51/dc9/l4f 140 1 2024-02-15T22:51:00.581 INFO:tasks.workunit.client.0.smithi138.stdout:5/658: symlink df/d18/d3e/d8a/ld6 0 2024-02-15T22:51:00.581 INFO:tasks.workunit.client.0.smithi138.stdout:5/659: write df/f27 [2416232,85880] 0 2024-02-15T22:51:00.582 INFO:tasks.workunit.client.0.smithi138.stdout:4/843: dwrite d17/d1e/d2d/f7c [0,4194304] 0 2024-02-15T22:51:00.584 INFO:tasks.workunit.client.0.smithi138.stdout:5/660: truncate df/d18/d3e/d51/dc9/f4d 348414 0 2024-02-15T22:51:00.584 INFO:tasks.workunit.client.0.smithi138.stdout:5/661: creat df/fd7 x:0 0 0 2024-02-15T22:51:00.586 INFO:tasks.workunit.client.0.smithi138.stdout:1/567: dread df/d1b/d1d/d25/d2e/d5b/f6d [0,4194304] 0 2024-02-15T22:51:00.595 INFO:tasks.workunit.client.0.smithi138.stdout:5/662: rename df/d18/d3e/d60/d65/lb6 to df/d18/d3e/d60/d65/d7f/ld8 0 2024-02-15T22:51:00.596 INFO:tasks.workunit.client.0.smithi138.stdout:5/663: mknod df/d18/d3e/d8a/cd9 0 2024-02-15T22:51:00.597 INFO:tasks.workunit.client.0.smithi138.stdout:3/888: dwrite d5/d16/fc1 [0,4194304] 0 2024-02-15T22:51:00.597 INFO:tasks.workunit.client.0.smithi138.stdout:3/889: write d5/d12/d26/da6/d107/d57/d5d/ff4 [93576,101304] 0 2024-02-15T22:51:00.597 INFO:tasks.workunit.client.0.smithi138.stdout:5/664: mknod df/d18/d77/cda 0 2024-02-15T22:51:00.600 INFO:tasks.workunit.client.0.smithi138.stdout:3/890: mknod d5/d16/d4d/de4/c127 0 2024-02-15T22:51:00.600 INFO:tasks.workunit.client.0.smithi138.stdout:3/891: truncate d5/d16/d4d/de4/fed 441408 0 2024-02-15T22:51:00.600 INFO:tasks.workunit.client.0.smithi138.stdout:3/892: readlink d5/d12/d26/da6/d107/d57/d5d/la4 0 2024-02-15T22:51:00.601 INFO:tasks.workunit.client.0.smithi138.stdout:5/665: unlink df/d18/d3e/d51/dc9/fa0 0 2024-02-15T22:51:00.603 INFO:tasks.workunit.client.0.smithi138.stdout:3/893: link d5/d16/dc/f66 d5/d12/d26/da6/d107/d57/d5d/de2/f128 0 2024-02-15T22:51:00.603 INFO:tasks.workunit.client.0.smithi138.stdout:3/894: write d5/d12/d26/da6/d107/d47/f10e [558351,89204] 0 2024-02-15T22:51:00.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/666: creat df/d18/d3e/d60/d65/d7f/d90/fdb x:0 0 0 2024-02-15T22:51:00.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/667: write df/d18/d3e/f48 [1483864,117066] 0 2024-02-15T22:51:00.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/668: fdatasync df/d18/d3e/d60/f7a 0 2024-02-15T22:51:00.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/669: dread - df/d18/d3e/d51/dc9/d9c/daf/fd3 zero size 2024-02-15T22:51:00.604 INFO:tasks.workunit.client.0.smithi138.stdout:5/670: creat df/d18/d77/fdc x:0 0 0 2024-02-15T22:51:00.605 INFO:tasks.workunit.client.0.smithi138.stdout:1/568: dwrite df/d1b/d1d/d25/d2e/d5b/fb0 [0,4194304] 0 2024-02-15T22:51:00.605 INFO:tasks.workunit.client.0.smithi138.stdout:1/569: stat df/d1b/d21/f32 0 2024-02-15T22:51:00.605 INFO:tasks.workunit.client.0.smithi138.stdout:4/844: dwrite d17/d1e/d2d/d36/f6e [4194304,4194304] 0 2024-02-15T22:51:00.605 INFO:tasks.workunit.client.0.smithi138.stdout:4/845: truncate d17/d1e/d2d/d36/f69 701474 0 2024-02-15T22:51:00.608 INFO:tasks.workunit.client.0.smithi138.stdout:5/671: creat df/d18/d3e/d60/d65/dc2/fdd x:0 0 0 2024-02-15T22:51:00.608 INFO:tasks.workunit.client.0.smithi138.stdout:5/672: truncate df/d18/d56/dae/fbc 219167 0 2024-02-15T22:51:00.609 INFO:tasks.workunit.client.0.smithi138.stdout:7/934: sync 2024-02-15T22:51:00.609 INFO:tasks.workunit.client.0.smithi138.stdout:0/690: sync 2024-02-15T22:51:00.609 INFO:tasks.workunit.client.0.smithi138.stdout:7/935: chown d1/d109/l107 827 1 2024-02-15T22:51:00.609 INFO:tasks.workunit.client.0.smithi138.stdout:0/691: write d6/d10/d13/d3d/dc6/fd1 [852854,72104] 0 2024-02-15T22:51:00.609 INFO:tasks.workunit.client.0.smithi138.stdout:7/936: creat d1/d2/db/d3c/d4d/d5b/f13d x:0 0 0 2024-02-15T22:51:00.612 INFO:tasks.workunit.client.0.smithi138.stdout:1/570: symlink df/d1b/d1d/d25/d2e/d5b/d65/db8/lbd 0 2024-02-15T22:51:00.622 INFO:tasks.workunit.client.0.smithi138.stdout:0/692: rmdir d6/d10/d18/d57/d8d 39 2024-02-15T22:51:00.623 INFO:tasks.workunit.client.0.smithi138.stdout:7/937: creat d1/d2/d29/f13e x:0 0 0 2024-02-15T22:51:00.624 INFO:tasks.workunit.client.0.smithi138.stdout:4/846: getdents d17/d1e/d2d/d36/d3e/d64 0 2024-02-15T22:51:00.626 INFO:tasks.workunit.client.0.smithi138.stdout:0/693: rmdir d6/d10/d18 39 2024-02-15T22:51:00.628 INFO:tasks.workunit.client.0.smithi138.stdout:0/694: symlink d6/d10/d18/d1b/lfa 0 2024-02-15T22:51:00.628 INFO:tasks.workunit.client.0.smithi138.stdout:0/695: chown d6/d10/d52/d72/la2 13799 1 2024-02-15T22:51:00.628 INFO:tasks.workunit.client.0.smithi138.stdout:8/785: sync 2024-02-15T22:51:00.628 INFO:tasks.workunit.client.0.smithi138.stdout:6/652: sync 2024-02-15T22:51:00.629 INFO:tasks.workunit.client.0.smithi138.stdout:9/916: sync 2024-02-15T22:51:00.629 INFO:tasks.workunit.client.0.smithi138.stdout:2/662: sync 2024-02-15T22:51:00.629 INFO:tasks.workunit.client.0.smithi138.stdout:8/786: dread - db/da0/de8/ff8 zero size 2024-02-15T22:51:00.629 INFO:tasks.workunit.client.0.smithi138.stdout:8/787: truncate db/d15/db6/df2/d13/d77/d8f/fff 930749 0 2024-02-15T22:51:00.630 INFO:tasks.workunit.client.0.smithi138.stdout:0/696: mkdir d6/d10/d13/d3d/dd2/dfb 0 2024-02-15T22:51:00.630 INFO:tasks.workunit.client.0.smithi138.stdout:6/653: symlink dc/d24/d6c/ddb/le4 0 2024-02-15T22:51:00.631 INFO:tasks.workunit.client.0.smithi138.stdout:8/788: symlink db/d15/db6/df2/d13/d19/d7d/l101 0 2024-02-15T22:51:00.632 INFO:tasks.workunit.client.0.smithi138.stdout:1/571: dwrite df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f66 [0,4194304] 0 2024-02-15T22:51:00.633 INFO:tasks.workunit.client.0.smithi138.stdout:9/917: symlink d0/de/d33/d57/l141 0 2024-02-15T22:51:00.634 INFO:tasks.workunit.client.0.smithi138.stdout:5/673: dwrite df/d18/f20 [0,4194304] 0 2024-02-15T22:51:00.634 INFO:tasks.workunit.client.0.smithi138.stdout:5/674: write df/d18/f25 [2244248,29329] 0 2024-02-15T22:51:00.635 INFO:tasks.workunit.client.0.smithi138.stdout:6/654: unlink dc/d24/d34/d3b/l65 0 2024-02-15T22:51:00.635 INFO:tasks.workunit.client.0.smithi138.stdout:6/655: stat dc/f79 0 2024-02-15T22:51:00.637 INFO:tasks.workunit.client.0.smithi138.stdout:7/938: read d1/d2/db/d3c/d4d/f52 [977751,28147] 0 2024-02-15T22:51:00.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/895: dwrite d5/d12/d26/da6/d107/da2/fe0 [0,4194304] 0 2024-02-15T22:51:00.639 INFO:tasks.workunit.client.0.smithi138.stdout:8/789: creat db/d15/db6/df2/d22/f102 x:0 0 0 2024-02-15T22:51:00.639 INFO:tasks.workunit.client.0.smithi138.stdout:8/790: fdatasync db/da0/fb5 0 2024-02-15T22:51:00.641 INFO:tasks.workunit.client.0.smithi138.stdout:6/656: mkdir dc/d24/d34/d99/de5 0 2024-02-15T22:51:00.641 INFO:tasks.workunit.client.0.smithi138.stdout:6/657: creat dc/d24/d34/d3b/d68/fe6 x:0 0 0 2024-02-15T22:51:00.641 INFO:tasks.workunit.client.0.smithi138.stdout:6/658: dread - dc/d24/f39 zero size 2024-02-15T22:51:00.641 INFO:tasks.workunit.client.0.smithi138.stdout:6/659: stat dc/d24/fd7 0 2024-02-15T22:51:00.641 INFO:tasks.workunit.client.0.smithi138.stdout:2/663: rename d0/dd/d9d to d0/da/d19/d53/d5d/d74/de9 0 2024-02-15T22:51:00.642 INFO:tasks.workunit.client.0.smithi138.stdout:6/660: chown dc/c19 40587036 1 2024-02-15T22:51:00.642 INFO:tasks.workunit.client.0.smithi138.stdout:6/661: truncate dc/d24/d6c/ddb/fdc 801673 0 2024-02-15T22:51:00.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/697: write d6/d10/d13/f41 [1974816,90979] 0 2024-02-15T22:51:00.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/698: write d6/d10/d64/faf [661478,64405] 0 2024-02-15T22:51:00.645 INFO:tasks.workunit.client.0.smithi138.stdout:5/675: dread df/d18/d56/f5d [0,4194304] 0 2024-02-15T22:51:00.647 INFO:tasks.workunit.client.0.smithi138.stdout:0/699: write d6/d10/d34/fe4 [345013,101222] 0 2024-02-15T22:51:00.651 INFO:tasks.workunit.client.0.smithi138.stdout:5/676: symlink df/d18/d3e/d60/d65/d7f/d9d/lde 0 2024-02-15T22:51:00.651 INFO:tasks.workunit.client.0.smithi138.stdout:2/664: rename d0/da/d19/d53/d5d/d6d/d7b/fac to d0/da/d95/fea 0 2024-02-15T22:51:00.651 INFO:tasks.workunit.client.0.smithi138.stdout:5/677: write df/d18/f4a [4411686,127702] 0 2024-02-15T22:51:00.651 INFO:tasks.workunit.client.0.smithi138.stdout:5/678: fsync df/f37 0 2024-02-15T22:51:00.652 INFO:tasks.workunit.client.0.smithi138.stdout:0/700: mkdir d6/d10/d75/dfc 0 2024-02-15T22:51:00.653 INFO:tasks.workunit.client.0.smithi138.stdout:2/665: mknod d0/da/d95/ceb 0 2024-02-15T22:51:00.654 INFO:tasks.workunit.client.0.smithi138.stdout:4/847: dwrite d17/d1e/d2d/d36/d3e/d64/fd3 [0,4194304] 0 2024-02-15T22:51:00.654 INFO:tasks.workunit.client.0.smithi138.stdout:4/848: chown d17/d2b/dd8/ff8 648228519 1 2024-02-15T22:51:00.655 INFO:tasks.workunit.client.0.smithi138.stdout:1/572: rename df/d1b/d21/d4f/lbb to df/d1b/d1d/d24/d3a/lbe 0 2024-02-15T22:51:00.656 INFO:tasks.workunit.client.0.smithi138.stdout:5/679: link df/d18/d3e/d60/f99 df/d18/d3e/d66/d82/fdf 0 2024-02-15T22:51:00.657 INFO:tasks.workunit.client.0.smithi138.stdout:5/680: creat df/d18/fe0 x:0 0 0 2024-02-15T22:51:00.657 INFO:tasks.workunit.client.0.smithi138.stdout:5/681: write df/d18/d3e/d60/f99 [560734,84613] 0 2024-02-15T22:51:00.659 INFO:tasks.workunit.client.0.smithi138.stdout:4/849: unlink d17/d1e/d2d/d52/c6d 0 2024-02-15T22:51:00.661 INFO:tasks.workunit.client.0.smithi138.stdout:7/939: rename d1/d2/db/c1a to d1/d79/d84/c13f 0 2024-02-15T22:51:00.662 INFO:tasks.workunit.client.0.smithi138.stdout:7/940: dread d1/d2/db/d3c/d4d/d5b/f76 [0,4194304] 0 2024-02-15T22:51:00.663 INFO:tasks.workunit.client.0.smithi138.stdout:5/682: mkdir df/d18/d3e/d60/de1 0 2024-02-15T22:51:00.664 INFO:tasks.workunit.client.0.smithi138.stdout:4/850: truncate d17/d1a/f50 1201555 0 2024-02-15T22:51:00.665 INFO:tasks.workunit.client.0.smithi138.stdout:7/941: mknod d1/d2/db/db9/c140 0 2024-02-15T22:51:00.666 INFO:tasks.workunit.client.0.smithi138.stdout:7/942: creat d1/d2/db/d3c/d4d/d5b/f141 x:0 0 0 2024-02-15T22:51:00.666 INFO:tasks.workunit.client.0.smithi138.stdout:7/943: write d1/d109/fbf [1042089,34123] 0 2024-02-15T22:51:00.668 INFO:tasks.workunit.client.0.smithi138.stdout:7/944: link d1/l85 d1/d2/d128/l142 0 2024-02-15T22:51:00.670 INFO:tasks.workunit.client.0.smithi138.stdout:7/945: rename d1/d2/db/fc0 to d1/d2/db/f143 0 2024-02-15T22:51:00.676 INFO:tasks.workunit.client.0.smithi138.stdout:5/683: dread df/d18/d3e/f41 [0,4194304] 0 2024-02-15T22:51:00.686 INFO:tasks.workunit.client.0.smithi138.stdout:3/896: dwrite d5/d16/fa [0,4194304] 0 2024-02-15T22:51:00.687 INFO:tasks.workunit.client.0.smithi138.stdout:3/897: read d5/d16/d4d/f85 [73251,55795] 0 2024-02-15T22:51:00.688 INFO:tasks.workunit.client.0.smithi138.stdout:3/898: creat d5/d12/d26/da6/d107/d57/d5d/f129 x:0 0 0 2024-02-15T22:51:00.688 INFO:tasks.workunit.client.0.smithi138.stdout:3/899: chown d5/d16/d4d/de4 14856 1 2024-02-15T22:51:00.689 INFO:tasks.workunit.client.0.smithi138.stdout:3/900: write d5/d12/f1d [763357,62732] 0 2024-02-15T22:51:00.689 INFO:tasks.workunit.client.0.smithi138.stdout:3/901: write d5/d16/f10 [3345693,120108] 0 2024-02-15T22:51:00.695 INFO:tasks.workunit.client.0.smithi138.stdout:9/918: dwrite d0/d1/fb2 [0,4194304] 0 2024-02-15T22:51:00.695 INFO:tasks.workunit.client.0.smithi138.stdout:9/919: stat d0/de/d33/d98/fae 0 2024-02-15T22:51:00.696 INFO:tasks.workunit.client.0.smithi138.stdout:9/920: dread d0/de/d14/f123 [0,4194304] 0 2024-02-15T22:51:00.697 INFO:tasks.workunit.client.0.smithi138.stdout:8/791: dwrite db/d15/db6/df2/d13/d19/fbd [0,4194304] 0 2024-02-15T22:51:00.697 INFO:tasks.workunit.client.0.smithi138.stdout:8/792: fdatasync db/d15/db6/df2/d4d/fa4 0 2024-02-15T22:51:00.697 INFO:tasks.workunit.client.0.smithi138.stdout:9/921: rmdir d0/d55/d59 39 2024-02-15T22:51:00.699 INFO:tasks.workunit.client.0.smithi138.stdout:8/793: creat db/d15/db6/df2/f103 x:0 0 0 2024-02-15T22:51:00.699 INFO:tasks.workunit.client.0.smithi138.stdout:8/794: write db/d15/d70/d7c/d92/de6/fd3 [584208,63193] 0 2024-02-15T22:51:00.700 INFO:tasks.workunit.client.0.smithi138.stdout:9/922: link d0/d4/c28 d0/de/d33/d98/da6/c142 0 2024-02-15T22:51:00.701 INFO:tasks.workunit.client.0.smithi138.stdout:8/795: truncate db/f3d 1701896 0 2024-02-15T22:51:00.701 INFO:tasks.workunit.client.0.smithi138.stdout:1/573: dwrite df/d1b/d33/f9d [0,4194304] 0 2024-02-15T22:51:00.702 INFO:tasks.workunit.client.0.smithi138.stdout:7/946: dwrite d1/f6b [4194304,4194304] 0 2024-02-15T22:51:00.702 INFO:tasks.workunit.client.0.smithi138.stdout:7/947: truncate d1/d109/fe8 517989 0 2024-02-15T22:51:00.702 INFO:tasks.workunit.client.0.smithi138.stdout:4/851: dwrite d17/d1e/d2d/d36/fe4 [0,4194304] 0 2024-02-15T22:51:00.702 INFO:tasks.workunit.client.0.smithi138.stdout:5/684: dwrite df/d18/d3e/d66/d82/f94 [0,4194304] 0 2024-02-15T22:51:00.702 INFO:tasks.workunit.client.0.smithi138.stdout:5/685: write df/d18/d77/fca [360764,43384] 0 2024-02-15T22:51:00.703 INFO:tasks.workunit.client.0.smithi138.stdout:9/923: creat d0/d2e/f143 x:0 0 0 2024-02-15T22:51:00.704 INFO:tasks.workunit.client.0.smithi138.stdout:8/796: symlink db/d15/db6/df4/l104 0 2024-02-15T22:51:00.704 INFO:tasks.workunit.client.0.smithi138.stdout:8/797: write db/da0/fb5 [745064,27735] 0 2024-02-15T22:51:00.706 INFO:tasks.workunit.client.0.smithi138.stdout:4/852: dread d17/d1e/d56/f5c [0,4194304] 0 2024-02-15T22:51:00.706 INFO:tasks.workunit.client.0.smithi138.stdout:4/853: chown d17/f6a 6 1 2024-02-15T22:51:00.707 INFO:tasks.workunit.client.0.smithi138.stdout:1/574: creat df/d1b/d1d/d24/fbf x:0 0 0 2024-02-15T22:51:00.707 INFO:tasks.workunit.client.0.smithi138.stdout:1/575: write df/d1b/d1d/d24/d3a/f44 [1837927,82190] 0 2024-02-15T22:51:00.709 INFO:tasks.workunit.client.0.smithi138.stdout:7/948: rmdir d1/d109 39 2024-02-15T22:51:00.709 INFO:tasks.workunit.client.0.smithi138.stdout:7/949: fsync d1/f12 0 2024-02-15T22:51:00.716 INFO:tasks.workunit.client.0.smithi138.stdout:5/686: mkdir df/d18/d3e/d66/de2 0 2024-02-15T22:51:00.721 INFO:tasks.workunit.client.0.smithi138.stdout:9/924: unlink d0/de/d14/d18/d10d/d116/d121/d7b/cc4 0 2024-02-15T22:51:00.721 INFO:tasks.workunit.client.0.smithi138.stdout:9/925: write d0/de/d14/dbd/fff [119699,26472] 0 2024-02-15T22:51:00.721 INFO:tasks.workunit.client.0.smithi138.stdout:9/926: getdents d0/d55/d139 0 2024-02-15T22:51:00.721 INFO:tasks.workunit.client.0.smithi138.stdout:9/927: write d0/de/d34/dd3/dec/f11c [842998,118014] 0 2024-02-15T22:51:00.723 INFO:tasks.workunit.client.0.smithi138.stdout:1/576: unlink df/d1b/f4c 0 2024-02-15T22:51:00.724 INFO:tasks.workunit.client.0.smithi138.stdout:7/950: creat d1/d2/db/d25/d41/f144 x:0 0 0 2024-02-15T22:51:00.725 INFO:tasks.workunit.client.0.smithi138.stdout:7/951: write d1/d5a/fef [1034744,53482] 0 2024-02-15T22:51:00.725 INFO:tasks.workunit.client.0.smithi138.stdout:7/952: dread - d1/d5a/d97/f100 zero size 2024-02-15T22:51:00.726 INFO:tasks.workunit.client.0.smithi138.stdout:6/662: rename dc/d24/d34/d3b/d68 to dc/d24/d6c/dbc/de7 0 2024-02-15T22:51:00.727 INFO:tasks.workunit.client.0.smithi138.stdout:5/687: mknod df/d18/d56/ce3 0 2024-02-15T22:51:00.729 INFO:tasks.workunit.client.0.smithi138.stdout:7/953: dread d1/d79/d84/da0/fc2 [0,4194304] 0 2024-02-15T22:51:00.730 INFO:tasks.workunit.client.0.smithi138.stdout:9/928: link d0/de/d14/d22/f113 d0/de/d14/d18/d10d/d116/f144 0 2024-02-15T22:51:00.731 INFO:tasks.workunit.client.0.smithi138.stdout:1/577: mknod df/d1b/d1d/cc0 0 2024-02-15T22:51:00.732 INFO:tasks.workunit.client.0.smithi138.stdout:0/701: rename d6/d10/d13/f45 to d6/d10/d64/dd7/ffd 0 2024-02-15T22:51:00.733 INFO:tasks.workunit.client.0.smithi138.stdout:6/663: truncate dc/f3a 3290300 0 2024-02-15T22:51:00.737 INFO:tasks.workunit.client.0.smithi138.stdout:2/666: rename d0/da/d19/d53/d5d/d6d/lc3 to d0/da/d19/d53/d5d/d83/d8a/dc2/lec 0 2024-02-15T22:51:00.737 INFO:tasks.workunit.client.0.smithi138.stdout:2/667: fdatasync d0/da/d19/d53/d80/dba/fcb 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:4/854: rename d17/d1a/l60 to d17/d1e/d2d/dd5/l117 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:5/688: rename df/d18 to df/d18/d3e/d60/d65/d7f/de4 22 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:7/954: read d1/d2/db/fb2 [2565625,17901] 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:7/955: chown d1/d2/db 30 1 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:7/956: creat d1/d2/f145 x:0 0 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:7/957: fsync d1/d5a/d97/fd6 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:2/668: symlink d0/da/dca/led 0 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:2/669: chown d0/da/d19/d53/d5d/d83/fc0 118316 1 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:2/670: chown d0/da/d19/d53/f8e 519 1 2024-02-15T22:51:00.739 INFO:tasks.workunit.client.0.smithi138.stdout:2/671: readlink d0/da/d19/l56 0 2024-02-15T22:51:00.740 INFO:tasks.workunit.client.0.smithi138.stdout:4/855: creat d17/d2b/d78/dc0/dc4/f118 x:0 0 0 2024-02-15T22:51:00.740 INFO:tasks.workunit.client.0.smithi138.stdout:7/958: link d1/d2/l125 d1/d5a/d12c/l146 0 2024-02-15T22:51:00.741 INFO:tasks.workunit.client.0.smithi138.stdout:2/672: symlink d0/dd/d15/de3/lee 0 2024-02-15T22:51:00.742 INFO:tasks.workunit.client.0.smithi138.stdout:7/959: symlink d1/d79/d84/d8c/l147 0 2024-02-15T22:51:00.742 INFO:tasks.workunit.client.0.smithi138.stdout:7/960: fsync d1/d79/d84/da0/ddf/fce 0 2024-02-15T22:51:00.742 INFO:tasks.workunit.client.0.smithi138.stdout:7/961: write d1/d2/d29/f2d [1614310,25927] 0 2024-02-15T22:51:00.742 INFO:tasks.workunit.client.0.smithi138.stdout:2/673: mknod d0/da/d19/d53/d5d/dcc/cef 0 2024-02-15T22:51:00.743 INFO:tasks.workunit.client.0.smithi138.stdout:7/962: mknod d1/d79/c148 0 2024-02-15T22:51:00.743 INFO:tasks.workunit.client.0.smithi138.stdout:2/674: creat d0/da/dca/ff0 x:0 0 0 2024-02-15T22:51:00.745 INFO:tasks.workunit.client.0.smithi138.stdout:2/675: mknod d0/dd/d15/de3/cf1 0 2024-02-15T22:51:00.745 INFO:tasks.workunit.client.0.smithi138.stdout:7/963: rmdir d1/d79/d84/da0/ddf 39 2024-02-15T22:51:00.769 INFO:tasks.workunit.client.0.smithi138.stdout:8/798: write db/d15/db6/df2/d13/d19/fbd [2646099,87841] 0 2024-02-15T22:51:00.772 INFO:tasks.workunit.client.0.smithi138.stdout:1/578: dread df/d1b/d1d/d25/fa6 [4194304,4194304] 0 2024-02-15T22:51:00.775 INFO:tasks.workunit.client.0.smithi138.stdout:7/964: dwrite d1/d79/d84/da0/fa5 [0,4194304] 0 2024-02-15T22:51:00.775 INFO:tasks.workunit.client.0.smithi138.stdout:7/965: chown d1/d79/d84/c13f 110 1 2024-02-15T22:51:00.775 INFO:tasks.workunit.client.0.smithi138.stdout:7/966: stat d1/d2/db/d25/d41/dee 0 2024-02-15T22:51:00.779 INFO:tasks.workunit.client.0.smithi138.stdout:9/929: dread d0/de/d14/d22/ffc [0,4194304] 0 2024-02-15T22:51:00.780 INFO:tasks.workunit.client.0.smithi138.stdout:9/930: chown d0/d2e/fc6 23717 1 2024-02-15T22:51:00.781 INFO:tasks.workunit.client.0.smithi138.stdout:7/967: mkdir d1/d79/d84/d8c/d149 0 2024-02-15T22:51:00.781 INFO:tasks.workunit.client.0.smithi138.stdout:7/968: dread - d1/d79/d84/d8c/fa7 zero size 2024-02-15T22:51:00.785 INFO:tasks.workunit.client.0.smithi138.stdout:9/931: mknod d0/de/d14/d18/d10d/d116/d121/d7b/c145 0 2024-02-15T22:51:00.786 INFO:tasks.workunit.client.0.smithi138.stdout:0/702: dwrite d6/d10/d13/fb7 [0,4194304] 0 2024-02-15T22:51:00.787 INFO:tasks.workunit.client.0.smithi138.stdout:1/579: rmdir df/d1b/d1d/d25/d2e/d5b/d65/d86/da0 0 2024-02-15T22:51:00.789 INFO:tasks.workunit.client.0.smithi138.stdout:9/932: mkdir d0/d55/d59/dac/d146 0 2024-02-15T22:51:00.789 INFO:tasks.workunit.client.0.smithi138.stdout:9/933: read - d0/fe5 zero size 2024-02-15T22:51:00.790 INFO:tasks.workunit.client.0.smithi138.stdout:9/934: creat d0/de/d14/d18/d10d/d116/d121/d7b/d9e/f147 x:0 0 0 2024-02-15T22:51:00.791 INFO:tasks.workunit.client.0.smithi138.stdout:2/676: dwrite d0/da/d19/fc7 [0,4194304] 0 2024-02-15T22:51:00.792 INFO:tasks.workunit.client.0.smithi138.stdout:0/703: creat d6/d10/d34/dcf/ffe x:0 0 0 2024-02-15T22:51:00.792 INFO:tasks.workunit.client.0.smithi138.stdout:2/677: truncate d0/f1 4685910 0 2024-02-15T22:51:00.792 INFO:tasks.workunit.client.0.smithi138.stdout:2/678: chown d0/dd/d15/de3 3267 1 2024-02-15T22:51:00.792 INFO:tasks.workunit.client.0.smithi138.stdout:0/704: write d6/d10/d13/d3d/f70 [4974012,116983] 0 2024-02-15T22:51:00.795 INFO:tasks.workunit.client.0.smithi138.stdout:0/705: unlink d6/d10/c2f 0 2024-02-15T22:51:00.798 INFO:tasks.workunit.client.0.smithi138.stdout:8/799: dwrite db/d15/db6/df2/fce [0,4194304] 0 2024-02-15T22:51:00.802 INFO:tasks.workunit.client.0.smithi138.stdout:1/580: write df/f53 [2472170,80975] 0 2024-02-15T22:51:00.802 INFO:tasks.workunit.client.0.smithi138.stdout:0/706: rmdir d6/d10/d52/d6f/d85 39 2024-02-15T22:51:00.806 INFO:tasks.workunit.client.0.smithi138.stdout:1/581: mknod df/d1b/d1d/d25/d8d/cc1 0 2024-02-15T22:51:00.810 INFO:tasks.workunit.client.0.smithi138.stdout:0/707: unlink d6/d10/d40/c44 0 2024-02-15T22:51:00.814 INFO:tasks.workunit.client.0.smithi138.stdout:0/708: symlink d6/d10/d18/lff 0 2024-02-15T22:51:00.814 INFO:tasks.workunit.client.0.smithi138.stdout:0/709: fsync d6/d10/d34/f3b 0 2024-02-15T22:51:00.816 INFO:tasks.workunit.client.0.smithi138.stdout:1/582: dread df/d1b/d1d/d25/d2e/d6c/f76 [0,4194304] 0 2024-02-15T22:51:00.816 INFO:tasks.workunit.client.0.smithi138.stdout:7/969: dwrite d1/d2/d29/f2d [0,4194304] 0 2024-02-15T22:51:00.816 INFO:tasks.workunit.client.0.smithi138.stdout:7/970: creat d1/d2/db/d25/d41/f14a x:0 0 0 2024-02-15T22:51:00.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/710: mknod d6/d10/d64/dbf/dcc/c100 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/711: dread d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/712: stat d6/d10/d64/dbf/dcc/c100 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/713: fdatasync d6/d10/d52/d72/f8c 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/714: readlink d6/d10/d34/l93 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:0/715: write d6/d10/d64/dbf/dcc/fef [681899,6597] 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:1/583: mknod df/d41/cc2 0 2024-02-15T22:51:00.819 INFO:tasks.workunit.client.0.smithi138.stdout:1/584: dread - df/d1b/d1d/d24/fbf zero size 2024-02-15T22:51:00.821 INFO:tasks.workunit.client.0.smithi138.stdout:9/935: dwrite d0/d4/f2c [0,4194304] 0 2024-02-15T22:51:00.822 INFO:tasks.workunit.client.0.smithi138.stdout:2/679: dwrite d0/da/d19/d53/d5d/fc9 [0,4194304] 0 2024-02-15T22:51:00.824 INFO:tasks.workunit.client.0.smithi138.stdout:7/971: symlink d1/d2/db/d25/df6/l14b 0 2024-02-15T22:51:00.827 INFO:tasks.workunit.client.0.smithi138.stdout:6/664: write dc/f3a [726395,123032] 0 2024-02-15T22:51:00.827 INFO:tasks.workunit.client.0.smithi138.stdout:1/585: link df/d1b/d1d/d25/d2e/d5b/d65/l95 df/d1b/d33/lc3 0 2024-02-15T22:51:00.830 INFO:tasks.workunit.client.0.smithi138.stdout:9/936: mknod d0/de/d33/d98/da6/c148 0 2024-02-15T22:51:00.835 INFO:tasks.workunit.client.0.smithi138.stdout:7/972: rename d1/d2/db/d3c/d4d/d63/c118 to d1/d79/d84/da0/c14c 0 2024-02-15T22:51:00.836 INFO:tasks.workunit.client.0.smithi138.stdout:7/973: write d1/d79/d84/f112 [445107,38867] 0 2024-02-15T22:51:00.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/716: dwrite d6/d10/d13/f2b [0,4194304] 0 2024-02-15T22:51:00.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/717: dread - d6/d10/d75/db1/fdf zero size 2024-02-15T22:51:00.836 INFO:tasks.workunit.client.0.smithi138.stdout:0/718: truncate d6/d10/d34/dcf/fe0 822335 0 2024-02-15T22:51:00.837 INFO:tasks.workunit.client.0.smithi138.stdout:1/586: symlink df/d1b/d1d/d25/lc4 0 2024-02-15T22:51:00.839 INFO:tasks.workunit.client.0.smithi138.stdout:9/937: creat d0/d1/db8/d126/f149 x:0 0 0 2024-02-15T22:51:00.839 INFO:tasks.workunit.client.0.smithi138.stdout:9/938: fdatasync d0/d55/d59/ffa 0 2024-02-15T22:51:00.844 INFO:tasks.workunit.client.0.smithi138.stdout:2/680: rmdir d0/d3 39 2024-02-15T22:51:00.844 INFO:tasks.workunit.client.0.smithi138.stdout:2/681: write d0/da/d19/d53/d5d/d6d/d7b/fdd [1017757,48826] 0 2024-02-15T22:51:00.848 INFO:tasks.workunit.client.0.smithi138.stdout:7/974: mknod d1/d2/c14d 0 2024-02-15T22:51:00.849 INFO:tasks.workunit.client.0.smithi138.stdout:7/975: creat d1/d2/db/d25/d41/f14e x:0 0 0 2024-02-15T22:51:00.849 INFO:tasks.workunit.client.0.smithi138.stdout:6/665: dwrite dc/d24/d34/d3b/d7c/f93 [4194304,4194304] 0 2024-02-15T22:51:00.850 INFO:tasks.workunit.client.0.smithi138.stdout:6/666: dread dc/ff [4194304,4194304] 0 2024-02-15T22:51:00.852 INFO:tasks.workunit.client.0.smithi138.stdout:0/719: creat d6/d10/d52/f101 x:0 0 0 2024-02-15T22:51:00.852 INFO:tasks.workunit.client.0.smithi138.stdout:0/720: write d6/d10/f14 [2154410,2450] 0 2024-02-15T22:51:00.852 INFO:tasks.workunit.client.0.smithi138.stdout:0/721: truncate d6/d10/d40/f91 533099 0 2024-02-15T22:51:00.852 INFO:tasks.workunit.client.0.smithi138.stdout:0/722: dread - d6/d10/d34/df6/fd9 zero size 2024-02-15T22:51:00.857 INFO:tasks.workunit.client.0.smithi138.stdout:7/976: read d1/d2/d29/f2d [3437752,85822] 0 2024-02-15T22:51:00.859 INFO:tasks.workunit.client.0.smithi138.stdout:6/667: rmdir dc/d4b/d98 39 2024-02-15T22:51:00.861 INFO:tasks.workunit.client.0.smithi138.stdout:7/977: mknod d1/d2/db/d25/df6/c14f 0 2024-02-15T22:51:00.862 INFO:tasks.workunit.client.0.smithi138.stdout:7/978: readlink d1/d79/d84/d8c/l147 0 2024-02-15T22:51:00.862 INFO:tasks.workunit.client.0.smithi138.stdout:0/723: dread d6/d10/d75/db1/fae [0,4194304] 0 2024-02-15T22:51:00.862 INFO:tasks.workunit.client.0.smithi138.stdout:7/979: write d1/d2/db/fb0 [580696,42265] 0 2024-02-15T22:51:00.863 INFO:tasks.workunit.client.0.smithi138.stdout:6/668: creat dc/d24/d6c/ddb/ddf/fe8 x:0 0 0 2024-02-15T22:51:00.872 INFO:tasks.workunit.client.0.smithi138.stdout:6/669: dread dc/fb6 [0,4194304] 0 2024-02-15T22:51:00.873 INFO:tasks.workunit.client.0.smithi138.stdout:6/670: truncate dc/d24/d34/d3b/d7c/da8/fc0 744261 0 2024-02-15T22:51:00.873 INFO:tasks.workunit.client.0.smithi138.stdout:6/671: write dc/d24/d34/d3b/d7c/da8/fc0 [1333197,66131] 0 2024-02-15T22:51:00.873 INFO:tasks.workunit.client.0.smithi138.stdout:0/724: rename d6/d10/d64/dbf to d6/d10/d75/d102 0 2024-02-15T22:51:00.874 INFO:tasks.workunit.client.0.smithi138.stdout:1/587: dwrite df/d1b/f1f [0,4194304] 0 2024-02-15T22:51:00.875 INFO:tasks.workunit.client.0.smithi138.stdout:9/939: dwrite d0/de/d14/f44 [0,4194304] 0 2024-02-15T22:51:00.875 INFO:tasks.workunit.client.0.smithi138.stdout:9/940: truncate d0/de/d34/fea 419213 0 2024-02-15T22:51:00.875 INFO:tasks.workunit.client.0.smithi138.stdout:9/941: readlink d0/de/d14/d18/d10d/d116/d121/d7b/l8b 0 2024-02-15T22:51:00.875 INFO:tasks.workunit.client.0.smithi138.stdout:9/942: creat d0/dc7/f14a x:0 0 0 2024-02-15T22:51:00.875 INFO:tasks.workunit.client.0.smithi138.stdout:9/943: chown d0/dc7/fd2 198723182 1 2024-02-15T22:51:00.876 INFO:tasks.workunit.client.0.smithi138.stdout:2/682: dwrite d0/da/d19/d53/d80/fb0 [0,4194304] 0 2024-02-15T22:51:00.876 INFO:tasks.workunit.client.0.smithi138.stdout:2/683: truncate d0/dd/d15/f71 1762983 0 2024-02-15T22:51:00.876 INFO:tasks.workunit.client.0.smithi138.stdout:2/684: creat d0/da/d19/d53/ff2 x:0 0 0 2024-02-15T22:51:00.879 INFO:tasks.workunit.client.0.smithi138.stdout:6/672: rmdir dc/d24/d34/d99/de5 0 2024-02-15T22:51:00.879 INFO:tasks.workunit.client.0.smithi138.stdout:6/673: dread - dc/d4b/f9e zero size 2024-02-15T22:51:00.879 INFO:tasks.workunit.client.0.smithi138.stdout:6/674: truncate dc/fd3 802120 0 2024-02-15T22:51:00.881 INFO:tasks.workunit.client.0.smithi138.stdout:7/980: rename d1/d2/f80 to d1/d2/db/d3c/d4d/f150 0 2024-02-15T22:51:00.886 INFO:tasks.workunit.client.0.smithi138.stdout:0/725: write d6/d10/d52/d72/fd3 [938449,64189] 0 2024-02-15T22:51:00.886 INFO:tasks.workunit.client.0.smithi138.stdout:0/726: creat d6/d10/d13/d3d/dc6/f103 x:0 0 0 2024-02-15T22:51:00.887 INFO:tasks.workunit.client.0.smithi138.stdout:9/944: symlink d0/de/d14/d18/d10d/d116/l14b 0 2024-02-15T22:51:00.890 INFO:tasks.workunit.client.0.smithi138.stdout:2/685: symlink d0/da/d19/d53/d5d/lf3 0 2024-02-15T22:51:00.892 INFO:tasks.workunit.client.0.smithi138.stdout:1/588: dwrite df/d1b/d1d/d25/d2e/d6c/f94 [0,4194304] 0 2024-02-15T22:51:00.892 INFO:tasks.workunit.client.0.smithi138.stdout:1/589: write df/d1b/d1d/d25/d2e/d5b/f67 [1912511,78485] 0 2024-02-15T22:51:00.893 INFO:tasks.workunit.client.0.smithi138.stdout:7/981: mkdir d1/d79/d84/d8c/d10a/d151 0 2024-02-15T22:51:00.893 INFO:tasks.workunit.client.0.smithi138.stdout:7/982: chown d1/f12 1564294 1 2024-02-15T22:51:00.893 INFO:tasks.workunit.client.0.smithi138.stdout:7/983: getdents d1/d2/db/d3c/d4d/d5b/dda 0 2024-02-15T22:51:00.895 INFO:tasks.workunit.client.0.smithi138.stdout:1/590: dread df/d41/f49 [0,4194304] 0 2024-02-15T22:51:00.896 INFO:tasks.workunit.client.0.smithi138.stdout:9/945: creat d0/de/d14/d18/d10d/f14c x:0 0 0 2024-02-15T22:51:00.898 INFO:tasks.workunit.client.0.smithi138.stdout:2/686: getdents d0/da/d19/d53/d5d/d6d 0 2024-02-15T22:51:00.900 INFO:tasks.workunit.client.0.smithi138.stdout:6/675: dwrite dc/d24/d34/d3b/d7c/d9f/fa5 [0,4194304] 0 2024-02-15T22:51:00.900 INFO:tasks.workunit.client.0.smithi138.stdout:6/676: truncate dc/d4b/dba/fcb 71279 0 2024-02-15T22:51:00.902 INFO:tasks.workunit.client.0.smithi138.stdout:7/984: rmdir d1/d79/d84/da0/ddf 39 2024-02-15T22:51:00.904 INFO:tasks.workunit.client.0.smithi138.stdout:0/727: read d6/f6b [4113350,38309] 0 2024-02-15T22:51:00.904 INFO:tasks.workunit.client.0.smithi138.stdout:6/677: dread dc/d76/d96/fbd [0,4194304] 0 2024-02-15T22:51:00.904 INFO:tasks.workunit.client.0.smithi138.stdout:6/678: fdatasync dc/d24/d34/f5c 0 2024-02-15T22:51:00.905 INFO:tasks.workunit.client.0.smithi138.stdout:1/591: symlink df/d41/lc5 0 2024-02-15T22:51:00.905 INFO:tasks.workunit.client.0.smithi138.stdout:1/592: chown df/d1b/d1d/d25/d2e/d5b/d7b 51153548 1 2024-02-15T22:51:00.905 INFO:tasks.workunit.client.0.smithi138.stdout:1/593: creat df/d1b/d1d/d24/fc6 x:0 0 0 2024-02-15T22:51:00.909 INFO:tasks.workunit.client.0.smithi138.stdout:9/946: mknod d0/d4/c14d 0 2024-02-15T22:51:00.909 INFO:tasks.workunit.client.0.smithi138.stdout:6/679: write dc/d24/f26 [4772157,49854] 0 2024-02-15T22:51:00.912 INFO:tasks.workunit.client.0.smithi138.stdout:2/687: symlink d0/dd/lf4 0 2024-02-15T22:51:00.912 INFO:tasks.workunit.client.0.smithi138.stdout:2/688: truncate d0/dd/d15/f6c 929441 0 2024-02-15T22:51:00.912 INFO:tasks.workunit.client.0.smithi138.stdout:2/689: dread - d0/da/d19/d53/fa4 zero size 2024-02-15T22:51:00.921 INFO:tasks.workunit.client.0.smithi138.stdout:2/690: dread d0/dd/d15/f57 [0,4194304] 0 2024-02-15T22:51:00.924 INFO:tasks.workunit.client.0.smithi138.stdout:9/947: dwrite d0/de/d14/da3/dc8/f42 [0,4194304] 0 2024-02-15T22:51:00.932 INFO:tasks.workunit.client.0.smithi138.stdout:7/985: creat d1/d79/d84/da0/ddf/f152 x:0 0 0 2024-02-15T22:51:00.932 INFO:tasks.workunit.client.0.smithi138.stdout:7/986: truncate d1/d109/fbf 1152191 0 2024-02-15T22:51:00.933 INFO:tasks.workunit.client.0.smithi138.stdout:1/594: creat df/d1b/fc7 x:0 0 0 2024-02-15T22:51:00.934 INFO:tasks.workunit.client.0.smithi138.stdout:6/680: mknod dc/d24/d34/dde/ce9 0 2024-02-15T22:51:00.939 INFO:tasks.workunit.client.0.smithi138.stdout:7/987: link d1/d2/d29/fb8 d1/d79/d84/da0/ddf/f153 0 2024-02-15T22:51:00.939 INFO:tasks.workunit.client.0.smithi138.stdout:7/988: chown d1/d2/db/d25/d41/dee/d114 5337 1 2024-02-15T22:51:00.941 INFO:tasks.workunit.client.0.smithi138.stdout:1/595: rename df/f83 to df/d1b/d21/fc8 0 2024-02-15T22:51:00.941 INFO:tasks.workunit.client.0.smithi138.stdout:1/596: creat df/d1b/d1d/d25/d2e/d5b/fc9 x:0 0 0 2024-02-15T22:51:00.942 INFO:tasks.workunit.client.0.smithi138.stdout:6/681: mkdir dc/d24/dea 0 2024-02-15T22:51:00.942 INFO:tasks.workunit.client.0.smithi138.stdout:6/682: write dc/d24/d34/d3b/f4a [1331167,84973] 0 2024-02-15T22:51:00.943 INFO:tasks.workunit.client.0.smithi138.stdout:6/683: stat dc/d24/d34/d3b/d7c/f92 0 2024-02-15T22:51:00.943 INFO:tasks.workunit.client.0.smithi138.stdout:6/684: truncate dc/d24/d34/d3b/d7c/fad 1142032 0 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:1/597: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f6f [0,4194304] 0 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:7/989: creat d1/d79/d127/f154 x:0 0 0 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:7/990: truncate d1/faa 2760483 0 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:7/991: write d1/d109/fbf [2095020,14364] 0 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:7/992: read - d1/d2/db/d3c/d4d/f150 zero size 2024-02-15T22:51:00.944 INFO:tasks.workunit.client.0.smithi138.stdout:7/993: fsync d1/d2/f8d 0 2024-02-15T22:51:00.947 INFO:tasks.workunit.client.1.smithi170.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T22:51:00.947 INFO:tasks.workunit.client.0.smithi138.stdout:1/598: creat df/d1b/d1d/d25/fca x:0 0 0 2024-02-15T22:51:00.948 INFO:tasks.workunit.client.0.smithi138.stdout:7/994: mknod d1/d5a/c155 0 2024-02-15T22:51:00.949 INFO:tasks.workunit.client.0.smithi138.stdout:6/685: dread dc/d24/d34/d3b/d66/f74 [0,4194304] 0 2024-02-15T22:51:00.952 INFO:tasks.workunit.client.0.smithi138.stdout:7/995: getdents d1/d79 0 2024-02-15T22:51:00.954 INFO:tasks.workunit.client.0.smithi138.stdout:6/686: rmdir dc/d4b/d7b 39 2024-02-15T22:51:00.954 INFO:tasks.workunit.client.1.smithi170.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:51:00.955 INFO:tasks.workunit.client.1.smithi170.stderr:+ make 2024-02-15T22:51:00.955 INFO:tasks.workunit.client.0.smithi138.stdout:7/996: creat d1/d28/f156 x:0 0 0 2024-02-15T22:51:00.960 INFO:tasks.workunit.client.0.smithi138.stdout:7/997: creat d1/d79/d84/d8c/d10a/f157 x:0 0 0 2024-02-15T22:51:00.960 INFO:tasks.workunit.client.0.smithi138.stdout:2/691: truncate d0/f1 4061684 0 2024-02-15T22:51:00.960 INFO:tasks.workunit.client.0.smithi138.stdout:2/692: rmdir d0/da/d19/d53/d5d/d83/d8a 39 2024-02-15T22:51:00.960 INFO:tasks.workunit.client.0.smithi138.stdout:2/693: stat d0/dd/d15/d65/le0 0 2024-02-15T22:51:00.960 INFO:tasks.workunit.client.0.smithi138.stdout:2/694: dread d0/da/d95/fa1 [0,4194304] 0 2024-02-15T22:51:00.961 INFO:tasks.workunit.client.0.smithi138.stdout:2/695: creat d0/da/d19/d53/ff5 x:0 0 0 2024-02-15T22:51:00.961 INFO:tasks.workunit.client.0.smithi138.stdout:2/696: truncate d0/da/d19/d53/d5d/d74/d79/fa5 182677 0 2024-02-15T22:51:00.961 INFO:tasks.workunit.client.0.smithi138.stdout:2/697: write d0/da/d95/fa1 [51831,88359] 0 2024-02-15T22:51:00.963 INFO:tasks.workunit.client.0.smithi138.stdout:6/687: dread dc/f1a [0,4194304] 0 2024-02-15T22:51:00.963 INFO:tasks.workunit.client.0.smithi138.stdout:6/688: stat dc/d24/d34/d3b/d66 0 2024-02-15T22:51:00.964 INFO:tasks.workunit.client.0.smithi138.stdout:6/689: mkdir dc/d4b/d98/dd6/deb 0 2024-02-15T22:51:00.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/698: write d0/da/d19/d53/d5d/fc9 [3276176,122053] 0 2024-02-15T22:51:00.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/699: write d0/da/d19/d53/ff5 [742852,16860] 0 2024-02-15T22:51:00.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/700: write d0/dd/fe4 [789600,24424] 0 2024-02-15T22:51:00.970 INFO:tasks.workunit.client.0.smithi138.stdout:2/701: truncate d0/dd/d15/f4b 834698 0 2024-02-15T22:51:00.971 INFO:tasks.workunit.client.0.smithi138.stdout:6/690: dread dc/f46 [0,4194304] 0 2024-02-15T22:51:00.973 INFO:tasks.workunit.client.0.smithi138.stdout:6/691: rmdir dc/d24/dea 0 2024-02-15T22:51:00.974 INFO:tasks.workunit.client.0.smithi138.stdout:2/702: rename d0/da/d19/d53/d5d/d6d/d97 to d0/da/df6 0 2024-02-15T22:51:00.976 INFO:tasks.workunit.client.0.smithi138.stdout:6/692: link dc/d24/lbe dc/d24/d34/lec 0 2024-02-15T22:51:00.976 INFO:tasks.workunit.client.0.smithi138.stdout:6/693: dread - dc/d24/d6c/fc9 zero size 2024-02-15T22:51:00.976 INFO:tasks.workunit.client.0.smithi138.stdout:6/694: write dc/d24/f56 [9171989,37772] 0 2024-02-15T22:51:00.983 INFO:tasks.workunit.client.0.smithi138.stdout:2/703: dread d0/da/d19/d53/d5d/d83/faf [0,4194304] 0 2024-02-15T22:51:00.984 INFO:tasks.workunit.client.0.smithi138.stdout:2/704: rmdir d0/da/d19/d53/d80/dba 39 2024-02-15T22:51:00.984 INFO:tasks.workunit.client.0.smithi138.stdout:2/705: creat d0/da/d19/d53/d80/ff7 x:0 0 0 2024-02-15T22:51:00.993 INFO:tasks.workunit.client.0.smithi138.stdout:2/706: dread d0/da/d19/d53/fd1 [0,4194304] 0 2024-02-15T22:51:01.001 INFO:tasks.workunit.client.0.smithi138.stdout:6/695: dwrite dc/ff [0,4194304] 0 2024-02-15T22:51:01.004 INFO:tasks.workunit.client.0.smithi138.stdout:2/707: truncate d0/dd/d15/f6c 555122 0 2024-02-15T22:51:01.005 INFO:tasks.workunit.client.0.smithi138.stdout:2/708: unlink d0/da/d19/d53/d5d/d6d/d7b/fdd 0 2024-02-15T22:51:01.007 INFO:tasks.workunit.client.0.smithi138.stdout:2/709: creat d0/ff8 x:0 0 0 2024-02-15T22:51:01.007 INFO:tasks.workunit.client.0.smithi138.stdout:2/710: truncate d0/da/d19/d53/ff2 555256 0 2024-02-15T22:51:01.014 INFO:tasks.workunit.client.0.smithi138.stdout:6/696: dwrite dc/fd3 [0,4194304] 0 2024-02-15T22:51:01.014 INFO:tasks.workunit.client.0.smithi138.stdout:6/697: creat dc/d24/d34/d3b/fed x:0 0 0 2024-02-15T22:51:01.014 INFO:tasks.workunit.client.0.smithi138.stdout:6/698: write dc/f40 [2067631,80983] 0 2024-02-15T22:51:01.015 INFO:tasks.workunit.client.0.smithi138.stdout:2/711: dread d0/da/d19/f54 [0,4194304] 0 2024-02-15T22:51:01.016 INFO:tasks.workunit.client.0.smithi138.stdout:6/699: truncate dc/d24/d34/d3b/d7c/da8/fc0 1371698 0 2024-02-15T22:51:01.023 INFO:tasks.workunit.client.0.smithi138.stdout:6/700: symlink dc/d24/d34/d3b/d7d/lee 0 2024-02-15T22:51:01.024 INFO:tasks.workunit.client.0.smithi138.stdout:2/712: link d0/da/d95/ceb d0/cf9 0 2024-02-15T22:51:01.024 INFO:tasks.workunit.client.0.smithi138.stdout:2/713: getdents d0/dd/d15/ddf 0 2024-02-15T22:51:01.025 INFO:tasks.workunit.client.0.smithi138.stdout:6/701: rmdir dc/d4b/d98/dd6 39 2024-02-15T22:51:01.025 INFO:tasks.workunit.client.0.smithi138.stdout:6/702: write dc/d24/d34/d3b/d7c/f92 [582549,10930] 0 2024-02-15T22:51:01.026 INFO:tasks.workunit.client.0.smithi138.stdout:2/714: rename d0/da/d19/f30 to d0/da/d19/d53/d5d/d74/de9/ffa 0 2024-02-15T22:51:01.028 INFO:tasks.workunit.client.0.smithi138.stdout:6/703: link dc/d4b/fb8 dc/d24/d6c/fef 0 2024-02-15T22:51:01.028 INFO:tasks.workunit.client.1.smithi170.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T22:51:01.029 INFO:tasks.workunit.client.0.smithi138.stdout:6/704: dread dc/ff [4194304,4194304] 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/705: rename dc/f1a to dc/d4b/d98/dd6/ff0 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/706: fsync dc/f79 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/707: creat dc/d24/d34/d3b/d7c/da8/ff1 x:0 0 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/708: chown dc/d24/c35 2062839 1 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/709: creat dc/d4b/dba/ff2 x:0 0 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/710: truncate dc/d4b/fb8 678887 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/711: write dc/d24/d34/d3b/d66/f8d [7782,96553] 0 2024-02-15T22:51:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:6/712: write dc/d24/d34/d3b/f4a [2559721,116156] 0 2024-02-15T22:51:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:6/713: creat dc/d4b/ff3 x:0 0 0 2024-02-15T22:51:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:2/715: dwrite d0/da/d19/d53/d5d/d6d/d7b/fda [0,4194304] 0 2024-02-15T22:51:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:2/716: link d0/da/d19/d53/l64 d0/da/df6/da0/lfb 0 2024-02-15T22:51:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:2/717: chown d0/dd/c40 2 1 2024-02-15T22:51:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:2/718: dread d0/dd/d15/f71 [0,4194304] 0 2024-02-15T22:51:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:2/719: chown d0/da/d19/d53/d5d/dcc/cef 77107 1 2024-02-15T22:51:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:6/714: dwrite dc/d4b/fb8 [0,4194304] 0 2024-02-15T22:51:01.060 INFO:tasks.workunit.client.0.smithi138.stdout:2/720: rmdir d0 39 2024-02-15T22:51:01.060 INFO:tasks.workunit.client.0.smithi138.stdout:2/721: write d0/dd/d15/d72/f92 [1004266,86941] 0 2024-02-15T22:51:01.061 INFO:tasks.workunit.client.0.smithi138.stdout:2/722: creat d0/dd/d15/de3/ffc x:0 0 0 2024-02-15T22:51:01.063 INFO:tasks.workunit.client.0.smithi138.stdout:2/723: unlink d0/da/d19/d53/d5d/dcc/cef 0 2024-02-15T22:51:01.063 INFO:tasks.workunit.client.0.smithi138.stdout:2/724: fdatasync d0/da/d19/d53/d5d/d83/fc0 0 2024-02-15T22:51:01.068 INFO:tasks.workunit.client.0.smithi138.stdout:6/715: dwrite dc/d24/d34/d3b/d7d/fae [0,4194304] 0 2024-02-15T22:51:01.068 INFO:tasks.workunit.client.0.smithi138.stdout:6/716: fdatasync dc/d24/d34/d3b/f78 0 2024-02-15T22:51:01.068 INFO:tasks.workunit.client.0.smithi138.stdout:6/717: readlink dc/l2b 0 2024-02-15T22:51:01.068 INFO:tasks.workunit.client.0.smithi138.stdout:6/718: read dc/d24/d34/f52 [277874,111325] 0 2024-02-15T22:51:01.075 INFO:tasks.workunit.client.0.smithi138.stdout:2/725: dwrite d0/da/d19/d53/d5d/d6d/f7c [0,4194304] 0 2024-02-15T22:51:01.077 INFO:tasks.workunit.client.0.smithi138.stdout:2/726: link d0/d3/cb d0/dd/d15/de3/cfd 0 2024-02-15T22:51:01.078 INFO:tasks.workunit.client.0.smithi138.stdout:2/727: symlink d0/dd/d15/de3/lfe 0 2024-02-15T22:51:01.078 INFO:tasks.workunit.client.0.smithi138.stdout:2/728: readlink d0/da/d19/d53/d5d/d74/l6a 0 2024-02-15T22:51:01.079 INFO:tasks.workunit.client.0.smithi138.stdout:2/729: mknod d0/da/d19/d53/d5d/d74/d79/cff 0 2024-02-15T22:51:01.084 INFO:tasks.workunit.client.0.smithi138.stdout:6/719: dwrite dc/d24/d34/d3b/d7c/da8/fbf [0,4194304] 0 2024-02-15T22:51:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:6/720: truncate dc/d24/fb0 1102481 0 2024-02-15T22:51:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:6/721: fsync dc/d24/d34/f63 0 2024-02-15T22:51:01.088 INFO:tasks.workunit.client.0.smithi138.stdout:2/730: write d0/dd/d15/d65/fcd [1583792,71374] 0 2024-02-15T22:51:01.088 INFO:tasks.workunit.client.0.smithi138.stdout:2/731: truncate d0/da/d95/fea 261616 0 2024-02-15T22:51:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:3/902: sync 2024-02-15T22:51:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:8/800: sync 2024-02-15T22:51:01.091 INFO:tasks.workunit.client.0.smithi138.stdout:4/856: sync 2024-02-15T22:51:01.091 INFO:tasks.workunit.client.0.smithi138.stdout:8/801: truncate db/d15/db6/ff5 20606 0 2024-02-15T22:51:01.091 INFO:tasks.workunit.client.0.smithi138.stdout:5/689: sync 2024-02-15T22:51:01.091 INFO:tasks.workunit.client.0.smithi138.stdout:5/690: write df/d18/d3e/d60/d65/d7f/fc3 [26173,1223] 0 2024-02-15T22:51:01.091 INFO:tasks.workunit.client.0.smithi138.stdout:2/732: creat d0/dd/d15/d72/f100 x:0 0 0 2024-02-15T22:51:01.093 INFO:tasks.workunit.client.0.smithi138.stdout:3/903: creat d5/d18/d11d/f12a x:0 0 0 2024-02-15T22:51:01.093 INFO:tasks.workunit.client.0.smithi138.stdout:3/904: write d5/d16/dc/f66 [3615022,116667] 0 2024-02-15T22:51:01.095 INFO:tasks.workunit.client.0.smithi138.stdout:4/857: creat d17/d1e/d2d/d36/dca/da3/dfd/f119 x:0 0 0 2024-02-15T22:51:01.097 INFO:tasks.workunit.client.0.smithi138.stdout:5/691: mkdir df/d18/d3e/d60/d65/d7c/de5 0 2024-02-15T22:51:01.097 INFO:tasks.workunit.client.0.smithi138.stdout:5/692: truncate df/d18/f84 892138 0 2024-02-15T22:51:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:6/722: dwrite dc/d4b/fb8 [4194304,4194304] 0 2024-02-15T22:51:01.106 INFO:tasks.workunit.client.0.smithi138.stdout:4/858: rmdir d17/d1e/d2d 39 2024-02-15T22:51:01.108 INFO:tasks.workunit.client.0.smithi138.stdout:5/693: truncate df/d18/d3e/f41 1943965 0 2024-02-15T22:51:01.109 INFO:tasks.workunit.client.0.smithi138.stdout:5/694: fsync df/d18/d56/fd5 0 2024-02-15T22:51:01.109 INFO:tasks.workunit.client.0.smithi138.stdout:5/695: write df/d18/d77/fca [1382421,97345] 0 2024-02-15T22:51:01.109 INFO:tasks.workunit.client.0.smithi138.stdout:5/696: creat df/d18/d56/dae/fe6 x:0 0 0 2024-02-15T22:51:01.109 INFO:tasks.workunit.client.0.smithi138.stdout:5/697: write df/f11 [191441,7474] 0 2024-02-15T22:51:01.110 INFO:tasks.workunit.client.0.smithi138.stdout:6/723: getdents dc/d24/d34/d99/dc4 0 2024-02-15T22:51:01.111 INFO:tasks.workunit.client.0.smithi138.stdout:4/859: mkdir d17/d1e/d2d/dc7/d11a 0 2024-02-15T22:51:01.113 INFO:tasks.workunit.client.0.smithi138.stdout:8/802: rename db/d15/db6/df2/d13/d19/d45 to db/d15/db6/df2/d13/d19/d6b/d105 0 2024-02-15T22:51:01.113 INFO:tasks.workunit.client.0.smithi138.stdout:8/803: dread - db/d15/db6/df2/d13/d19/f97 zero size 2024-02-15T22:51:01.121 INFO:tasks.workunit.client.0.smithi138.stdout:2/733: dwrite d0/da/d95/fea [0,4194304] 0 2024-02-15T22:51:01.122 INFO:tasks.workunit.client.0.smithi138.stdout:5/698: symlink df/d18/d3e/d60/d65/le7 0 2024-02-15T22:51:01.130 INFO:tasks.workunit.client.0.smithi138.stdout:5/699: symlink df/d18/d3e/d51/le8 0 2024-02-15T22:51:01.131 INFO:tasks.workunit.client.0.smithi138.stdout:8/804: getdents db/d15/db6/df2/d13/d19/d6b/dba 0 2024-02-15T22:51:01.133 INFO:tasks.workunit.client.0.smithi138.stdout:5/700: rename df/d18/d3e/d60/d65/d7c/fb7 to df/d18/d3e/d8a/fe9 0 2024-02-15T22:51:01.133 INFO:tasks.workunit.client.0.smithi138.stdout:8/805: truncate db/d15/db6/df2/d13/d19/fa3 964471 0 2024-02-15T22:51:01.134 INFO:tasks.workunit.client.0.smithi138.stdout:8/806: mkdir db/d15/db6/d106 0 2024-02-15T22:51:01.137 INFO:tasks.workunit.client.0.smithi138.stdout:5/701: dread df/d18/f7b [0,4194304] 0 2024-02-15T22:51:01.137 INFO:tasks.workunit.client.0.smithi138.stdout:5/702: read df/f17 [1468571,87405] 0 2024-02-15T22:51:01.138 INFO:tasks.workunit.client.0.smithi138.stdout:5/703: mknod df/d18/d3e/d60/d65/d7f/cea 0 2024-02-15T22:51:01.139 INFO:tasks.workunit.client.0.smithi138.stdout:5/704: mkdir df/d18/d3e/d60/d65/d7c/deb 0 2024-02-15T22:51:01.147 INFO:tasks.workunit.client.0.smithi138.stdout:4/860: dwrite d17/d2b/ffc [0,4194304] 0 2024-02-15T22:51:01.148 INFO:tasks.workunit.client.0.smithi138.stdout:6/724: dwrite dc/d24/d34/d3b/f41 [0,4194304] 0 2024-02-15T22:51:01.148 INFO:tasks.workunit.client.0.smithi138.stdout:6/725: fdatasync dc/f15 0 2024-02-15T22:51:01.148 INFO:tasks.workunit.client.0.smithi138.stdout:6/726: truncate dc/d4b/ff3 198538 0 2024-02-15T22:51:01.148 INFO:tasks.workunit.client.0.smithi138.stdout:6/727: chown dc/f1e 327918 1 2024-02-15T22:51:01.150 INFO:tasks.workunit.client.0.smithi138.stdout:4/861: chown d17/d1a/l5b 987812934 1 2024-02-15T22:51:01.151 INFO:tasks.workunit.client.0.smithi138.stdout:3/905: dwrite d5/d12/f1b [0,4194304] 0 2024-02-15T22:51:01.151 INFO:tasks.workunit.client.0.smithi138.stdout:2/734: dwrite d0/ff8 [0,4194304] 0 2024-02-15T22:51:01.152 INFO:tasks.workunit.client.0.smithi138.stdout:2/735: fdatasync d0/da/d19/f2d 0 2024-02-15T22:51:01.152 INFO:tasks.workunit.client.0.smithi138.stdout:2/736: chown d0/da/d19/d53/d5d/d6d/d7b 6685295 1 2024-02-15T22:51:01.154 INFO:tasks.workunit.client.0.smithi138.stdout:6/728: mkdir dc/d24/df4 0 2024-02-15T22:51:01.155 INFO:tasks.workunit.client.0.smithi138.stdout:6/729: fdatasync dc/d24/d34/d3b/d7c/da8/fc5 0 2024-02-15T22:51:01.157 INFO:tasks.workunit.client.0.smithi138.stdout:4/862: mkdir d17/d1e/d2d/d36/dca/da3/dee/d11b 0 2024-02-15T22:51:01.157 INFO:tasks.workunit.client.0.smithi138.stdout:4/863: chown d17/d1e/db8 6 1 2024-02-15T22:51:01.158 INFO:tasks.workunit.client.0.smithi138.stdout:3/906: symlink d5/d16/l12b 0 2024-02-15T22:51:01.161 INFO:tasks.workunit.client.0.smithi138.stdout:2/737: symlink d0/da/df6/l101 0 2024-02-15T22:51:01.162 INFO:tasks.workunit.client.0.smithi138.stdout:6/730: rmdir dc/d24/d34/d3b/d7c/d9f 39 2024-02-15T22:51:01.164 INFO:tasks.workunit.client.0.smithi138.stdout:5/705: dwrite df/d18/d3e/d60/d65/d7f/fc3 [0,4194304] 0 2024-02-15T22:51:01.164 INFO:tasks.workunit.client.0.smithi138.stdout:8/807: dwrite db/d15/f17 [0,4194304] 0 2024-02-15T22:51:01.164 INFO:tasks.workunit.client.0.smithi138.stdout:4/864: symlink d17/d1e/d2d/d36/dca/l11c 0 2024-02-15T22:51:01.164 INFO:tasks.workunit.client.0.smithi138.stdout:4/865: creat d17/d1e/d2d/d36/dca/da3/dbf/f11d x:0 0 0 2024-02-15T22:51:01.165 INFO:tasks.workunit.client.0.smithi138.stdout:3/907: symlink d5/d12/d26/da6/d107/d47/l12c 0 2024-02-15T22:51:01.166 INFO:tasks.workunit.client.0.smithi138.stdout:2/738: creat d0/da/d95/f102 x:0 0 0 2024-02-15T22:51:01.172 INFO:tasks.workunit.client.0.smithi138.stdout:8/808: symlink db/d15/db6/df2/d13/d19/d6b/dba/dfe/l107 0 2024-02-15T22:51:01.172 INFO:tasks.workunit.client.0.smithi138.stdout:8/809: chown db/f39 6495 1 2024-02-15T22:51:01.173 INFO:tasks.workunit.client.0.smithi138.stdout:4/866: rmdir d17/d1e/d2d/d36/dca/da3 39 2024-02-15T22:51:01.174 INFO:tasks.workunit.client.0.smithi138.stdout:3/908: mknod d5/d12/d26/d2e/c12d 0 2024-02-15T22:51:01.177 INFO:tasks.workunit.client.0.smithi138.stdout:2/739: unlink d0/da/d19/d53/d5d/d6d/l66 0 2024-02-15T22:51:01.178 INFO:tasks.workunit.client.0.smithi138.stdout:8/810: unlink db/d15/db6/df2/d13/f64 0 2024-02-15T22:51:01.180 INFO:tasks.workunit.client.0.smithi138.stdout:3/909: mknod d5/d16/d4d/de4/c12e 0 2024-02-15T22:51:01.181 INFO:tasks.workunit.client.0.smithi138.stdout:2/740: stat d0/dd/d15/c41 0 2024-02-15T22:51:01.182 INFO:tasks.workunit.client.0.smithi138.stdout:8/811: unlink db/d15/db6/df2/d13/d19/d7d/f85 0 2024-02-15T22:51:01.182 INFO:tasks.workunit.client.0.smithi138.stdout:0/728: sync 2024-02-15T22:51:01.185 INFO:tasks.workunit.client.0.smithi138.stdout:3/910: unlink d5/d18/d35/f80 0 2024-02-15T22:51:01.186 INFO:tasks.workunit.client.0.smithi138.stdout:8/812: write db/d15/db6/df2/d13/d19/d6b/d105/fdf [648037,68749] 0 2024-02-15T22:51:01.186 INFO:tasks.workunit.client.0.smithi138.stdout:2/741: mkdir d0/da/d19/d53/d5d/d83/d8a/d103 0 2024-02-15T22:51:01.188 INFO:tasks.workunit.client.0.smithi138.stdout:0/729: creat d6/d10/d34/f104 x:0 0 0 2024-02-15T22:51:01.188 INFO:tasks.workunit.client.0.smithi138.stdout:9/948: sync 2024-02-15T22:51:01.188 INFO:tasks.workunit.client.0.smithi138.stdout:7/998: sync 2024-02-15T22:51:01.188 INFO:tasks.workunit.client.0.smithi138.stdout:1/599: sync 2024-02-15T22:51:01.189 INFO:tasks.workunit.client.0.smithi138.stdout:7/999: chown d1/d2 1224 1 2024-02-15T22:51:01.189 INFO:tasks.workunit.client.0.smithi138.stdout:9/949: fsync d0/de/d14/d18/f49 0 2024-02-15T22:51:01.190 INFO:tasks.workunit.client.0.smithi138.stdout:4/867: rename d17/d1e/d2d/d52 to d17/d1e/d2d/d36/dca/da3/d11e 0 2024-02-15T22:51:01.191 INFO:tasks.workunit.client.0.smithi138.stdout:3/911: symlink d5/d12/d23/d94/d122/l12f 0 2024-02-15T22:51:01.192 INFO:tasks.workunit.client.0.smithi138.stdout:3/912: write d5/d16/dc/f6d [1858081,19214] 0 2024-02-15T22:51:01.195 INFO:tasks.workunit.client.0.smithi138.stdout:1/600: dread fa [0,4194304] 0 2024-02-15T22:51:01.195 INFO:tasks.workunit.client.0.smithi138.stdout:1/601: read - df/d1b/d1d/d25/d8d/fab zero size 2024-02-15T22:51:01.195 INFO:tasks.workunit.client.0.smithi138.stdout:1/602: dread - df/d1b/d1d/d25/d8d/fab zero size 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:1/603: creat df/d1b/d1d/d25/d2e/d5b/d65/fcb x:0 0 0 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:1/604: fsync df/d1b/d1d/d25/d2e/d6c/f94 0 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:1/605: chown df/d1b/d1d/d25/d2e/d5b/d65/d86/la7 0 1 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:1/606: readlink df/d1b/d1d/d25/d2e/d5b/la9 0 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:2/742: symlink d0/dd/l104 0 2024-02-15T22:51:01.196 INFO:tasks.workunit.client.0.smithi138.stdout:4/868: mkdir d17/d1e/d2d/d11f 0 2024-02-15T22:51:01.197 INFO:tasks.workunit.client.0.smithi138.stdout:3/913: rmdir d5/d12/d26/da6/d107/da2 39 2024-02-15T22:51:01.198 INFO:tasks.workunit.client.0.smithi138.stdout:4/869: read d17/d1a/daa/fb6 [818597,51868] 0 2024-02-15T22:51:01.198 INFO:tasks.workunit.client.0.smithi138.stdout:4/870: chown d17/d1e/d2d/d36/d3e/d64/fa5 72562598 1 2024-02-15T22:51:01.200 INFO:tasks.workunit.client.0.smithi138.stdout:9/950: dread d0/de/d33/d98/fae [0,4194304] 0 2024-02-15T22:51:01.201 INFO:tasks.workunit.client.0.smithi138.stdout:2/743: rename d0/da/c7d to d0/da/d19/d53/d5d/d6d/dd8/c105 0 2024-02-15T22:51:01.201 INFO:tasks.workunit.client.0.smithi138.stdout:2/744: chown d0/da/d19/d53/d5d/d74/d79/f89 20457503 1 2024-02-15T22:51:01.202 INFO:tasks.workunit.client.0.smithi138.stdout:3/914: creat d5/d12/d23/d29/d4f/d102/f130 x:0 0 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:4/871: rmdir d17/d1e/d2d/dc7 39 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/607: dread df/d1b/d1d/d24/d3a/f70 [0,4194304] 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/608: chown df/c72 413209074 1 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/609: stat df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/610: creat df/d1b/d1d/d24/fcc x:0 0 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/611: write df/d1b/d21/d4f/f9f [683862,16011] 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/612: fsync df/d1b/d1d/d25/d2e/d6c/f94 0 2024-02-15T22:51:01.204 INFO:tasks.workunit.client.0.smithi138.stdout:1/613: fdatasync df/d1b/d1d/d25/d2e/d37/f54 0 2024-02-15T22:51:01.207 INFO:tasks.workunit.client.0.smithi138.stdout:9/951: unlink d0/df/d11/f17 0 2024-02-15T22:51:01.208 INFO:tasks.workunit.client.0.smithi138.stdout:0/730: dwrite d6/d10/d52/d72/fd3 [0,4194304] 0 2024-02-15T22:51:01.211 INFO:tasks.workunit.client.0.smithi138.stdout:3/915: dread d5/f61 [0,4194304] 0 2024-02-15T22:51:01.211 INFO:tasks.workunit.client.0.smithi138.stdout:3/916: readlink d5/la5 0 2024-02-15T22:51:01.217 INFO:tasks.workunit.client.0.smithi138.stdout:9/952: read d0/d1/fb2 [2014282,30267] 0 2024-02-15T22:51:01.218 INFO:tasks.workunit.client.0.smithi138.stdout:4/872: dwrite d17/d1e/d2d/dc7/f102 [0,4194304] 0 2024-02-15T22:51:01.227 INFO:tasks.workunit.client.0.smithi138.stdout:4/873: dread d17/f6a [0,4194304] 0 2024-02-15T22:51:01.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:00 smithi138 ceph-mon[29229]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 135 MiB/s rd, 160 MiB/s wr, 218 op/s 2024-02-15T22:51:01.235 INFO:tasks.workunit.client.0.smithi138.stdout:0/731: creat d6/d10/d40/f105 x:0 0 0 2024-02-15T22:51:01.237 INFO:tasks.workunit.client.0.smithi138.stdout:3/917: mknod d5/d12/d26/da6/d107/d57/c131 0 2024-02-15T22:51:01.239 INFO:tasks.workunit.client.0.smithi138.stdout:4/874: mknod d17/d2b/d78/dfa/c120 0 2024-02-15T22:51:01.241 INFO:tasks.workunit.client.0.smithi138.stdout:2/745: rename d0/da/d19/d53/f8e to d0/f106 0 2024-02-15T22:51:01.243 INFO:tasks.workunit.client.0.smithi138.stdout:3/918: rmdir d5/d16/d4d 39 2024-02-15T22:51:01.245 INFO:tasks.workunit.client.0.smithi138.stdout:1/614: rename df/d1b/f1f to df/d1b/d1d/d25/d2e/d5b/d65/fcd 0 2024-02-15T22:51:01.245 INFO:tasks.workunit.client.0.smithi138.stdout:1/615: stat df/d1b/d1d/d25/d2e/d5b/f67 0 2024-02-15T22:51:01.247 INFO:tasks.workunit.client.0.smithi138.stdout:2/746: symlink d0/da/d19/d53/d5d/d6d/l107 0 2024-02-15T22:51:01.248 INFO:tasks.workunit.client.0.smithi138.stdout:0/732: truncate d6/d10/d52/d72/fd3 4088339 0 2024-02-15T22:51:01.249 INFO:tasks.workunit.client.0.smithi138.stdout:3/919: symlink d5/d12/d23/d29/d4f/d102/l132 0 2024-02-15T22:51:01.249 INFO:tasks.workunit.client.0.smithi138.stdout:3/920: stat d5/d12/d23 0 2024-02-15T22:51:01.251 INFO:tasks.workunit.client.0.smithi138.stdout:9/953: rename d0/de/d34/d89/d117/l132 to d0/de/d14/d18/d10d/d116/d121/d7b/d9e/l14e 0 2024-02-15T22:51:01.252 INFO:tasks.workunit.client.0.smithi138.stdout:1/616: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80 0 2024-02-15T22:51:01.255 INFO:tasks.workunit.client.0.smithi138.stdout:0/733: symlink d6/d10/d18/d57/d8d/l106 0 2024-02-15T22:51:01.256 INFO:tasks.workunit.client.0.smithi138.stdout:4/875: dwrite d17/d1e/d2d/dd5/fde [0,4194304] 0 2024-02-15T22:51:01.256 INFO:tasks.workunit.client.0.smithi138.stdout:3/921: mkdir d5/d12/d26/da6/d107/da2/d133 0 2024-02-15T22:51:01.258 INFO:tasks.workunit.client.0.smithi138.stdout:9/954: getdents d0/de/d33/d57 0 2024-02-15T22:51:01.259 INFO:tasks.workunit.client.0.smithi138.stdout:1/617: truncate df/d1b/d21/d4f/f9f 642239 0 2024-02-15T22:51:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:00 smithi170 ceph-mon[35248]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 135 MiB/s rd, 160 MiB/s wr, 218 op/s 2024-02-15T22:51:01.261 INFO:tasks.workunit.client.0.smithi138.stdout:0/734: link d6/d10/d64/f87 d6/d10/d52/f107 0 2024-02-15T22:51:01.261 INFO:tasks.workunit.client.0.smithi138.stdout:0/735: fsync d6/d10/d52/d6f/d85/fc7 0 2024-02-15T22:51:01.269 INFO:tasks.workunit.client.0.smithi138.stdout:9/955: write d0/d55/f5e [1634465,120722] 0 2024-02-15T22:51:01.272 INFO:tasks.workunit.client.0.smithi138.stdout:0/736: creat d6/d10/d34/df6/f108 x:0 0 0 2024-02-15T22:51:01.274 INFO:tasks.workunit.client.0.smithi138.stdout:3/922: dwrite d5/d12/d26/da6/d107/d47/d67/faf [0,4194304] 0 2024-02-15T22:51:01.275 INFO:tasks.workunit.client.0.smithi138.stdout:3/923: creat d5/d12/d23/da1/f134 x:0 0 0 2024-02-15T22:51:01.275 INFO:tasks.workunit.client.0.smithi138.stdout:3/924: dread - d5/fe6 zero size 2024-02-15T22:51:01.276 INFO:tasks.workunit.client.0.smithi138.stdout:4/876: rename d17/d2b to d17/d1e/d2d/dd5/d121 0 2024-02-15T22:51:01.280 INFO:tasks.workunit.client.0.smithi138.stdout:1/618: dread df/d1b/d1d/d25/d2e/f58 [0,4194304] 0 2024-02-15T22:51:01.280 INFO:tasks.workunit.client.0.smithi138.stdout:3/925: creat d5/d12/d26/da6/d107/da2/f135 x:0 0 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:9/956: rename d0/d4/f2c to d0/d55/d59/dac/d146/f14f 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:9/957: creat d0/d1/db8/d126/f150 x:0 0 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:3/926: dread d5/d12/d26/f5c [4194304,4194304] 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:3/927: truncate d5/d12/fd7 229073 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:3/928: write d5/d12/d26/da6/d107/d57/d5d/de2/f128 [1547780,54402] 0 2024-02-15T22:51:01.283 INFO:tasks.workunit.client.0.smithi138.stdout:0/737: dread d6/f24 [0,4194304] 0 2024-02-15T22:51:01.284 INFO:tasks.workunit.client.0.smithi138.stdout:1/619: rmdir df/d1b/d1d/d24/d3a 39 2024-02-15T22:51:01.286 INFO:tasks.workunit.client.0.smithi138.stdout:9/958: creat d0/de/d34/dd3/dec/d120/f151 x:0 0 0 2024-02-15T22:51:01.287 INFO:tasks.workunit.client.0.smithi138.stdout:3/929: mknod d5/d12/d23/d94/d122/c136 0 2024-02-15T22:51:01.287 INFO:tasks.workunit.client.0.smithi138.stdout:3/930: stat d5/d18/f9a 0 2024-02-15T22:51:01.287 INFO:tasks.workunit.client.0.smithi138.stdout:3/931: truncate d5/d12/d23/d29/d4f/fbb 697271 0 2024-02-15T22:51:01.288 INFO:tasks.workunit.client.0.smithi138.stdout:9/959: mkdir d0/de/d34/d152 0 2024-02-15T22:51:01.288 INFO:tasks.workunit.client.0.smithi138.stdout:4/877: write d17/d1e/d2d/d36/dca/da3/d11e/f74 [4145676,73626] 0 2024-02-15T22:51:01.289 INFO:tasks.workunit.client.0.smithi138.stdout:9/960: creat d0/d55/d59/dac/f153 x:0 0 0 2024-02-15T22:51:01.291 INFO:tasks.workunit.client.0.smithi138.stdout:9/961: mknod d0/de/d14/d18/c154 0 2024-02-15T22:51:01.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/962: unlink d0/de/d14/f41 0 2024-02-15T22:51:01.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/963: write d0/d2e/f6e [2427554,103031] 0 2024-02-15T22:51:01.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/964: dread - d0/de/d14/d18/f115 zero size 2024-02-15T22:51:01.293 INFO:tasks.workunit.client.0.smithi138.stdout:9/965: creat d0/de/d34/f155 x:0 0 0 2024-02-15T22:51:01.294 INFO:tasks.workunit.client.0.smithi138.stdout:9/966: chown d0/d2e/f8f 22272 1 2024-02-15T22:51:01.295 INFO:tasks.workunit.client.0.smithi138.stdout:1/620: write fe [3896330,124522] 0 2024-02-15T22:51:01.295 INFO:tasks.workunit.client.0.smithi138.stdout:1/621: write df/d1b/d1d/d25/d2e/d6c/f76 [1207185,121726] 0 2024-02-15T22:51:01.297 INFO:tasks.workunit.client.0.smithi138.stdout:1/622: getdents df/d1b 0 2024-02-15T22:51:01.303 INFO:tasks.workunit.client.0.smithi138.stdout:9/967: write d0/de/d14/da3/dc8/f42 [2776517,63291] 0 2024-02-15T22:51:01.311 INFO:tasks.workunit.client.0.smithi138.stdout:9/968: write d0/de/d14/dbd/fe3 [3783854,85746] 0 2024-02-15T22:51:01.313 INFO:tasks.workunit.client.0.smithi138.stdout:0/738: dwrite d6/d10/d13/ff0 [0,4194304] 0 2024-02-15T22:51:01.313 INFO:tasks.workunit.client.0.smithi138.stdout:3/932: dwrite d5/d12/d26/d2e/f5b [4194304,4194304] 0 2024-02-15T22:51:01.313 INFO:tasks.workunit.client.0.smithi138.stdout:3/933: chown d5/d18 33 1 2024-02-15T22:51:01.313 INFO:tasks.workunit.client.0.smithi138.stdout:3/934: fsync d5/d12/d26/da6/d107/d47/f101 0 2024-02-15T22:51:01.313 INFO:tasks.workunit.client.0.smithi138.stdout:4/878: dwrite d17/d1e/d2d/d36/dca/da3/d11e/ff3 [0,4194304] 0 2024-02-15T22:51:01.314 INFO:tasks.workunit.client.0.smithi138.stdout:9/969: link d0/de/d14/d18/ff5 d0/de/d14/f156 0 2024-02-15T22:51:01.314 INFO:tasks.workunit.client.0.smithi138.stdout:9/970: fdatasync d0/d55/d59/dac/d146/f14f 0 2024-02-15T22:51:01.314 INFO:tasks.workunit.client.0.smithi138.stdout:9/971: read - d0/de/d14/d18/f115 zero size 2024-02-15T22:51:01.330 INFO:tasks.workunit.client.0.smithi138.stdout:9/972: fsync d0/de/d34/d89/d90/fad 0 2024-02-15T22:51:01.330 INFO:tasks.workunit.client.0.smithi138.stdout:9/973: dread - d0/de/d14/d18/d10d/f14c zero size 2024-02-15T22:51:01.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/974: symlink d0/d55/d59/l157 0 2024-02-15T22:51:01.334 INFO:tasks.workunit.client.0.smithi138.stdout:9/975: fdatasync d0/d55/ffe 0 2024-02-15T22:51:01.336 INFO:tasks.workunit.client.0.smithi138.stdout:9/976: mknod d0/de/d14/d18/d10d/d116/d121/d7b/d9e/da1/d11a/c158 0 2024-02-15T22:51:01.336 INFO:tasks.workunit.client.0.smithi138.stdout:9/977: write d0/d2e/f143 [808662,73517] 0 2024-02-15T22:51:01.337 INFO:tasks.workunit.client.0.smithi138.stdout:9/978: creat d0/d55/d59/dac/d146/f159 x:0 0 0 2024-02-15T22:51:01.337 INFO:tasks.workunit.client.0.smithi138.stdout:9/979: chown d0/d55/d59/f5f 3641 1 2024-02-15T22:51:01.337 INFO:tasks.workunit.client.0.smithi138.stdout:9/980: dread - d0/de/d34/dd3/dec/f125 zero size 2024-02-15T22:51:01.338 INFO:tasks.workunit.client.0.smithi138.stdout:9/981: getdents d0/de/d34/d89/d119 0 2024-02-15T22:51:01.338 INFO:tasks.workunit.client.0.smithi138.stdout:4/879: dwrite d17/d1e/d2d/d36/d3e/fb4 [0,4194304] 0 2024-02-15T22:51:01.338 INFO:tasks.workunit.client.0.smithi138.stdout:4/880: chown d17/d1e/d2d/dd5/d121/l86 531 1 2024-02-15T22:51:01.338 INFO:tasks.workunit.client.0.smithi138.stdout:3/935: dwrite d5/d12/d23/f4c [0,4194304] 0 2024-02-15T22:51:01.338 INFO:tasks.workunit.client.0.smithi138.stdout:3/936: stat d5/d12/d23/da1/f134 0 2024-02-15T22:51:01.340 INFO:tasks.workunit.client.0.smithi138.stdout:3/937: rename d5/d18/l36 to d5/d16/dc/l137 0 2024-02-15T22:51:01.342 INFO:tasks.workunit.client.0.smithi138.stdout:4/881: dread d17/d1e/d2d/d36/f68 [0,4194304] 0 2024-02-15T22:51:01.342 INFO:tasks.workunit.client.0.smithi138.stdout:3/938: rename d5/d12/d23/d29/d4f/cbf to d5/d12/d26/da6/d107/c138 0 2024-02-15T22:51:01.342 INFO:tasks.workunit.client.0.smithi138.stdout:3/939: chown d5/d16/dc/dca/fe7 8064143 1 2024-02-15T22:51:01.342 INFO:tasks.workunit.client.0.smithi138.stdout:3/940: chown d5/d16/dc/f66 31214 1 2024-02-15T22:51:01.344 INFO:tasks.workunit.client.0.smithi138.stdout:4/882: rmdir d17/d1e/d2d/d36/dca/da3/dfd 39 2024-02-15T22:51:01.344 INFO:tasks.workunit.client.0.smithi138.stdout:4/883: chown d17/d1e/d2d/ccc 11984 1 2024-02-15T22:51:01.344 INFO:tasks.workunit.client.0.smithi138.stdout:3/941: write d5/d12/d26/da6/d107/da2/f100 [502214,112464] 0 2024-02-15T22:51:01.344 INFO:tasks.workunit.client.0.smithi138.stdout:3/942: fsync d5/d16/f120 0 2024-02-15T22:51:01.346 INFO:tasks.workunit.client.0.smithi138.stdout:4/884: creat d17/d1e/d2d/d36/dca/da3/dfd/f122 x:0 0 0 2024-02-15T22:51:01.347 INFO:tasks.workunit.client.0.smithi138.stdout:3/943: symlink d5/d16/dc/l139 0 2024-02-15T22:51:01.347 INFO:tasks.workunit.client.0.smithi138.stdout:3/944: chown d5/d18/fbe 2978462 1 2024-02-15T22:51:01.348 INFO:tasks.workunit.client.0.smithi138.stdout:4/885: mkdir d17/d1e/d2d/d36/dca/da3/dbf/d123 0 2024-02-15T22:51:01.350 INFO:tasks.workunit.client.0.smithi138.stdout:4/886: unlink d17/d1a/daa/fb6 0 2024-02-15T22:51:01.356 INFO:tasks.workunit.client.0.smithi138.stdout:9/982: dwrite d0/d55/d59/dac/f153 [0,4194304] 0 2024-02-15T22:51:01.357 INFO:tasks.workunit.client.0.smithi138.stdout:3/945: dread d5/d12/d26/d2e/f110 [0,4194304] 0 2024-02-15T22:51:01.357 INFO:tasks.workunit.client.0.smithi138.stdout:9/983: symlink d0/dc7/l15a 0 2024-02-15T22:51:01.359 INFO:tasks.workunit.client.0.smithi138.stdout:3/946: mknod d5/d12/d26/da6/d107/d47/d67/c13a 0 2024-02-15T22:51:01.364 INFO:tasks.workunit.client.0.smithi138.stdout:9/984: dread d0/d2e/f6e [0,4194304] 0 2024-02-15T22:51:01.528 INFO:tasks.workunit.client.0.smithi138.stdout:8/813: sync 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/706: sync 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:6/731: sync 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/707: chown df/d18/c57 618467329 1 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:8/814: readlink db/d15/db6/df2/d13/d19/d6b/lea 0 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/708: chown df/d18/d3e/d60/d65/cac 236 1 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:8/815: fsync db/d15/db6/fb7 0 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/709: write df/d18/d3e/d66/f79 [422016,15136] 0 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/710: read - df/d18/d3e/d8a/fe9 zero size 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:5/711: truncate df/d18/d3e/d60/d65/d7f/fc3 5046679 0 2024-02-15T22:51:01.529 INFO:tasks.workunit.client.0.smithi138.stdout:6/732: creat dc/d24/d34/d3b/dda/ff5 x:0 0 0 2024-02-15T22:51:01.530 INFO:tasks.workunit.client.0.smithi138.stdout:5/712: link df/d18/fe0 df/d18/d3e/d60/d65/dc2/fec 0 2024-02-15T22:51:01.530 INFO:tasks.workunit.client.0.smithi138.stdout:5/713: write df/d18/d3e/d60/d72/fbd [223757,4754] 0 2024-02-15T22:51:01.599 INFO:tasks.workunit.client.0.smithi138.stdout:8/816: dwrite db/d15/d70/d7c/d92/f2c [0,4194304] 0 2024-02-15T22:51:01.599 INFO:tasks.workunit.client.0.smithi138.stdout:8/817: creat db/d15/db6/df2/d13/d19/d6b/f108 x:0 0 0 2024-02-15T22:51:01.656 INFO:tasks.workunit.client.0.smithi138.stdout:6/733: dwrite dc/d4b/f9e [0,4194304] 0 2024-02-15T22:51:01.723 INFO:tasks.workunit.client.0.smithi138.stdout:5/714: dwrite df/d18/f7b [0,4194304] 0 2024-02-15T22:51:01.730 INFO:tasks.workunit.client.0.smithi138.stdout:5/715: mknod df/d18/d56/dae/ced 0 2024-02-15T22:51:01.838 INFO:tasks.workunit.client.0.smithi138.stdout:0/739: sync 2024-02-15T22:51:01.839 INFO:tasks.workunit.client.0.smithi138.stdout:1/623: sync 2024-02-15T22:51:01.839 INFO:tasks.workunit.client.0.smithi138.stdout:1/624: chown df/d1b/d1d/d25/fa6 339069532 1 2024-02-15T22:51:01.839 INFO:tasks.workunit.client.0.smithi138.stdout:4/887: sync 2024-02-15T22:51:01.839 INFO:tasks.workunit.client.0.smithi138.stdout:2/747: sync 2024-02-15T22:51:01.839 INFO:tasks.workunit.client.0.smithi138.stdout:0/740: rmdir d6/d10/d52/d6f/d85 39 2024-02-15T22:51:01.841 INFO:tasks.workunit.client.0.smithi138.stdout:1/625: creat df/d1b/d1d/d25/d2e/d5b/d7b/fce x:0 0 0 2024-02-15T22:51:01.842 INFO:tasks.workunit.client.0.smithi138.stdout:0/741: symlink d6/d10/d52/l109 0 2024-02-15T22:51:01.843 INFO:tasks.workunit.client.0.smithi138.stdout:0/742: readlink d6/d10/d75/d102/lf7 0 2024-02-15T22:51:01.843 INFO:tasks.workunit.client.0.smithi138.stdout:0/743: truncate d6/d10/d34/dcf/fe0 1447838 0 2024-02-15T22:51:01.843 INFO:tasks.workunit.client.0.smithi138.stdout:1/626: creat df/d1b/d1d/d25/d2e/fcf x:0 0 0 2024-02-15T22:51:01.848 INFO:tasks.workunit.client.0.smithi138.stdout:1/627: mknod df/d1b/d1d/d25/d2e/d5b/cd0 0 2024-02-15T22:51:01.851 INFO:tasks.workunit.client.0.smithi138.stdout:1/628: unlink df/d1b/d21/d4f/c8f 0 2024-02-15T22:51:01.851 INFO:tasks.workunit.client.0.smithi138.stdout:1/629: truncate df/d1b/d1d/d24/d3a/f9b 57998 0 2024-02-15T22:51:01.851 INFO:tasks.workunit.client.0.smithi138.stdout:1/630: fsync df/d1b/d1d/d25/d2e/d37/f45 0 2024-02-15T22:51:01.853 INFO:tasks.workunit.client.0.smithi138.stdout:1/631: creat df/d1b/d1d/d25/d2e/d5b/d65/d86/fd1 x:0 0 0 2024-02-15T22:51:01.860 INFO:tasks.workunit.client.0.smithi138.stdout:1/632: getdents df/d1b/d1d/d25/d2e/d37 0 2024-02-15T22:51:01.860 INFO:tasks.workunit.client.0.smithi138.stdout:1/633: chown df/d1b/d1d/d24/d3a/f71 41704 1 2024-02-15T22:51:02.019 INFO:tasks.workunit.client.0.smithi138.stdout:6/734: dwrite dc/d24/d6c/ddb/ddf/fe8 [0,4194304] 0 2024-02-15T22:51:02.019 INFO:tasks.workunit.client.0.smithi138.stdout:6/735: fdatasync dc/d24/d34/d3b/d7c/f93 0 2024-02-15T22:51:02.019 INFO:tasks.workunit.client.0.smithi138.stdout:6/736: creat dc/d24/d34/d99/ff6 x:0 0 0 2024-02-15T22:51:02.025 INFO:tasks.workunit.client.0.smithi138.stdout:2/748: write d0/da/d19/d53/d5d/d74/de9/ffa [1870876,77379] 0 2024-02-15T22:51:02.128 INFO:tasks.workunit.client.0.smithi138.stdout:5/716: write df/d18/d3e/d60/d65/d7f/d90/f92 [3345543,95876] 0 2024-02-15T22:51:02.131 INFO:tasks.workunit.client.0.smithi138.stdout:6/737: write dc/d24/d6c/ddb/ddf/fe8 [1802383,122069] 0 2024-02-15T22:51:02.135 INFO:tasks.workunit.client.0.smithi138.stdout:5/717: getdents df/d18 0 2024-02-15T22:51:02.137 INFO:tasks.workunit.client.0.smithi138.stdout:6/738: creat dc/d4b/d98/dd6/deb/ff7 x:0 0 0 2024-02-15T22:51:02.217 INFO:tasks.workunit.client.0.smithi138.stdout:2/749: truncate d0/da/d19/d53/d5d/d74/de9/ffa 559800 0 2024-02-15T22:51:02.218 INFO:tasks.workunit.client.0.smithi138.stdout:2/750: creat d0/da/d19/d53/d5d/d6d/d7b/da3/f108 x:0 0 0 2024-02-15T22:51:02.218 INFO:tasks.workunit.client.0.smithi138.stdout:2/751: chown d0/da/d19/d53/d80/dd4/dde 58540 1 2024-02-15T22:51:02.219 INFO:tasks.workunit.client.0.smithi138.stdout:3/947: sync 2024-02-15T22:51:02.220 INFO:tasks.workunit.client.0.smithi138.stdout:3/948: write d5/d12/d26/da6/d107/d47/d67/f87 [3398028,77297] 0 2024-02-15T22:51:02.220 INFO:tasks.workunit.client.0.smithi138.stdout:3/949: readlink d5/d12/d26/da6/d107/l78 0 2024-02-15T22:51:02.220 INFO:tasks.workunit.client.0.smithi138.stdout:3/950: fdatasync d5/d12/d23/d29/feb 0 2024-02-15T22:51:02.220 INFO:tasks.workunit.client.0.smithi138.stdout:9/985: sync 2024-02-15T22:51:02.220 INFO:tasks.workunit.client.0.smithi138.stdout:8/818: sync 2024-02-15T22:51:02.224 INFO:tasks.workunit.client.0.smithi138.stdout:3/951: mkdir d5/d12/d23/d13b 0 2024-02-15T22:51:02.224 INFO:tasks.workunit.client.0.smithi138.stdout:3/952: chown d5/d18/c48 123 1 2024-02-15T22:51:02.224 INFO:tasks.workunit.client.0.smithi138.stdout:3/953: fdatasync d5/d12/d26/da6/d107/d47/f75 0 2024-02-15T22:51:02.225 INFO:tasks.workunit.client.0.smithi138.stdout:5/718: dwrite df/d18/d3e/d60/f64 [0,4194304] 0 2024-02-15T22:51:02.226 INFO:tasks.workunit.client.0.smithi138.stdout:5/719: fdatasync df/d18/d3e/d60/f64 0 2024-02-15T22:51:02.227 INFO:tasks.workunit.client.0.smithi138.stdout:3/954: link d5/d12/f115 d5/d12/d26/da6/d107/d47/d67/f13c 0 2024-02-15T22:51:02.228 INFO:tasks.workunit.client.0.smithi138.stdout:3/955: chown d5/d12/d26/f10b 578 1 2024-02-15T22:51:02.228 INFO:tasks.workunit.client.0.smithi138.stdout:3/956: chown d5/d12/d26/da6/d107/da2/f135 0 1 2024-02-15T22:51:02.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/720: truncate df/d18/d3e/d51/f5c 906520 0 2024-02-15T22:51:02.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/721: write fc [3719053,10897] 0 2024-02-15T22:51:02.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/722: write df/d18/d3e/d60/d72/da5/fc1 [4950663,75283] 0 2024-02-15T22:51:02.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/723: fdatasync df/d18/d56/dae/fcd 0 2024-02-15T22:51:02.232 INFO:tasks.workunit.client.0.smithi138.stdout:5/724: creat df/d18/d3e/d51/dc9/d9c/daf/fee x:0 0 0 2024-02-15T22:51:02.233 INFO:tasks.workunit.client.0.smithi138.stdout:3/957: symlink d5/d18/d35/l13d 0 2024-02-15T22:51:02.233 INFO:tasks.workunit.client.0.smithi138.stdout:3/958: fdatasync d5/d12/d26/d2e/f5b 0 2024-02-15T22:51:02.235 INFO:tasks.workunit.client.0.smithi138.stdout:9/986: mkdir d0/de/d34/d15b 0 2024-02-15T22:51:02.237 INFO:tasks.workunit.client.0.smithi138.stdout:8/819: link db/d15/c1f db/d15/db6/df2/d13/c109 0 2024-02-15T22:51:02.239 INFO:tasks.workunit.client.0.smithi138.stdout:3/959: symlink d5/d12/d26/l13e 0 2024-02-15T22:51:02.239 INFO:tasks.workunit.client.0.smithi138.stdout:3/960: fdatasync d5/d12/d26/da6/d107/d47/f10d 0 2024-02-15T22:51:02.239 INFO:tasks.workunit.client.0.smithi138.stdout:3/961: truncate d5/d12/d26/da6/d107/d57/d5d/ff4 209088 0 2024-02-15T22:51:02.239 INFO:tasks.workunit.client.0.smithi138.stdout:5/725: read df/d18/d3e/f3f [283911,35659] 0 2024-02-15T22:51:02.240 INFO:tasks.workunit.client.0.smithi138.stdout:5/726: creat df/d18/d56/dc6/fef x:0 0 0 2024-02-15T22:51:02.247 INFO:tasks.workunit.client.0.smithi138.stdout:3/962: rename d5/f61 to d5/d12/d26/da6/d107/f13f 0 2024-02-15T22:51:02.247 INFO:tasks.workunit.client.0.smithi138.stdout:3/963: read - d5/d12/f115 zero size 2024-02-15T22:51:02.250 INFO:tasks.workunit.client.0.smithi138.stdout:3/964: link d5/d16/dc/dca/fe7 d5/d16/dcf/f140 0 2024-02-15T22:51:02.252 INFO:tasks.workunit.client.0.smithi138.stdout:5/727: dread df/d18/f25 [0,4194304] 0 2024-02-15T22:51:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/728: rename df/d18/d3e/d60/d65/d7f/d9d/lde to df/d18/d3e/d66/d82/lf0 0 2024-02-15T22:51:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/729: chown df/c43 220269548 1 2024-02-15T22:51:02.256 INFO:tasks.workunit.client.0.smithi138.stdout:5/730: creat df/d18/d3e/d51/dc9/d9c/ff1 x:0 0 0 2024-02-15T22:51:02.257 INFO:tasks.workunit.client.0.smithi138.stdout:5/731: symlink df/d18/d56/dae/lf2 0 2024-02-15T22:51:02.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/732: rename df/d18/f97 to df/d18/d3e/d51/ff3 0 2024-02-15T22:51:02.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/733: chown df/d18/d3e/d60/d72/da5/fc7 6061 1 2024-02-15T22:51:02.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/734: creat df/ff4 x:0 0 0 2024-02-15T22:51:02.260 INFO:tasks.workunit.client.0.smithi138.stdout:5/735: write df/d18/d56/dae/fcd [82216,46410] 0 2024-02-15T22:51:02.261 INFO:tasks.workunit.client.0.smithi138.stdout:3/965: dread d5/d12/d23/d94/fef [0,4194304] 0 2024-02-15T22:51:02.263 INFO:tasks.workunit.client.0.smithi138.stdout:3/966: mknod d5/d12/d26/da6/d107/da2/dc6/dd2/c141 0 2024-02-15T22:51:02.263 INFO:tasks.workunit.client.0.smithi138.stdout:3/967: write d5/fe6 [694805,28444] 0 2024-02-15T22:51:02.270 INFO:tasks.workunit.client.0.smithi138.stdout:9/987: write d0/de/d14/da3/dc8/d6a/fd0 [3552265,106658] 0 2024-02-15T22:51:02.274 INFO:tasks.workunit.client.0.smithi138.stdout:9/988: unlink d0/dc7/f14a 0 2024-02-15T22:51:02.276 INFO:tasks.workunit.client.0.smithi138.stdout:9/989: creat d0/de/d34/f15c x:0 0 0 2024-02-15T22:51:02.279 INFO:tasks.workunit.client.0.smithi138.stdout:9/990: mknod d0/d1/db8/c15d 0 2024-02-15T22:51:02.280 INFO:tasks.workunit.client.0.smithi138.stdout:9/991: creat d0/de/d14/d18/f15e x:0 0 0 2024-02-15T22:51:02.280 INFO:tasks.workunit.client.0.smithi138.stdout:9/992: write d0/d2e/f8f [4569799,118323] 0 2024-02-15T22:51:02.280 INFO:tasks.workunit.client.0.smithi138.stdout:9/993: truncate d0/df/fde 1012360 0 2024-02-15T22:51:02.282 INFO:tasks.workunit.client.0.smithi138.stdout:9/994: dread d0/de/d14/da3/dc8/d6a/f110 [0,4194304] 0 2024-02-15T22:51:02.285 INFO:tasks.workunit.client.0.smithi138.stdout:9/995: mkdir d0/de/d14/da3/d15f 0 2024-02-15T22:51:02.287 INFO:tasks.workunit.client.0.smithi138.stdout:9/996: chown d0/de/d34/d89/fb1 3282 1 2024-02-15T22:51:02.324 INFO:tasks.workunit.client.0.smithi138.stdout:0/744: write d6/d10/d13/ff0 [3494156,266] 0 2024-02-15T22:51:02.338 INFO:tasks.workunit.client.0.smithi138.stdout:0/745: dread d6/d10/d13/fb7 [0,4194304] 0 2024-02-15T22:51:02.349 INFO:tasks.workunit.client.0.smithi138.stdout:2/752: dwrite d0/da/d19/d53/d5d/d74/f5f [0,4194304] 0 2024-02-15T22:51:02.354 INFO:tasks.workunit.client.0.smithi138.stdout:0/746: dread d6/d10/d13/d3d/f70 [0,4194304] 0 2024-02-15T22:51:02.354 INFO:tasks.workunit.client.0.smithi138.stdout:0/747: chown d6/d10/d75/l80 124694 1 2024-02-15T22:51:02.358 INFO:tasks.workunit.client.0.smithi138.stdout:2/753: symlink d0/dd/d15/d65/l109 0 2024-02-15T22:51:02.358 INFO:tasks.workunit.client.0.smithi138.stdout:2/754: fsync d0/dd/d15/de3/ffc 0 2024-02-15T22:51:02.360 INFO:tasks.workunit.client.0.smithi138.stdout:0/748: creat d6/dba/f10a x:0 0 0 2024-02-15T22:51:02.361 INFO:tasks.workunit.client.0.smithi138.stdout:0/749: creat d6/d10/d18/d1b/f10b x:0 0 0 2024-02-15T22:51:02.361 INFO:tasks.workunit.client.0.smithi138.stdout:0/750: write d6/d10/d18/d1b/feb [299585,104958] 0 2024-02-15T22:51:02.362 INFO:tasks.workunit.client.0.smithi138.stdout:2/755: dread d0/da/d95/fa1 [0,4194304] 0 2024-02-15T22:51:02.362 INFO:tasks.workunit.client.0.smithi138.stdout:2/756: write d0/da/d19/d53/d5d/d83/d8a/fe1 [841693,83624] 0 2024-02-15T22:51:02.362 INFO:tasks.workunit.client.0.smithi138.stdout:0/751: symlink d6/d10/d40/l10c 0 2024-02-15T22:51:02.366 INFO:tasks.workunit.client.0.smithi138.stdout:0/752: link d6/d10/d64/dd7/ffd d6/d10/d75/d102/f10d 0 2024-02-15T22:51:02.366 INFO:tasks.workunit.client.0.smithi138.stdout:0/753: fdatasync d6/d10/d40/f91 0 2024-02-15T22:51:02.367 INFO:tasks.workunit.client.0.smithi138.stdout:0/754: read - d6/d10/d75/fc5 zero size 2024-02-15T22:51:02.371 INFO:tasks.workunit.client.0.smithi138.stdout:2/757: rename d0/da/d95 to d0/da/df6/d10a 0 2024-02-15T22:51:02.371 INFO:tasks.workunit.client.0.smithi138.stdout:2/758: write d0/da/d19/d53/d5d/fc9 [1931150,118240] 0 2024-02-15T22:51:02.374 INFO:tasks.workunit.client.0.smithi138.stdout:0/755: dread d6/d10/d13/d3d/f71 [0,4194304] 0 2024-02-15T22:51:02.383 INFO:tasks.workunit.client.0.smithi138.stdout:0/756: creat d6/d10/d18/d6e/f10e x:0 0 0 2024-02-15T22:51:02.383 INFO:tasks.workunit.client.0.smithi138.stdout:8/820: dread db/d15/d70/f7a [0,4194304] 0 2024-02-15T22:51:02.384 INFO:tasks.workunit.client.0.smithi138.stdout:8/821: write db/da0/fb5 [468607,52899] 0 2024-02-15T22:51:02.384 INFO:tasks.workunit.client.0.smithi138.stdout:8/822: write db/d15/db6/df2/d13/d19/fa3 [1386838,111336] 0 2024-02-15T22:51:02.384 INFO:tasks.workunit.client.0.smithi138.stdout:8/823: creat db/d15/db6/d106/f10a x:0 0 0 2024-02-15T22:51:02.385 INFO:tasks.workunit.client.0.smithi138.stdout:2/759: dread d0/da/d19/d53/d5d/d6d/f7c [0,4194304] 0 2024-02-15T22:51:02.385 INFO:tasks.workunit.client.0.smithi138.stdout:2/760: stat d0/da/d19/d53/ff2 0 2024-02-15T22:51:02.386 INFO:tasks.workunit.client.0.smithi138.stdout:2/761: chown d0/da/d19/d53/d5d/d6d/c77 175148957 1 2024-02-15T22:51:02.393 INFO:tasks.workunit.client.0.smithi138.stdout:9/997: dwrite d0/de/d14/d18/ff5 [0,4194304] 0 2024-02-15T22:51:02.393 INFO:tasks.workunit.client.0.smithi138.stdout:8/824: truncate db/d15/db6/df2/d13/d19/d6b/d105/fdf 1264181 0 2024-02-15T22:51:02.403 INFO:tasks.workunit.client.0.smithi138.stdout:8/825: link db/d15/db6/df2/fa8 db/d15/db6/df2/f10b 0 2024-02-15T22:51:02.412 INFO:tasks.workunit.client.0.smithi138.stdout:8/826: read db/f1a [2450744,51554] 0 2024-02-15T22:51:02.413 INFO:tasks.workunit.client.0.smithi138.stdout:8/827: stat db/d15/d70/d7c/d92/de6/l9b 0 2024-02-15T22:51:02.415 INFO:tasks.workunit.client.0.smithi138.stdout:8/828: symlink db/d15/db6/df2/d13/d19/d6b/dba/dfe/l10c 0 2024-02-15T22:51:02.417 INFO:tasks.workunit.client.0.smithi138.stdout:8/829: symlink db/d15/db6/df2/d13/d77/l10d 0 2024-02-15T22:51:02.426 INFO:tasks.workunit.client.0.smithi138.stdout:1/634: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f56 [0,4194304] 0 2024-02-15T22:51:02.427 INFO:tasks.workunit.client.0.smithi138.stdout:1/635: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e [273717,19441] 0 2024-02-15T22:51:02.427 INFO:tasks.workunit.client.0.smithi138.stdout:1/636: truncate df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f56 655220 0 2024-02-15T22:51:02.440 INFO:tasks.workunit.client.0.smithi138.stdout:1/637: symlink df/d1b/d33/ld2 0 2024-02-15T22:51:02.516 INFO:tasks.workunit.client.0.smithi138.stdout:3/968: dwrite d5/d12/d23/d29/d4f/ff8 [0,4194304] 0 2024-02-15T22:51:02.575 INFO:tasks.workunit.client.0.smithi138.stdout:4/888: write d17/f18 [1318507,103345] 0 2024-02-15T22:51:02.576 INFO:tasks.workunit.client.0.smithi138.stdout:4/889: dread d17/d1e/d2d/d36/dca/da3/dbf/fe5 [0,4194304] 0 2024-02-15T22:51:02.576 INFO:tasks.workunit.client.0.smithi138.stdout:4/890: stat d17/d1e/d2d/d36/dca/da3/dbf/f11d 0 2024-02-15T22:51:02.599 INFO:tasks.workunit.client.0.smithi138.stdout:1/638: dwrite df/d1b/d1d/d25/d2e/d37/f54 [0,4194304] 0 2024-02-15T22:51:02.600 INFO:tasks.workunit.client.0.smithi138.stdout:1/639: getdents df/d1b 0 2024-02-15T22:51:02.603 INFO:tasks.workunit.client.0.smithi138.stdout:1/640: symlink df/d1b/d1d/d25/d2e/d5b/d7b/ld3 0 2024-02-15T22:51:02.647 INFO:tasks.workunit.client.0.smithi138.stdout:3/969: dwrite d5/d12/d26/da6/d107/d47/d67/fa3 [4194304,4194304] 0 2024-02-15T22:51:02.647 INFO:tasks.workunit.client.0.smithi138.stdout:3/970: getdents d5/d12/d26/da6/d107/da2/d133 0 2024-02-15T22:51:02.661 INFO:tasks.workunit.client.0.smithi138.stdout:3/971: dread d5/d12/d26/da6/d107/d47/f10e [0,4194304] 0 2024-02-15T22:51:02.662 INFO:tasks.workunit.client.0.smithi138.stdout:6/739: dwrite dc/d4b/ff3 [0,4194304] 0 2024-02-15T22:51:02.665 INFO:tasks.workunit.client.0.smithi138.stdout:3/972: rename d5/d18/fbe to d5/d12/d26/d2f/f142 0 2024-02-15T22:51:02.673 INFO:tasks.workunit.client.0.smithi138.stdout:6/740: dread dc/d4b/dba/fcb [0,4194304] 0 2024-02-15T22:51:02.676 INFO:tasks.workunit.client.0.smithi138.stdout:6/741: symlink dc/d24/d34/d3b/d7c/da8/lf8 0 2024-02-15T22:51:02.678 INFO:tasks.workunit.client.0.smithi138.stdout:3/973: dread d5/d12/d26/d2e/f110 [0,4194304] 0 2024-02-15T22:51:02.678 INFO:tasks.workunit.client.0.smithi138.stdout:6/742: mknod dc/d24/d6c/dbc/de7/cf9 0 2024-02-15T22:51:02.680 INFO:tasks.workunit.client.0.smithi138.stdout:3/974: mkdir d5/d18/d143 0 2024-02-15T22:51:02.681 INFO:tasks.workunit.client.0.smithi138.stdout:6/743: truncate dc/d24/d6c/fef 7321242 0 2024-02-15T22:51:02.682 INFO:tasks.workunit.client.0.smithi138.stdout:0/757: dwrite d6/d10/d13/f1e [0,4194304] 0 2024-02-15T22:51:02.682 INFO:tasks.workunit.client.0.smithi138.stdout:3/975: mkdir d5/d18/d144 0 2024-02-15T22:51:02.685 INFO:tasks.workunit.client.0.smithi138.stdout:6/744: unlink dc/d24/d6c/dbc/de7/fa3 0 2024-02-15T22:51:02.685 INFO:tasks.workunit.client.0.smithi138.stdout:3/976: mknod d5/d16/d4d/c145 0 2024-02-15T22:51:02.687 INFO:tasks.workunit.client.0.smithi138.stdout:3/977: link d5/d18/l11c d5/d12/d23/d29/d5a/dc2/l146 0 2024-02-15T22:51:02.688 INFO:tasks.workunit.client.0.smithi138.stdout:6/745: getdents dc/d24/d34/d3b/d7c 0 2024-02-15T22:51:02.689 INFO:tasks.workunit.client.0.smithi138.stdout:3/978: getdents d5/d12/d23/d29/d4f 0 2024-02-15T22:51:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:6/746: mknod dc/d24/d34/dde/cfa 0 2024-02-15T22:51:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:6/747: chown dc/d24/d34/d3b/d7c/d9f/fa5 253 1 2024-02-15T22:51:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:6/748: write dc/d24/d34/d3b/f5d [823798,78576] 0 2024-02-15T22:51:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:6/749: chown dc/d24/d6c/ddb/fdc 3416 1 2024-02-15T22:51:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:3/979: mknod d5/d18/d143/c147 0 2024-02-15T22:51:02.692 INFO:tasks.workunit.client.0.smithi138.stdout:6/750: mknod dc/d24/d6c/ddb/ddf/cfb 0 2024-02-15T22:51:02.694 INFO:tasks.workunit.client.0.smithi138.stdout:3/980: symlink d5/d16/dc/db8/l148 0 2024-02-15T22:51:02.694 INFO:tasks.workunit.client.0.smithi138.stdout:3/981: write d5/d12/d26/da6/d107/d57/d5d/ff4 [576855,95049] 0 2024-02-15T22:51:02.694 INFO:tasks.workunit.client.0.smithi138.stdout:3/982: fdatasync d5/d16/d4d/de4/fed 0 2024-02-15T22:51:02.694 INFO:tasks.workunit.client.0.smithi138.stdout:3/983: dread - d5/d12/d26/da6/d107/da2/dc6/dd2/f11b zero size 2024-02-15T22:51:02.694 INFO:tasks.workunit.client.0.smithi138.stdout:3/984: write d5/d12/d26/da6/d107/d47/f10d [580313,26686] 0 2024-02-15T22:51:02.698 INFO:tasks.workunit.client.0.smithi138.stdout:3/985: link d5/d18/d35/c9f d5/d18/d11d/c149 0 2024-02-15T22:51:02.706 INFO:tasks.workunit.client.0.smithi138.stdout:8/830: dwrite db/f10 [4194304,4194304] 0 2024-02-15T22:51:02.707 INFO:tasks.workunit.client.0.smithi138.stdout:8/831: rename db/d15/f94 to db/d15/d70/f10e 0 2024-02-15T22:51:02.709 INFO:tasks.workunit.client.0.smithi138.stdout:8/832: creat db/d15/db6/df2/d4d/de5/f10f x:0 0 0 2024-02-15T22:51:02.718 INFO:tasks.workunit.client.0.smithi138.stdout:8/833: dread db/d15/db6/df2/d13/f31 [0,4194304] 0 2024-02-15T22:51:02.745 INFO:tasks.workunit.client.0.smithi138.stdout:8/834: dwrite db/d15/d70/d7c/d92/f2c [4194304,4194304] 0 2024-02-15T22:51:02.769 INFO:tasks.workunit.client.0.smithi138.stdout:8/835: dwrite db/d15/d70/f5b [0,4194304] 0 2024-02-15T22:51:02.770 INFO:tasks.workunit.client.0.smithi138.stdout:8/836: chown db/d15/db6/df2/d13/d19/d7d/db2 416 1 2024-02-15T22:51:02.770 INFO:tasks.workunit.client.0.smithi138.stdout:8/837: readlink db/d15/l65 0 2024-02-15T22:51:02.771 INFO:tasks.workunit.client.0.smithi138.stdout:8/838: unlink db/d15/db6/df2/d13/d77/d8f/lb1 0 2024-02-15T22:51:02.771 INFO:tasks.workunit.client.0.smithi138.stdout:3/986: rmdir d5/d12/d23 39 2024-02-15T22:51:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:8/839: getdents db/d15/db6/df2/d13/d19/d6b/dba/dfe 0 2024-02-15T22:51:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:8/840: fdatasync db/d15/db6/df2/d13/d19/f43 0 2024-02-15T22:51:02.774 INFO:tasks.workunit.client.0.smithi138.stdout:8/841: symlink db/d15/db6/df2/d13/d77/d8f/l110 0 2024-02-15T22:51:02.779 INFO:tasks.workunit.client.0.smithi138.stdout:8/842: creat db/d15/db6/df2/d13/d19/d6b/dba/f111 x:0 0 0 2024-02-15T22:51:02.804 INFO:tasks.workunit.client.0.smithi138.stdout:3/987: dwrite d5/d12/d26/da6/d107/fac [0,4194304] 0 2024-02-15T22:51:02.804 INFO:tasks.workunit.client.0.smithi138.stdout:3/988: write d5/d12/fd7 [261066,80249] 0 2024-02-15T22:51:02.823 INFO:tasks.workunit.client.0.smithi138.stdout:6/751: dwrite dc/d24/d34/d3b/d7c/da8/ff1 [0,4194304] 0 2024-02-15T22:51:02.826 INFO:tasks.workunit.client.0.smithi138.stdout:3/989: dwrite d5/d18/f24 [0,4194304] 0 2024-02-15T22:51:02.826 INFO:tasks.workunit.client.0.smithi138.stdout:3/990: dread - d5/d12/d23/f121 zero size 2024-02-15T22:51:02.837 INFO:tasks.workunit.client.0.smithi138.stdout:2/762: read d0/da/d19/d53/d5d/d83/d8a/fe1 [415360,125577] 0 2024-02-15T22:51:02.838 INFO:tasks.workunit.client.0.smithi138.stdout:2/763: dread d0/da/df6/f99 [0,4194304] 0 2024-02-15T22:51:02.838 INFO:tasks.workunit.client.0.smithi138.stdout:2/764: rename d0/da to d0/da/d19/d53/d5d/d6d/d7b/d10b 22 2024-02-15T22:51:02.840 INFO:tasks.workunit.client.0.smithi138.stdout:2/765: mknod d0/da/d19/d53/d5d/d83/d8a/c10c 0 2024-02-15T22:51:02.840 INFO:tasks.workunit.client.0.smithi138.stdout:2/766: fdatasync d0/da/d19/d53/d5d/d83/f88 0 2024-02-15T22:51:02.841 INFO:tasks.workunit.client.0.smithi138.stdout:2/767: mkdir d0/da/d19/d3f/d10d 0 2024-02-15T22:51:02.841 INFO:tasks.workunit.client.0.smithi138.stdout:2/768: fdatasync d0/dd/f18 0 2024-02-15T22:51:02.852 INFO:tasks.workunit.client.0.smithi138.stdout:3/991: dwrite d5/d18/d35/f8c [0,4194304] 0 2024-02-15T22:51:02.852 INFO:tasks.workunit.client.0.smithi138.stdout:3/992: chown d5/d12/d26/da6/d107/d47/f75 1738 1 2024-02-15T22:51:02.938 INFO:tasks.workunit.client.0.smithi138.stdout:9/998: dread d0/de/d34/fe1 [0,4194304] 0 2024-02-15T22:51:02.938 INFO:tasks.workunit.client.0.smithi138.stdout:9/999: read - d0/de/d14/da3/f140 zero size 2024-02-15T22:51:03.015 INFO:tasks.workunit.client.0.smithi138.stdout:2/769: dwrite d0/da/dca/ff0 [0,4194304] 0 2024-02-15T22:51:03.017 INFO:tasks.workunit.client.0.smithi138.stdout:2/770: rename d0/da/cab to d0/da/d19/d53/d5d/d6d/dd8/c10e 0 2024-02-15T22:51:03.018 INFO:tasks.workunit.client.0.smithi138.stdout:2/771: mknod d0/da/d19/d53/d5d/d6d/d7b/dbf/c10f 0 2024-02-15T22:51:03.019 INFO:tasks.workunit.client.0.smithi138.stdout:2/772: symlink d0/da/d19/l110 0 2024-02-15T22:51:03.019 INFO:tasks.workunit.client.0.smithi138.stdout:2/773: write d0/da/d19/d53/d5d/d74/d79/f89 [680871,93504] 0 2024-02-15T22:51:03.019 INFO:tasks.workunit.client.0.smithi138.stdout:2/774: chown d0/da/d19/d53/d5d/d83 476455 1 2024-02-15T22:51:03.033 INFO:tasks.workunit.client.0.smithi138.stdout:6/752: dread dc/d24/d34/d3b/d7c/da8/fc5 [0,4194304] 0 2024-02-15T22:51:03.036 INFO:tasks.workunit.client.0.smithi138.stdout:5/736: dread df/d18/d3e/d60/d65/d7f/d90/f92 [0,4194304] 0 2024-02-15T22:51:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:02 smithi138 ceph-mon[29229]: pgmap v14: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 220 MiB/s rd, 258 MiB/s wr, 365 op/s 2024-02-15T22:51:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:02 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:02 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:03.245 INFO:tasks.workunit.client.0.smithi138.stdout:2/775: truncate d0/f1 2180411 0 2024-02-15T22:51:03.245 INFO:tasks.workunit.client.0.smithi138.stdout:2/776: stat d0/dd/d15/f8c 0 2024-02-15T22:51:03.245 INFO:tasks.workunit.client.0.smithi138.stdout:2/777: chown d0/da/d19/l56 58 1 2024-02-15T22:51:03.245 INFO:tasks.workunit.client.0.smithi138.stdout:6/753: creat dc/d24/df4/ffc x:0 0 0 2024-02-15T22:51:03.247 INFO:tasks.workunit.client.0.smithi138.stdout:5/737: rename df/d18/d77/lcc to df/d18/d3e/lf5 0 2024-02-15T22:51:03.254 INFO:tasks.workunit.client.0.smithi138.stdout:2/778: rename d0/da/d19/d53/d5d/d6d/dd8/c10e to d0/da/d19/c111 0 2024-02-15T22:51:03.254 INFO:tasks.workunit.client.0.smithi138.stdout:6/754: write dc/d24/d34/d3b/d7c/d9f/fa5 [2229656,13170] 0 2024-02-15T22:51:03.257 INFO:tasks.workunit.client.0.smithi138.stdout:5/738: rename df/d18/d3e/d51/dc9/d9c/fce to df/d18/d3e/d60/d65/d7c/ff6 0 2024-02-15T22:51:03.260 INFO:tasks.workunit.client.0.smithi138.stdout:6/755: creat dc/d24/d34/ffd x:0 0 0 2024-02-15T22:51:03.260 INFO:tasks.workunit.client.0.smithi138.stdout:6/756: creat dc/d24/df4/ffe x:0 0 0 2024-02-15T22:51:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:02 smithi170 ceph-mon[35248]: pgmap v14: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 220 MiB/s rd, 258 MiB/s wr, 365 op/s 2024-02-15T22:51:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:02 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:02 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:03.261 INFO:tasks.workunit.client.0.smithi138.stdout:2/779: rename d0/da/d19/d53/d5d/d74/de9/fd5 to d0/da/d19/d53/d5d/dcc/f112 0 2024-02-15T22:51:03.264 INFO:tasks.workunit.client.0.smithi138.stdout:6/757: unlink dc/d24/d34/d3b/d7d/lee 0 2024-02-15T22:51:03.265 INFO:tasks.workunit.client.0.smithi138.stdout:2/780: creat d0/da/d19/d53/d5d/d6d/f113 x:0 0 0 2024-02-15T22:51:03.266 INFO:tasks.workunit.client.0.smithi138.stdout:6/758: mkdir dc/d4b/dba/dff 0 2024-02-15T22:51:03.267 INFO:tasks.workunit.client.0.smithi138.stdout:6/759: link dc/d4b/dba/ff2 dc/d4b/d98/f100 0 2024-02-15T22:51:03.267 INFO:tasks.workunit.client.0.smithi138.stdout:6/760: creat dc/d76/f101 x:0 0 0 2024-02-15T22:51:03.278 INFO:tasks.workunit.client.0.smithi138.stdout:6/761: getdents dc/d4b/d98 0 2024-02-15T22:51:03.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/762: rename dc/d24/c2f to dc/d24/d6c/dbc/c102 0 2024-02-15T22:51:03.280 INFO:tasks.workunit.client.0.smithi138.stdout:6/763: dread - dc/d24/f39 zero size 2024-02-15T22:51:03.281 INFO:tasks.workunit.client.0.smithi138.stdout:2/781: dwrite d0/dd/fe4 [0,4194304] 0 2024-02-15T22:51:03.284 INFO:tasks.workunit.client.0.smithi138.stdout:2/782: mkdir d0/dd/d15/d72/d114 0 2024-02-15T22:51:03.286 INFO:tasks.workunit.client.0.smithi138.stdout:2/783: unlink d0/dd/d15/l60 0 2024-02-15T22:51:03.288 INFO:tasks.workunit.client.0.smithi138.stdout:2/784: rename d0/dd/fe4 to d0/da/f115 0 2024-02-15T22:51:03.288 INFO:tasks.workunit.client.0.smithi138.stdout:2/785: truncate d0/da/d19/d53/d5d/d83/d8a/fe1 1519154 0 2024-02-15T22:51:03.289 INFO:tasks.workunit.client.0.smithi138.stdout:2/786: creat d0/da/d19/d53/d5d/d6d/d7b/f116 x:0 0 0 2024-02-15T22:51:03.292 INFO:tasks.workunit.client.0.smithi138.stdout:2/787: rmdir d0/dd/d15/d72/dbd 0 2024-02-15T22:51:03.292 INFO:tasks.workunit.client.0.smithi138.stdout:2/788: truncate d0/d3/fe6 88322 0 2024-02-15T22:51:03.292 INFO:tasks.workunit.client.0.smithi138.stdout:2/789: chown d0/da/d19/d53/d5d/d6d/d7b/da3/f108 1397 1 2024-02-15T22:51:03.292 INFO:tasks.workunit.client.0.smithi138.stdout:2/790: fdatasync d0/da/d19/d53/d5d/d6d/d7b/fe7 0 2024-02-15T22:51:03.292 INFO:tasks.workunit.client.0.smithi138.stdout:2/791: fsync d0/da/f3a 0 2024-02-15T22:51:03.293 INFO:tasks.workunit.client.0.smithi138.stdout:2/792: creat d0/da/d19/d53/d5d/dcc/f117 x:0 0 0 2024-02-15T22:51:03.298 INFO:tasks.workunit.client.0.smithi138.stdout:6/764: dwrite dc/fb6 [0,4194304] 0 2024-02-15T22:51:03.298 INFO:tasks.workunit.client.0.smithi138.stdout:6/765: readlink dc/d24/d34/lcc 0 2024-02-15T22:51:03.300 INFO:tasks.workunit.client.0.smithi138.stdout:6/766: creat dc/d24/d34/d99/dc4/dd1/f103 x:0 0 0 2024-02-15T22:51:03.300 INFO:tasks.workunit.client.0.smithi138.stdout:6/767: readlink dc/d24/d34/d3b/l4f 0 2024-02-15T22:51:03.301 INFO:tasks.workunit.client.0.smithi138.stdout:6/768: symlink dc/d76/l104 0 2024-02-15T22:51:03.303 INFO:tasks.workunit.client.0.smithi138.stdout:6/769: link dc/d24/l37 dc/d24/d34/d3b/d7c/l105 0 2024-02-15T22:51:03.305 INFO:tasks.workunit.client.0.smithi138.stdout:6/770: rename dc/d24/d6c/fdd to dc/d24/d6c/ddb/ddf/f106 0 2024-02-15T22:51:03.305 INFO:tasks.workunit.client.0.smithi138.stdout:6/771: chown dc/d24/d34/d3b/d7c/d9f/ca7 413 1 2024-02-15T22:51:03.305 INFO:tasks.workunit.client.0.smithi138.stdout:6/772: fdatasync dc/d24/d34/d3b/f4a 0 2024-02-15T22:51:03.309 INFO:tasks.workunit.client.0.smithi138.stdout:2/793: dwrite d0/dd/d15/d72/f92 [0,4194304] 0 2024-02-15T22:51:03.310 INFO:tasks.workunit.client.0.smithi138.stdout:2/794: chown d0/da/d19/d53/d5d/d6d/d7b/cb5 20589 1 2024-02-15T22:51:03.311 INFO:tasks.workunit.client.0.smithi138.stdout:2/795: unlink d0/d3/c28 0 2024-02-15T22:51:03.322 INFO:tasks.workunit.client.0.smithi138.stdout:6/773: dwrite dc/d4b/dba/fcb [0,4194304] 0 2024-02-15T22:51:03.323 INFO:tasks.workunit.client.0.smithi138.stdout:2/796: dread d0/dd/d15/d72/f92 [0,4194304] 0 2024-02-15T22:51:03.323 INFO:tasks.workunit.client.0.smithi138.stdout:2/797: chown d0/da/d19/d3f 4 1 2024-02-15T22:51:03.326 INFO:tasks.workunit.client.0.smithi138.stdout:6/774: rename dc/d4b/l4c to dc/d24/df4/l107 0 2024-02-15T22:51:03.327 INFO:tasks.workunit.client.0.smithi138.stdout:2/798: mkdir d0/da/d19/d53/d80/dba/d118 0 2024-02-15T22:51:03.329 INFO:tasks.workunit.client.0.smithi138.stdout:6/775: link dc/f1e dc/d24/d34/d3b/d7c/da8/f108 0 2024-02-15T22:51:03.329 INFO:tasks.workunit.client.0.smithi138.stdout:6/776: dread - dc/d24/d6c/fc9 zero size 2024-02-15T22:51:03.329 INFO:tasks.workunit.client.0.smithi138.stdout:2/799: write d0/dd/d15/f71 [1536371,67983] 0 2024-02-15T22:51:03.330 INFO:tasks.workunit.client.0.smithi138.stdout:2/800: creat d0/dd/d15/f119 x:0 0 0 2024-02-15T22:51:03.331 INFO:tasks.workunit.client.0.smithi138.stdout:2/801: symlink d0/da/d19/d53/d5d/d83/d8a/l11a 0 2024-02-15T22:51:03.333 INFO:tasks.workunit.client.0.smithi138.stdout:2/802: dread d0/dd/d15/d65/f7e [0,4194304] 0 2024-02-15T22:51:03.334 INFO:tasks.workunit.client.0.smithi138.stdout:2/803: dread - d0/da/d19/d53/d5d/d83/fc0 zero size 2024-02-15T22:51:03.335 INFO:tasks.workunit.client.0.smithi138.stdout:2/804: truncate d0/dd/f18 903861 0 2024-02-15T22:51:03.335 INFO:tasks.workunit.client.0.smithi138.stdout:6/777: dread f2 [0,4194304] 0 2024-02-15T22:51:03.338 INFO:tasks.workunit.client.0.smithi138.stdout:2/805: mknod d0/dd/c11b 0 2024-02-15T22:51:03.340 INFO:tasks.workunit.client.0.smithi138.stdout:6/778: creat dc/d24/d34/d3b/f109 x:0 0 0 2024-02-15T22:51:03.341 INFO:tasks.workunit.client.0.smithi138.stdout:2/806: rmdir d0/da/d19/d3f 39 2024-02-15T22:51:03.342 INFO:tasks.workunit.client.0.smithi138.stdout:2/807: dread - d0/da/d19/d53/d5d/d6d/d7b/f116 zero size 2024-02-15T22:51:03.342 INFO:tasks.workunit.client.0.smithi138.stdout:6/779: mknod dc/d24/d34/d3b/d66/c10a 0 2024-02-15T22:51:03.345 INFO:tasks.workunit.client.0.smithi138.stdout:2/808: mkdir d0/da/d19/d53/d80/d11c 0 2024-02-15T22:51:03.348 INFO:tasks.workunit.client.0.smithi138.stdout:6/780: mkdir dc/d4b/dba/d10b 0 2024-02-15T22:51:03.351 INFO:tasks.workunit.client.0.smithi138.stdout:6/781: symlink dc/d4b/dba/d10b/l10c 0 2024-02-15T22:51:03.352 INFO:tasks.workunit.client.0.smithi138.stdout:2/809: getdents d0/dd/d15 0 2024-02-15T22:51:03.354 INFO:tasks.workunit.client.0.smithi138.stdout:2/810: truncate d0/da/d19/d53/d5d/d74/fa7 1953439 0 2024-02-15T22:51:03.354 INFO:tasks.workunit.client.0.smithi138.stdout:2/811: write d0/da/d19/d53/d80/dba/fcb [1249307,23486] 0 2024-02-15T22:51:03.363 INFO:tasks.workunit.client.0.smithi138.stdout:2/812: read d0/da/d19/d53/d5d/d6d/d7b/fda [1735768,113406] 0 2024-02-15T22:51:03.372 INFO:tasks.workunit.client.0.smithi138.stdout:2/813: dread d0/da/d19/fc7 [0,4194304] 0 2024-02-15T22:51:03.372 INFO:tasks.workunit.client.0.smithi138.stdout:2/814: dread - d0/da/d19/d53/d5d/fe8 zero size 2024-02-15T22:51:03.372 INFO:tasks.workunit.client.0.smithi138.stdout:2/815: chown d0/d3/fe6 720357765 1 2024-02-15T22:51:03.385 INFO:tasks.workunit.client.0.smithi138.stdout:2/816: dwrite d0/da/f8 [0,4194304] 0 2024-02-15T22:51:03.387 INFO:tasks.workunit.client.0.smithi138.stdout:2/817: creat d0/da/f11d x:0 0 0 2024-02-15T22:51:03.401 INFO:tasks.workunit.client.0.smithi138.stdout:2/818: dwrite d0/da/d19/d53/ff5 [0,4194304] 0 2024-02-15T22:51:03.403 INFO:tasks.workunit.client.0.smithi138.stdout:2/819: getdents d0/da/d19/d53/d5d/d6d/d7b 0 2024-02-15T22:51:03.403 INFO:tasks.workunit.client.0.smithi138.stdout:2/820: write d0/da/d19/d53/d5d/fb2 [6209461,69838] 0 2024-02-15T22:51:03.405 INFO:tasks.workunit.client.0.smithi138.stdout:2/821: mkdir d0/da/d19/d11e 0 2024-02-15T22:51:03.413 INFO:tasks.workunit.client.0.smithi138.stdout:2/822: dread d0/da/f8 [0,4194304] 0 2024-02-15T22:51:03.413 INFO:tasks.workunit.client.0.smithi138.stdout:2/823: fdatasync d0/da/f33 0 2024-02-15T22:51:03.414 INFO:tasks.workunit.client.0.smithi138.stdout:2/824: mkdir d0/da/d19/d53/d80/dba/d118/d11f 0 2024-02-15T22:51:03.414 INFO:tasks.workunit.client.0.smithi138.stdout:2/825: chown d0/da/d19/fc7 1054369807 1 2024-02-15T22:51:03.414 INFO:tasks.workunit.client.0.smithi138.stdout:2/826: truncate d0/dd/f18 1724960 0 2024-02-15T22:51:03.414 INFO:tasks.workunit.client.0.smithi138.stdout:2/827: chown d0/da/d19/l56 3627394 1 2024-02-15T22:51:03.415 INFO:tasks.workunit.client.0.smithi138.stdout:2/828: getdents d0/da/d19/d53/d5d/d74/d79 0 2024-02-15T22:51:03.415 INFO:tasks.workunit.client.0.smithi138.stdout:2/829: fdatasync d0/da/df6/f9a 0 2024-02-15T22:51:03.423 INFO:tasks.workunit.client.0.smithi138.stdout:2/830: getdents d0/da/d19/d53/d80/dba 0 2024-02-15T22:51:03.438 INFO:tasks.workunit.client.0.smithi138.stdout:2/831: dwrite d0/da/d19/d53/ff5 [4194304,4194304] 0 2024-02-15T22:51:03.439 INFO:tasks.workunit.client.0.smithi138.stdout:2/832: creat d0/da/d19/d53/d5d/d74/f120 x:0 0 0 2024-02-15T22:51:03.447 INFO:tasks.workunit.client.0.smithi138.stdout:2/833: dread d0/ff8 [0,4194304] 0 2024-02-15T22:51:03.447 INFO:tasks.workunit.client.0.smithi138.stdout:2/834: getdents d0/da/d19/d53/d80/dba/d118/d11f 0 2024-02-15T22:51:03.463 INFO:tasks.workunit.client.0.smithi138.stdout:2/835: dwrite d0/da/d19/d53/d5d/d83/fd6 [0,4194304] 0 2024-02-15T22:51:03.469 INFO:tasks.workunit.client.0.smithi138.stdout:2/836: read d0/dd/d15/d72/f92 [2243673,19750] 0 2024-02-15T22:51:03.471 INFO:tasks.workunit.client.0.smithi138.stdout:2/837: creat d0/da/df6/da0/f121 x:0 0 0 2024-02-15T22:51:03.471 INFO:tasks.workunit.client.0.smithi138.stdout:2/838: truncate d0/dd/d15/d65/f76 5139041 0 2024-02-15T22:51:03.471 INFO:tasks.workunit.client.0.smithi138.stdout:2/839: chown d0/da/d19/d53/d5d/d83/faf 47698951 1 2024-02-15T22:51:03.472 INFO:tasks.workunit.client.0.smithi138.stdout:2/840: dread d0/da/f27 [0,4194304] 0 2024-02-15T22:51:03.474 INFO:tasks.workunit.client.0.smithi138.stdout:2/841: rename d0/da/d19/d53/d80/dd4/dde to d0/da/d19/d53/d5d/d6d/d7b/da3/d122 0 2024-02-15T22:51:03.474 INFO:tasks.workunit.client.0.smithi138.stdout:2/842: chown d0/da/d19/f55 822205372 1 2024-02-15T22:51:03.482 INFO:tasks.workunit.client.0.smithi138.stdout:2/843: read d0/da/f9c [399853,9917] 0 2024-02-15T22:51:03.497 INFO:tasks.workunit.client.0.smithi138.stdout:2/844: dwrite d0/da/d19/fc7 [0,4194304] 0 2024-02-15T22:51:03.512 INFO:tasks.workunit.client.0.smithi138.stdout:2/845: dwrite d0/dd/d15/f119 [0,4194304] 0 2024-02-15T22:51:03.512 INFO:tasks.workunit.client.0.smithi138.stdout:2/846: chown d0/dd/d15/f119 0 1 2024-02-15T22:51:03.514 INFO:tasks.workunit.client.0.smithi138.stdout:2/847: truncate d0/da/d19/d53/d5d/d6d/d7b/fda 2619854 0 2024-02-15T22:51:03.517 INFO:tasks.workunit.client.0.smithi138.stdout:2/848: rmdir d0/da/d19/d53/d5d/d6d/d7b/da3/d122 0 2024-02-15T22:51:03.518 INFO:tasks.workunit.client.0.smithi138.stdout:2/849: symlink d0/d3/l123 0 2024-02-15T22:51:03.519 INFO:tasks.workunit.client.0.smithi138.stdout:2/850: read d0/f1 [2138713,34419] 0 2024-02-15T22:51:03.519 INFO:tasks.workunit.client.0.smithi138.stdout:2/851: write d0/da/df6/da0/fc1 [422832,39738] 0 2024-02-15T22:51:03.531 INFO:tasks.workunit.client.0.smithi138.stdout:2/852: dwrite d0/da/fb4 [4194304,4194304] 0 2024-02-15T22:51:03.533 INFO:tasks.workunit.client.0.smithi138.stdout:2/853: creat d0/da/dca/f124 x:0 0 0 2024-02-15T22:51:03.534 INFO:tasks.workunit.client.0.smithi138.stdout:2/854: rename d0/dd/d15/l1c to d0/dd/d15/ddf/l125 0 2024-02-15T22:51:03.535 INFO:tasks.workunit.client.0.smithi138.stdout:2/855: creat d0/da/d19/d53/d80/dba/f126 x:0 0 0 2024-02-15T22:51:03.557 INFO:tasks.workunit.client.0.smithi138.stdout:2/856: dwrite d0/dd/d15/f6c [0,4194304] 0 2024-02-15T22:51:03.558 INFO:tasks.workunit.client.0.smithi138.stdout:2/857: creat d0/da/d19/d53/d5d/d6d/d7b/f127 x:0 0 0 2024-02-15T22:51:03.559 INFO:tasks.workunit.client.0.smithi138.stdout:2/858: truncate d0/dd/d15/f8c 3058 0 2024-02-15T22:51:03.560 INFO:tasks.workunit.client.0.smithi138.stdout:2/859: creat d0/da/d19/d3f/f128 x:0 0 0 2024-02-15T22:51:03.561 INFO:tasks.workunit.client.0.smithi138.stdout:2/860: symlink d0/da/df6/da0/l129 0 2024-02-15T22:51:03.562 INFO:tasks.workunit.client.0.smithi138.stdout:2/861: dread d0/dd/d15/d65/f76 [4194304,4194304] 0 2024-02-15T22:51:03.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/862: dread d0/da/d19/d53/ff5 [0,4194304] 0 2024-02-15T22:51:03.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/863: rmdir d0/da/dca 39 2024-02-15T22:51:03.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/864: fsync d0/da/d19/d53/d80/fbb 0 2024-02-15T22:51:03.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/865: getdents d0/da/dca 0 2024-02-15T22:51:03.572 INFO:tasks.workunit.client.0.smithi138.stdout:2/866: symlink d0/da/dca/l12a 0 2024-02-15T22:51:03.596 INFO:tasks.workunit.client.0.smithi138.stdout:2/867: dwrite d0/da/d19/d3f/f58 [0,4194304] 0 2024-02-15T22:51:03.596 INFO:tasks.workunit.client.0.smithi138.stdout:2/868: creat d0/dd/d15/d72/f12b x:0 0 0 2024-02-15T22:51:03.597 INFO:tasks.workunit.client.0.smithi138.stdout:2/869: chown d0/dd/d15/l59 890048 1 2024-02-15T22:51:03.597 INFO:tasks.workunit.client.0.smithi138.stdout:2/870: rmdir d0/dd/d15/d65 39 2024-02-15T22:51:03.598 INFO:tasks.workunit.client.0.smithi138.stdout:2/871: symlink d0/da/d19/d53/d5d/d6d/d7b/l12c 0 2024-02-15T22:51:03.598 INFO:tasks.workunit.client.0.smithi138.stdout:2/872: write d0/da/d19/d53/d80/f90 [682579,8864] 0 2024-02-15T22:51:03.598 INFO:tasks.workunit.client.0.smithi138.stdout:2/873: truncate d0/f1 1814415 0 2024-02-15T22:51:03.598 INFO:tasks.workunit.client.0.smithi138.stdout:2/874: readlink d0/da/d19/d53/l64 0 2024-02-15T22:51:03.600 INFO:tasks.workunit.client.0.smithi138.stdout:2/875: rmdir d0/da/d19/d53/d80/dd4 0 2024-02-15T22:51:03.601 INFO:tasks.workunit.client.0.smithi138.stdout:2/876: truncate d0/da/d19/d53/d5d/d74/d79/f89 1146513 0 2024-02-15T22:51:03.601 INFO:tasks.workunit.client.0.smithi138.stdout:2/877: dread d0/d3/fe6 [0,4194304] 0 2024-02-15T22:51:03.603 INFO:tasks.workunit.client.0.smithi138.stdout:2/878: truncate d0/dd/d15/f119 553927 0 2024-02-15T22:51:03.604 INFO:tasks.workunit.client.0.smithi138.stdout:2/879: symlink d0/da/df6/da0/l12d 0 2024-02-15T22:51:03.604 INFO:tasks.workunit.client.0.smithi138.stdout:2/880: readlink d0/da/d19/d53/d5d/lf3 0 2024-02-15T22:51:03.605 INFO:tasks.workunit.client.0.smithi138.stdout:2/881: creat d0/da/d19/d53/d5d/d83/d8a/f12e x:0 0 0 2024-02-15T22:51:03.606 INFO:tasks.workunit.client.0.smithi138.stdout:2/882: symlink d0/da/d19/d53/d5d/dcc/l12f 0 2024-02-15T22:51:03.616 INFO:tasks.workunit.client.0.smithi138.stdout:2/883: read d0/da/d19/d3f/f58 [3288046,27711] 0 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:0/758: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:5/739: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:1/641: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:4/891: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:3/993: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:8/843: sync 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:1/642: chown df/d1b/d1d/d25/d8d/cc1 28 1 2024-02-15T22:51:03.623 INFO:tasks.workunit.client.0.smithi138.stdout:8/844: read db/d15/db6/df2/d13/d19/d7d/db2/ff6 [11334,1999] 0 2024-02-15T22:51:03.624 INFO:tasks.workunit.client.0.smithi138.stdout:1/643: truncate df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e 960687 0 2024-02-15T22:51:03.624 INFO:tasks.workunit.client.0.smithi138.stdout:1/644: readlink df/d1b/d1d/d25/d2e/d5b/d65/l95 0 2024-02-15T22:51:03.624 INFO:tasks.workunit.client.0.smithi138.stdout:6/782: sync 2024-02-15T22:51:03.625 INFO:tasks.workunit.client.0.smithi138.stdout:0/759: symlink d6/d10/d52/d6f/d85/l10f 0 2024-02-15T22:51:03.625 INFO:tasks.workunit.client.0.smithi138.stdout:0/760: chown d6/d10/d18/d57/c5b 12194565 1 2024-02-15T22:51:03.625 INFO:tasks.workunit.client.0.smithi138.stdout:1/645: getdents df/d1b/d1d/d25/d2e/d6c 0 2024-02-15T22:51:03.626 INFO:tasks.workunit.client.0.smithi138.stdout:1/646: readlink df/d1b/l1e 0 2024-02-15T22:51:03.627 INFO:tasks.workunit.client.0.smithi138.stdout:6/783: creat dc/d4b/d7b/f10d x:0 0 0 2024-02-15T22:51:03.629 INFO:tasks.workunit.client.0.smithi138.stdout:0/761: rename d6/d10/d52/l109 to d6/d10/d52/d6f/d85/l110 0 2024-02-15T22:51:03.630 INFO:tasks.workunit.client.0.smithi138.stdout:0/762: truncate d6/dba/f10a 856987 0 2024-02-15T22:51:03.630 INFO:tasks.workunit.client.0.smithi138.stdout:1/647: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 [0,4194304] 0 2024-02-15T22:51:03.630 INFO:tasks.workunit.client.0.smithi138.stdout:6/784: creat dc/d24/f10e x:0 0 0 2024-02-15T22:51:03.634 INFO:tasks.workunit.client.0.smithi138.stdout:1/648: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f56 [0,4194304] 0 2024-02-15T22:51:03.635 INFO:tasks.workunit.client.0.smithi138.stdout:3/994: dread d5/d12/d26/da6/d107/d57/d5d/de2/fe3 [0,4194304] 0 2024-02-15T22:51:03.636 INFO:tasks.workunit.client.0.smithi138.stdout:3/995: mkdir d5/d18/d11d/d14a 0 2024-02-15T22:51:03.636 INFO:tasks.workunit.client.0.smithi138.stdout:3/996: truncate d5/d12/d26/d2e/f10c 1025828 0 2024-02-15T22:51:03.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/997: read d5/d12/d26/da6/d107/d57/ffa [553744,39584] 0 2024-02-15T22:51:03.637 INFO:tasks.workunit.client.0.smithi138.stdout:3/998: creat d5/d12/d26/da6/d107/d57/f14b x:0 0 0 2024-02-15T22:51:03.640 INFO:tasks.workunit.client.0.smithi138.stdout:3/999: creat d5/d12/d23/d29/d5a/f14c x:0 0 0 2024-02-15T22:51:03.643 INFO:tasks.workunit.client.0.smithi138.stdout:0/763: dread d6/d10/d64/dd7/ffd [0,4194304] 0 2024-02-15T22:51:03.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/764: dread - d6/d10/d75/d102/ff3 zero size 2024-02-15T22:51:03.644 INFO:tasks.workunit.client.0.smithi138.stdout:0/765: stat d6/d10/d64/l8e 0 2024-02-15T22:51:03.644 INFO:tasks.workunit.client.0.smithi138.stdout:8/845: read db/d15/db6/df2/d4d/fa4 [277689,108261] 0 2024-02-15T22:51:03.644 INFO:tasks.workunit.client.0.smithi138.stdout:2/884: dwrite d0/da/d19/d53/d5d/d74/f5b [0,4194304] 0 2024-02-15T22:51:03.645 INFO:tasks.workunit.client.0.smithi138.stdout:0/766: mkdir d6/d10/d34/dcf/d111 0 2024-02-15T22:51:03.645 INFO:tasks.workunit.client.0.smithi138.stdout:0/767: chown d6/d10/d75/d102/lf7 2 1 2024-02-15T22:51:03.645 INFO:tasks.workunit.client.0.smithi138.stdout:0/768: write d6/d10/d18/fa3 [634942,86849] 0 2024-02-15T22:51:03.646 INFO:tasks.workunit.client.0.smithi138.stdout:8/846: creat db/d15/db6/df2/d13/d19/d6b/d105/f112 x:0 0 0 2024-02-15T22:51:03.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/847: write db/d15/db6/df2/d22/fd4 [1147087,38064] 0 2024-02-15T22:51:03.647 INFO:tasks.workunit.client.0.smithi138.stdout:8/848: creat db/d15/db6/df2/d13/d19/d6b/dba/f113 x:0 0 0 2024-02-15T22:51:03.647 INFO:tasks.workunit.client.0.smithi138.stdout:1/649: read df/d1b/d33/f9d [1920042,24706] 0 2024-02-15T22:51:03.648 INFO:tasks.workunit.client.0.smithi138.stdout:0/769: creat d6/d10/d52/d6f/d85/f112 x:0 0 0 2024-02-15T22:51:03.648 INFO:tasks.workunit.client.0.smithi138.stdout:5/740: dwrite df/d18/d3e/d60/d65/dc2/fdd [0,4194304] 0 2024-02-15T22:51:03.650 INFO:tasks.workunit.client.0.smithi138.stdout:0/770: mknod d6/d10/d52/d6f/d85/c113 0 2024-02-15T22:51:03.650 INFO:tasks.workunit.client.0.smithi138.stdout:0/771: creat d6/dba/f114 x:0 0 0 2024-02-15T22:51:03.652 INFO:tasks.workunit.client.0.smithi138.stdout:0/772: chown d6/fb 127466 1 2024-02-15T22:51:03.652 INFO:tasks.workunit.client.0.smithi138.stdout:1/650: dread df/d1b/d21/f32 [0,4194304] 0 2024-02-15T22:51:03.653 INFO:tasks.workunit.client.0.smithi138.stdout:4/892: dwrite d17/d1e/d2d/d36/dca/da3/dfd/f119 [0,4194304] 0 2024-02-15T22:51:03.655 INFO:tasks.workunit.client.0.smithi138.stdout:0/773: unlink d6/d10/d75/db1/fdf 0 2024-02-15T22:51:03.658 INFO:tasks.workunit.client.0.smithi138.stdout:6/785: dwrite dc/d24/d6c/ddb/ddf/f106 [0,4194304] 0 2024-02-15T22:51:03.658 INFO:tasks.workunit.client.0.smithi138.stdout:6/786: creat dc/d24/d34/f10f x:0 0 0 2024-02-15T22:51:03.662 INFO:tasks.workunit.client.0.smithi138.stdout:2/885: write d0/da/d19/d53/f9f [1006738,13901] 0 2024-02-15T22:51:03.663 INFO:tasks.workunit.client.0.smithi138.stdout:1/651: unlink df/d1b/d1d/c90 0 2024-02-15T22:51:03.663 INFO:tasks.workunit.client.0.smithi138.stdout:1/652: truncate df/d1b/d1d/f28 1581049 0 2024-02-15T22:51:03.674 INFO:tasks.workunit.client.0.smithi138.stdout:6/787: creat dc/d4b/dba/d10b/f110 x:0 0 0 2024-02-15T22:51:03.679 INFO:tasks.workunit.client.0.smithi138.stdout:2/886: mkdir d0/da/d19/d53/d80/dba/d118/d11f/d130 0 2024-02-15T22:51:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:0/774: dwrite d6/d10/d34/df6/f108 [0,4194304] 0 2024-02-15T22:51:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:0/775: dread - d6/d10/d40/f105 zero size 2024-02-15T22:51:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:5/741: dwrite df/d18/d3e/d60/d65/dc2/fdd [0,4194304] 0 2024-02-15T22:51:03.680 INFO:tasks.workunit.client.0.smithi138.stdout:4/893: dwrite d17/d1e/f4b [0,4194304] 0 2024-02-15T22:51:03.682 INFO:tasks.workunit.client.0.smithi138.stdout:1/653: rename df/d1b/d1d/d25/d2e/d5b/d7b/fce to df/d1b/d33/fd4 0 2024-02-15T22:51:03.682 INFO:tasks.workunit.client.0.smithi138.stdout:1/654: chown df/d1b/d1d/d25/d2e/cb2 9831187 1 2024-02-15T22:51:03.682 INFO:tasks.workunit.client.0.smithi138.stdout:1/655: chown df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/c7c 33902854 1 2024-02-15T22:51:03.682 INFO:tasks.workunit.client.0.smithi138.stdout:1/656: readlink df/d1b/d33/lc3 0 2024-02-15T22:51:03.682 INFO:tasks.workunit.client.0.smithi138.stdout:6/788: dread dc/d24/f47 [0,4194304] 0 2024-02-15T22:51:03.692 INFO:tasks.workunit.client.0.smithi138.stdout:5/742: symlink df/d18/d3e/d60/d65/d7c/deb/lf7 0 2024-02-15T22:51:03.697 INFO:tasks.workunit.client.0.smithi138.stdout:1/657: rename df/d1b/d1d/f20 to df/d1b/d1d/d25/d8d/fd5 0 2024-02-15T22:51:03.697 INFO:tasks.workunit.client.0.smithi138.stdout:1/658: chown df/cbc 823 1 2024-02-15T22:51:03.697 INFO:tasks.workunit.client.0.smithi138.stdout:1/659: chown df/d1b/d33/f9d 149032 1 2024-02-15T22:51:03.698 INFO:tasks.workunit.client.0.smithi138.stdout:6/789: mknod dc/d76/d96/c111 0 2024-02-15T22:51:03.699 INFO:tasks.workunit.client.0.smithi138.stdout:0/776: getdents d6/d10/d34/df6 0 2024-02-15T22:51:03.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/743: rename df/d18/d56/dae/lf2 to df/d18/d3e/lf8 0 2024-02-15T22:51:03.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/744: fsync df/d18/d3e/d60/d65/d7c/ff6 0 2024-02-15T22:51:03.704 INFO:tasks.workunit.client.0.smithi138.stdout:6/790: symlink dc/d24/d34/dde/l112 0 2024-02-15T22:51:03.704 INFO:tasks.workunit.client.0.smithi138.stdout:6/791: write dc/d24/d34/d3b/d7c/f91 [2073720,403] 0 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:2/887: dwrite d0/f1 [0,4194304] 0 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:2/888: chown d0/da/d19/d53/d5d/d6d/d7b/dbf/c10f 39667 1 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:2/889: fsync d0/da/d19/d53/d5d/d74/fa7 0 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:4/894: dwrite d17/d1e/fcd [0,4194304] 0 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:0/777: unlink d6/d10/d75/fc5 0 2024-02-15T22:51:03.707 INFO:tasks.workunit.client.0.smithi138.stdout:0/778: truncate d6/dba/f10a 1721668 0 2024-02-15T22:51:03.708 INFO:tasks.workunit.client.0.smithi138.stdout:5/745: unlink df/d18/d3e/d60/d65/dc2/fec 0 2024-02-15T22:51:03.709 INFO:tasks.workunit.client.0.smithi138.stdout:1/660: dread df/d1b/d1d/d25/d2e/d5b/d65/fcd [0,4194304] 0 2024-02-15T22:51:03.712 INFO:tasks.workunit.client.0.smithi138.stdout:1/661: dread df/f79 [0,4194304] 0 2024-02-15T22:51:03.712 INFO:tasks.workunit.client.0.smithi138.stdout:2/890: getdents d0/dd/d15/d65 0 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:0/779: truncate d6/d10/d13/f41 562094 0 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:0/780: creat d6/dba/f115 x:0 0 0 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:0/781: chown d6/d10/d18 259133 1 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:0/782: read - d6/d10/d18/d1b/fe7 zero size 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:5/746: dread df/f37 [0,4194304] 0 2024-02-15T22:51:03.717 INFO:tasks.workunit.client.0.smithi138.stdout:5/747: readlink df/d18/d3e/d66/l69 0 2024-02-15T22:51:03.718 INFO:tasks.workunit.client.0.smithi138.stdout:1/662: creat df/d1b/d1d/d25/d2e/d5b/d65/d80/fd6 x:0 0 0 2024-02-15T22:51:03.718 INFO:tasks.workunit.client.0.smithi138.stdout:1/663: chown df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f 11503 1 2024-02-15T22:51:03.718 INFO:tasks.workunit.client.0.smithi138.stdout:1/664: creat df/d1b/d1d/d25/d8d/fd7 x:0 0 0 2024-02-15T22:51:03.719 INFO:tasks.workunit.client.0.smithi138.stdout:2/891: symlink d0/da/d19/d53/d80/dba/d118/d11f/d130/l131 0 2024-02-15T22:51:03.726 INFO:tasks.workunit.client.0.smithi138.stdout:1/665: rename df/d1b/d33/lb7 to df/ld8 0 2024-02-15T22:51:03.727 INFO:tasks.workunit.client.0.smithi138.stdout:2/892: mknod d0/da/d19/d53/d5d/d6d/d7b/da3/c132 0 2024-02-15T22:51:03.730 INFO:tasks.workunit.client.0.smithi138.stdout:5/748: rmdir df/d18/d3e/d51/dc9 39 2024-02-15T22:51:03.730 INFO:tasks.workunit.client.0.smithi138.stdout:5/749: stat df/d18/d3e/d8a/fe9 0 2024-02-15T22:51:03.730 INFO:tasks.workunit.client.0.smithi138.stdout:0/783: dwrite d6/d10/d18/d1b/f10b [0,4194304] 0 2024-02-15T22:51:03.731 INFO:tasks.workunit.client.0.smithi138.stdout:0/784: chown d6/d10/d52/f101 3918897 1 2024-02-15T22:51:03.732 INFO:tasks.workunit.client.0.smithi138.stdout:1/666: rename df/c92 to df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/cd9 0 2024-02-15T22:51:03.732 INFO:tasks.workunit.client.0.smithi138.stdout:1/667: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a 0 2024-02-15T22:51:03.732 INFO:tasks.workunit.client.0.smithi138.stdout:5/750: mknod df/d18/d3e/d60/d65/d7f/d90/cf9 0 2024-02-15T22:51:03.735 INFO:tasks.workunit.client.0.smithi138.stdout:0/785: mkdir d6/d10/d13/d3d/dd2/d116 0 2024-02-15T22:51:03.737 INFO:tasks.workunit.client.0.smithi138.stdout:2/893: rename d0/dd/c38 to d0/da/d19/c133 0 2024-02-15T22:51:03.739 INFO:tasks.workunit.client.0.smithi138.stdout:5/751: link df/d18/f6f df/d18/d3e/d51/dc9/d9c/daf/ffa 0 2024-02-15T22:51:03.742 INFO:tasks.workunit.client.0.smithi138.stdout:1/668: dread df/d1b/d1d/d24/d3a/f70 [0,4194304] 0 2024-02-15T22:51:03.743 INFO:tasks.workunit.client.0.smithi138.stdout:2/894: creat d0/da/d19/d53/d80/f134 x:0 0 0 2024-02-15T22:51:03.744 INFO:tasks.workunit.client.0.smithi138.stdout:5/752: mkdir df/d18/d77/dfb 0 2024-02-15T22:51:03.744 INFO:tasks.workunit.client.0.smithi138.stdout:5/753: write df/d18/d3e/d51/ff3 [752952,13814] 0 2024-02-15T22:51:03.746 INFO:tasks.workunit.client.0.smithi138.stdout:2/895: rename d0/da/d19/d53/d5d/d74/de9/ffa to d0/dd/d15/ddf/f135 0 2024-02-15T22:51:03.750 INFO:tasks.workunit.client.0.smithi138.stdout:2/896: creat d0/da/df6/f136 x:0 0 0 2024-02-15T22:51:03.753 INFO:tasks.workunit.client.0.smithi138.stdout:2/897: write d0/da/dca/f124 [297715,129534] 0 2024-02-15T22:51:03.757 INFO:tasks.workunit.client.0.smithi138.stdout:0/786: dwrite d6/d10/d75/d102/f10d [0,4194304] 0 2024-02-15T22:51:03.768 INFO:tasks.workunit.client.0.smithi138.stdout:2/898: write d0/da/d19/d53/d5d/d74/f5f [2142620,25336] 0 2024-02-15T22:51:03.777 INFO:tasks.workunit.client.0.smithi138.stdout:5/754: dwrite df/f37 [4194304,4194304] 0 2024-02-15T22:51:03.777 INFO:tasks.workunit.client.0.smithi138.stdout:0/787: dwrite d6/d10/d18/f32 [4194304,4194304] 0 2024-02-15T22:51:03.777 INFO:tasks.workunit.client.0.smithi138.stdout:0/788: chown d6/d10/d52/d6f 9297080 1 2024-02-15T22:51:03.777 INFO:tasks.workunit.client.0.smithi138.stdout:1/669: dwrite df/d1b/d33/f75 [0,4194304] 0 2024-02-15T22:51:03.779 INFO:tasks.workunit.client.0.smithi138.stdout:5/755: getdents df/d18/d3e/d60/d65/d7c 0 2024-02-15T22:51:03.785 INFO:tasks.workunit.client.0.smithi138.stdout:2/899: dwrite d0/f87 [0,4194304] 0 2024-02-15T22:51:03.788 INFO:tasks.workunit.client.0.smithi138.stdout:1/670: mknod df/d1b/d1d/d25/d2e/d5b/d7b/cda 0 2024-02-15T22:51:03.793 INFO:tasks.workunit.client.0.smithi138.stdout:1/671: unlink df/c18 0 2024-02-15T22:51:03.793 INFO:tasks.workunit.client.0.smithi138.stdout:1/672: write df/d1b/d1d/d25/d8d/f91 [226849,62754] 0 2024-02-15T22:51:03.793 INFO:tasks.workunit.client.0.smithi138.stdout:1/673: chown df/d1b/d33/f75 57272 1 2024-02-15T22:51:03.794 INFO:tasks.workunit.client.0.smithi138.stdout:5/756: getdents df/d18/d77 0 2024-02-15T22:51:03.794 INFO:tasks.workunit.client.0.smithi138.stdout:5/757: chown df/d18/d3e/d66/de2 11 1 2024-02-15T22:51:03.797 INFO:tasks.workunit.client.0.smithi138.stdout:5/758: rename df/d18/d56/l7e to df/d18/d3e/d8a/db2/lfc 0 2024-02-15T22:51:03.797 INFO:tasks.workunit.client.0.smithi138.stdout:5/759: write f5 [3188824,55272] 0 2024-02-15T22:51:03.798 INFO:tasks.workunit.client.0.smithi138.stdout:5/760: rename df/c89 to df/d18/d3e/d60/d65/dc2/cfd 0 2024-02-15T22:51:03.798 INFO:tasks.workunit.client.0.smithi138.stdout:5/761: write df/d18/d56/fd5 [373389,85106] 0 2024-02-15T22:51:03.800 INFO:tasks.workunit.client.0.smithi138.stdout:5/762: unlink df/d18/f25 0 2024-02-15T22:51:03.801 INFO:tasks.workunit.client.0.smithi138.stdout:5/763: creat df/d18/d3e/d60/d65/d7c/ffe x:0 0 0 2024-02-15T22:51:03.802 INFO:tasks.workunit.client.0.smithi138.stdout:5/764: unlink df/d18/d3e/d60/d65/d7c/l8b 0 2024-02-15T22:51:03.803 INFO:tasks.workunit.client.0.smithi138.stdout:5/765: unlink df/l96 0 2024-02-15T22:51:03.805 INFO:tasks.workunit.client.0.smithi138.stdout:0/789: dwrite d6/f95 [0,4194304] 0 2024-02-15T22:51:03.809 INFO:tasks.workunit.client.0.smithi138.stdout:2/900: dwrite d0/da/f3a [0,4194304] 0 2024-02-15T22:51:03.809 INFO:tasks.workunit.client.0.smithi138.stdout:2/901: creat d0/da/d19/d3f/f137 x:0 0 0 2024-02-15T22:51:03.810 INFO:tasks.workunit.client.0.smithi138.stdout:2/902: creat d0/da/d19/d53/d5d/d6d/d7b/da3/f138 x:0 0 0 2024-02-15T22:51:03.810 INFO:tasks.workunit.client.0.smithi138.stdout:2/903: stat d0/dd/fd9 0 2024-02-15T22:51:03.810 INFO:tasks.workunit.client.0.smithi138.stdout:0/790: rename d6/d10/d52/d6f/d85/l10f to d6/d10/d18/d1b/l117 0 2024-02-15T22:51:03.810 INFO:tasks.workunit.client.0.smithi138.stdout:0/791: dread - d6/d10/d75/d102/ff3 zero size 2024-02-15T22:51:03.810 INFO:tasks.workunit.client.0.smithi138.stdout:0/792: truncate d6/d10/d13/f1e 4689440 0 2024-02-15T22:51:03.812 INFO:tasks.workunit.client.0.smithi138.stdout:1/674: dwrite df/f12 [0,4194304] 0 2024-02-15T22:51:03.814 INFO:tasks.workunit.client.0.smithi138.stdout:2/904: rename d0/dd/lf4 to d0/da/df6/da0/l139 0 2024-02-15T22:51:03.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/793: creat d6/d10/d18/d57/d8d/f118 x:0 0 0 2024-02-15T22:51:03.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/794: creat d6/d10/d13/d3d/dc6/f119 x:0 0 0 2024-02-15T22:51:03.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/795: truncate d6/d10/d34/fe4 1709494 0 2024-02-15T22:51:03.816 INFO:tasks.workunit.client.0.smithi138.stdout:0/796: stat d6/d10/d40/c7b 0 2024-02-15T22:51:03.817 INFO:tasks.workunit.client.0.smithi138.stdout:1/675: unlink df/d1b/d1d/d25/d2e/d37/c9e 0 2024-02-15T22:51:03.819 INFO:tasks.workunit.client.0.smithi138.stdout:2/905: mkdir d0/da/d19/d53/d5d/d74/d13a 0 2024-02-15T22:51:03.827 INFO:tasks.workunit.client.0.smithi138.stdout:5/766: dwrite df/d18/d3e/d60/f99 [0,4194304] 0 2024-02-15T22:51:03.827 INFO:tasks.workunit.client.0.smithi138.stdout:0/797: dread d6/d10/d34/df6/f108 [0,4194304] 0 2024-02-15T22:51:03.833 INFO:tasks.workunit.client.0.smithi138.stdout:1/676: unlink df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f56 0 2024-02-15T22:51:03.834 INFO:tasks.workunit.client.0.smithi138.stdout:2/906: symlink d0/da/d19/d53/d5d/d83/l13b 0 2024-02-15T22:51:03.840 INFO:tasks.workunit.client.0.smithi138.stdout:0/798: symlink d6/d10/d64/dd7/l11a 0 2024-02-15T22:51:03.840 INFO:tasks.workunit.client.0.smithi138.stdout:0/799: fdatasync d6/d10/d13/f16 0 2024-02-15T22:51:03.845 INFO:tasks.workunit.client.0.smithi138.stdout:2/907: rmdir d0/da/d19/d53/d5d/d74/d79 39 2024-02-15T22:51:03.845 INFO:tasks.workunit.client.0.smithi138.stdout:5/767: dwrite df/d18/d3e/d60/d65/d7f/fa7 [0,4194304] 0 2024-02-15T22:51:03.855 INFO:tasks.workunit.client.0.smithi138.stdout:2/908: dread d0/da/d19/d53/f68 [0,4194304] 0 2024-02-15T22:51:03.856 INFO:tasks.workunit.client.0.smithi138.stdout:0/800: dwrite d6/d10/d40/f91 [0,4194304] 0 2024-02-15T22:51:03.857 INFO:tasks.workunit.client.0.smithi138.stdout:1/677: rename df/d1b/d33 to df/d41/ddb 0 2024-02-15T22:51:03.860 INFO:tasks.workunit.client.0.smithi138.stdout:5/768: dwrite df/f17 [4194304,4194304] 0 2024-02-15T22:51:03.860 INFO:tasks.workunit.client.0.smithi138.stdout:5/769: creat df/d18/d56/fff x:0 0 0 2024-02-15T22:51:03.861 INFO:tasks.workunit.client.0.smithi138.stdout:0/801: mkdir d6/d10/d18/d11b 0 2024-02-15T22:51:03.861 INFO:tasks.workunit.client.0.smithi138.stdout:0/802: write d6/d10/d64/f88 [4631918,44442] 0 2024-02-15T22:51:03.863 INFO:tasks.workunit.client.0.smithi138.stdout:5/770: symlink df/d18/d3e/d60/d65/d7f/d9d/l100 0 2024-02-15T22:51:03.865 INFO:tasks.workunit.client.0.smithi138.stdout:0/803: mknod d6/d10/d64/c11c 0 2024-02-15T22:51:03.879 INFO:tasks.workunit.client.0.smithi138.stdout:5/771: write df/d18/f7b [3580165,115005] 0 2024-02-15T22:51:03.879 INFO:tasks.workunit.client.0.smithi138.stdout:1/678: dwrite df/d1b/d1d/d25/d8d/fd5 [0,4194304] 0 2024-02-15T22:51:03.880 INFO:tasks.workunit.client.0.smithi138.stdout:0/804: dread d6/d10/d52/d6f/f7d [0,4194304] 0 2024-02-15T22:51:03.883 INFO:tasks.workunit.client.0.smithi138.stdout:0/805: rename d6/lb2 to d6/d10/l11d 0 2024-02-15T22:51:03.884 INFO:tasks.workunit.client.0.smithi138.stdout:8/849: sync 2024-02-15T22:51:03.891 INFO:tasks.workunit.client.0.smithi138.stdout:0/806: write d6/d10/d52/d72/fd3 [3575272,46358] 0 2024-02-15T22:51:03.892 INFO:tasks.workunit.client.0.smithi138.stdout:0/807: readlink d6/d10/lf2 0 2024-02-15T22:51:03.892 INFO:tasks.workunit.client.0.smithi138.stdout:0/808: creat d6/d10/d75/db1/f11e x:0 0 0 2024-02-15T22:51:03.893 INFO:tasks.workunit.client.0.smithi138.stdout:0/809: mknod d6/d10/d34/df6/c11f 0 2024-02-15T22:51:03.894 INFO:tasks.workunit.client.0.smithi138.stdout:0/810: write d6/d10/d64/f87 [1995335,67398] 0 2024-02-15T22:51:03.894 INFO:tasks.workunit.client.0.smithi138.stdout:0/811: getdents d6/d10/d75/d102/dcc 0 2024-02-15T22:51:03.895 INFO:tasks.workunit.client.0.smithi138.stdout:1/679: dwrite df/d1b/d1d/d25/d2e/d5b/fc9 [0,4194304] 0 2024-02-15T22:51:03.895 INFO:tasks.workunit.client.0.smithi138.stdout:1/680: fdatasync df/d1b/d1d/d25/d2e/d6c/f94 0 2024-02-15T22:51:03.896 INFO:tasks.workunit.client.0.smithi138.stdout:0/812: mknod d6/d10/d75/d102/dcc/c120 0 2024-02-15T22:51:03.896 INFO:tasks.workunit.client.0.smithi138.stdout:0/813: chown d6/d10/lb6 536070 1 2024-02-15T22:51:03.906 INFO:tasks.workunit.client.0.smithi138.stdout:1/681: read df/d1b/d1d/d25/d2e/d5b/d65/f8c [2693230,63156] 0 2024-02-15T22:51:03.906 INFO:tasks.workunit.client.0.smithi138.stdout:0/814: dread d6/f42 [0,4194304] 0 2024-02-15T22:51:03.907 INFO:tasks.workunit.client.0.smithi138.stdout:1/682: mknod df/d1b/d1d/d25/d2e/d5b/d65/cdc 0 2024-02-15T22:51:03.920 INFO:tasks.workunit.client.0.smithi138.stdout:1/683: read df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f64 [996914,130035] 0 2024-02-15T22:51:03.920 INFO:tasks.workunit.client.0.smithi138.stdout:8/850: dwrite db/d15/f17 [0,4194304] 0 2024-02-15T22:51:03.929 INFO:tasks.workunit.client.0.smithi138.stdout:0/815: dwrite d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:51:03.930 INFO:tasks.workunit.client.0.smithi138.stdout:0/816: unlink d6/d10/d64/dd7/ffd 0 2024-02-15T22:51:03.930 INFO:tasks.workunit.client.0.smithi138.stdout:0/817: readlink d6/d10/d34/df6/lf1 0 2024-02-15T22:51:03.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/818: write d6/d10/d34/df6/fd9 [558443,18756] 0 2024-02-15T22:51:03.931 INFO:tasks.workunit.client.0.smithi138.stdout:0/819: creat d6/d10/d18/d1b/f121 x:0 0 0 2024-02-15T22:51:03.932 INFO:tasks.workunit.client.0.smithi138.stdout:0/820: symlink d6/d10/d18/d6e/df8/l122 0 2024-02-15T22:51:03.933 INFO:tasks.workunit.client.0.smithi138.stdout:0/821: creat d6/d10/d13/d3d/dd2/dfb/f123 x:0 0 0 2024-02-15T22:51:03.934 INFO:tasks.workunit.client.0.smithi138.stdout:0/822: rmdir d6/d10/d18/d11b 0 2024-02-15T22:51:03.935 INFO:tasks.workunit.client.0.smithi138.stdout:0/823: mkdir d6/d10/d18/d57/d8d/d124 0 2024-02-15T22:51:03.935 INFO:tasks.workunit.client.0.smithi138.stdout:0/824: chown d6/d10/d13/d3d/f70 3995011 1 2024-02-15T22:51:03.935 INFO:tasks.workunit.client.0.smithi138.stdout:0/825: write d6/d10/d18/f65 [253338,128117] 0 2024-02-15T22:51:03.936 INFO:tasks.workunit.client.0.smithi138.stdout:8/851: dwrite db/d15/d70/df9/de4/fef [0,4194304] 0 2024-02-15T22:51:03.936 INFO:tasks.workunit.client.0.smithi138.stdout:8/852: chown db/d15/db6/df2/d13/cb3 0 1 2024-02-15T22:51:03.936 INFO:tasks.workunit.client.0.smithi138.stdout:8/853: chown db/d15/db6/df2/f47 10793 1 2024-02-15T22:51:03.938 INFO:tasks.workunit.client.0.smithi138.stdout:8/854: truncate db/d15/db6/df2/fce 3445397 0 2024-02-15T22:51:03.947 INFO:tasks.workunit.client.0.smithi138.stdout:8/855: write db/d15/db6/df2/d22/f73 [7677491,43652] 0 2024-02-15T22:51:03.949 INFO:tasks.workunit.client.0.smithi138.stdout:0/826: dwrite d6/d10/d18/d57/f5e [0,4194304] 0 2024-02-15T22:51:03.950 INFO:tasks.workunit.client.0.smithi138.stdout:8/856: symlink db/d15/db6/df2/d13/d19/l114 0 2024-02-15T22:51:03.967 INFO:tasks.workunit.client.0.smithi138.stdout:0/827: dwrite d6/d10/d64/f87 [0,4194304] 0 2024-02-15T22:51:03.967 INFO:tasks.workunit.client.0.smithi138.stdout:0/828: stat d6/dba/f10a 0 2024-02-15T22:51:03.970 INFO:tasks.workunit.client.0.smithi138.stdout:8/857: dwrite db/d15/d70/d7c/d92/f57 [0,4194304] 0 2024-02-15T22:51:03.970 INFO:tasks.workunit.client.0.smithi138.stdout:8/858: chown db/d15/db6/df2/d13/f21 781 1 2024-02-15T22:51:03.970 INFO:tasks.workunit.client.0.smithi138.stdout:8/859: truncate db/d15/db6/df2/d13/d77/d8f/fff 1491519 0 2024-02-15T22:51:03.971 INFO:tasks.workunit.client.0.smithi138.stdout:0/829: creat d6/d10/f125 x:0 0 0 2024-02-15T22:51:03.975 INFO:tasks.workunit.client.0.smithi138.stdout:8/860: creat db/d15/d70/d7c/f115 x:0 0 0 2024-02-15T22:51:03.994 INFO:tasks.workunit.client.0.smithi138.stdout:0/830: dwrite d6/d10/d64/fa6 [0,4194304] 0 2024-02-15T22:51:03.996 INFO:tasks.workunit.client.0.smithi138.stdout:0/831: link d6/d10/d40/f74 d6/d10/d52/d6f/d85/f126 0 2024-02-15T22:51:04.000 INFO:tasks.workunit.client.0.smithi138.stdout:0/832: dread d6/f24 [0,4194304] 0 2024-02-15T22:51:04.000 INFO:tasks.workunit.client.0.smithi138.stdout:0/833: creat d6/d10/d75/db1/f127 x:0 0 0 2024-02-15T22:51:04.001 INFO:tasks.workunit.client.0.smithi138.stdout:0/834: getdents d6/d10/d75 0 2024-02-15T22:51:04.037 INFO:tasks.workunit.client.0.smithi138.stdout:8/861: dwrite db/d15/d70/df9/de4/fef [4194304,4194304] 0 2024-02-15T22:51:04.040 INFO:tasks.workunit.client.0.smithi138.stdout:0/835: dread d6/d10/d52/f107 [0,4194304] 0 2024-02-15T22:51:04.040 INFO:tasks.workunit.client.0.smithi138.stdout:0/836: chown d6/d10/d13/d3d/dd2 1 1 2024-02-15T22:51:04.041 INFO:tasks.workunit.client.0.smithi138.stdout:8/862: creat db/d15/daa/f116 x:0 0 0 2024-02-15T22:51:04.042 INFO:tasks.workunit.client.0.smithi138.stdout:8/863: symlink db/d15/db6/df2/d13/d19/d6b/d105/l117 0 2024-02-15T22:51:04.042 INFO:tasks.workunit.client.0.smithi138.stdout:8/864: fsync db/d15/db6/df2/d22/f7f 0 2024-02-15T22:51:04.044 INFO:tasks.workunit.client.0.smithi138.stdout:0/837: dread d6/d10/d52/f107 [0,4194304] 0 2024-02-15T22:51:04.047 INFO:tasks.workunit.client.0.smithi138.stdout:0/838: unlink d6/d10/d13/l4a 0 2024-02-15T22:51:04.047 INFO:tasks.workunit.client.0.smithi138.stdout:0/839: stat d6/d10/f30 0 2024-02-15T22:51:04.051 INFO:tasks.workunit.client.0.smithi138.stdout:0/840: unlink d6/d10/d75/d102/dcc/fef 0 2024-02-15T22:51:04.053 INFO:tasks.workunit.client.0.smithi138.stdout:0/841: rename d6/d10/d64/cd6 to d6/dba/c128 0 2024-02-15T22:51:04.053 INFO:tasks.workunit.client.0.smithi138.stdout:0/842: chown d6/d10/d75/d102/cf5 128629 1 2024-02-15T22:51:04.054 INFO:tasks.workunit.client.0.smithi138.stdout:0/843: rmdir d6/d10/d18/d57 39 2024-02-15T22:51:04.054 INFO:tasks.workunit.client.0.smithi138.stdout:0/844: stat d6/d10/d64/f87 0 2024-02-15T22:51:04.055 INFO:tasks.workunit.client.0.smithi138.stdout:0/845: mknod d6/d10/d13/d3d/dc6/c129 0 2024-02-15T22:51:04.057 INFO:tasks.workunit.client.0.smithi138.stdout:8/865: dwrite db/d15/db6/df2/d13/d19/f83 [0,4194304] 0 2024-02-15T22:51:04.057 INFO:tasks.workunit.client.0.smithi138.stdout:0/846: creat d6/d10/d52/f12a x:0 0 0 2024-02-15T22:51:04.059 INFO:tasks.workunit.client.0.smithi138.stdout:8/866: symlink db/d15/l118 0 2024-02-15T22:51:04.077 INFO:tasks.workunit.client.0.smithi138.stdout:8/867: dwrite db/da0/de8/ff8 [0,4194304] 0 2024-02-15T22:51:04.077 INFO:tasks.workunit.client.0.smithi138.stdout:8/868: dread - db/d15/db6/df2/f103 zero size 2024-02-15T22:51:04.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/847: dwrite d6/d10/d34/fe4 [0,4194304] 0 2024-02-15T22:51:04.080 INFO:tasks.workunit.client.0.smithi138.stdout:0/848: fsync d6/dba/f10a 0 2024-02-15T22:51:04.082 INFO:tasks.workunit.client.0.smithi138.stdout:0/849: mknod d6/d10/d13/c12b 0 2024-02-15T22:51:04.093 INFO:tasks.workunit.client.0.smithi138.stdout:6/792: sync 2024-02-15T22:51:04.096 INFO:tasks.workunit.client.0.smithi138.stdout:0/850: creat d6/d10/d34/dcf/d111/f12c x:0 0 0 2024-02-15T22:51:04.098 INFO:tasks.workunit.client.0.smithi138.stdout:6/793: mkdir dc/d24/d6c/dbc/de7/d113 0 2024-02-15T22:51:04.101 INFO:tasks.workunit.client.0.smithi138.stdout:0/851: dread d6/d10/d52/d72/fd3 [0,4194304] 0 2024-02-15T22:51:04.101 INFO:tasks.workunit.client.0.smithi138.stdout:0/852: creat d6/dba/f12d x:0 0 0 2024-02-15T22:51:04.106 INFO:tasks.workunit.client.0.smithi138.stdout:6/794: write dc/d24/d34/d3b/d66/f75 [3343613,75900] 0 2024-02-15T22:51:04.117 INFO:tasks.workunit.client.0.smithi138.stdout:6/795: write dc/d24/f38 [7024436,49672] 0 2024-02-15T22:51:04.117 INFO:tasks.workunit.client.0.smithi138.stdout:6/796: chown dc/f3a 3294 1 2024-02-15T22:51:04.117 INFO:tasks.workunit.client.0.smithi138.stdout:6/797: creat dc/f114 x:0 0 0 2024-02-15T22:51:04.117 INFO:tasks.workunit.client.0.smithi138.stdout:6/798: fdatasync dc/d4b/dba/d10b/f110 0 2024-02-15T22:51:04.118 INFO:tasks.workunit.client.0.smithi138.stdout:6/799: chown dc/d24/l32 3 1 2024-02-15T22:51:04.119 INFO:tasks.workunit.client.0.smithi138.stdout:6/800: unlink dc/l8f 0 2024-02-15T22:51:04.120 INFO:tasks.workunit.client.0.smithi138.stdout:6/801: chown dc/f15 111 1 2024-02-15T22:51:04.120 INFO:tasks.workunit.client.0.smithi138.stdout:6/802: stat dc/d4b/d7b/ld4 0 2024-02-15T22:51:04.121 INFO:tasks.workunit.client.0.smithi138.stdout:6/803: mkdir dc/d24/d34/d3b/d7d/d115 0 2024-02-15T22:51:04.121 INFO:tasks.workunit.client.0.smithi138.stdout:6/804: read - dc/d24/d34/f63 zero size 2024-02-15T22:51:04.122 INFO:tasks.workunit.client.0.smithi138.stdout:6/805: rename dc/l21 to dc/d76/l116 0 2024-02-15T22:51:04.122 INFO:tasks.workunit.client.0.smithi138.stdout:6/806: fsync dc/d24/d34/d3b/d7d/fae 0 2024-02-15T22:51:04.123 INFO:tasks.workunit.client.0.smithi138.stdout:6/807: mkdir dc/d24/d6c/dbc/d117 0 2024-02-15T22:51:04.123 INFO:tasks.workunit.client.0.smithi138.stdout:6/808: fdatasync dc/d24/d6c/dbc/de7/f8a 0 2024-02-15T22:51:04.123 INFO:tasks.workunit.client.0.smithi138.stdout:6/809: chown dc/d24/d34/d3b/d7c/d9f/fa5 2364 1 2024-02-15T22:51:04.123 INFO:tasks.workunit.client.0.smithi138.stdout:6/810: mknod dc/d24/d34/d3b/dda/c118 0 2024-02-15T22:51:04.125 INFO:tasks.workunit.client.0.smithi138.stdout:6/811: creat dc/d24/d6c/dbc/f119 x:0 0 0 2024-02-15T22:51:04.125 INFO:tasks.workunit.client.0.smithi138.stdout:6/812: chown dc/d24/d34/d3b/dda/c118 6579087 1 2024-02-15T22:51:04.125 INFO:tasks.workunit.client.0.smithi138.stdout:6/813: creat dc/d24/d34/d99/f11a x:0 0 0 2024-02-15T22:51:04.125 INFO:tasks.workunit.client.0.smithi138.stdout:0/853: dwrite d6/d10/d34/df6/fd9 [0,4194304] 0 2024-02-15T22:51:04.127 INFO:tasks.workunit.client.0.smithi138.stdout:0/854: readlink d6/lf 0 2024-02-15T22:51:04.139 INFO:tasks.workunit.client.0.smithi138.stdout:6/814: dwrite dc/d4b/fb1 [0,4194304] 0 2024-02-15T22:51:04.147 INFO:tasks.workunit.client.0.smithi138.stdout:6/815: dread f1 [0,4194304] 0 2024-02-15T22:51:04.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/816: symlink dc/d24/d6c/ddb/l11b 0 2024-02-15T22:51:04.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/817: chown dc/d24/d34/l71 847 1 2024-02-15T22:51:04.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/818: fdatasync dc/d4b/d98/f100 0 2024-02-15T22:51:04.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/819: write dc/d24/f26 [4030700,98051] 0 2024-02-15T22:51:04.149 INFO:tasks.workunit.client.0.smithi138.stdout:6/820: getdents dc/d24/d34/d3b/d7c/d9f 0 2024-02-15T22:51:04.151 INFO:tasks.workunit.client.0.smithi138.stdout:6/821: creat dc/d24/d34/d3b/d7c/f11c x:0 0 0 2024-02-15T22:51:04.151 INFO:tasks.workunit.client.0.smithi138.stdout:6/822: creat dc/d24/d6c/f11d x:0 0 0 2024-02-15T22:51:04.169 INFO:tasks.workunit.client.0.smithi138.stdout:6/823: dwrite dc/d24/d6c/ddb/ddf/f106 [0,4194304] 0 2024-02-15T22:51:04.175 INFO:tasks.workunit.client.0.smithi138.stdout:6/824: truncate dc/d24/d6c/dbc/de7/f95 85258 0 2024-02-15T22:51:04.175 INFO:tasks.workunit.client.0.smithi138.stdout:6/825: mknod dc/d24/d34/d3b/d7c/da8/c11e 0 2024-02-15T22:51:04.175 INFO:tasks.workunit.client.0.smithi138.stdout:6/826: creat dc/d4b/d7b/f11f x:0 0 0 2024-02-15T22:51:04.185 INFO:tasks.workunit.client.0.smithi138.stdout:6/827: read dc/d4b/dba/fcb [3249497,96183] 0 2024-02-15T22:51:04.199 INFO:tasks.workunit.client.0.smithi138.stdout:6/828: dwrite dc/d24/f38 [0,4194304] 0 2024-02-15T22:51:04.199 INFO:tasks.workunit.client.0.smithi138.stdout:6/829: dread - dc/d24/d34/f10f zero size 2024-02-15T22:51:04.200 INFO:tasks.workunit.client.0.smithi138.stdout:6/830: symlink dc/d24/d34/d3b/d7c/da8/l120 0 2024-02-15T22:51:04.200 INFO:tasks.workunit.client.0.smithi138.stdout:6/831: write dc/d24/d6c/ddb/fdc [1219637,59735] 0 2024-02-15T22:51:04.209 INFO:tasks.workunit.client.0.smithi138.stdout:6/832: dread dc/d24/f56 [4194304,4194304] 0 2024-02-15T22:51:04.210 INFO:tasks.workunit.client.0.smithi138.stdout:6/833: creat dc/d24/d34/d3b/d66/f121 x:0 0 0 2024-02-15T22:51:04.210 INFO:tasks.workunit.client.0.smithi138.stdout:6/834: creat dc/d24/d34/d3b/d7c/f122 x:0 0 0 2024-02-15T22:51:04.212 INFO:tasks.workunit.client.0.smithi138.stdout:6/835: dread dc/d4b/d7b/fbb [0,4194304] 0 2024-02-15T22:51:04.212 INFO:tasks.workunit.client.0.smithi138.stdout:6/836: stat dc/d4b/dba/d10b/l10c 0 2024-02-15T22:51:04.212 INFO:tasks.workunit.client.0.smithi138.stdout:6/837: dread - dc/d76/f81 zero size 2024-02-15T22:51:04.212 INFO:tasks.workunit.client.0.smithi138.stdout:6/838: chown dc/d4b/d7b/c7f 12726 1 2024-02-15T22:51:04.213 INFO:tasks.workunit.client.0.smithi138.stdout:4/895: sync 2024-02-15T22:51:04.213 INFO:tasks.workunit.client.0.smithi138.stdout:4/896: write d17/d1e/d2d/dd5/d121/d78/dc0/f108 [565054,70206] 0 2024-02-15T22:51:04.213 INFO:tasks.workunit.client.0.smithi138.stdout:4/897: chown d17/d1e/db8/c10f 1587 1 2024-02-15T22:51:04.213 INFO:tasks.workunit.client.0.smithi138.stdout:6/839: mkdir dc/d24/d34/d99/dc4/d123 0 2024-02-15T22:51:04.237 INFO:tasks.workunit.client.0.smithi138.stdout:4/898: dwrite d17/d1e/d2d/d36/dca/da3/dbf/fe5 [0,4194304] 0 2024-02-15T22:51:04.237 INFO:tasks.workunit.client.0.smithi138.stdout:6/840: dwrite dc/d24/d34/f63 [0,4194304] 0 2024-02-15T22:51:04.241 INFO:tasks.workunit.client.0.smithi138.stdout:6/841: getdents dc/d24/d34/d3b 0 2024-02-15T22:51:04.243 INFO:tasks.workunit.client.0.smithi138.stdout:6/842: mkdir dc/d24/df4/d124 0 2024-02-15T22:51:04.243 INFO:tasks.workunit.client.0.smithi138.stdout:6/843: chown dc/d24/d34/d3b/dda/c118 12 1 2024-02-15T22:51:04.243 INFO:tasks.workunit.client.0.smithi138.stdout:6/844: readlink dc/d24/d34/d3b/d7d/la1 0 2024-02-15T22:51:04.243 INFO:tasks.workunit.client.0.smithi138.stdout:6/845: mkdir dc/d24/d34/d3b/dda/d125 0 2024-02-15T22:51:04.252 INFO:tasks.workunit.client.0.smithi138.stdout:6/846: dread dc/d24/f5e [0,4194304] 0 2024-02-15T22:51:04.252 INFO:tasks.workunit.client.0.smithi138.stdout:6/847: read - dc/d24/d34/d3b/f109 zero size 2024-02-15T22:51:04.252 INFO:tasks.workunit.client.0.smithi138.stdout:6/848: mknod dc/d4b/d7b/c126 0 2024-02-15T22:51:04.253 INFO:tasks.workunit.client.0.smithi138.stdout:4/899: dwrite d17/d1e/d2d/dd5/ff5 [0,4194304] 0 2024-02-15T22:51:04.254 INFO:tasks.workunit.client.0.smithi138.stdout:6/849: rmdir dc/d24/d6c/dbc 39 2024-02-15T22:51:04.254 INFO:tasks.workunit.client.0.smithi138.stdout:6/850: creat dc/d24/d34/f127 x:0 0 0 2024-02-15T22:51:04.254 INFO:tasks.workunit.client.0.smithi138.stdout:6/851: stat dc/d4b/f9e 0 2024-02-15T22:51:04.256 INFO:tasks.workunit.client.0.smithi138.stdout:4/900: truncate d17/d1e/f4b 4018189 0 2024-02-15T22:51:04.256 INFO:tasks.workunit.client.0.smithi138.stdout:4/901: chown d17/d1a/daa/fb9 56663528 1 2024-02-15T22:51:04.256 INFO:tasks.workunit.client.0.smithi138.stdout:4/902: chown d17/d1e/d56 23 1 2024-02-15T22:51:04.257 INFO:tasks.workunit.client.0.smithi138.stdout:4/903: mkdir d17/d1e/d2d/d124 0 2024-02-15T22:51:04.259 INFO:tasks.workunit.client.0.smithi138.stdout:4/904: creat d17/d1e/d2d/dd5/d121/dd8/d107/f125 x:0 0 0 2024-02-15T22:51:04.261 INFO:tasks.workunit.client.0.smithi138.stdout:6/852: dread dc/d24/d34/f63 [0,4194304] 0 2024-02-15T22:51:04.262 INFO:tasks.workunit.client.0.smithi138.stdout:6/853: rmdir dc/d24/d6c/dbc 39 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:2/909: sync 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/684: sync 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/685: chown df/d1b/d1d/f28 0 1 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/686: fdatasync df/d1b/d1d/d24/fc6 0 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/687: chown df/d1b/d1d/d25/d2e/d5b/fb0 80 1 2024-02-15T22:51:04.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/688: chown df/d1b/d1d/d25/d2e/d37/l43 31331 1 2024-02-15T22:51:04.269 INFO:tasks.workunit.client.0.smithi138.stdout:2/910: unlink d0/da/d19/c35 0 2024-02-15T22:51:04.272 INFO:tasks.workunit.client.0.smithi138.stdout:1/689: rename df/d1b/d1d/d25/d2e/d5b/la9 to df/d1b/d21/d4f/ldd 0 2024-02-15T22:51:04.272 INFO:tasks.workunit.client.0.smithi138.stdout:1/690: dread - df/d1b/d1d/d25/d8d/fab zero size 2024-02-15T22:51:04.272 INFO:tasks.workunit.client.0.smithi138.stdout:1/691: write df/d41/ddb/fb1 [848906,65653] 0 2024-02-15T22:51:04.282 INFO:tasks.workunit.client.0.smithi138.stdout:1/692: read df/d1b/f69 [1834125,84923] 0 2024-02-15T22:51:04.283 INFO:tasks.workunit.client.0.smithi138.stdout:6/854: dwrite dc/d24/d6c/dbc/f119 [0,4194304] 0 2024-02-15T22:51:04.284 INFO:tasks.workunit.client.0.smithi138.stdout:4/905: dwrite d17/d1e/d2d/f2e [0,4194304] 0 2024-02-15T22:51:04.287 INFO:tasks.workunit.client.0.smithi138.stdout:6/855: rmdir dc/d24/df4 39 2024-02-15T22:51:04.290 INFO:tasks.workunit.client.0.smithi138.stdout:6/856: dread dc/d24/f47 [0,4194304] 0 2024-02-15T22:51:04.290 INFO:tasks.workunit.client.0.smithi138.stdout:6/857: creat dc/d24/d34/d3b/d7c/da8/f128 x:0 0 0 2024-02-15T22:51:04.291 INFO:tasks.workunit.client.0.smithi138.stdout:6/858: creat dc/d4b/d98/dd6/f129 x:0 0 0 2024-02-15T22:51:04.305 INFO:tasks.workunit.client.0.smithi138.stdout:1/693: dwrite df/d1b/d1d/d25/fca [0,4194304] 0 2024-02-15T22:51:04.305 INFO:tasks.workunit.client.0.smithi138.stdout:1/694: creat df/d1b/d1d/d25/fde x:0 0 0 2024-02-15T22:51:04.307 INFO:tasks.workunit.client.0.smithi138.stdout:4/906: dwrite d17/d1e/f3f [4194304,4194304] 0 2024-02-15T22:51:04.311 INFO:tasks.workunit.client.0.smithi138.stdout:4/907: mkdir d17/d1e/d2d/d36/dca/da3/dfd/d126 0 2024-02-15T22:51:04.318 INFO:tasks.workunit.client.0.smithi138.stdout:0/855: sync 2024-02-15T22:51:04.318 INFO:tasks.workunit.client.0.smithi138.stdout:8/869: sync 2024-02-15T22:51:04.318 INFO:tasks.workunit.client.0.smithi138.stdout:5/772: sync 2024-02-15T22:51:04.320 INFO:tasks.workunit.client.0.smithi138.stdout:5/773: rename df/f37 to df/d18/d3e/d60/d65/d7c/f101 0 2024-02-15T22:51:04.320 INFO:tasks.workunit.client.0.smithi138.stdout:5/774: stat df/d18/d56/f5a 0 2024-02-15T22:51:04.323 INFO:tasks.workunit.client.0.smithi138.stdout:4/908: dread d17/d1e/d2d/dd5/ff5 [0,4194304] 0 2024-02-15T22:51:04.323 INFO:tasks.workunit.client.0.smithi138.stdout:4/909: write d17/d1e/d2d/f30 [1464240,79927] 0 2024-02-15T22:51:04.323 INFO:tasks.workunit.client.0.smithi138.stdout:4/910: write d17/d1e/d2d/d8c/fea [717518,51605] 0 2024-02-15T22:51:04.323 INFO:tasks.workunit.client.0.smithi138.stdout:4/911: getdents d17/d1e/d2d/d36/dca/da3/dfd/d126 0 2024-02-15T22:51:04.324 INFO:tasks.workunit.client.0.smithi138.stdout:5/775: symlink df/d18/d3e/l102 0 2024-02-15T22:51:04.324 INFO:tasks.workunit.client.0.smithi138.stdout:1/695: dwrite df/d1b/d1d/d25/d2e/f58 [4194304,4194304] 0 2024-02-15T22:51:04.325 INFO:tasks.workunit.client.0.smithi138.stdout:4/912: creat d17/d1e/d2d/dc7/f127 x:0 0 0 2024-02-15T22:51:04.326 INFO:tasks.workunit.client.0.smithi138.stdout:1/696: mkdir df/d1b/d1d/d24/ddf 0 2024-02-15T22:51:04.326 INFO:tasks.workunit.client.0.smithi138.stdout:1/697: truncate df/d1b/d1d/d25/fca 4423359 0 2024-02-15T22:51:04.326 INFO:tasks.workunit.client.0.smithi138.stdout:1/698: chown df/d1b/d1d/d25/c62 100530760 1 2024-02-15T22:51:04.326 INFO:tasks.workunit.client.0.smithi138.stdout:4/913: truncate d17/d1e/d2d/dd5/d121/f55 1547753 0 2024-02-15T22:51:04.326 INFO:tasks.workunit.client.0.smithi138.stdout:4/914: getdents d17/d1e/d2d/d124 0 2024-02-15T22:51:04.329 INFO:tasks.workunit.client.0.smithi138.stdout:4/915: unlink d17/d1e/d2d/d36/d3e/d64/fd3 0 2024-02-15T22:51:04.330 INFO:tasks.workunit.client.0.smithi138.stdout:4/916: creat d17/d1e/d2d/d36/dca/f128 x:0 0 0 2024-02-15T22:51:04.346 INFO:tasks.workunit.client.0.smithi138.stdout:0/856: dwrite d6/d10/d34/f66 [0,4194304] 0 2024-02-15T22:51:04.347 INFO:tasks.workunit.client.0.smithi138.stdout:8/870: dwrite db/d15/db6/df2/d13/f79 [4194304,4194304] 0 2024-02-15T22:51:04.348 INFO:tasks.workunit.client.0.smithi138.stdout:0/857: mknod d6/d10/d18/d57/d8d/d124/c12e 0 2024-02-15T22:51:04.349 INFO:tasks.workunit.client.0.smithi138.stdout:8/871: mknod db/d15/d70/d7c/c119 0 2024-02-15T22:51:04.349 INFO:tasks.workunit.client.0.smithi138.stdout:8/872: creat db/d15/db6/d106/f11a x:0 0 0 2024-02-15T22:51:04.349 INFO:tasks.workunit.client.0.smithi138.stdout:8/873: fsync db/d15/db6/df2/d22/f73 0 2024-02-15T22:51:04.354 INFO:tasks.workunit.client.0.smithi138.stdout:0/858: dread d6/d10/d13/d3d/f71 [0,4194304] 0 2024-02-15T22:51:04.354 INFO:tasks.workunit.client.0.smithi138.stdout:0/859: chown d6/d10/d75/ced 50277 1 2024-02-15T22:51:04.355 INFO:tasks.workunit.client.0.smithi138.stdout:1/699: dwrite df/f79 [0,4194304] 0 2024-02-15T22:51:04.355 INFO:tasks.workunit.client.0.smithi138.stdout:1/700: stat df/d1b/d1d/caa 0 2024-02-15T22:51:04.355 INFO:tasks.workunit.client.0.smithi138.stdout:0/860: mkdir d6/d10/d13/d3d/dc6/d12f 0 2024-02-15T22:51:04.357 INFO:tasks.workunit.client.0.smithi138.stdout:1/701: symlink df/d1b/d1d/d25/d2e/d5b/d7b/le0 0 2024-02-15T22:51:04.357 INFO:tasks.workunit.client.0.smithi138.stdout:4/917: dwrite d17/d1e/d2d/d36/d3e/d64/f76 [0,4194304] 0 2024-02-15T22:51:04.358 INFO:tasks.workunit.client.0.smithi138.stdout:0/861: truncate d6/d10/d18/d1b/f23 3805996 0 2024-02-15T22:51:04.360 INFO:tasks.workunit.client.0.smithi138.stdout:4/918: fdatasync d17/d1a/fb7 0 2024-02-15T22:51:04.362 INFO:tasks.workunit.client.0.smithi138.stdout:8/874: write db/f10 [1947694,94335] 0 2024-02-15T22:51:04.362 INFO:tasks.workunit.client.0.smithi138.stdout:8/875: write db/d15/d70/d7c/fc7 [347469,101596] 0 2024-02-15T22:51:04.362 INFO:tasks.workunit.client.0.smithi138.stdout:8/876: write db/d15/db6/df2/d13/d19/d6b/fd1 [579676,31480] 0 2024-02-15T22:51:04.362 INFO:tasks.workunit.client.0.smithi138.stdout:8/877: chown db/d15/db6/df2 15605 1 2024-02-15T22:51:04.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/878: mkdir db/d15/db6/df2/d4d/d11b 0 2024-02-15T22:51:04.364 INFO:tasks.workunit.client.0.smithi138.stdout:8/879: chown db/d15/d70/f5b 3 1 2024-02-15T22:51:04.365 INFO:tasks.workunit.client.0.smithi138.stdout:8/880: mknod db/c11c 0 2024-02-15T22:51:04.367 INFO:tasks.workunit.client.0.smithi138.stdout:1/702: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f66 [2520642,60775] 0 2024-02-15T22:51:04.369 INFO:tasks.workunit.client.0.smithi138.stdout:1/703: unlink df/d1b/d1d/d25/d2e/d37/lac 0 2024-02-15T22:51:04.369 INFO:tasks.workunit.client.0.smithi138.stdout:0/862: write d6/f95 [2989631,43271] 0 2024-02-15T22:51:04.371 INFO:tasks.workunit.client.0.smithi138.stdout:1/704: truncate df/d1b/fb4 1825610 0 2024-02-15T22:51:04.371 INFO:tasks.workunit.client.0.smithi138.stdout:0/863: rmdir d6/d10/d52/d6f 39 2024-02-15T22:51:04.372 INFO:tasks.workunit.client.0.smithi138.stdout:0/864: symlink d6/d10/d13/d3d/dd2/d116/l130 0 2024-02-15T22:51:04.372 INFO:tasks.workunit.client.0.smithi138.stdout:8/881: dread db/d15/db6/fb7 [0,4194304] 0 2024-02-15T22:51:04.372 INFO:tasks.workunit.client.0.smithi138.stdout:8/882: getdents db/d15/db6/df2/d4d/dd6/dfd 0 2024-02-15T22:51:04.373 INFO:tasks.workunit.client.0.smithi138.stdout:0/865: creat d6/f131 x:0 0 0 2024-02-15T22:51:04.375 INFO:tasks.workunit.client.0.smithi138.stdout:1/705: dread df/d41/ddb/fb1 [0,4194304] 0 2024-02-15T22:51:04.375 INFO:tasks.workunit.client.0.smithi138.stdout:1/706: fsync df/d1b/d1d/d25/d2e/d5b/d65/d80/fa8 0 2024-02-15T22:51:04.375 INFO:tasks.workunit.client.0.smithi138.stdout:1/707: dread - df/d1b/d21/fb9 zero size 2024-02-15T22:51:04.375 INFO:tasks.workunit.client.0.smithi138.stdout:1/708: chown df/d1b/d1d/d25/d2e/d5b/d7b 1 1 2024-02-15T22:51:04.376 INFO:tasks.workunit.client.0.smithi138.stdout:4/919: dwrite d17/d1e/d2d/f31 [4194304,4194304] 0 2024-02-15T22:51:04.376 INFO:tasks.workunit.client.0.smithi138.stdout:1/709: creat df/fe1 x:0 0 0 2024-02-15T22:51:04.376 INFO:tasks.workunit.client.0.smithi138.stdout:8/883: dread db/d15/db6/df2/fa8 [0,4194304] 0 2024-02-15T22:51:04.376 INFO:tasks.workunit.client.0.smithi138.stdout:8/884: write db/d15/db6/df2/d13/d19/d7d/db2/fca [1088076,98038] 0 2024-02-15T22:51:04.377 INFO:tasks.workunit.client.0.smithi138.stdout:8/885: read - db/d15/d70/fc3 zero size 2024-02-15T22:51:04.379 INFO:tasks.workunit.client.0.smithi138.stdout:4/920: link d17/d1e/d2d/d36/f68 d17/d1e/d2d/f129 0 2024-02-15T22:51:04.379 INFO:tasks.workunit.client.0.smithi138.stdout:1/710: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f6f [0,4194304] 0 2024-02-15T22:51:04.381 INFO:tasks.workunit.client.0.smithi138.stdout:8/886: symlink db/d15/db6/df2/d13/d19/d7d/db2/l11d 0 2024-02-15T22:51:04.391 INFO:tasks.workunit.client.0.smithi138.stdout:0/866: dwrite d6/d10/d52/f12a [0,4194304] 0 2024-02-15T22:51:04.402 INFO:tasks.workunit.client.0.smithi138.stdout:8/887: dwrite db/d15/db6/df2/d13/d19/f83 [0,4194304] 0 2024-02-15T22:51:04.402 INFO:tasks.workunit.client.0.smithi138.stdout:8/888: fdatasync db/d15/db6/df2/d22/f8a 0 2024-02-15T22:51:04.404 INFO:tasks.workunit.client.0.smithi138.stdout:8/889: creat db/d15/d70/d7c/d92/f11e x:0 0 0 2024-02-15T22:51:04.404 INFO:tasks.workunit.client.0.smithi138.stdout:4/921: dwrite d17/d1e/d2d/d36/f98 [0,4194304] 0 2024-02-15T22:51:04.404 INFO:tasks.workunit.client.0.smithi138.stdout:4/922: write d17/d1e/d2d/d36/dca/da3/dfd/f122 [150003,107443] 0 2024-02-15T22:51:04.404 INFO:tasks.workunit.client.0.smithi138.stdout:4/923: readlink d17/d1e/d2d/d36/d3e/l58 0 2024-02-15T22:51:04.404 INFO:tasks.workunit.client.0.smithi138.stdout:4/924: getdents d17/d1e/d2d/d124 0 2024-02-15T22:51:04.412 INFO:tasks.workunit.client.0.smithi138.stdout:0/867: dwrite d6/d10/d64/f88 [0,4194304] 0 2024-02-15T22:51:04.413 INFO:tasks.workunit.client.0.smithi138.stdout:0/868: mknod d6/d10/d34/c132 0 2024-02-15T22:51:04.417 INFO:tasks.workunit.client.0.smithi138.stdout:4/925: dread d17/d1e/d2d/fc2 [0,4194304] 0 2024-02-15T22:51:04.418 INFO:tasks.workunit.client.0.smithi138.stdout:4/926: creat d17/d1e/d56/f12a x:0 0 0 2024-02-15T22:51:04.420 INFO:tasks.workunit.client.0.smithi138.stdout:4/927: rename d17/d1e/d2d/f2e to d17/d1e/d2d/d124/f12b 0 2024-02-15T22:51:04.421 INFO:tasks.workunit.client.0.smithi138.stdout:8/890: dwrite db/d15/db6/df2/f1d [0,4194304] 0 2024-02-15T22:51:04.421 INFO:tasks.workunit.client.0.smithi138.stdout:8/891: readlink db/lc1 0 2024-02-15T22:51:04.421 INFO:tasks.workunit.client.0.smithi138.stdout:0/869: dread d6/d10/d18/fa7 [4194304,4194304] 0 2024-02-15T22:51:04.421 INFO:tasks.workunit.client.0.smithi138.stdout:4/928: symlink d17/d1e/d2d/d36/l12c 0 2024-02-15T22:51:04.422 INFO:tasks.workunit.client.0.smithi138.stdout:4/929: creat d17/d1e/d2d/d36/dca/da3/dfd/f12d x:0 0 0 2024-02-15T22:51:04.422 INFO:tasks.workunit.client.0.smithi138.stdout:4/930: chown d17/d1e/d2d/dd5/d121/d78/dc0/dc4 95799 1 2024-02-15T22:51:04.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/892: link db/d15/daa/fd5 db/d15/db6/df2/d13/d19/d6b/dba/df7/f11f 0 2024-02-15T22:51:04.423 INFO:tasks.workunit.client.0.smithi138.stdout:8/893: fsync db/d15/db6/df2/d13/f6d 0 2024-02-15T22:51:04.425 INFO:tasks.workunit.client.0.smithi138.stdout:4/931: rename d17/d1e/fcd to d17/d1e/db8/f12e 0 2024-02-15T22:51:04.427 INFO:tasks.workunit.client.0.smithi138.stdout:4/932: rename d17/d1e/d2d/d36/dca/da3/d11e/ff3 to d17/d1e/f12f 0 2024-02-15T22:51:04.427 INFO:tasks.workunit.client.0.smithi138.stdout:4/933: write d17/d1e/d2d/d36/dca/f128 [496405,56214] 0 2024-02-15T22:51:04.437 INFO:tasks.workunit.client.0.smithi138.stdout:4/934: fsync d17/d1e/f12f 0 2024-02-15T22:51:04.437 INFO:tasks.workunit.client.0.smithi138.stdout:4/935: readlink d17/lad 0 2024-02-15T22:51:04.438 INFO:tasks.workunit.client.0.smithi138.stdout:4/936: creat d17/d1e/d2d/d36/dca/da3/dbf/f130 x:0 0 0 2024-02-15T22:51:04.438 INFO:tasks.workunit.client.0.smithi138.stdout:4/937: symlink d17/d1e/d2d/d36/d3e/l131 0 2024-02-15T22:51:04.440 INFO:tasks.workunit.client.0.smithi138.stdout:8/894: dwrite f0 [0,4194304] 0 2024-02-15T22:51:04.443 INFO:tasks.workunit.client.0.smithi138.stdout:8/895: creat db/d15/d70/df9/de4/f120 x:0 0 0 2024-02-15T22:51:04.443 INFO:tasks.workunit.client.0.smithi138.stdout:8/896: chown db/d15/db6/df2/d13/f79 2154 1 2024-02-15T22:51:04.444 INFO:tasks.workunit.client.0.smithi138.stdout:8/897: readlink db/d15/d70/d7c/d92/l33 0 2024-02-15T22:51:04.445 INFO:tasks.workunit.client.0.smithi138.stdout:8/898: chown db/d15/db6/df2/d22 339295566 1 2024-02-15T22:51:04.448 INFO:tasks.workunit.client.0.smithi138.stdout:8/899: dread db/d15/db6/df2/d13/d19/fa3 [0,4194304] 0 2024-02-15T22:51:04.450 INFO:tasks.workunit.client.0.smithi138.stdout:8/900: getdents db/d15/d70/df9/de4 0 2024-02-15T22:51:04.450 INFO:tasks.workunit.client.0.smithi138.stdout:8/901: creat db/d15/db6/df2/d13/d19/d6b/dba/f121 x:0 0 0 2024-02-15T22:51:04.451 INFO:tasks.workunit.client.0.smithi138.stdout:4/938: dread d17/d1e/f12f [0,4194304] 0 2024-02-15T22:51:04.451 INFO:tasks.workunit.client.0.smithi138.stdout:8/902: rmdir db/d15/db6/df2/d13/d19/d6b/dba/df7 39 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:4/939: mkdir d17/d1e/d2d/d36/dca/da3/dfd/d132 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:4/940: fsync d17/d1e/db8/fe7 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:4/941: chown d17/d1e/db8/c10f 465440816 1 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/903: symlink db/d15/db6/df2/d13/d19/d6b/dba/l122 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/904: creat db/d15/db6/df2/f123 x:0 0 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/905: write db/d15/d70/d7c/d92/fee [849919,3810] 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/906: fdatasync db/d15/db6/df2/d13/d19/d6b/d105/fdf 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/907: readlink db/d15/db6/df2/d13/d19/d7d/l101 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:8/908: read db/d15/d70/d7c/d92/de6/fb9 [2613093,40081] 0 2024-02-15T22:51:04.456 INFO:tasks.workunit.client.0.smithi138.stdout:4/942: link d17/d1e/d2d/dd5/d121/d78/dfa/c120 d17/d1e/d2d/dd5/d121/d78/dfa/c133 0 2024-02-15T22:51:04.476 INFO:tasks.workunit.client.0.smithi138.stdout:8/909: dwrite db/d15/d70/f46 [4194304,4194304] 0 2024-02-15T22:51:04.476 INFO:tasks.workunit.client.0.smithi138.stdout:4/943: dwrite d17/d1e/d2d/dd5/d121/ffc [0,4194304] 0 2024-02-15T22:51:04.478 INFO:tasks.workunit.client.0.smithi138.stdout:8/910: symlink db/d15/db6/df4/l124 0 2024-02-15T22:51:04.480 INFO:tasks.workunit.client.0.smithi138.stdout:4/944: unlink d17/d1e/d2d/dd5/d121/f3d 0 2024-02-15T22:51:04.483 INFO:tasks.workunit.client.0.smithi138.stdout:8/911: rename db/d15/db6/df2/d13/l26 to db/d15/db6/df4/l125 0 2024-02-15T22:51:04.485 INFO:tasks.workunit.client.0.smithi138.stdout:4/945: getdents d17/d1e/d2d/dd5 0 2024-02-15T22:51:04.495 INFO:tasks.workunit.client.0.smithi138.stdout:2/911: sync 2024-02-15T22:51:04.495 INFO:tasks.workunit.client.0.smithi138.stdout:6/859: sync 2024-02-15T22:51:04.496 INFO:tasks.workunit.client.0.smithi138.stdout:2/912: getdents d0/da/d19/d53/d5d/d6d/dd8 0 2024-02-15T22:51:04.496 INFO:tasks.workunit.client.0.smithi138.stdout:2/913: creat d0/da/d19/d53/d5d/d6d/d7b/f13c x:0 0 0 2024-02-15T22:51:04.496 INFO:tasks.workunit.client.0.smithi138.stdout:2/914: dread - d0/da/df6/f136 zero size 2024-02-15T22:51:04.498 INFO:tasks.workunit.client.0.smithi138.stdout:6/860: link dc/d76/lc1 dc/d24/d34/d3b/d7c/d9f/l12a 0 2024-02-15T22:51:04.500 INFO:tasks.workunit.client.0.smithi138.stdout:2/915: mkdir d0/da/d19/d53/d5d/d6d/dd8/d13d 0 2024-02-15T22:51:04.501 INFO:tasks.workunit.client.0.smithi138.stdout:8/912: dwrite db/d15/db6/df2/d13/f3b [0,4194304] 0 2024-02-15T22:51:04.503 INFO:tasks.workunit.client.0.smithi138.stdout:2/916: creat d0/da/d19/d53/d5d/d83/d8a/dc2/f13e x:0 0 0 2024-02-15T22:51:04.504 INFO:tasks.workunit.client.0.smithi138.stdout:4/946: dwrite d17/d1e/d2d/d36/dca/da3/d11e/f74 [4194304,4194304] 0 2024-02-15T22:51:04.504 INFO:tasks.workunit.client.0.smithi138.stdout:4/947: write d17/d1e/db8/fe7 [980264,58623] 0 2024-02-15T22:51:04.504 INFO:tasks.workunit.client.0.smithi138.stdout:6/861: rename dc/d24/d34/d99/dc4 to dc/d12b 0 2024-02-15T22:51:04.505 INFO:tasks.workunit.client.0.smithi138.stdout:6/862: readlink dc/d24/d34/d3b/l8e 0 2024-02-15T22:51:04.505 INFO:tasks.workunit.client.0.smithi138.stdout:6/863: chown dc/d24/c44 120487 1 2024-02-15T22:51:04.506 INFO:tasks.workunit.client.0.smithi138.stdout:2/917: symlink d0/dd/l13f 0 2024-02-15T22:51:04.506 INFO:tasks.workunit.client.0.smithi138.stdout:2/918: chown d0/da/d19/d53/d5d/d74/l6a 2 1 2024-02-15T22:51:04.508 INFO:tasks.workunit.client.0.smithi138.stdout:4/948: mknod d17/d1e/d2d/d36/dca/da3/c134 0 2024-02-15T22:51:04.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/919: dread d0/da/d19/d53/ff5 [0,4194304] 0 2024-02-15T22:51:04.510 INFO:tasks.workunit.client.0.smithi138.stdout:2/920: read d0/dd/f2c [72285,82392] 0 2024-02-15T22:51:04.510 INFO:tasks.workunit.client.0.smithi138.stdout:8/913: rename db/d15/d70/d7c/la1 to db/d15/db6/df2/d13/d19/d6b/dba/dfe/l126 0 2024-02-15T22:51:04.512 INFO:tasks.workunit.client.0.smithi138.stdout:4/949: creat d17/d1e/d2d/dd5/d121/d78/dc0/dc4/f135 x:0 0 0 2024-02-15T22:51:04.514 INFO:tasks.workunit.client.0.smithi138.stdout:6/864: dread dc/f79 [0,4194304] 0 2024-02-15T22:51:04.517 INFO:tasks.workunit.client.0.smithi138.stdout:6/865: truncate dc/d24/d34/d3b/d7c/da8/f108 8200236 0 2024-02-15T22:51:04.517 INFO:tasks.workunit.client.0.smithi138.stdout:6/866: write dc/d76/d96/fbd [79165,82387] 0 2024-02-15T22:51:04.517 INFO:tasks.workunit.client.0.smithi138.stdout:6/867: read - dc/d76/f81 zero size 2024-02-15T22:51:04.518 INFO:tasks.workunit.client.0.smithi138.stdout:6/868: dread dc/d24/d34/f52 [0,4194304] 0 2024-02-15T22:51:04.518 INFO:tasks.workunit.client.0.smithi138.stdout:4/950: dread d17/d1e/d2d/dd5/ff5 [0,4194304] 0 2024-02-15T22:51:04.521 INFO:tasks.workunit.client.0.smithi138.stdout:4/951: unlink d17/d1e/d2d/d36/dca/c100 0 2024-02-15T22:51:04.522 INFO:tasks.workunit.client.0.smithi138.stdout:4/952: mkdir d17/d1e/d2d/dc7/d136 0 2024-02-15T22:51:04.523 INFO:tasks.workunit.client.0.smithi138.stdout:2/921: rmdir d0/da/d19/d53/d5d/d83/d8a/dc2 39 2024-02-15T22:51:04.526 INFO:tasks.workunit.client.0.smithi138.stdout:4/953: creat d17/d1e/d2d/dd5/d121/d78/f137 x:0 0 0 2024-02-15T22:51:04.536 INFO:tasks.workunit.client.0.smithi138.stdout:8/914: dwrite db/d15/db6/df2/f3e [0,4194304] 0 2024-02-15T22:51:04.536 INFO:tasks.workunit.client.0.smithi138.stdout:8/915: fsync db/d15/daa/fd5 0 2024-02-15T22:51:04.539 INFO:tasks.workunit.client.0.smithi138.stdout:8/916: rename db/d15/db6/df2/d22/c25 to db/d15/d70/df9/de4/c127 0 2024-02-15T22:51:04.542 INFO:tasks.workunit.client.0.smithi138.stdout:6/869: dwrite dc/d24/d6c/dbc/de7/fc2 [0,4194304] 0 2024-02-15T22:51:04.544 INFO:tasks.workunit.client.0.smithi138.stdout:6/870: symlink dc/d24/d6c/dbc/de7/d113/l12c 0 2024-02-15T22:51:04.545 INFO:tasks.workunit.client.0.smithi138.stdout:2/922: dwrite d0/da/df6/fc5 [0,4194304] 0 2024-02-15T22:51:04.545 INFO:tasks.workunit.client.0.smithi138.stdout:2/923: dread - d0/da/df6/fe2 zero size 2024-02-15T22:51:04.546 INFO:tasks.workunit.client.0.smithi138.stdout:6/871: mkdir dc/d4b/dba/dff/d12d 0 2024-02-15T22:51:04.547 INFO:tasks.workunit.client.0.smithi138.stdout:2/924: creat d0/dd/d15/ddf/f140 x:0 0 0 2024-02-15T22:51:04.547 INFO:tasks.workunit.client.0.smithi138.stdout:2/925: stat d0/da/df6/l101 0 2024-02-15T22:51:04.547 INFO:tasks.workunit.client.0.smithi138.stdout:2/926: readlink d0/da/d19/d53/d5d/d74/l6a 0 2024-02-15T22:51:04.548 INFO:tasks.workunit.client.0.smithi138.stdout:6/872: mknod dc/d12b/dd1/c12e 0 2024-02-15T22:51:04.548 INFO:tasks.workunit.client.0.smithi138.stdout:6/873: fsync dc/d24/d34/d3b/fca 0 2024-02-15T22:51:04.551 INFO:tasks.workunit.client.0.smithi138.stdout:6/874: symlink dc/d24/d34/l12f 0 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/927: rmdir d0/da/d19/d53/d80 39 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/928: write d0/da/f11d [1029969,125681] 0 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/929: chown d0/da/d19/d53/d5d/d6d/dd8 67 1 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/930: write d0/dd/d15/ddf/f140 [980241,51833] 0 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/931: chown d0/da/f27 11 1 2024-02-15T22:51:04.553 INFO:tasks.workunit.client.0.smithi138.stdout:2/932: chown d0/da/df6/l101 2462378 1 2024-02-15T22:51:04.554 INFO:tasks.workunit.client.0.smithi138.stdout:6/875: creat dc/d24/d6c/dbc/f130 x:0 0 0 2024-02-15T22:51:04.555 INFO:tasks.workunit.client.0.smithi138.stdout:6/876: mknod dc/d24/d34/d3b/d7c/c131 0 2024-02-15T22:51:04.556 INFO:tasks.workunit.client.0.smithi138.stdout:6/877: symlink dc/d24/d34/d3b/d7c/da8/l132 0 2024-02-15T22:51:04.556 INFO:tasks.workunit.client.0.smithi138.stdout:6/878: creat dc/d4b/d7b/f133 x:0 0 0 2024-02-15T22:51:04.563 INFO:tasks.workunit.client.0.smithi138.stdout:4/954: dwrite d17/d1e/d2d/d8c/fa2 [0,4194304] 0 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/933: dread d0/d3/f5e [0,4194304] 0 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:2/934: write d0/dd/d15/f71 [1584010,6546] 0 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:8/917: dwrite db/fc0 [0,4194304] 0 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:8/918: chown db/ld0 2281975 1 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:8/919: chown db/d15/d70/df9/de4/fef 36597 1 2024-02-15T22:51:04.571 INFO:tasks.workunit.client.0.smithi138.stdout:8/920: stat db/d15 0 2024-02-15T22:51:04.572 INFO:tasks.workunit.client.0.smithi138.stdout:2/935: mkdir d0/da/d19/d53/d5d/d74/d13a/d141 0 2024-02-15T22:51:04.574 INFO:tasks.workunit.client.0.smithi138.stdout:2/936: rmdir d0/da/d19/d53/d5d/d6d/dd8/d13d 0 2024-02-15T22:51:04.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/879: dwrite dc/d24/d34/f52 [0,4194304] 0 2024-02-15T22:51:04.575 INFO:tasks.workunit.client.0.smithi138.stdout:6/880: write dc/d4b/d7b/f11f [413418,24920] 0 2024-02-15T22:51:04.575 INFO:tasks.workunit.client.0.smithi138.stdout:2/937: truncate d0/da/dca/f124 328118 0 2024-02-15T22:51:04.577 INFO:tasks.workunit.client.0.smithi138.stdout:6/881: mknod dc/d24/d34/d99/c134 0 2024-02-15T22:51:04.577 INFO:tasks.workunit.client.0.smithi138.stdout:2/938: chown d0/da/d19/d53/d5d/d6d/dd8/c105 36079671 1 2024-02-15T22:51:04.578 INFO:tasks.workunit.client.0.smithi138.stdout:6/882: symlink dc/d76/d96/l135 0 2024-02-15T22:51:04.580 INFO:tasks.workunit.client.0.smithi138.stdout:2/939: unlink d0/dd/f4f 0 2024-02-15T22:51:04.580 INFO:tasks.workunit.client.0.smithi138.stdout:2/940: chown d0/dd/d15/d65/l75 65812463 1 2024-02-15T22:51:04.580 INFO:tasks.workunit.client.0.smithi138.stdout:2/941: fdatasync d0/da/d19/d53/d5d/d6d/d7b/f13c 0 2024-02-15T22:51:04.581 INFO:tasks.workunit.client.0.smithi138.stdout:2/942: rmdir d0/da/d19/d53/d80 39 2024-02-15T22:51:04.581 INFO:tasks.workunit.client.0.smithi138.stdout:2/943: chown d0/da/d19/d53/d5d/d6d/f7c 458078 1 2024-02-15T22:51:04.583 INFO:tasks.workunit.client.0.smithi138.stdout:4/955: dwrite d17/d1e/db8/f12e [0,4194304] 0 2024-02-15T22:51:04.583 INFO:tasks.workunit.client.0.smithi138.stdout:2/944: rmdir d0/dd/d15 39 2024-02-15T22:51:04.583 INFO:tasks.workunit.client.0.smithi138.stdout:2/945: chown d0/dd/c2f 51 1 2024-02-15T22:51:04.586 INFO:tasks.workunit.client.0.smithi138.stdout:4/956: mknod d17/d1e/d2d/d36/d3e/d64/c138 0 2024-02-15T22:51:04.593 INFO:tasks.workunit.client.0.smithi138.stdout:2/946: write d0/dd/d15/f6c [2491911,130430] 0 2024-02-15T22:51:04.594 INFO:tasks.workunit.client.0.smithi138.stdout:6/883: dwrite dc/d24/d34/d3b/f4a [0,4194304] 0 2024-02-15T22:51:04.596 INFO:tasks.workunit.client.0.smithi138.stdout:4/957: creat d17/d1a/f139 x:0 0 0 2024-02-15T22:51:04.596 INFO:tasks.workunit.client.0.smithi138.stdout:4/958: stat d17/d1e/d2d/dc7/d136 0 2024-02-15T22:51:04.599 INFO:tasks.workunit.client.0.smithi138.stdout:6/884: unlink dc/d24/d34/d3b/d7c/d9f/fa5 0 2024-02-15T22:51:04.600 INFO:tasks.workunit.client.0.smithi138.stdout:2/947: getdents d0/da/d19/d53/d5d/d74 0 2024-02-15T22:51:04.602 INFO:tasks.workunit.client.0.smithi138.stdout:6/885: rename dc/d24/d34/d3b/fe3 to dc/d24/d34/d3b/dda/d125/f136 0 2024-02-15T22:51:04.603 INFO:tasks.workunit.client.0.smithi138.stdout:5/776: sync 2024-02-15T22:51:04.603 INFO:tasks.workunit.client.0.smithi138.stdout:5/777: write df/d18/d3e/d60/f99 [4477403,64851] 0 2024-02-15T22:51:04.605 INFO:tasks.workunit.client.0.smithi138.stdout:2/948: unlink d0/da/d19/c111 0 2024-02-15T22:51:04.614 INFO:tasks.workunit.client.0.smithi138.stdout:2/949: dread d0/da/f9e [0,4194304] 0 2024-02-15T22:51:04.614 INFO:tasks.workunit.client.0.smithi138.stdout:4/959: dwrite d17/f6a [0,4194304] 0 2024-02-15T22:51:04.614 INFO:tasks.workunit.client.0.smithi138.stdout:4/960: creat d17/d1e/d2d/d36/d3e/daf/f13a x:0 0 0 2024-02-15T22:51:04.615 INFO:tasks.workunit.client.0.smithi138.stdout:2/950: mknod d0/da/d19/d3f/c142 0 2024-02-15T22:51:04.617 INFO:tasks.workunit.client.0.smithi138.stdout:4/961: truncate d17/d1e/d2d/d36/ff1 5501278 0 2024-02-15T22:51:04.617 INFO:tasks.workunit.client.0.smithi138.stdout:4/962: dread - d17/d1e/d2d/d36/d3e/daf/fff zero size 2024-02-15T22:51:04.617 INFO:tasks.workunit.client.0.smithi138.stdout:4/963: stat d17/d1e/d2d/d36/d3e/fb4 0 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/951: mknod d0/da/d19/d53/d80/dba/c143 0 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/952: write d0/da/df6/d10a/f102 [698326,79282] 0 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/953: creat d0/da/d19/d53/d5d/d6d/d7b/f144 x:0 0 0 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/954: chown d0/dd/f18 3326495 1 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/955: truncate d0/da/d19/d53/d5d/d74/d79/fd3 246168 0 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/956: chown d0/da/d19/d53/d5d/d74/fbc 26066709 1 2024-02-15T22:51:04.618 INFO:tasks.workunit.client.0.smithi138.stdout:2/957: write d0/d3/fe6 [556068,97245] 0 2024-02-15T22:51:04.619 INFO:tasks.workunit.client.0.smithi138.stdout:2/958: write d0/dd/d15/ddf/f135 [1530681,102322] 0 2024-02-15T22:51:04.624 INFO:tasks.workunit.client.0.smithi138.stdout:6/886: dwrite dc/d24/f26 [0,4194304] 0 2024-02-15T22:51:04.624 INFO:tasks.workunit.client.0.smithi138.stdout:2/959: link d0/da/d19/d53/d5d/d6d/f7c d0/da/d19/d53/d5d/d74/d13a/d141/f145 0 2024-02-15T22:51:04.635 INFO:tasks.workunit.client.0.smithi138.stdout:2/960: symlink d0/da/d19/d11e/l146 0 2024-02-15T22:51:04.635 INFO:tasks.workunit.client.0.smithi138.stdout:2/961: symlink d0/dd/l147 0 2024-02-15T22:51:04.635 INFO:tasks.workunit.client.0.smithi138.stdout:2/962: mkdir d0/dd/d15/de3/d148 0 2024-02-15T22:51:04.635 INFO:tasks.workunit.client.0.smithi138.stdout:5/778: dwrite df/d18/d56/f5d [0,4194304] 0 2024-02-15T22:51:04.636 INFO:tasks.workunit.client.0.smithi138.stdout:2/963: creat d0/da/d19/d3f/d10d/f149 x:0 0 0 2024-02-15T22:51:04.637 INFO:tasks.workunit.client.0.smithi138.stdout:4/964: dwrite d17/ff0 [0,4194304] 0 2024-02-15T22:51:04.644 INFO:tasks.workunit.client.0.smithi138.stdout:6/887: dwrite dc/d4b/d7b/f133 [0,4194304] 0 2024-02-15T22:51:04.646 INFO:tasks.workunit.client.0.smithi138.stdout:2/964: truncate d0/dd/d15/f6c 1658477 0 2024-02-15T22:51:04.646 INFO:tasks.workunit.client.0.smithi138.stdout:2/965: readlink d0/da/d19/d53/d5d/lf3 0 2024-02-15T22:51:04.647 INFO:tasks.workunit.client.0.smithi138.stdout:5/779: read fb [2656371,96452] 0 2024-02-15T22:51:04.648 INFO:tasks.workunit.client.0.smithi138.stdout:6/888: mkdir dc/d4b/dba/dff/d137 0 2024-02-15T22:51:04.648 INFO:tasks.workunit.client.0.smithi138.stdout:6/889: creat dc/d24/d34/d3b/d7d/f138 x:0 0 0 2024-02-15T22:51:04.651 INFO:tasks.workunit.client.0.smithi138.stdout:2/966: link d0/da/d19/d53/d5d/d6d/ca9 d0/da/df6/c14a 0 2024-02-15T22:51:04.677 INFO:tasks.workunit.client.0.smithi138.stdout:6/890: dwrite dc/d4b/d7b/fbb [0,4194304] 0 2024-02-15T22:51:04.678 INFO:tasks.workunit.client.0.smithi138.stdout:5/780: dwrite df/ff4 [0,4194304] 0 2024-02-15T22:51:04.678 INFO:tasks.workunit.client.0.smithi138.stdout:5/781: creat df/d18/d3e/d60/d65/d7f/f103 x:0 0 0 2024-02-15T22:51:04.678 INFO:tasks.workunit.client.0.smithi138.stdout:2/967: dwrite d0/da/d19/d53/d80/dba/f126 [0,4194304] 0 2024-02-15T22:51:04.684 INFO:tasks.workunit.client.0.smithi138.stdout:2/968: mknod d0/da/d19/d53/d5d/d6d/d7b/da3/c14b 0 2024-02-15T22:51:04.687 INFO:tasks.workunit.client.0.smithi138.stdout:2/969: link d0/da/d19/d53/d5d/d6d/d7b/f116 d0/da/d19/d53/d80/dba/d118/d11f/f14c 0 2024-02-15T22:51:04.688 INFO:tasks.workunit.client.0.smithi138.stdout:2/970: creat d0/da/d19/d53/d5d/f14d x:0 0 0 2024-02-15T22:51:04.688 INFO:tasks.workunit.client.0.smithi138.stdout:2/971: truncate d0/da/d19/d53/d5d/f14d 998441 0 2024-02-15T22:51:04.688 INFO:tasks.workunit.client.0.smithi138.stdout:2/972: truncate d0/da/df6/fe2 188483 0 2024-02-15T22:51:04.688 INFO:tasks.workunit.client.0.smithi138.stdout:2/973: write d0/da/fb4 [9199176,116621] 0 2024-02-15T22:51:04.699 INFO:tasks.workunit.client.0.smithi138.stdout:6/891: dwrite dc/d24/d6c/dbc/f119 [4194304,4194304] 0 2024-02-15T22:51:04.699 INFO:tasks.workunit.client.0.smithi138.stdout:6/892: read - dc/d76/f81 zero size 2024-02-15T22:51:04.700 INFO:tasks.workunit.client.0.smithi138.stdout:5/782: dwrite df/d18/f84 [0,4194304] 0 2024-02-15T22:51:04.702 INFO:tasks.workunit.client.0.smithi138.stdout:5/783: fdatasync df/d18/d3e/d60/d65/d7f/d90/f92 0 2024-02-15T22:51:04.703 INFO:tasks.workunit.client.0.smithi138.stdout:5/784: mkdir df/d18/d3e/d60/d65/d7f/d104 0 2024-02-15T22:51:04.710 INFO:tasks.workunit.client.0.smithi138.stdout:1/711: sync 2024-02-15T22:51:04.711 INFO:tasks.workunit.client.0.smithi138.stdout:0/870: sync 2024-02-15T22:51:04.711 INFO:tasks.workunit.client.0.smithi138.stdout:1/712: write df/d1b/d1d/f35 [716902,84483] 0 2024-02-15T22:51:04.711 INFO:tasks.workunit.client.0.smithi138.stdout:1/713: dread - df/d1b/d1d/d25/fde zero size 2024-02-15T22:51:04.711 INFO:tasks.workunit.client.0.smithi138.stdout:1/714: readlink df/d1b/d21/d4f/ldd 0 2024-02-15T22:51:04.712 INFO:tasks.workunit.client.0.smithi138.stdout:0/871: creat d6/d10/d18/d6e/df8/f133 x:0 0 0 2024-02-15T22:51:04.712 INFO:tasks.workunit.client.0.smithi138.stdout:0/872: creat d6/d10/d34/f134 x:0 0 0 2024-02-15T22:51:04.714 INFO:tasks.workunit.client.0.smithi138.stdout:1/715: getdents df 0 2024-02-15T22:51:04.715 INFO:tasks.workunit.client.0.smithi138.stdout:5/785: dread df/d18/d3e/d60/d65/d7f/fc3 [0,4194304] 0 2024-02-15T22:51:04.718 INFO:tasks.workunit.client.0.smithi138.stdout:5/786: mkdir df/d18/d3e/d51/d105 0 2024-02-15T22:51:04.718 INFO:tasks.workunit.client.0.smithi138.stdout:1/716: symlink df/d1b/d1d/d25/d2e/d5b/d65/d86/le2 0 2024-02-15T22:51:04.720 INFO:tasks.workunit.client.0.smithi138.stdout:1/717: unlink df/d1b/d1d/d25/d2e/c51 0 2024-02-15T22:51:04.720 INFO:tasks.workunit.client.0.smithi138.stdout:1/718: creat df/d1b/d1d/d25/d2e/d5b/d7b/fe3 x:0 0 0 2024-02-15T22:51:04.722 INFO:tasks.workunit.client.0.smithi138.stdout:6/893: dwrite dc/d4b/d98/f100 [0,4194304] 0 2024-02-15T22:51:04.722 INFO:tasks.workunit.client.0.smithi138.stdout:6/894: readlink dc/d76/l104 0 2024-02-15T22:51:04.724 INFO:tasks.workunit.client.0.smithi138.stdout:6/895: unlink dc/d76/f81 0 2024-02-15T22:51:04.724 INFO:tasks.workunit.client.0.smithi138.stdout:6/896: chown dc/d4b/dba 64440822 1 2024-02-15T22:51:04.724 INFO:tasks.workunit.client.0.smithi138.stdout:6/897: write dc/d24/df4/ffc [966340,105916] 0 2024-02-15T22:51:04.724 INFO:tasks.workunit.client.0.smithi138.stdout:6/898: fsync dc/d24/d34/d3b/d7d/f138 0 2024-02-15T22:51:04.725 INFO:tasks.workunit.client.0.smithi138.stdout:5/787: dread fb [0,4194304] 0 2024-02-15T22:51:04.726 INFO:tasks.workunit.client.0.smithi138.stdout:6/899: mknod dc/d4b/dba/dff/d12d/c139 0 2024-02-15T22:51:04.737 INFO:tasks.workunit.client.0.smithi138.stdout:6/900: write f0 [198314,102306] 0 2024-02-15T22:51:04.737 INFO:tasks.workunit.client.0.smithi138.stdout:6/901: fdatasync dc/d24/f5e 0 2024-02-15T22:51:04.738 INFO:tasks.workunit.client.0.smithi138.stdout:0/873: dwrite d6/d10/d18/d57/fd0 [0,4194304] 0 2024-02-15T22:51:04.741 INFO:tasks.workunit.client.0.smithi138.stdout:0/874: symlink d6/d10/d64/dd7/l135 0 2024-02-15T22:51:04.742 INFO:tasks.workunit.client.0.smithi138.stdout:1/719: dwrite df/d1b/d1d/d25/fca [0,4194304] 0 2024-02-15T22:51:04.742 INFO:tasks.workunit.client.0.smithi138.stdout:0/875: symlink d6/dba/l136 0 2024-02-15T22:51:04.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/720: read df/d1b/d1d/f35 [593067,102211] 0 2024-02-15T22:51:04.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/721: dread - df/d1b/d1d/d25/d2e/d5b/d65/fb5 zero size 2024-02-15T22:51:04.753 INFO:tasks.workunit.client.0.smithi138.stdout:1/722: read df/d1b/d1d/d25/fa6 [5071727,85683] 0 2024-02-15T22:51:04.753 INFO:tasks.workunit.client.0.smithi138.stdout:1/723: truncate df/d1b/d21/fc8 885553 0 2024-02-15T22:51:04.755 INFO:tasks.workunit.client.0.smithi138.stdout:6/902: dwrite dc/d4b/dba/d10b/f110 [0,4194304] 0 2024-02-15T22:51:04.758 INFO:tasks.workunit.client.0.smithi138.stdout:6/903: link dc/d24/d34/d3b/d7c/da8/fc5 dc/d24/df4/d124/f13a 0 2024-02-15T22:51:04.758 INFO:tasks.workunit.client.0.smithi138.stdout:6/904: readlink dc/d24/d34/d3b/l8e 0 2024-02-15T22:51:04.759 INFO:tasks.workunit.client.0.smithi138.stdout:6/905: link dc/d24/l37 dc/d24/d34/d3b/d7d/d115/l13b 0 2024-02-15T22:51:04.760 INFO:tasks.workunit.client.0.smithi138.stdout:6/906: unlink dc/d4b/c60 0 2024-02-15T22:51:04.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/907: getdents dc/d76/d96 0 2024-02-15T22:51:04.762 INFO:tasks.workunit.client.0.smithi138.stdout:6/908: fsync dc/d76/fb7 0 2024-02-15T22:51:04.763 INFO:tasks.workunit.client.0.smithi138.stdout:6/909: truncate dc/d4b/d98/f100 386396 0 2024-02-15T22:51:04.765 INFO:tasks.workunit.client.0.smithi138.stdout:6/910: mkdir dc/d24/d34/d3b/dda/d13c 0 2024-02-15T22:51:04.765 INFO:tasks.workunit.client.0.smithi138.stdout:6/911: creat dc/d24/d34/d99/f13d x:0 0 0 2024-02-15T22:51:04.765 INFO:tasks.workunit.client.0.smithi138.stdout:6/912: chown dc/d24/d6c/dbc/f119 12 1 2024-02-15T22:51:04.773 INFO:tasks.workunit.client.0.smithi138.stdout:1/724: dwrite df/d41/ddb/fb1 [0,4194304] 0 2024-02-15T22:51:04.777 INFO:tasks.workunit.client.0.smithi138.stdout:1/725: unlink df/d41/ddb/ld2 0 2024-02-15T22:51:04.779 INFO:tasks.workunit.client.0.smithi138.stdout:1/726: getdents df/d1b/d1d/d25/d2e/d37 0 2024-02-15T22:51:04.779 INFO:tasks.workunit.client.0.smithi138.stdout:6/913: write dc/d4b/fb1 [3446485,113073] 0 2024-02-15T22:51:04.781 INFO:tasks.workunit.client.0.smithi138.stdout:6/914: link dc/d24/df4/ffc dc/d24/d6c/dbc/d117/f13e 0 2024-02-15T22:51:04.784 INFO:tasks.workunit.client.0.smithi138.stdout:6/915: creat dc/d4b/dba/dff/f13f x:0 0 0 2024-02-15T22:51:04.784 INFO:tasks.workunit.client.0.smithi138.stdout:6/916: stat dc/d4b/d98/fb2 0 2024-02-15T22:51:04.785 INFO:tasks.workunit.client.0.smithi138.stdout:6/917: mkdir dc/d12b/d140 0 2024-02-15T22:51:04.787 INFO:tasks.workunit.client.0.smithi138.stdout:6/918: link dc/d76/f101 dc/d24/d6c/dbc/f141 0 2024-02-15T22:51:04.787 INFO:tasks.workunit.client.0.smithi138.stdout:6/919: unlink dc/d24/d6c/dbc/d117/f13e 0 2024-02-15T22:51:04.788 INFO:tasks.workunit.client.0.smithi138.stdout:6/920: dread - dc/d24/d34/d99/f11a zero size 2024-02-15T22:51:04.799 INFO:tasks.workunit.client.0.smithi138.stdout:1/727: dwrite fa [0,4194304] 0 2024-02-15T22:51:04.802 INFO:tasks.workunit.client.0.smithi138.stdout:6/921: dwrite dc/d24/d34/d3b/d7d/fae [0,4194304] 0 2024-02-15T22:51:04.803 INFO:tasks.workunit.client.0.smithi138.stdout:6/922: creat dc/d24/d6c/dbc/de7/f142 x:0 0 0 2024-02-15T22:51:04.806 INFO:tasks.workunit.client.0.smithi138.stdout:6/923: link dc/d4b/dba/fcb dc/d24/f143 0 2024-02-15T22:51:04.808 INFO:tasks.workunit.client.0.smithi138.stdout:1/728: write df/d1b/d1d/d25/d8d/fd5 [2020992,84874] 0 2024-02-15T22:51:04.808 INFO:tasks.workunit.client.0.smithi138.stdout:1/729: truncate df/d1b/d1d/d25/d2e/d5b/d7b/fe3 539975 0 2024-02-15T22:51:04.808 INFO:tasks.workunit.client.0.smithi138.stdout:1/730: write df/d1b/d1d/d25/f61 [65,98291] 0 2024-02-15T22:51:04.827 INFO:tasks.workunit.client.0.smithi138.stdout:1/731: dwrite df/f53 [0,4194304] 0 2024-02-15T22:51:04.827 INFO:tasks.workunit.client.0.smithi138.stdout:1/732: chown df/d1b/d1d/c31 976 1 2024-02-15T22:51:04.827 INFO:tasks.workunit.client.0.smithi138.stdout:1/733: creat df/d1b/d1d/d25/d8d/fe4 x:0 0 0 2024-02-15T22:51:04.828 INFO:tasks.workunit.client.0.smithi138.stdout:1/734: write df/d1b/d1d/d25/d2e/d5b/f67 [335616,94842] 0 2024-02-15T22:51:04.886 INFO:tasks.workunit.client.0.smithi138.stdout:6/924: creat dc/d12b/d123/f144 x:0 0 0 2024-02-15T22:51:04.893 INFO:tasks.workunit.client.0.smithi138.stdout:6/925: dread dc/d24/fa9 [0,4194304] 0 2024-02-15T22:51:04.893 INFO:tasks.workunit.client.0.smithi138.stdout:6/926: fsync dc/d24/d34/f10f 0 2024-02-15T22:51:04.893 INFO:tasks.workunit.client.0.smithi138.stdout:1/735: mknod df/d1b/d1d/d25/d2e/d5b/d7b/ce5 0 2024-02-15T22:51:04.899 INFO:tasks.workunit.client.0.smithi138.stdout:1/736: creat df/d1b/d1d/d25/d2e/fe6 x:0 0 0 2024-02-15T22:51:04.900 INFO:tasks.workunit.client.0.smithi138.stdout:1/737: rmdir df/d1b/d1d/d24 39 2024-02-15T22:51:04.901 INFO:tasks.workunit.client.0.smithi138.stdout:1/738: symlink df/d1b/le7 0 2024-02-15T22:51:04.912 INFO:tasks.workunit.client.0.smithi138.stdout:1/739: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 [2408135,42948] 0 2024-02-15T22:51:04.914 INFO:tasks.workunit.client.0.smithi138.stdout:1/740: mkdir df/d41/de8 0 2024-02-15T22:51:04.914 INFO:tasks.workunit.client.0.smithi138.stdout:1/741: write df/d1b/d1d/d24/d3a/f44 [1072462,91501] 0 2024-02-15T22:51:04.914 INFO:tasks.workunit.client.0.smithi138.stdout:1/742: mknod df/d1b/d1d/d25/d2e/d5b/d7b/ce9 0 2024-02-15T22:51:04.914 INFO:tasks.workunit.client.0.smithi138.stdout:1/743: chown df/d41/ddb/c36 2895876 1 2024-02-15T22:51:04.916 INFO:tasks.workunit.client.0.smithi138.stdout:1/744: unlink df/d1b/d1d/d24/d3a/f89 0 2024-02-15T22:51:04.917 INFO:tasks.workunit.client.0.smithi138.stdout:1/745: creat df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/fea x:0 0 0 2024-02-15T22:51:04.922 INFO:tasks.workunit.client.0.smithi138.stdout:6/927: dwrite dc/d24/d34/d3b/d66/f8d [0,4194304] 0 2024-02-15T22:51:04.924 INFO:tasks.workunit.client.0.smithi138.stdout:6/928: creat dc/d4b/f145 x:0 0 0 2024-02-15T22:51:04.925 INFO:tasks.workunit.client.0.smithi138.stdout:6/929: truncate dc/d24/f2c 4045949 0 2024-02-15T22:51:04.926 INFO:tasks.workunit.client.0.smithi138.stdout:6/930: fdatasync dc/d24/d34/d3b/d7c/fad 0 2024-02-15T22:51:04.926 INFO:tasks.workunit.client.0.smithi138.stdout:6/931: read - dc/d4b/d98/dd6/f129 zero size 2024-02-15T22:51:04.927 INFO:tasks.workunit.client.0.smithi138.stdout:6/932: mkdir dc/d12b/dd1/d146 0 2024-02-15T22:51:04.929 INFO:tasks.workunit.client.0.smithi138.stdout:6/933: unlink dc/d24/d34/d3b/d7c/d9f/ca7 0 2024-02-15T22:51:04.931 INFO:tasks.workunit.client.0.smithi138.stdout:1/746: rmdir df/d1b/d1d 39 2024-02-15T22:51:04.933 INFO:tasks.workunit.client.0.smithi138.stdout:1/747: symlink df/d41/de8/leb 0 2024-02-15T22:51:04.936 INFO:tasks.workunit.client.0.smithi138.stdout:6/934: write dc/d24/d34/d3b/d7c/da8/ff1 [2180031,112572] 0 2024-02-15T22:51:04.936 INFO:tasks.workunit.client.0.smithi138.stdout:6/935: chown dc/d24/fd7 5036 1 2024-02-15T22:51:04.942 INFO:tasks.workunit.client.0.smithi138.stdout:1/748: dread fa [0,4194304] 0 2024-02-15T22:51:04.942 INFO:tasks.workunit.client.0.smithi138.stdout:1/749: fdatasync df/f14 0 2024-02-15T22:51:04.943 INFO:tasks.workunit.client.0.smithi138.stdout:1/750: link df/d1b/d1d/d24/fc6 df/d1b/d1d/fec 0 2024-02-15T22:51:04.944 INFO:tasks.workunit.client.0.smithi138.stdout:1/751: mknod df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/ced 0 2024-02-15T22:51:04.953 INFO:tasks.workunit.client.0.smithi138.stdout:8/921: sync 2024-02-15T22:51:04.954 INFO:tasks.workunit.client.0.smithi138.stdout:8/922: creat db/d15/db6/df2/d13/d77/d8f/f128 x:0 0 0 2024-02-15T22:51:04.955 INFO:tasks.workunit.client.0.smithi138.stdout:6/936: dwrite dc/d4b/ff3 [0,4194304] 0 2024-02-15T22:51:04.957 INFO:tasks.workunit.client.0.smithi138.stdout:6/937: mkdir dc/d12b/dd1/d146/d147 0 2024-02-15T22:51:04.957 INFO:tasks.workunit.client.0.smithi138.stdout:6/938: truncate dc/d4b/d98/fb2 800857 0 2024-02-15T22:51:04.963 INFO:tasks.workunit.client.0.smithi138.stdout:1/752: dwrite df/d1b/d1d/d24/fcc [0,4194304] 0 2024-02-15T22:51:04.976 INFO:tasks.workunit.client.0.smithi138.stdout:6/939: dwrite dc/d24/d6c/dbc/de7/fe6 [0,4194304] 0 2024-02-15T22:51:04.980 INFO:tasks.workunit.client.0.smithi138.stdout:6/940: mkdir dc/d24/d34/dde/d148 0 2024-02-15T22:51:04.982 INFO:tasks.workunit.client.0.smithi138.stdout:1/753: dwrite df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f [0,4194304] 0 2024-02-15T22:51:04.989 INFO:tasks.workunit.client.0.smithi138.stdout:6/941: unlink dc/d24/d34/f5c 0 2024-02-15T22:51:04.998 INFO:tasks.workunit.client.0.smithi138.stdout:6/942: chown dc/d24/d34/d3b/dda/d13c 1 1 2024-02-15T22:51:04.998 INFO:tasks.workunit.client.0.smithi138.stdout:6/943: dread - dc/d12b/d123/f144 zero size 2024-02-15T22:51:04.999 INFO:tasks.workunit.client.0.smithi138.stdout:1/754: dwrite df/d1b/d1d/d25/d2e/d6c/f94 [0,4194304] 0 2024-02-15T22:51:04.999 INFO:tasks.workunit.client.0.smithi138.stdout:1/755: write df/d1b/d1d/d25/d2e/f84 [5656698,112356] 0 2024-02-15T22:51:04.999 INFO:tasks.workunit.client.0.smithi138.stdout:1/756: read df/d41/ddb/f9d [2991768,31976] 0 2024-02-15T22:51:04.999 INFO:tasks.workunit.client.0.smithi138.stdout:1/757: dread - df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/fea zero size 2024-02-15T22:51:04.999 INFO:tasks.workunit.client.0.smithi138.stdout:1/758: dread df/d1b/f27 [0,4194304] 0 2024-02-15T22:51:05.001 INFO:tasks.workunit.client.0.smithi138.stdout:1/759: mkdir df/d1b/dee 0 2024-02-15T22:51:05.001 INFO:tasks.workunit.client.0.smithi138.stdout:1/760: readlink df/d1b/d21/d4f/ldd 0 2024-02-15T22:51:05.001 INFO:tasks.workunit.client.0.smithi138.stdout:1/761: write df/d41/ddb/f9d [375807,44946] 0 2024-02-15T22:51:05.008 INFO:tasks.workunit.client.0.smithi138.stdout:6/944: dread dc/d24/d6c/fef [0,4194304] 0 2024-02-15T22:51:05.010 INFO:tasks.workunit.client.0.smithi138.stdout:6/945: symlink dc/d4b/dba/d10b/l149 0 2024-02-15T22:51:05.012 INFO:tasks.workunit.client.0.smithi138.stdout:6/946: creat dc/d4b/dba/dff/d12d/f14a x:0 0 0 2024-02-15T22:51:05.023 INFO:tasks.workunit.client.0.smithi138.stdout:6/947: dread dc/d24/d34/d3b/d66/f74 [0,4194304] 0 2024-02-15T22:51:05.023 INFO:tasks.workunit.client.0.smithi138.stdout:6/948: readlink dc/d24/d34/d3b/d7d/l7e 0 2024-02-15T22:51:05.023 INFO:tasks.workunit.client.0.smithi138.stdout:1/762: dwrite df/d1b/d1d/d25/d2e/d5b/d65/d80/fd6 [0,4194304] 0 2024-02-15T22:51:05.027 INFO:tasks.workunit.client.0.smithi138.stdout:1/763: rename df/d1b/d1d/c5a to df/d1b/cef 0 2024-02-15T22:51:05.030 INFO:tasks.workunit.client.0.smithi138.stdout:1/764: rename df/d41/de8/leb to df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/lf0 0 2024-02-15T22:51:05.031 INFO:tasks.workunit.client.0.smithi138.stdout:6/949: dread dc/f15 [0,4194304] 0 2024-02-15T22:51:05.032 INFO:tasks.workunit.client.0.smithi138.stdout:1/765: mknod df/d1b/d1d/d25/d2e/d5b/d65/d86/cf1 0 2024-02-15T22:51:05.032 INFO:tasks.workunit.client.0.smithi138.stdout:1/766: fsync df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f 0 2024-02-15T22:51:05.034 INFO:tasks.workunit.client.0.smithi138.stdout:6/950: symlink dc/d24/d34/d3b/d7c/l14b 0 2024-02-15T22:51:05.037 INFO:tasks.workunit.client.0.smithi138.stdout:6/951: symlink dc/d4b/dba/l14c 0 2024-02-15T22:51:05.037 INFO:tasks.workunit.client.0.smithi138.stdout:6/952: creat dc/d4b/dba/dff/d12d/f14d x:0 0 0 2024-02-15T22:51:05.039 INFO:tasks.workunit.client.0.smithi138.stdout:6/953: mknod dc/d4b/dba/dff/d137/c14e 0 2024-02-15T22:51:05.045 INFO:tasks.workunit.client.0.smithi138.stdout:1/767: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a 0 2024-02-15T22:51:05.045 INFO:tasks.workunit.client.0.smithi138.stdout:1/768: getdents df 0 2024-02-15T22:51:05.045 INFO:tasks.workunit.client.0.smithi138.stdout:1/769: readlink df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/lf0 0 2024-02-15T22:51:05.048 INFO:tasks.workunit.client.0.smithi138.stdout:4/965: sync 2024-02-15T22:51:05.048 INFO:tasks.workunit.client.0.smithi138.stdout:2/974: sync 2024-02-15T22:51:05.050 INFO:tasks.workunit.client.0.smithi138.stdout:2/975: creat d0/da/d19/d53/d80/dba/f14e x:0 0 0 2024-02-15T22:51:05.050 INFO:tasks.workunit.client.0.smithi138.stdout:2/976: stat d0/da/d19/d3f/f137 0 2024-02-15T22:51:05.052 INFO:tasks.workunit.client.0.smithi138.stdout:6/954: write dc/d24/d34/d3b/d7d/fae [3523960,21271] 0 2024-02-15T22:51:05.052 INFO:tasks.workunit.client.0.smithi138.stdout:6/955: fdatasync dc/d24/d34/d3b/f109 0 2024-02-15T22:51:05.055 INFO:tasks.workunit.client.0.smithi138.stdout:6/956: read dc/d24/d6c/ddb/fdc [1159909,76720] 0 2024-02-15T22:51:05.056 INFO:tasks.workunit.client.0.smithi138.stdout:6/957: symlink dc/d24/df4/l14f 0 2024-02-15T22:51:05.056 INFO:tasks.workunit.client.0.smithi138.stdout:6/958: dread - dc/d24/d34/d3b/d7c/da8/f128 zero size 2024-02-15T22:51:05.057 INFO:tasks.workunit.client.0.smithi138.stdout:6/959: readlink dc/d24/d34/d3b/l59 0 2024-02-15T22:51:05.057 INFO:tasks.workunit.client.0.smithi138.stdout:6/960: mknod dc/d4b/d98/dd6/c150 0 2024-02-15T22:51:05.059 INFO:tasks.workunit.client.0.smithi138.stdout:1/770: dread df/d1b/d1d/d25/d2e/d5b/d65/d80/fa8 [0,4194304] 0 2024-02-15T22:51:05.059 INFO:tasks.workunit.client.0.smithi138.stdout:4/966: write d17/d1e/d2d/d124/f12b [1579254,123668] 0 2024-02-15T22:51:05.060 INFO:tasks.workunit.client.0.smithi138.stdout:6/961: rename dc/d24/d34/d3b/d7c/da8/c11e to dc/d4b/d98/c151 0 2024-02-15T22:51:05.060 INFO:tasks.workunit.client.0.smithi138.stdout:6/962: getdents dc/d76/d96 0 2024-02-15T22:51:05.063 INFO:tasks.workunit.client.0.smithi138.stdout:6/963: symlink dc/d24/d34/d3b/d7d/l152 0 2024-02-15T22:51:05.063 INFO:tasks.workunit.client.0.smithi138.stdout:4/967: rmdir d17/d1e/d2d/d36/d3e/daf 39 2024-02-15T22:51:05.071 INFO:tasks.workunit.client.0.smithi138.stdout:2/977: dwrite d0/da/df6/fc5 [0,4194304] 0 2024-02-15T22:51:05.073 INFO:tasks.workunit.client.0.smithi138.stdout:2/978: mknod d0/da/dca/c14f 0 2024-02-15T22:51:05.075 INFO:tasks.workunit.client.0.smithi138.stdout:2/979: link d0/da/d19/d53/d5d/d6d/d7b/da3/c132 d0/da/d19/d53/c150 0 2024-02-15T22:51:05.084 INFO:tasks.workunit.client.0.smithi138.stdout:2/980: dread d0/da/f9c [0,4194304] 0 2024-02-15T22:51:05.084 INFO:tasks.workunit.client.0.smithi138.stdout:1/771: dwrite df/d1b/d1d/d25/f42 [0,4194304] 0 2024-02-15T22:51:05.084 INFO:tasks.workunit.client.0.smithi138.stdout:2/981: fsync d0/da/d19/d53/d5d/d83/fc0 0 2024-02-15T22:51:05.084 INFO:tasks.workunit.client.0.smithi138.stdout:2/982: fdatasync d0/da/d19/d3f/d10d/f149 0 2024-02-15T22:51:05.085 INFO:tasks.workunit.client.0.smithi138.stdout:4/968: dwrite d17/d1e/d56/f5c [0,4194304] 0 2024-02-15T22:51:05.087 INFO:tasks.workunit.client.0.smithi138.stdout:2/983: creat d0/da/dca/f151 x:0 0 0 2024-02-15T22:51:05.087 INFO:tasks.workunit.client.0.smithi138.stdout:2/984: chown d0/f1 2 1 2024-02-15T22:51:05.088 INFO:tasks.workunit.client.0.smithi138.stdout:1/772: creat df/d1b/dee/ff2 x:0 0 0 2024-02-15T22:51:05.088 INFO:tasks.workunit.client.0.smithi138.stdout:1/773: dread - df/fe1 zero size 2024-02-15T22:51:05.092 INFO:tasks.workunit.client.0.smithi138.stdout:4/969: mknod d17/d1e/d2d/dd5/d121/d78/c13b 0 2024-02-15T22:51:05.092 INFO:tasks.workunit.client.0.smithi138.stdout:6/964: dwrite dc/d24/d34/d3b/d7c/fe2 [0,4194304] 0 2024-02-15T22:51:05.095 INFO:tasks.workunit.client.0.smithi138.stdout:2/985: rename d0/da/f9e to d0/da/d19/d53/d80/dba/f152 0 2024-02-15T22:51:05.102 INFO:tasks.workunit.client.0.smithi138.stdout:2/986: rename d0/da/d19/d53/l64 to d0/da/d19/l153 0 2024-02-15T22:51:05.102 INFO:tasks.workunit.client.0.smithi138.stdout:2/987: chown d0/dd/d15/de3/d148 240 1 2024-02-15T22:51:05.102 INFO:tasks.workunit.client.0.smithi138.stdout:2/988: dread - d0/da/d19/d53/d5d/d83/d8a/dc2/f13e zero size 2024-02-15T22:51:05.103 INFO:tasks.workunit.client.0.smithi138.stdout:6/965: rmdir dc/d4b/dba/dff/d12d 39 2024-02-15T22:51:05.109 INFO:tasks.workunit.client.0.smithi138.stdout:0/876: sync 2024-02-15T22:51:05.109 INFO:tasks.workunit.client.0.smithi138.stdout:5/788: sync 2024-02-15T22:51:05.110 INFO:tasks.workunit.client.0.smithi138.stdout:0/877: truncate d6/d10/d18/fa7 5838696 0 2024-02-15T22:51:05.110 INFO:tasks.workunit.client.0.smithi138.stdout:0/878: chown d6/d10/d52/d6f/d85/f126 4 1 2024-02-15T22:51:05.110 INFO:tasks.workunit.client.0.smithi138.stdout:1/774: dwrite df/d1b/d1d/d25/d2e/d6c/f94 [0,4194304] 0 2024-02-15T22:51:05.112 INFO:tasks.workunit.client.0.smithi138.stdout:4/970: dwrite d17/d1e/d2d/d8c/fea [0,4194304] 0 2024-02-15T22:51:05.112 INFO:tasks.workunit.client.0.smithi138.stdout:0/879: getdents d6/d10/d52/d6f 0 2024-02-15T22:51:05.112 INFO:tasks.workunit.client.0.smithi138.stdout:0/880: creat d6/d10/d18/d57/d8d/f137 x:0 0 0 2024-02-15T22:51:05.112 INFO:tasks.workunit.client.0.smithi138.stdout:5/789: rmdir df/d18/d3e/d60/d65/dc2 39 2024-02-15T22:51:05.114 INFO:tasks.workunit.client.0.smithi138.stdout:2/989: dread d0/ff8 [0,4194304] 0 2024-02-15T22:51:05.114 INFO:tasks.workunit.client.0.smithi138.stdout:8/923: sync 2024-02-15T22:51:05.116 INFO:tasks.workunit.client.0.smithi138.stdout:1/775: creat df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/ff3 x:0 0 0 2024-02-15T22:51:05.116 INFO:tasks.workunit.client.0.smithi138.stdout:8/924: dread db/d15/d70/f7a [0,4194304] 0 2024-02-15T22:51:05.116 INFO:tasks.workunit.client.0.smithi138.stdout:8/925: fsync db/ff 0 2024-02-15T22:51:05.119 INFO:tasks.workunit.client.0.smithi138.stdout:4/971: rename d17/d1e/d2d/d36/d3e/d64/l6b to d17/d1e/d2d/d36/dca/da3/dee/d11b/l13c 0 2024-02-15T22:51:05.120 INFO:tasks.workunit.client.0.smithi138.stdout:0/881: fsync d6/f7a 0 2024-02-15T22:51:05.121 INFO:tasks.workunit.client.0.smithi138.stdout:5/790: creat df/d18/d3e/d8a/f106 x:0 0 0 2024-02-15T22:51:05.121 INFO:tasks.workunit.client.0.smithi138.stdout:5/791: stat df/d18/d3e/d60/d72/f7d 0 2024-02-15T22:51:05.121 INFO:tasks.workunit.client.0.smithi138.stdout:2/990: rmdir d0/da/d19/d53/d5d/d83 39 2024-02-15T22:51:05.123 INFO:tasks.workunit.client.0.smithi138.stdout:1/776: symlink df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/lf4 0 2024-02-15T22:51:05.123 INFO:tasks.workunit.client.0.smithi138.stdout:1/777: chown df/d1b/fb4 1120989 1 2024-02-15T22:51:05.125 INFO:tasks.workunit.client.0.smithi138.stdout:4/972: creat d17/d1e/d2d/dd5/d121/d78/dc0/f13d x:0 0 0 2024-02-15T22:51:05.126 INFO:tasks.workunit.client.0.smithi138.stdout:0/882: symlink d6/d10/d52/d6f/l138 0 2024-02-15T22:51:05.127 INFO:tasks.workunit.client.0.smithi138.stdout:4/973: dread d17/d1e/d56/fc5 [0,4194304] 0 2024-02-15T22:51:05.127 INFO:tasks.workunit.client.0.smithi138.stdout:5/792: symlink df/d18/d3e/d60/d65/d7c/dad/l107 0 2024-02-15T22:51:05.128 INFO:tasks.workunit.client.0.smithi138.stdout:5/793: chown df/d18/d3e/d66/de2 3 1 2024-02-15T22:51:05.130 INFO:tasks.workunit.client.0.smithi138.stdout:2/991: rename d0/da/d19/d53/d5d/d83/d8a/d103 to d0/dd/d15/de3/d148/d154 0 2024-02-15T22:51:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:2/992: dread d0/da/d19/d53/d5d/d83/d8a/fe1 [0,4194304] 0 2024-02-15T22:51:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:4/974: creat d17/d1e/d2d/d36/dca/da3/dee/f13e x:0 0 0 2024-02-15T22:51:05.135 INFO:tasks.workunit.client.0.smithi138.stdout:2/993: symlink d0/da/d19/d53/d5d/d74/de9/l155 0 2024-02-15T22:51:05.136 INFO:tasks.workunit.client.0.smithi138.stdout:4/975: mkdir d17/d1e/d56/d13f 0 2024-02-15T22:51:05.137 INFO:tasks.workunit.client.0.smithi138.stdout:8/926: dwrite db/d15/db6/df2/d13/d19/d6b/f108 [0,4194304] 0 2024-02-15T22:51:05.138 INFO:tasks.workunit.client.0.smithi138.stdout:0/883: dread d6/f6d [0,4194304] 0 2024-02-15T22:51:05.139 INFO:tasks.workunit.client.0.smithi138.stdout:2/994: creat d0/dd/d15/d72/d114/f156 x:0 0 0 2024-02-15T22:51:05.146 INFO:tasks.workunit.client.0.smithi138.stdout:1/778: dread df/d1b/d1d/d24/d3a/f77 [0,4194304] 0 2024-02-15T22:51:05.146 INFO:tasks.workunit.client.0.smithi138.stdout:8/927: rename db/d15/f17 to db/d15/db6/df2/f129 0 2024-02-15T22:51:05.146 INFO:tasks.workunit.client.0.smithi138.stdout:8/928: rename db/d15/db6/df2/d4d to db/d15/db6/df2/d4d/dd6/d12a 22 2024-02-15T22:51:05.146 INFO:tasks.workunit.client.0.smithi138.stdout:5/794: dwrite df/f83 [0,4194304] 0 2024-02-15T22:51:05.149 INFO:tasks.workunit.client.0.smithi138.stdout:1/779: creat df/d1b/d1d/d25/ff5 x:0 0 0 2024-02-15T22:51:05.151 INFO:tasks.workunit.client.0.smithi138.stdout:8/929: rename db/d15/db6/df2/fcc to db/d15/daa/df0/f12b 0 2024-02-15T22:51:05.152 INFO:tasks.workunit.client.0.smithi138.stdout:2/995: rmdir d0/da/d19/d53/d5d/dcc 39 2024-02-15T22:51:05.152 INFO:tasks.workunit.client.0.smithi138.stdout:4/976: dwrite d17/d1a/daa/fb9 [0,4194304] 0 2024-02-15T22:51:05.156 INFO:tasks.workunit.client.0.smithi138.stdout:1/780: unlink df/d1b/d1d/d25/la1 0 2024-02-15T22:51:05.157 INFO:tasks.workunit.client.0.smithi138.stdout:2/996: dread d0/da/d19/d53/d5d/d83/d8a/fe1 [0,4194304] 0 2024-02-15T22:51:05.157 INFO:tasks.workunit.client.0.smithi138.stdout:2/997: write d0/da/d19/d53/d5d/d6d/f113 [427106,3959] 0 2024-02-15T22:51:05.160 INFO:tasks.workunit.client.0.smithi138.stdout:0/884: rename d6/d10/d18/d1b/f3a to d6/d10/d75/db1/f139 0 2024-02-15T22:51:05.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/930: symlink db/da0/l12c 0 2024-02-15T22:51:05.162 INFO:tasks.workunit.client.0.smithi138.stdout:8/931: write db/d15/db6/df2/fce [4195959,14469] 0 2024-02-15T22:51:05.162 INFO:tasks.workunit.client.0.smithi138.stdout:0/885: dread d6/d10/d18/fa7 [4194304,4194304] 0 2024-02-15T22:51:05.162 INFO:tasks.workunit.client.0.smithi138.stdout:0/886: getdents d6/d10/d52/d6f/df9 0 2024-02-15T22:51:05.165 INFO:tasks.workunit.client.0.smithi138.stdout:5/795: dwrite df/d18/d3e/d66/f79 [0,4194304] 0 2024-02-15T22:51:05.165 INFO:tasks.workunit.client.0.smithi138.stdout:5/796: readlink df/l74 0 2024-02-15T22:51:05.165 INFO:tasks.workunit.client.0.smithi138.stdout:4/977: unlink d17/d1e/d2d/ccc 0 2024-02-15T22:51:05.167 INFO:tasks.workunit.client.0.smithi138.stdout:2/998: mkdir d0/da/d19/d53/d5d/d83/d157 0 2024-02-15T22:51:05.170 INFO:tasks.workunit.client.0.smithi138.stdout:2/999: dread d0/da/d19/d53/d80/dba/fcb [0,4194304] 0 2024-02-15T22:51:05.170 INFO:tasks.workunit.client.0.smithi138.stdout:0/887: creat d6/d10/d75/dfc/f13a x:0 0 0 2024-02-15T22:51:05.171 INFO:tasks.workunit.client.0.smithi138.stdout:8/932: write db/d15/db6/df2/f47 [7754391,25426] 0 2024-02-15T22:51:05.172 INFO:tasks.workunit.client.0.smithi138.stdout:8/933: creat db/d15/db6/df2/d4d/de5/f12d x:0 0 0 2024-02-15T22:51:05.172 INFO:tasks.workunit.client.0.smithi138.stdout:4/978: symlink d17/d1e/db8/l140 0 2024-02-15T22:51:05.174 INFO:tasks.workunit.client.0.smithi138.stdout:0/888: mknod d6/d10/d18/d6e/c13b 0 2024-02-15T22:51:05.177 INFO:tasks.workunit.client.0.smithi138.stdout:5/797: dread df/f2e [0,4194304] 0 2024-02-15T22:51:05.177 INFO:tasks.workunit.client.0.smithi138.stdout:0/889: link d6/c98 d6/d10/d13/d3d/dc6/c13c 0 2024-02-15T22:51:05.177 INFO:tasks.workunit.client.0.smithi138.stdout:5/798: creat df/d18/d3e/d60/d65/d7f/d9d/f108 x:0 0 0 2024-02-15T22:51:05.178 INFO:tasks.workunit.client.0.smithi138.stdout:5/799: unlink df/d18/d3e/d60/d65/cac 0 2024-02-15T22:51:05.179 INFO:tasks.workunit.client.0.smithi138.stdout:5/800: unlink df/d18/d3e/d66/f79 0 2024-02-15T22:51:05.181 INFO:tasks.workunit.client.0.smithi138.stdout:5/801: dread df/f16 [0,4194304] 0 2024-02-15T22:51:05.181 INFO:tasks.workunit.client.0.smithi138.stdout:5/802: truncate df/d18/d3e/d60/d72/fbd 1086453 0 2024-02-15T22:51:05.182 INFO:tasks.workunit.client.0.smithi138.stdout:5/803: write df/d18/d3e/d51/dc9/f4d [852629,33257] 0 2024-02-15T22:51:05.183 INFO:tasks.workunit.client.0.smithi138.stdout:8/934: dread db/d15/db6/df2/d13/f79 [0,4194304] 0 2024-02-15T22:51:05.189 INFO:tasks.workunit.client.0.smithi138.stdout:0/890: write d6/d10/d40/f91 [545082,21582] 0 2024-02-15T22:51:05.195 INFO:tasks.workunit.client.0.smithi138.stdout:4/979: dwrite d17/d1e/d2d/d36/dca/da3/d11e/fe8 [0,4194304] 0 2024-02-15T22:51:05.199 INFO:tasks.workunit.client.0.smithi138.stdout:4/980: mkdir d17/d1e/d2d/d36/dca/da3/dbf/d123/d141 0 2024-02-15T22:51:05.201 INFO:tasks.workunit.client.0.smithi138.stdout:4/981: creat d17/d1e/d2d/f142 x:0 0 0 2024-02-15T22:51:05.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/982: rmdir d17/d1e/d56/d13f 0 2024-02-15T22:51:05.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/983: readlink d17/d1e/d2d/dd5/d121/dd8/l103 0 2024-02-15T22:51:05.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/984: chown d17/d1e/d2d/d36/dca/da3/dbf 3 1 2024-02-15T22:51:05.203 INFO:tasks.workunit.client.0.smithi138.stdout:4/985: stat d17/d1e/d2d/dc7/f102 0 2024-02-15T22:51:05.204 INFO:tasks.workunit.client.0.smithi138.stdout:4/986: truncate d17/d1e/d2d/d8c/fc6 709915 0 2024-02-15T22:51:05.206 INFO:tasks.workunit.client.0.smithi138.stdout:0/891: dwrite d6/dba/f10a [0,4194304] 0 2024-02-15T22:51:05.206 INFO:tasks.workunit.client.0.smithi138.stdout:0/892: truncate d6/d10/d18/d1b/f121 722351 0 2024-02-15T22:51:05.209 INFO:tasks.workunit.client.0.smithi138.stdout:0/893: getdents d6/d10/d34/df6 0 2024-02-15T22:51:05.218 INFO:tasks.workunit.client.0.smithi138.stdout:0/894: dread d6/d10/d13/f69 [0,4194304] 0 2024-02-15T22:51:05.220 INFO:tasks.workunit.client.0.smithi138.stdout:4/987: dwrite d17/d1e/d2d/f142 [0,4194304] 0 2024-02-15T22:51:05.223 INFO:tasks.workunit.client.0.smithi138.stdout:4/988: mknod d17/d1e/d2d/dd5/d121/d78/dc0/c143 0 2024-02-15T22:51:05.223 INFO:tasks.workunit.client.0.smithi138.stdout:4/989: creat d17/d1e/f144 x:0 0 0 2024-02-15T22:51:05.223 INFO:tasks.workunit.client.0.smithi138.stdout:4/990: creat d17/d1e/d2d/dd5/d121/dd8/d107/f145 x:0 0 0 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: pgmap v15: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 179 MiB/s rd, 209 MiB/s wr, 292 op/s 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:05.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:04 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:05.237 INFO:tasks.workunit.client.0.smithi138.stdout:0/895: dwrite d6/d10/d40/f43 [4194304,4194304] 0 2024-02-15T22:51:05.239 INFO:tasks.workunit.client.0.smithi138.stdout:0/896: mkdir d6/d10/d18/d6e/df8/d13d 0 2024-02-15T22:51:05.239 INFO:tasks.workunit.client.0.smithi138.stdout:0/897: chown d6/d10/l3c 296005382 1 2024-02-15T22:51:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: pgmap v15: 65 pgs: 65 active+clean; 1.7 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 179 MiB/s rd, 209 MiB/s wr, 292 op/s 2024-02-15T22:51:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:51:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:04 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:05.290 INFO:tasks.workunit.client.0.smithi138.stdout:5/804: dwrite df/d18/d3e/f41 [0,4194304] 0 2024-02-15T22:51:05.290 INFO:tasks.workunit.client.0.smithi138.stdout:5/805: fdatasync df/f2e 0 2024-02-15T22:51:05.291 INFO:tasks.workunit.client.0.smithi138.stdout:5/806: dread - df/d18/fe0 zero size 2024-02-15T22:51:05.291 INFO:tasks.workunit.client.0.smithi138.stdout:5/807: mkdir df/d18/d56/dae/d109 0 2024-02-15T22:51:05.291 INFO:tasks.workunit.client.0.smithi138.stdout:5/808: chown df/d18/d77/fca 284 1 2024-02-15T22:51:05.292 INFO:tasks.workunit.client.0.smithi138.stdout:5/809: chown df/d18/d3e/d8a/cd9 9677912 1 2024-02-15T22:51:05.292 INFO:tasks.workunit.client.0.smithi138.stdout:5/810: write df/f13 [741412,113016] 0 2024-02-15T22:51:05.293 INFO:tasks.workunit.client.0.smithi138.stdout:5/811: truncate df/d18/d3e/d66/d82/f94 2324144 0 2024-02-15T22:51:05.294 INFO:tasks.workunit.client.0.smithi138.stdout:5/812: mkdir df/d18/d3e/d51/dc9/d10a 0 2024-02-15T22:51:05.295 INFO:tasks.workunit.client.0.smithi138.stdout:5/813: mkdir df/d18/d3e/d66/de2/d10b 0 2024-02-15T22:51:05.297 INFO:tasks.workunit.client.0.smithi138.stdout:0/898: dwrite d6/fb [0,4194304] 0 2024-02-15T22:51:05.297 INFO:tasks.workunit.client.0.smithi138.stdout:4/991: dwrite d17/d1e/d2d/d36/d3e/daf/f13a [0,4194304] 0 2024-02-15T22:51:05.298 INFO:tasks.workunit.client.0.smithi138.stdout:8/935: dwrite db/d15/db6/df2/d13/f3b [0,4194304] 0 2024-02-15T22:51:05.299 INFO:tasks.workunit.client.0.smithi138.stdout:0/899: truncate d6/d10/d18/d57/fd0 3686 0 2024-02-15T22:51:05.299 INFO:tasks.workunit.client.0.smithi138.stdout:0/900: fsync d6/d10/d34/fe4 0 2024-02-15T22:51:05.299 INFO:tasks.workunit.client.0.smithi138.stdout:0/901: truncate d6/d10/d52/d72/f8c 5201481 0 2024-02-15T22:51:05.301 INFO:tasks.workunit.client.0.smithi138.stdout:8/936: dread db/d15/d70/f7a [0,4194304] 0 2024-02-15T22:51:05.314 INFO:tasks.workunit.client.0.smithi138.stdout:0/902: rename d6/f42 to d6/d10/f13e 0 2024-02-15T22:51:05.314 INFO:tasks.workunit.client.0.smithi138.stdout:0/903: dread - d6/d10/d18/d6e/df8/f133 zero size 2024-02-15T22:51:05.316 INFO:tasks.workunit.client.0.smithi138.stdout:4/992: mknod d17/c146 0 2024-02-15T22:51:05.318 INFO:tasks.workunit.client.0.smithi138.stdout:4/993: rename d17/d1e/d2d/d36/d3e/fb4 to d17/d1e/d2d/d36/dca/da3/dee/f147 0 2024-02-15T22:51:05.318 INFO:tasks.workunit.client.0.smithi138.stdout:4/994: getdents d17/d1e/d2d/d36/dca/da3/dbf/d123/d141 0 2024-02-15T22:51:05.318 INFO:tasks.workunit.client.0.smithi138.stdout:4/995: dread - d17/d1e/d2d/d36/dca/da3/dfd/f12d zero size 2024-02-15T22:51:05.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/937: dwrite db/d15/db6/df2/d13/d19/d6b/dba/f121 [0,4194304] 0 2024-02-15T22:51:05.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/938: write db/d15/db6/df2/f47 [3308250,32109] 0 2024-02-15T22:51:05.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/939: truncate db/d15/db6/df2/d13/d19/d6b/dba/fe7 391353 0 2024-02-15T22:51:05.320 INFO:tasks.workunit.client.0.smithi138.stdout:8/940: stat db/d15/db6/df2/d13/d77/d8f/fff 0 2024-02-15T22:51:05.320 INFO:tasks.workunit.client.0.smithi138.stdout:5/814: dwrite df/d18/d56/dae/fcd [0,4194304] 0 2024-02-15T22:51:05.321 INFO:tasks.workunit.client.0.smithi138.stdout:8/941: symlink db/d15/db6/df2/d4d/d11b/l12e 0 2024-02-15T22:51:05.332 INFO:tasks.workunit.client.0.smithi138.stdout:4/996: dread d17/d1e/d2d/d36/dca/da3/dee/f147 [0,4194304] 0 2024-02-15T22:51:05.332 INFO:tasks.workunit.client.0.smithi138.stdout:4/997: read d17/d1e/d2d/d36/dca/da3/dfd/f122 [105946,21325] 0 2024-02-15T22:51:05.332 INFO:tasks.workunit.client.0.smithi138.stdout:4/998: dread - d17/d1e/d2d/dd5/fdf zero size 2024-02-15T22:51:05.332 INFO:tasks.workunit.client.0.smithi138.stdout:4/999: write d17/d1e/d2d/d36/dca/da3/dbf/f11d [584560,93628] 0 2024-02-15T22:51:05.333 INFO:tasks.workunit.client.0.smithi138.stdout:8/942: dread db/d15/db6/df2/d13/f21 [0,4194304] 0 2024-02-15T22:51:05.333 INFO:tasks.workunit.client.0.smithi138.stdout:5/815: truncate df/d18/d3e/d60/f64 1099245 0 2024-02-15T22:51:05.334 INFO:tasks.workunit.client.0.smithi138.stdout:5/816: truncate df/d18/f84 5155639 0 2024-02-15T22:51:05.335 INFO:tasks.workunit.client.0.smithi138.stdout:5/817: rename df/d18/d3e/cb9 to df/d18/d56/dc6/c10c 0 2024-02-15T22:51:05.336 INFO:tasks.workunit.client.0.smithi138.stdout:5/818: truncate df/d18/d3e/d60/d65/d7f/d90/fdb 660478 0 2024-02-15T22:51:05.343 INFO:tasks.workunit.client.0.smithi138.stdout:8/943: read db/d15/db6/df2/d13/f3b [2871351,61039] 0 2024-02-15T22:51:05.344 INFO:tasks.workunit.client.0.smithi138.stdout:0/904: dwrite d6/d10/f73 [0,4194304] 0 2024-02-15T22:51:05.345 INFO:tasks.workunit.client.0.smithi138.stdout:8/944: mknod db/d15/d70/d7c/d92/c12f 0 2024-02-15T22:51:05.345 INFO:tasks.workunit.client.0.smithi138.stdout:8/945: chown db/d15/db6/df2/d22/f56 205 1 2024-02-15T22:51:05.349 INFO:tasks.workunit.client.0.smithi138.stdout:0/905: dread d6/d10/d40/f91 [0,4194304] 0 2024-02-15T22:51:05.350 INFO:tasks.workunit.client.0.smithi138.stdout:0/906: creat d6/d10/d75/f13f x:0 0 0 2024-02-15T22:51:05.350 INFO:tasks.workunit.client.0.smithi138.stdout:0/907: fdatasync d6/d10/d52/f101 0 2024-02-15T22:51:05.350 INFO:tasks.workunit.client.0.smithi138.stdout:0/908: chown d6/d10/d64/lac 1341011431 1 2024-02-15T22:51:05.351 INFO:tasks.workunit.client.0.smithi138.stdout:6/966: sync 2024-02-15T22:51:05.352 INFO:tasks.workunit.client.0.smithi138.stdout:5/819: dwrite df/d18/d3e/d66/d82/f94 [0,4194304] 0 2024-02-15T22:51:05.355 INFO:tasks.workunit.client.0.smithi138.stdout:6/967: rename dc/d4b/ff3 to dc/d4b/dba/dff/d12d/f153 0 2024-02-15T22:51:05.356 INFO:tasks.workunit.client.0.smithi138.stdout:8/946: dread db/d15/db6/df2/f4e [0,4194304] 0 2024-02-15T22:51:05.356 INFO:tasks.workunit.client.0.smithi138.stdout:8/947: fdatasync db/d15/daa/fd5 0 2024-02-15T22:51:05.361 INFO:tasks.workunit.client.0.smithi138.stdout:5/820: mknod df/d18/d3e/d60/d65/c10d 0 2024-02-15T22:51:05.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/948: creat db/d15/d70/d7c/d92/f130 x:0 0 0 2024-02-15T22:51:05.363 INFO:tasks.workunit.client.0.smithi138.stdout:8/949: chown db/d15/db6/df2/d13/d19/d7d/db2/l11d 3160 1 2024-02-15T22:51:05.363 INFO:tasks.workunit.client.0.smithi138.stdout:5/821: mkdir df/d18/d3e/d60/de1/d10e 0 2024-02-15T22:51:05.365 INFO:tasks.workunit.client.0.smithi138.stdout:5/822: rename df/d18/d3e/d60/f7a to df/d18/d3e/d60/d65/d7f/d9d/f10f 0 2024-02-15T22:51:05.369 INFO:tasks.workunit.client.0.smithi138.stdout:0/909: dwrite d6/d10/d13/d3d/fbc [0,4194304] 0 2024-02-15T22:51:05.369 INFO:tasks.workunit.client.0.smithi138.stdout:0/910: write d6/d10/d75/db1/f139 [4936985,59518] 0 2024-02-15T22:51:05.369 INFO:tasks.workunit.client.0.smithi138.stdout:0/911: stat d6/d10 0 2024-02-15T22:51:05.370 INFO:tasks.workunit.client.0.smithi138.stdout:0/912: readlink d6/d10/d52/d6f/lbe 0 2024-02-15T22:51:05.373 INFO:tasks.workunit.client.0.smithi138.stdout:1/781: sync 2024-02-15T22:51:05.373 INFO:tasks.workunit.client.0.smithi138.stdout:1/782: truncate df/d1b/d1d/d25/d2e/d37/f9c 539563 0 2024-02-15T22:51:05.376 INFO:tasks.workunit.client.0.smithi138.stdout:1/783: dread df/d1b/d1d/f35 [0,4194304] 0 2024-02-15T22:51:05.376 INFO:tasks.workunit.client.0.smithi138.stdout:0/913: dread d6/d10/d18/f1d [4194304,4194304] 0 2024-02-15T22:51:05.376 INFO:tasks.workunit.client.0.smithi138.stdout:6/968: dwrite dc/d4b/d7b/fce [0,4194304] 0 2024-02-15T22:51:05.378 INFO:tasks.workunit.client.0.smithi138.stdout:0/914: mknod d6/d10/d52/d72/c140 0 2024-02-15T22:51:05.378 INFO:tasks.workunit.client.0.smithi138.stdout:0/915: write d6/d10/d13/d3d/dc6/fd1 [1545142,99443] 0 2024-02-15T22:51:05.379 INFO:tasks.workunit.client.0.smithi138.stdout:1/784: mknod df/d1b/d1d/d25/d2e/d5b/d65/cf6 0 2024-02-15T22:51:05.384 INFO:tasks.workunit.client.0.smithi138.stdout:6/969: rmdir dc/d24/d34 39 2024-02-15T22:51:05.385 INFO:tasks.workunit.client.0.smithi138.stdout:1/785: creat df/d1b/d1d/d25/d2e/d5b/d7b/ff7 x:0 0 0 2024-02-15T22:51:05.385 INFO:tasks.workunit.client.0.smithi138.stdout:8/950: dwrite db/d15/db6/df2/d13/d19/f97 [0,4194304] 0 2024-02-15T22:51:05.387 INFO:tasks.workunit.client.0.smithi138.stdout:6/970: rename dc/d24/d34/d3b/f64 to dc/d4b/dba/d10b/f154 0 2024-02-15T22:51:05.397 INFO:tasks.workunit.client.0.smithi138.stdout:0/916: dwrite d6/d10/d52/f107 [4194304,4194304] 0 2024-02-15T22:51:05.397 INFO:tasks.workunit.client.0.smithi138.stdout:5/823: dwrite df/d18/d3e/d51/dc9/d9c/daf/fd3 [0,4194304] 0 2024-02-15T22:51:05.400 INFO:tasks.workunit.client.0.smithi138.stdout:8/951: dread db/d15/db6/df2/d4d/f8d [0,4194304] 0 2024-02-15T22:51:05.402 INFO:tasks.workunit.client.0.smithi138.stdout:8/952: rmdir db/d15/db6/df2/d13/d19/d6b/dba 39 2024-02-15T22:51:05.403 INFO:tasks.workunit.client.0.smithi138.stdout:8/953: mknod db/d15/db6/d106/c131 0 2024-02-15T22:51:05.404 INFO:tasks.workunit.client.0.smithi138.stdout:8/954: dread - db/d15/db6/df2/d13/fe9 zero size 2024-02-15T22:51:05.410 INFO:tasks.workunit.client.0.smithi138.stdout:1/786: dwrite df/d1b/dee/ff2 [0,4194304] 0 2024-02-15T22:51:05.411 INFO:tasks.workunit.client.0.smithi138.stdout:0/917: dread d6/d10/d75/db1/fae [0,4194304] 0 2024-02-15T22:51:05.411 INFO:tasks.workunit.client.0.smithi138.stdout:0/918: readlink d6/d10/d52/le6 0 2024-02-15T22:51:05.414 INFO:tasks.workunit.client.0.smithi138.stdout:0/919: rename d6/d10/d13/d3d/dc6/f119 to d6/d10/d18/d57/d8d/d124/f141 0 2024-02-15T22:51:05.421 INFO:tasks.workunit.client.0.smithi138.stdout:5/824: dwrite df/d18/d56/f5a [0,4194304] 0 2024-02-15T22:51:05.428 INFO:tasks.workunit.client.0.smithi138.stdout:8/955: dwrite db/d15/db6/df2/d13/d19/d6b/dba/ffb [0,4194304] 0 2024-02-15T22:51:05.428 INFO:tasks.workunit.client.0.smithi138.stdout:8/956: chown db/d15/db6/df2/d13/d77/d8f/f128 1 1 2024-02-15T22:51:05.428 INFO:tasks.workunit.client.0.smithi138.stdout:8/957: chown db/d15/db6/df2/d13/d19/d6b/lea 426 1 2024-02-15T22:51:05.430 INFO:tasks.workunit.client.0.smithi138.stdout:8/958: mknod db/d15/db6/df2/d4d/dd6/dfd/c132 0 2024-02-15T22:51:05.430 INFO:tasks.workunit.client.0.smithi138.stdout:8/959: stat db/d15/d70/c6a 0 2024-02-15T22:51:05.431 INFO:tasks.workunit.client.0.smithi138.stdout:8/960: creat db/d15/db6/df2/d4d/dd6/dfd/f133 x:0 0 0 2024-02-15T22:51:05.432 INFO:tasks.workunit.client.0.smithi138.stdout:5/825: write df/f83 [3853274,94795] 0 2024-02-15T22:51:05.434 INFO:tasks.workunit.client.0.smithi138.stdout:8/961: rename db/d15/d70/fc3 to db/d15/db6/df2/d13/d77/d8f/f134 0 2024-02-15T22:51:05.435 INFO:tasks.workunit.client.0.smithi138.stdout:8/962: mknod db/d15/db6/df2/d4d/c135 0 2024-02-15T22:51:05.437 INFO:tasks.workunit.client.0.smithi138.stdout:8/963: rename db/d15/d70/d7c/d92/f57 to db/d15/d70/d7c/d92/de6/f136 0 2024-02-15T22:51:05.437 INFO:tasks.workunit.client.0.smithi138.stdout:8/964: write db/ff [7937431,94028] 0 2024-02-15T22:51:05.437 INFO:tasks.workunit.client.0.smithi138.stdout:8/965: chown db/da0/de8/ff8 1 1 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:0/920: dwrite d6/d10/d18/d1b/fe7 [0,4194304] 0 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/826: dread df/d18/d3e/d60/d65/d7f/fc3 [0,4194304] 0 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/827: dread - df/d18/d56/dc6/fef zero size 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/828: chown df/d18/d3e/d51/dc9/d9c/daf 144 1 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/829: fsync df/d18/d3e/f4e 0 2024-02-15T22:51:05.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/830: truncate df/d18/d3e/d60/f8f 4209497 0 2024-02-15T22:51:05.439 INFO:tasks.workunit.client.0.smithi138.stdout:1/787: dwrite df/d1b/d1d/d25/d2e/d5b/d65/fcd [4194304,4194304] 0 2024-02-15T22:51:05.444 INFO:tasks.workunit.client.0.smithi138.stdout:1/788: mknod df/d1b/d1d/d25/d2e/d5b/d65/d86/cf8 0 2024-02-15T22:51:05.447 INFO:tasks.workunit.client.0.smithi138.stdout:1/789: read df/d1b/d1d/f28 [847596,69077] 0 2024-02-15T22:51:05.460 INFO:tasks.workunit.client.0.smithi138.stdout:0/921: dwrite d6/d10/d13/f69 [4194304,4194304] 0 2024-02-15T22:51:05.463 INFO:tasks.workunit.client.0.smithi138.stdout:8/966: dwrite db/d15/db6/df2/f123 [0,4194304] 0 2024-02-15T22:51:05.465 INFO:tasks.workunit.client.0.smithi138.stdout:8/967: link db/d15/db6/df2/d13/d19/l63 db/d15/db6/d106/l137 0 2024-02-15T22:51:05.465 INFO:tasks.workunit.client.0.smithi138.stdout:8/968: stat db/d15/db6/df2/d13/d19/fbb 0 2024-02-15T22:51:05.466 INFO:tasks.workunit.client.0.smithi138.stdout:8/969: mkdir db/d15/d138 0 2024-02-15T22:51:05.467 INFO:tasks.workunit.client.0.smithi138.stdout:8/970: rmdir db/d15/d70/d7c/d92/de6 39 2024-02-15T22:51:05.468 INFO:tasks.workunit.client.0.smithi138.stdout:8/971: mkdir db/d15/db6/df2/d13/d77/d139 0 2024-02-15T22:51:05.468 INFO:tasks.workunit.client.0.smithi138.stdout:1/790: dwrite df/d1b/d1d/d24/d3a/f71 [0,4194304] 0 2024-02-15T22:51:05.468 INFO:tasks.workunit.client.0.smithi138.stdout:8/972: fdatasync db/d15/db6/df2/d13/d77/d8f/fff 0 2024-02-15T22:51:05.468 INFO:tasks.workunit.client.0.smithi138.stdout:8/973: write db/d15/db6/df2/d13/d19/d6b/dba/f121 [5147438,35129] 0 2024-02-15T22:51:05.469 INFO:tasks.workunit.client.0.smithi138.stdout:1/791: mknod df/d1b/d1d/d25/d8d/cf9 0 2024-02-15T22:51:05.471 INFO:tasks.workunit.client.0.smithi138.stdout:8/974: rename db/d15/db6/df2/d13/d77/d8f/l110 to db/d15/db6/df2/d4d/dd6/l13a 0 2024-02-15T22:51:05.479 INFO:tasks.workunit.client.0.smithi138.stdout:0/922: dwrite d6/f7a [0,4194304] 0 2024-02-15T22:51:05.480 INFO:tasks.workunit.client.0.smithi138.stdout:0/923: symlink d6/d10/d18/d57/l142 0 2024-02-15T22:51:05.481 INFO:tasks.workunit.client.0.smithi138.stdout:0/924: write d6/d10/d13/d3d/dc6/fd1 [1507790,1053] 0 2024-02-15T22:51:05.482 INFO:tasks.workunit.client.0.smithi138.stdout:0/925: write d6/d10/d34/dcf/d111/f12c [579090,43378] 0 2024-02-15T22:51:05.490 INFO:tasks.workunit.client.0.smithi138.stdout:1/792: dwrite df/d41/ddb/fb1 [0,4194304] 0 2024-02-15T22:51:05.490 INFO:tasks.workunit.client.0.smithi138.stdout:8/975: dwrite db/d15/db6/df2/d13/d19/d6b/f100 [0,4194304] 0 2024-02-15T22:51:05.492 INFO:tasks.workunit.client.0.smithi138.stdout:1/793: rename df/l13 to df/d1b/d1d/d25/d2e/lfa 0 2024-02-15T22:51:05.494 INFO:tasks.workunit.client.0.smithi138.stdout:8/976: symlink db/d15/db6/df2/d4d/dd6/l13b 0 2024-02-15T22:51:05.494 INFO:tasks.workunit.client.0.smithi138.stdout:8/977: chown db/d15/db6/df2/d13/d19/d6b/d105/l8e 0 1 2024-02-15T22:51:05.495 INFO:tasks.workunit.client.0.smithi138.stdout:1/794: mknod df/d1b/d1d/d25/cfb 0 2024-02-15T22:51:05.499 INFO:tasks.workunit.client.0.smithi138.stdout:0/926: dwrite d6/d10/d40/f74 [0,4194304] 0 2024-02-15T22:51:05.501 INFO:tasks.workunit.client.0.smithi138.stdout:1/795: dread df/d1b/d1d/d25/d2e/f84 [0,4194304] 0 2024-02-15T22:51:05.504 INFO:tasks.workunit.client.0.smithi138.stdout:1/796: read df/d1b/d21/d4f/f9f [171519,1677] 0 2024-02-15T22:51:05.505 INFO:tasks.workunit.client.0.smithi138.stdout:1/797: truncate df/d1b/d1d/d25/d2e/d37/f3e 108025 0 2024-02-15T22:51:05.505 INFO:tasks.workunit.client.0.smithi138.stdout:1/798: chown fa 522715 1 2024-02-15T22:51:05.505 INFO:tasks.workunit.client.0.smithi138.stdout:1/799: stat df/d1b/d1d/d24/ddf 0 2024-02-15T22:51:05.506 INFO:tasks.workunit.client.0.smithi138.stdout:1/800: mknod df/d1b/d1d/d25/d2e/d37/cfc 0 2024-02-15T22:51:05.506 INFO:tasks.workunit.client.0.smithi138.stdout:1/801: fdatasync df/d1b/d1d/d24/d3a/f44 0 2024-02-15T22:51:05.506 INFO:tasks.workunit.client.0.smithi138.stdout:1/802: chown df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a 1444286 1 2024-02-15T22:51:05.507 INFO:tasks.workunit.client.0.smithi138.stdout:1/803: rename df/d1b/d1d/d25/d2e/d6c to df/d1b/d21/d4f/dfd 0 2024-02-15T22:51:05.508 INFO:tasks.workunit.client.0.smithi138.stdout:1/804: rename df/l5d to df/d1b/d1d/d25/d2e/d5b/d65/d80/lfe 0 2024-02-15T22:51:05.510 INFO:tasks.workunit.client.0.smithi138.stdout:1/805: creat df/d1b/fff x:0 0 0 2024-02-15T22:51:05.512 INFO:tasks.workunit.client.0.smithi138.stdout:1/806: unlink df/d1b/d1d/d24/d3a/l50 0 2024-02-15T22:51:05.512 INFO:tasks.workunit.client.0.smithi138.stdout:1/807: stat df/d1b/d21/d4f/dfd/la5 0 2024-02-15T22:51:05.512 INFO:tasks.workunit.client.0.smithi138.stdout:1/808: write df/d1b/d1d/d25/d8d/fd7 [790082,122178] 0 2024-02-15T22:51:05.513 INFO:tasks.workunit.client.0.smithi138.stdout:1/809: rmdir df/d1b/d1d/d25/d2e/d5b/d65 39 2024-02-15T22:51:05.514 INFO:tasks.workunit.client.0.smithi138.stdout:1/810: creat df/d1b/d1d/d24/ddf/f100 x:0 0 0 2024-02-15T22:51:05.515 INFO:tasks.workunit.client.0.smithi138.stdout:8/978: dwrite db/d15/daa/fd5 [0,4194304] 0 2024-02-15T22:51:05.515 INFO:tasks.workunit.client.0.smithi138.stdout:1/811: symlink df/d1b/l101 0 2024-02-15T22:51:05.516 INFO:tasks.workunit.client.0.smithi138.stdout:8/979: rmdir db/d15/daa/df0 39 2024-02-15T22:51:05.517 INFO:tasks.workunit.client.0.smithi138.stdout:8/980: dread - db/d15/db6/df2/d13/d19/d6b/fb4 zero size 2024-02-15T22:51:05.517 INFO:tasks.workunit.client.0.smithi138.stdout:1/812: truncate df/f14 3793390 0 2024-02-15T22:51:05.519 INFO:tasks.workunit.client.0.smithi138.stdout:0/927: dwrite d6/d10/f13e [0,4194304] 0 2024-02-15T22:51:05.519 INFO:tasks.workunit.client.0.smithi138.stdout:0/928: chown d6 14209551 1 2024-02-15T22:51:05.519 INFO:tasks.workunit.client.0.smithi138.stdout:8/981: rename db/d15/daa/df0/f12b to db/d15/db6/df2/d13/d19/d6b/dba/df7/f13c 0 2024-02-15T22:51:05.520 INFO:tasks.workunit.client.0.smithi138.stdout:1/813: mknod df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/c102 0 2024-02-15T22:51:05.520 INFO:tasks.workunit.client.0.smithi138.stdout:1/814: chown df/d41 10535996 1 2024-02-15T22:51:05.521 INFO:tasks.workunit.client.0.smithi138.stdout:0/929: mknod d6/d10/d18/d57/d8d/c143 0 2024-02-15T22:51:05.524 INFO:tasks.workunit.client.0.smithi138.stdout:8/982: rmdir db/d15/d70/d7c/d92/de6 39 2024-02-15T22:51:05.526 INFO:tasks.workunit.client.0.smithi138.stdout:0/930: mknod d6/d10/d64/c144 0 2024-02-15T22:51:05.535 INFO:tasks.workunit.client.0.smithi138.stdout:1/815: dwrite df/d1b/d1d/d25/d2e/fcf [0,4194304] 0 2024-02-15T22:51:05.535 INFO:tasks.workunit.client.0.smithi138.stdout:1/816: read - df/d1b/d1d/d25/d2e/fe6 zero size 2024-02-15T22:51:05.538 INFO:tasks.workunit.client.0.smithi138.stdout:8/983: symlink db/d15/d70/d7c/d92/de6/l13d 0 2024-02-15T22:51:05.541 INFO:tasks.workunit.client.0.smithi138.stdout:0/931: rename d6/d10/d13/d3d to d6/d10/d75/d145 0 2024-02-15T22:51:05.543 INFO:tasks.workunit.client.0.smithi138.stdout:1/817: rename fe to df/d1b/d21/d4f/dfd/f103 0 2024-02-15T22:51:05.559 INFO:tasks.workunit.client.0.smithi138.stdout:0/932: dwrite d6/d10/d52/f97 [0,4194304] 0 2024-02-15T22:51:05.574 INFO:tasks.workunit.client.0.smithi138.stdout:0/933: dwrite d6/d10/d64/faf [0,4194304] 0 2024-02-15T22:51:05.574 INFO:tasks.workunit.client.0.smithi138.stdout:0/934: write d6/d10/d34/f3b [3316025,96063] 0 2024-02-15T22:51:05.575 INFO:tasks.workunit.client.0.smithi138.stdout:1/818: rename df/d1b/d1d/caa to df/d1b/d1d/d24/d3a/c104 0 2024-02-15T22:51:05.579 INFO:tasks.workunit.client.0.smithi138.stdout:0/935: link d6/d10/d64/fc9 d6/d10/d18/d57/d8d/d124/f146 0 2024-02-15T22:51:05.579 INFO:tasks.workunit.client.0.smithi138.stdout:0/936: dread - d6/d10/d75/db1/f127 zero size 2024-02-15T22:51:05.579 INFO:tasks.workunit.client.0.smithi138.stdout:0/937: creat d6/d10/f147 x:0 0 0 2024-02-15T22:51:05.580 INFO:tasks.workunit.client.0.smithi138.stdout:1/819: symlink df/d41/l105 0 2024-02-15T22:51:05.582 INFO:tasks.workunit.client.0.smithi138.stdout:0/938: truncate d6/d10/d40/f91 2583483 0 2024-02-15T22:51:05.583 INFO:tasks.workunit.client.0.smithi138.stdout:1/820: truncate df/f53 8360218 0 2024-02-15T22:51:05.583 INFO:tasks.workunit.client.0.smithi138.stdout:1/821: dread - df/d1b/d1d/d24/fc6 zero size 2024-02-15T22:51:05.583 INFO:tasks.workunit.client.0.smithi138.stdout:1/822: chown df/d1b/d21/f32 40 1 2024-02-15T22:51:05.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/939: link d6/c9f d6/d10/d34/dcf/d111/c148 0 2024-02-15T22:51:05.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/940: truncate d6/d10/d52/d6f/fd8 875238 0 2024-02-15T22:51:05.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/941: readlink d6/d10/d75/d145/dd2/d116/l130 0 2024-02-15T22:51:05.586 INFO:tasks.workunit.client.0.smithi138.stdout:0/942: fsync d6/d10/d34/df6/fd9 0 2024-02-15T22:51:05.587 INFO:tasks.workunit.client.0.smithi138.stdout:0/943: getdents d6/d10/d64 0 2024-02-15T22:51:05.587 INFO:tasks.workunit.client.0.smithi138.stdout:0/944: dread - d6/d10/d75/f13f zero size 2024-02-15T22:51:05.588 INFO:tasks.workunit.client.0.smithi138.stdout:0/945: write d6/f6b [4999928,49121] 0 2024-02-15T22:51:05.595 INFO:tasks.workunit.client.0.smithi138.stdout:1/823: write df/d1b/d1d/d25/d2e/d37/f9c [636097,34173] 0 2024-02-15T22:51:05.595 INFO:tasks.workunit.client.0.smithi138.stdout:1/824: dread - df/d1b/d1d/d25/d2e/d5b/d65/fcb zero size 2024-02-15T22:51:05.597 INFO:tasks.workunit.client.0.smithi138.stdout:1/825: link df/d1b/d1d/d25/d2e/d37/f9c df/d1b/d1d/d25/f106 0 2024-02-15T22:51:05.598 INFO:tasks.workunit.client.0.smithi138.stdout:1/826: symlink df/d1b/d1d/d24/l107 0 2024-02-15T22:51:05.620 INFO:tasks.workunit.client.0.smithi138.stdout:1/827: dwrite df/d1b/d1d/d25/f106 [0,4194304] 0 2024-02-15T22:51:05.620 INFO:tasks.workunit.client.0.smithi138.stdout:1/828: chown df/d1b/d1d/d25/d2e/d37 637462 1 2024-02-15T22:51:05.622 INFO:tasks.workunit.client.0.smithi138.stdout:1/829: rename df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/c6a to df/d1b/d1d/d25/d2e/d5b/c108 0 2024-02-15T22:51:05.622 INFO:tasks.workunit.client.0.smithi138.stdout:1/830: readlink df/d1b/d1d/d25/l2d 0 2024-02-15T22:51:05.622 INFO:tasks.workunit.client.0.smithi138.stdout:1/831: write df/f12 [4312069,60055] 0 2024-02-15T22:51:05.623 INFO:tasks.workunit.client.0.smithi138.stdout:1/832: truncate df/d1b/d1d/d25/d2e/d37/f54 3336158 0 2024-02-15T22:51:05.623 INFO:tasks.workunit.client.0.smithi138.stdout:1/833: creat df/d1b/d21/d4f/f109 x:0 0 0 2024-02-15T22:51:05.625 INFO:tasks.workunit.client.0.smithi138.stdout:1/834: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/d10a 0 2024-02-15T22:51:05.625 INFO:tasks.workunit.client.0.smithi138.stdout:1/835: truncate df/d1b/d21/d4f/dfd/f76 1873249 0 2024-02-15T22:51:05.626 INFO:tasks.workunit.client.0.smithi138.stdout:1/836: mknod df/d1b/d1d/c10b 0 2024-02-15T22:51:05.627 INFO:tasks.workunit.client.0.smithi138.stdout:1/837: symlink df/d1b/l10c 0 2024-02-15T22:51:05.665 INFO:tasks.workunit.client.0.smithi138.stdout:6/971: sync 2024-02-15T22:51:05.665 INFO:tasks.workunit.client.0.smithi138.stdout:6/972: getdents dc/d24/d6c/dbc/de7/dd8 0 2024-02-15T22:51:05.671 INFO:tasks.workunit.client.0.smithi138.stdout:6/973: dread dc/d24/d34/f52 [0,4194304] 0 2024-02-15T22:51:05.672 INFO:tasks.workunit.client.0.smithi138.stdout:6/974: mknod dc/d4b/dba/d10b/c155 0 2024-02-15T22:51:05.683 INFO:tasks.workunit.client.0.smithi138.stdout:6/975: write dc/d24/f26 [2169782,68729] 0 2024-02-15T22:51:05.683 INFO:tasks.workunit.client.0.smithi138.stdout:6/976: stat dc/d24/d34/d99/ff6 0 2024-02-15T22:51:05.697 INFO:tasks.workunit.client.0.smithi138.stdout:6/977: dwrite dc/d24/f56 [8388608,4194304] 0 2024-02-15T22:51:05.698 INFO:tasks.workunit.client.0.smithi138.stdout:6/978: mknod dc/d24/d34/d3b/d7c/da8/c156 0 2024-02-15T22:51:05.698 INFO:tasks.workunit.client.0.smithi138.stdout:6/979: chown dc/d24/d34/d3b/l4f 74037226 1 2024-02-15T22:51:05.710 INFO:tasks.workunit.client.0.smithi138.stdout:6/980: dwrite dc/d24/d34/d99/f11a [0,4194304] 0 2024-02-15T22:51:05.713 INFO:tasks.workunit.client.0.smithi138.stdout:6/981: rename dc/d76/lc1 to dc/d4b/dba/l157 0 2024-02-15T22:51:05.713 INFO:tasks.workunit.client.0.smithi138.stdout:6/982: write dc/d12b/dd1/f103 [836209,25028] 0 2024-02-15T22:51:05.714 INFO:tasks.workunit.client.0.smithi138.stdout:6/983: mknod dc/d12b/c158 0 2024-02-15T22:51:05.714 INFO:tasks.workunit.client.0.smithi138.stdout:6/984: chown dc/d24/d6c/dbc/de7/dd8 1012260 1 2024-02-15T22:51:05.714 INFO:tasks.workunit.client.0.smithi138.stdout:6/985: chown dc/d24/d34/d3b/f90 314 1 2024-02-15T22:51:05.722 INFO:tasks.workunit.client.0.smithi138.stdout:6/986: write dc/d24/d34/d3b/d66/f8d [2571906,88129] 0 2024-02-15T22:51:05.738 INFO:tasks.workunit.client.0.smithi138.stdout:6/987: dwrite dc/d24/d34/d3b/d7c/da8/fc0 [0,4194304] 0 2024-02-15T22:51:05.741 INFO:tasks.workunit.client.0.smithi138.stdout:6/988: mknod dc/d24/d34/d3b/d7c/c159 0 2024-02-15T22:51:05.741 INFO:tasks.workunit.client.0.smithi138.stdout:6/989: write dc/d24/d34/d3b/d7c/f92 [587278,100030] 0 2024-02-15T22:51:05.742 INFO:tasks.workunit.client.0.smithi138.stdout:6/990: creat dc/d24/df4/f15a x:0 0 0 2024-02-15T22:51:05.743 INFO:tasks.workunit.client.0.smithi138.stdout:6/991: symlink dc/d12b/d123/l15b 0 2024-02-15T22:51:05.745 INFO:tasks.workunit.client.0.smithi138.stdout:6/992: mkdir dc/d24/d34/d3b/d66/d15c 0 2024-02-15T22:51:05.745 INFO:tasks.workunit.client.0.smithi138.stdout:6/993: write dc/d24/d6c/dbc/de7/f8a [600115,2185] 0 2024-02-15T22:51:05.750 INFO:tasks.workunit.client.0.smithi138.stdout:6/994: truncate dc/d24/d6c/dbc/de7/f8a 18005 0 2024-02-15T22:51:05.750 INFO:tasks.workunit.client.0.smithi138.stdout:6/995: chown dc/d24/d34/d3b/l4f 52577029 1 2024-02-15T22:51:05.752 INFO:tasks.workunit.client.0.smithi138.stdout:6/996: creat dc/d24/d6c/dbc/de7/d113/f15d x:0 0 0 2024-02-15T22:51:05.753 INFO:tasks.workunit.client.0.smithi138.stdout:6/997: symlink dc/d4b/dba/dff/d137/l15e 0 2024-02-15T22:51:05.755 INFO:tasks.workunit.client.0.smithi138.stdout:6/998: unlink dc/d24/d6c/ddb/fdc 0 2024-02-15T22:51:05.755 INFO:tasks.workunit.client.0.smithi138.stdout:6/999: creat dc/d24/d6c/dbc/de7/f15f x:0 0 0 2024-02-15T22:51:05.765 INFO:tasks.workunit.client.0.smithi138.stdout:5/831: sync 2024-02-15T22:51:05.771 INFO:tasks.workunit.client.0.smithi138.stdout:5/832: dread df/f83 [0,4194304] 0 2024-02-15T22:51:05.772 INFO:tasks.workunit.client.0.smithi138.stdout:5/833: read df/d18/f4c [528855,29903] 0 2024-02-15T22:51:05.772 INFO:tasks.workunit.client.0.smithi138.stdout:5/834: chown df/d18/d3e/d66/de2 7 1 2024-02-15T22:51:05.789 INFO:tasks.workunit.client.0.smithi138.stdout:5/835: dwrite df/f2e [0,4194304] 0 2024-02-15T22:51:05.789 INFO:tasks.workunit.client.0.smithi138.stdout:5/836: read - df/d18/fe0 zero size 2024-02-15T22:51:05.789 INFO:tasks.workunit.client.0.smithi138.stdout:5/837: fsync df/f16 0 2024-02-15T22:51:05.791 INFO:tasks.workunit.client.0.smithi138.stdout:5/838: rename df/d18/d3e/d60/d65/d7f/fa7 to df/d18/f110 0 2024-02-15T22:51:05.791 INFO:tasks.workunit.client.0.smithi138.stdout:5/839: mkdir df/d18/d3e/d51/dc9/d10a/d111 0 2024-02-15T22:51:05.800 INFO:tasks.workunit.client.0.smithi138.stdout:8/984: sync 2024-02-15T22:51:05.800 INFO:tasks.workunit.client.0.smithi138.stdout:5/840: dread df/d18/d3e/d60/f8f [0,4194304] 0 2024-02-15T22:51:05.800 INFO:tasks.workunit.client.0.smithi138.stdout:8/985: stat db/d15/db6/df2 0 2024-02-15T22:51:05.800 INFO:tasks.workunit.client.0.smithi138.stdout:8/986: read - db/d15/db6/df2/d22/f8a zero size 2024-02-15T22:51:05.800 INFO:tasks.workunit.client.0.smithi138.stdout:5/841: write df/d18/d3e/d8a/f106 [251228,97182] 0 2024-02-15T22:51:05.801 INFO:tasks.workunit.client.0.smithi138.stdout:8/987: truncate db/d15/d70/d7c/d92/f2c 3620121 0 2024-02-15T22:51:05.817 INFO:tasks.workunit.client.0.smithi138.stdout:5/842: dwrite df/d18/d3e/d60/d65/f67 [0,4194304] 0 2024-02-15T22:51:05.817 INFO:tasks.workunit.client.0.smithi138.stdout:5/843: creat df/d18/d56/dc6/f112 x:0 0 0 2024-02-15T22:51:05.827 INFO:tasks.workunit.client.0.smithi138.stdout:5/844: dread df/d18/f6f [0,4194304] 0 2024-02-15T22:51:05.841 INFO:tasks.workunit.client.0.smithi138.stdout:5/845: dwrite df/d18/d56/dc6/f112 [0,4194304] 0 2024-02-15T22:51:05.843 INFO:tasks.workunit.client.0.smithi138.stdout:5/846: mknod df/d18/d3e/d60/d65/dc2/c113 0 2024-02-15T22:51:05.847 INFO:tasks.workunit.client.0.smithi138.stdout:5/847: dread df/d18/d3e/d60/f8f [0,4194304] 0 2024-02-15T22:51:05.848 INFO:tasks.workunit.client.0.smithi138.stdout:5/848: mkdir df/d18/d3e/d60/d65/d7f/d104/d114 0 2024-02-15T22:51:05.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/849: write df/d18/d3e/d60/d65/d7f/d90/f92 [730132,96665] 0 2024-02-15T22:51:05.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/850: chown df/d18/d3e/d8a/db2 3 1 2024-02-15T22:51:05.855 INFO:tasks.workunit.client.0.smithi138.stdout:1/838: sync 2024-02-15T22:51:05.855 INFO:tasks.workunit.client.0.smithi138.stdout:0/946: sync 2024-02-15T22:51:05.858 INFO:tasks.workunit.client.0.smithi138.stdout:5/851: dread df/f2e [0,4194304] 0 2024-02-15T22:51:05.858 INFO:tasks.workunit.client.0.smithi138.stdout:5/852: dread - df/d18/d3e/d60/d65/d7f/fd2 zero size 2024-02-15T22:51:05.858 INFO:tasks.workunit.client.0.smithi138.stdout:5/853: chown df/d18/d3e/d51 103271297 1 2024-02-15T22:51:05.858 INFO:tasks.workunit.client.0.smithi138.stdout:5/854: fdatasync df/d18/d77/fca 0 2024-02-15T22:51:05.858 INFO:tasks.workunit.client.0.smithi138.stdout:5/855: write df/d18/d3e/d60/d65/d7f/fd2 [17418,26353] 0 2024-02-15T22:51:05.865 INFO:tasks.workunit.client.0.smithi138.stdout:5/856: dread df/d18/d77/fab [0,4194304] 0 2024-02-15T22:51:05.877 INFO:tasks.workunit.client.0.smithi138.stdout:1/839: dwrite df/d1b/d1d/d24/d3a/f9b [0,4194304] 0 2024-02-15T22:51:05.877 INFO:tasks.workunit.client.0.smithi138.stdout:5/857: dread df/d18/d56/f5a [0,4194304] 0 2024-02-15T22:51:05.879 INFO:tasks.workunit.client.0.smithi138.stdout:5/858: mknod df/d18/d3e/d60/de1/d10e/c115 0 2024-02-15T22:51:05.879 INFO:tasks.workunit.client.0.smithi138.stdout:1/840: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d86/d10d 0 2024-02-15T22:51:05.880 INFO:tasks.workunit.client.0.smithi138.stdout:5/859: symlink df/d18/d77/dfb/l116 0 2024-02-15T22:51:05.882 INFO:tasks.workunit.client.0.smithi138.stdout:1/841: link df/d1b/d1d/d25/d8d/cf9 df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/d10a/c10e 0 2024-02-15T22:51:05.882 INFO:tasks.workunit.client.0.smithi138.stdout:0/947: dwrite d6/d10/d34/dcf/fe0 [0,4194304] 0 2024-02-15T22:51:05.882 INFO:tasks.workunit.client.0.smithi138.stdout:0/948: write d6/d10/d13/f69 [8476221,41188] 0 2024-02-15T22:51:05.883 INFO:tasks.workunit.client.0.smithi138.stdout:5/860: rename df/d18/d3e/d60/d65/f67 to df/d18/d3e/d60/d65/d7f/d9d/f117 0 2024-02-15T22:51:05.883 INFO:tasks.workunit.client.0.smithi138.stdout:5/861: write fb [3625830,83181] 0 2024-02-15T22:51:05.896 INFO:tasks.workunit.client.0.smithi138.stdout:0/949: creat d6/d10/d64/dd7/f149 x:0 0 0 2024-02-15T22:51:05.896 INFO:tasks.workunit.client.0.smithi138.stdout:0/950: creat d6/d10/d75/db1/f14a x:0 0 0 2024-02-15T22:51:05.896 INFO:tasks.workunit.client.0.smithi138.stdout:0/951: write d6/dba/f115 [90103,46516] 0 2024-02-15T22:51:05.899 INFO:tasks.workunit.client.0.smithi138.stdout:5/862: unlink df/d18/d3e/d60/d65/d7c/f101 0 2024-02-15T22:51:05.899 INFO:tasks.workunit.client.0.smithi138.stdout:5/863: fsync df/d18/d3e/d51/dc9/d9c/daf/fd3 0 2024-02-15T22:51:05.902 INFO:tasks.workunit.client.0.smithi138.stdout:5/864: dread df/d18/d3e/d51/f5c [0,4194304] 0 2024-02-15T22:51:05.913 INFO:tasks.workunit.client.0.smithi138.stdout:0/952: dwrite d6/d10/f147 [0,4194304] 0 2024-02-15T22:51:05.913 INFO:tasks.workunit.client.0.smithi138.stdout:0/953: fsync d6/d10/d18/d57/d8d/f118 0 2024-02-15T22:51:05.927 INFO:tasks.workunit.client.0.smithi138.stdout:5/865: rmdir df/d18/d77/dfb 39 2024-02-15T22:51:05.936 INFO:tasks.workunit.client.0.smithi138.stdout:1/842: rename df/d1b/d21/d4f to df/d1b/d1d/d24/d10f 0 2024-02-15T22:51:05.937 INFO:tasks.workunit.client.0.smithi138.stdout:5/866: truncate df/f83 3269615 0 2024-02-15T22:51:05.938 INFO:tasks.workunit.client.0.smithi138.stdout:5/867: creat df/d18/d56/dae/d109/f118 x:0 0 0 2024-02-15T22:51:05.945 INFO:tasks.workunit.client.0.smithi138.stdout:1/843: dread df/d1b/d1d/d24/d3a/f9b [0,4194304] 0 2024-02-15T22:51:05.951 INFO:tasks.workunit.client.0.smithi138.stdout:1/844: write df/d1b/d1d/d24/d3a/f9b [1459576,122906] 0 2024-02-15T22:51:06.004 INFO:tasks.workunit.client.0.smithi138.stdout:1/845: dwrite df/d1b/d1d/d24/d3a/f71 [0,4194304] 0 2024-02-15T22:51:06.004 INFO:tasks.workunit.client.0.smithi138.stdout:0/954: dwrite d6/d10/d18/f4b [0,4194304] 0 2024-02-15T22:51:06.028 INFO:tasks.workunit.client.0.smithi138.stdout:1/846: creat df/d1b/d1d/d25/d2e/d5b/d65/d86/f110 x:0 0 0 2024-02-15T22:51:06.028 INFO:tasks.workunit.client.0.smithi138.stdout:1/847: chown df/d1b/dee 0 1 2024-02-15T22:51:06.028 INFO:tasks.workunit.client.0.smithi138.stdout:1/848: readlink df/d1b/d1d/d24/l3b 0 2024-02-15T22:51:06.028 INFO:tasks.workunit.client.0.smithi138.stdout:1/849: fsync df/d1b/d1d/d25/d2e/d5b/d7b/ff7 0 2024-02-15T22:51:06.031 INFO:tasks.workunit.client.0.smithi138.stdout:1/850: symlink df/d1b/d1d/d24/d10f/dfd/l111 0 2024-02-15T22:51:06.031 INFO:tasks.workunit.client.0.smithi138.stdout:1/851: creat df/d1b/d1d/d25/d2e/d5b/d65/d86/f112 x:0 0 0 2024-02-15T22:51:06.032 INFO:tasks.workunit.client.0.smithi138.stdout:0/955: rename d6/d10/d34/df6/fd9 to d6/d10/d75/d102/f14b 0 2024-02-15T22:51:06.033 INFO:tasks.workunit.client.0.smithi138.stdout:8/988: sync 2024-02-15T22:51:06.040 INFO:tasks.workunit.client.0.smithi138.stdout:1/852: write df/d1b/dee/ff2 [3387150,69313] 0 2024-02-15T22:51:06.040 INFO:tasks.workunit.client.0.smithi138.stdout:1/853: rename df/d1b/d21 to df/d1b/d21/d113 22 2024-02-15T22:51:06.041 INFO:tasks.workunit.client.0.smithi138.stdout:1/854: mkdir df/d41/ddb/d114 0 2024-02-15T22:51:06.041 INFO:tasks.workunit.client.0.smithi138.stdout:1/855: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a/f6f 0 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/856: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f 0 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/857: creat df/d1b/f115 x:0 0 0 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/858: write df/d41/ddb/fd4 [714410,23527] 0 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/859: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/fea [789967,91500] 0 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/860: chown df/cbc 5 1 2024-02-15T22:51:06.043 INFO:tasks.workunit.client.0.smithi138.stdout:1/861: write df/d1b/d1d/d24/d3a/f44 [186108,44321] 0 2024-02-15T22:51:06.044 INFO:tasks.workunit.client.0.smithi138.stdout:1/862: creat df/d1b/d1d/d24/d3a/f116 x:0 0 0 2024-02-15T22:51:06.045 INFO:tasks.workunit.client.0.smithi138.stdout:1/863: getdents df/d1b/d1d/d25/d2e/d5b/d65/db8 0 2024-02-15T22:51:06.045 INFO:tasks.workunit.client.0.smithi138.stdout:8/989: dread db/d15/d70/f46 [4194304,4194304] 0 2024-02-15T22:51:06.046 INFO:tasks.workunit.client.0.smithi138.stdout:1/864: creat df/d1b/d1d/d25/d2e/f117 x:0 0 0 2024-02-15T22:51:06.046 INFO:tasks.workunit.client.0.smithi138.stdout:1/865: chown df/d1b/d21 2268 1 2024-02-15T22:51:06.047 INFO:tasks.workunit.client.0.smithi138.stdout:1/866: mknod df/d1b/d1d/c118 0 2024-02-15T22:51:06.047 INFO:tasks.workunit.client.0.smithi138.stdout:1/867: fsync df/d1b/d1d/d25/d2e/d37/f4b 0 2024-02-15T22:51:06.055 INFO:tasks.workunit.client.0.smithi138.stdout:8/990: write db/d15/db6/df2/d13/d19/f83 [3322396,5194] 0 2024-02-15T22:51:06.061 INFO:tasks.workunit.client.0.smithi138.stdout:1/868: dwrite f4 [4194304,4194304] 0 2024-02-15T22:51:06.061 INFO:tasks.workunit.client.0.smithi138.stdout:1/869: truncate df/d1b/d1d/d25/d2e/d5b/d7b/ff7 804836 0 2024-02-15T22:51:06.080 INFO:tasks.workunit.client.0.smithi138.stdout:1/870: dwrite df/d1b/d1d/d25/d2e/d37/f3e [0,4194304] 0 2024-02-15T22:51:06.080 INFO:tasks.workunit.client.0.smithi138.stdout:1/871: creat df/d1b/dee/f119 x:0 0 0 2024-02-15T22:51:06.081 INFO:tasks.workunit.client.0.smithi138.stdout:1/872: stat df/d1b/le7 0 2024-02-15T22:51:06.082 INFO:tasks.workunit.client.0.smithi138.stdout:1/873: truncate df/d1b/d1d/d25/d2e/fcf 3149654 0 2024-02-15T22:51:06.088 INFO:tasks.workunit.client.0.smithi138.stdout:1/874: dread df/d1b/d1d/d25/d2e/d5b/d65/f8c [0,4194304] 0 2024-02-15T22:51:06.089 INFO:tasks.workunit.client.0.smithi138.stdout:1/875: rmdir df/d1b/d1d/d24/ddf 39 2024-02-15T22:51:06.106 INFO:tasks.workunit.client.0.smithi138.stdout:1/876: dwrite df/d1b/d1d/d25/d2e/d5b/d65/d86/fd1 [0,4194304] 0 2024-02-15T22:51:06.106 INFO:tasks.workunit.client.0.smithi138.stdout:1/877: fdatasync df/d1b/d1d/d25/d2e/d5b/fc9 0 2024-02-15T22:51:06.106 INFO:tasks.workunit.client.0.smithi138.stdout:1/878: truncate df/d1b/d1d/d25/d2e/d5b/d65/fb5 593885 0 2024-02-15T22:51:06.121 INFO:tasks.workunit.client.0.smithi138.stdout:1/879: dwrite df/d1b/d21/fb9 [0,4194304] 0 2024-02-15T22:51:06.122 INFO:tasks.workunit.client.0.smithi138.stdout:1/880: rmdir df/d1b/d1d/d25/d8d 39 2024-02-15T22:51:06.123 INFO:tasks.workunit.client.0.smithi138.stdout:1/881: rmdir df/d1b/d1d/d24/d10f 39 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: Adjusting osd_memory_target on smithi138 to 1216M 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:05 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:06.228 INFO:tasks.workunit.client.0.smithi138.stdout:8/991: sync 2024-02-15T22:51:06.229 INFO:tasks.workunit.client.0.smithi138.stdout:1/882: sync 2024-02-15T22:51:06.229 INFO:tasks.workunit.client.0.smithi138.stdout:5/868: sync 2024-02-15T22:51:06.229 INFO:tasks.workunit.client.0.smithi138.stdout:0/956: sync 2024-02-15T22:51:06.230 INFO:tasks.workunit.client.0.smithi138.stdout:5/869: mkdir df/d18/d77/d119 0 2024-02-15T22:51:06.231 INFO:tasks.workunit.client.0.smithi138.stdout:0/957: symlink d6/d10/d75/l14c 0 2024-02-15T22:51:06.232 INFO:tasks.workunit.client.0.smithi138.stdout:8/992: symlink db/d15/db6/df2/d13/l13e 0 2024-02-15T22:51:06.233 INFO:tasks.workunit.client.0.smithi138.stdout:5/870: write df/d18/f6f [2268774,25550] 0 2024-02-15T22:51:06.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/993: mknod db/d15/db6/df2/d22/c13f 0 2024-02-15T22:51:06.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/994: stat db/d15/d70/l74 0 2024-02-15T22:51:06.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/995: write db/d15/db6/df2/f103 [646405,36428] 0 2024-02-15T22:51:06.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/996: fdatasync db/d15/db6/df2/d13/d19/f97 0 2024-02-15T22:51:06.236 INFO:tasks.workunit.client.0.smithi138.stdout:8/997: chown db/d15/db6/df2/d13/f79 300843 1 2024-02-15T22:51:06.237 INFO:tasks.workunit.client.0.smithi138.stdout:5/871: mknod df/d18/d3e/d51/dc9/c11a 0 2024-02-15T22:51:06.238 INFO:tasks.workunit.client.0.smithi138.stdout:1/883: rename df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/d9a to df/d11a 0 2024-02-15T22:51:06.239 INFO:tasks.workunit.client.0.smithi138.stdout:8/998: truncate db/f38 1018492 0 2024-02-15T22:51:06.241 INFO:tasks.workunit.client.0.smithi138.stdout:5/872: rename df/d18/d3e/d51/dc9/l85 to df/d18/d3e/d60/d65/d7c/deb/l11b 0 2024-02-15T22:51:06.242 INFO:tasks.workunit.client.0.smithi138.stdout:8/999: creat db/d15/db6/df2/d13/d19/d6b/dba/df7/f140 x:0 0 0 2024-02-15T22:51:06.244 INFO:tasks.workunit.client.0.smithi138.stdout:0/958: write d6/d10/d75/d102/f10d [1874057,47785] 0 2024-02-15T22:51:06.246 INFO:tasks.workunit.client.0.smithi138.stdout:0/959: mkdir d6/d10/d34/df6/d14d 0 2024-02-15T22:51:06.246 INFO:tasks.workunit.client.0.smithi138.stdout:0/960: chown d6/d10/d75/d145/dc6/d12f 2638725 1 2024-02-15T22:51:06.250 INFO:tasks.workunit.client.0.smithi138.stdout:5/873: dread df/d18/d3e/d51/f6a [0,4194304] 0 2024-02-15T22:51:06.250 INFO:tasks.workunit.client.0.smithi138.stdout:5/874: write df/f11 [4171818,11820] 0 2024-02-15T22:51:06.257 INFO:tasks.workunit.client.0.smithi138.stdout:0/961: dread d6/d10/d18/f1d [0,4194304] 0 2024-02-15T22:51:06.257 INFO:tasks.workunit.client.0.smithi138.stdout:1/884: dwrite df/d1b/d1d/d24/d10f/f109 [0,4194304] 0 2024-02-15T22:51:06.258 INFO:tasks.workunit.client.0.smithi138.stdout:1/885: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 0 2024-02-15T22:51:06.258 INFO:tasks.workunit.client.0.smithi138.stdout:0/962: dread d6/d10/d18/d57/fd0 [0,4194304] 0 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: Adjusting osd_memory_target on smithi138 to 1216M 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:05 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:06.262 INFO:tasks.workunit.client.0.smithi138.stdout:1/886: link df/d1b/d1d/d24/ddf/f100 df/d1b/d1d/d25/d2e/f11b 0 2024-02-15T22:51:06.262 INFO:tasks.workunit.client.0.smithi138.stdout:5/875: write df/d18/d3e/d66/d82/f94 [2013015,58708] 0 2024-02-15T22:51:06.262 INFO:tasks.workunit.client.0.smithi138.stdout:5/876: creat df/f11c x:0 0 0 2024-02-15T22:51:06.263 INFO:tasks.workunit.client.0.smithi138.stdout:5/877: symlink df/d18/d3e/d51/l11d 0 2024-02-15T22:51:06.263 INFO:tasks.workunit.client.0.smithi138.stdout:5/878: chown df/d18/d3e/d60/d65/d7f/d9d/l100 1785 1 2024-02-15T22:51:06.264 INFO:tasks.workunit.client.0.smithi138.stdout:5/879: creat df/d18/d77/dfb/f11e x:0 0 0 2024-02-15T22:51:06.265 INFO:tasks.workunit.client.0.smithi138.stdout:5/880: mkdir df/d18/d3e/d51/dc9/d10a/d11f 0 2024-02-15T22:51:06.268 INFO:tasks.workunit.client.0.smithi138.stdout:1/887: dread df/d1b/d1d/f28 [0,4194304] 0 2024-02-15T22:51:06.269 INFO:tasks.workunit.client.0.smithi138.stdout:1/888: unlink df/d1b/d1d/d24/d3a/c104 0 2024-02-15T22:51:06.270 INFO:tasks.workunit.client.0.smithi138.stdout:1/889: truncate df/d1b/d21/f32 474713 0 2024-02-15T22:51:06.282 INFO:tasks.workunit.client.0.smithi138.stdout:0/963: dwrite d6/d10/d34/dcf/d111/f12c [0,4194304] 0 2024-02-15T22:51:06.284 INFO:tasks.workunit.client.0.smithi138.stdout:0/964: mkdir d6/d10/d52/d6f/d85/d14e 0 2024-02-15T22:51:06.285 INFO:tasks.workunit.client.0.smithi138.stdout:5/881: dwrite df/d18/d3e/d60/d65/d7c/fb0 [0,4194304] 0 2024-02-15T22:51:06.286 INFO:tasks.workunit.client.0.smithi138.stdout:0/965: symlink d6/d10/d18/d57/d8d/l14f 0 2024-02-15T22:51:06.288 INFO:tasks.workunit.client.0.smithi138.stdout:0/966: rmdir d6/d10/d75/d145/dd2/dfb 39 2024-02-15T22:51:06.288 INFO:tasks.workunit.client.0.smithi138.stdout:1/890: dwrite df/fe1 [0,4194304] 0 2024-02-15T22:51:06.289 INFO:tasks.workunit.client.0.smithi138.stdout:5/882: symlink df/d18/d3e/d60/d65/d7f/d90/l120 0 2024-02-15T22:51:06.289 INFO:tasks.workunit.client.0.smithi138.stdout:5/883: fdatasync df/d18/d3e/d51/dc9/f4b 0 2024-02-15T22:51:06.290 INFO:tasks.workunit.client.0.smithi138.stdout:0/967: truncate d6/d10/d18/d1b/f121 341610 0 2024-02-15T22:51:06.293 INFO:tasks.workunit.client.0.smithi138.stdout:1/891: truncate df/d1b/d1d/d25/d2e/d5b/d65/d86/fd1 1294663 0 2024-02-15T22:51:06.295 INFO:tasks.workunit.client.0.smithi138.stdout:5/884: truncate df/d18/d3e/d60/d65/dc2/fdd 3413298 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:0/968: creat d6/d10/d18/d57/f150 x:0 0 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:0/969: write d6/d10/d64/dd7/f149 [232297,62310] 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:1/892: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d11c 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:1/893: chown df/d1b/d1d/d25/d8d/cf9 29053532 1 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:5/885: mkdir df/d18/d3e/d66/de2/d10b/d121 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:0/970: symlink d6/d10/d34/df6/l151 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:5/886: dread df/d18/d3e/d60/d72/fbd [0,4194304] 0 2024-02-15T22:51:06.300 INFO:tasks.workunit.client.0.smithi138.stdout:1/894: rename df/d41/cba to df/d41/ddb/c11d 0 2024-02-15T22:51:06.302 INFO:tasks.workunit.client.0.smithi138.stdout:1/895: creat df/d1b/d1d/d25/d2e/d5b/d65/f11e x:0 0 0 2024-02-15T22:51:06.304 INFO:tasks.workunit.client.0.smithi138.stdout:1/896: dread df/d1b/d1d/f28 [0,4194304] 0 2024-02-15T22:51:06.305 INFO:tasks.workunit.client.0.smithi138.stdout:1/897: rename df/d1b/d1d/d25/d2e/d5b/d7b/caf to df/d1b/d1d/d24/ddf/c11f 0 2024-02-15T22:51:06.307 INFO:tasks.workunit.client.0.smithi138.stdout:1/898: symlink df/d41/ddb/d114/l120 0 2024-02-15T22:51:06.307 INFO:tasks.workunit.client.0.smithi138.stdout:1/899: creat df/d1b/d1d/d25/d2e/d5b/d7b/f121 x:0 0 0 2024-02-15T22:51:06.307 INFO:tasks.workunit.client.0.smithi138.stdout:1/900: readlink df/d1b/d1d/d25/d2e/d5b/d65/d86/la7 0 2024-02-15T22:51:06.307 INFO:tasks.workunit.client.0.smithi138.stdout:1/901: chown df/d1b/d1d/d25/l2d 15035508 1 2024-02-15T22:51:06.309 INFO:tasks.workunit.client.0.smithi138.stdout:1/902: mknod df/d1b/d1d/d24/d3a/c122 0 2024-02-15T22:51:06.309 INFO:tasks.workunit.client.0.smithi138.stdout:1/903: chown df/d1b/d1d/d25/d2e/d5b/d7b/fe3 51 1 2024-02-15T22:51:06.310 INFO:tasks.workunit.client.0.smithi138.stdout:0/971: write d6/d10/d52/d6f/d85/f126 [4156779,101037] 0 2024-02-15T22:51:06.310 INFO:tasks.workunit.client.0.smithi138.stdout:0/972: fsync d6/d10/d18/d57/d8d/d124/f146 0 2024-02-15T22:51:06.318 INFO:tasks.workunit.client.0.smithi138.stdout:1/904: dread df/d1b/d21/fb9 [0,4194304] 0 2024-02-15T22:51:06.319 INFO:tasks.workunit.client.0.smithi138.stdout:0/973: dread d6/d10/d13/fb7 [0,4194304] 0 2024-02-15T22:51:06.321 INFO:tasks.workunit.client.0.smithi138.stdout:0/974: rename d6/d10/d18/d1b/f10b to d6/d10/d18/f152 0 2024-02-15T22:51:06.321 INFO:tasks.workunit.client.0.smithi138.stdout:0/975: creat d6/d10/d18/d6e/f153 x:0 0 0 2024-02-15T22:51:06.321 INFO:tasks.workunit.client.0.smithi138.stdout:0/976: write d6/d10/d40/f74 [3318065,21480] 0 2024-02-15T22:51:06.322 INFO:tasks.workunit.client.0.smithi138.stdout:0/977: chown d6/d10/d52/d6f/lb9 6369144 1 2024-02-15T22:51:06.322 INFO:tasks.workunit.client.0.smithi138.stdout:0/978: truncate d6/d10/d18/d6e/f153 634134 0 2024-02-15T22:51:06.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/887: dwrite df/d18/d77/fca [0,4194304] 0 2024-02-15T22:51:06.322 INFO:tasks.workunit.client.0.smithi138.stdout:5/888: chown df/d18/d3e/d60/d65/dc2/cfd 62403532 1 2024-02-15T22:51:06.322 INFO:tasks.workunit.client.1.smithi170.stderr:++ readlink -f fsstress 2024-02-15T22:51:06.324 INFO:tasks.workunit.client.1.smithi170.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T22:51:06.324 INFO:tasks.workunit.client.1.smithi170.stderr:+ popd 2024-02-15T22:51:06.330 INFO:tasks.workunit.client.0.smithi138.stdout:0/979: symlink d6/l154 0 2024-02-15T22:51:06.330 INFO:tasks.workunit.client.0.smithi138.stdout:1/905: dread df/f12 [0,4194304] 0 2024-02-15T22:51:06.332 INFO:tasks.workunit.client.1.smithi170.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:51:06.332 INFO:tasks.workunit.client.1.smithi170.stderr:+ popd 2024-02-15T22:51:06.333 INFO:tasks.workunit.client.1.smithi170.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-15T22:51:06.333 INFO:tasks.workunit.client.1.smithi170.stderr:++ mktemp -d -p . 2024-02-15T22:51:06.335 INFO:tasks.workunit.client.1.smithi170.stderr:+ T=./tmp.oISZ7cLITq 2024-02-15T22:51:06.335 INFO:tasks.workunit.client.1.smithi170.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.oISZ7cLITq -l 1 -n 1000 -p 10 -v 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.0.smithi138.stdout:1/906: dread df/d1b/fb4 [0,4194304] 0 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.0.smithi138.stdout:1/907: chown df/d1b/d1d/d25/d2e/d5b/d65/f8c 3112162 1 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.0.smithi138.stdout:1/908: getdents df/d1b/d1d/d25/d2e/d5b/d65/d80/d11c 0 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.0.smithi138.stdout:1/909: stat df/d1b/fff 0 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.0.smithi138.stdout:1/910: readlink df/d1b/l101 0 2024-02-15T22:51:06.337 INFO:tasks.workunit.client.1.smithi170.stdout:seed = 1707848813 2024-02-15T22:51:06.338 INFO:tasks.workunit.client.0.smithi138.stdout:1/911: creat df/d41/ddb/f123 x:0 0 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:0/980: write d6/d10/d34/f5a [2232368,27099] 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:0/981: creat d6/d10/d75/db1/f155 x:0 0 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:0/982: write d6/d10/d18/d57/d8d/d124/f146 [989840,55193] 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:0/983: fsync d6/d10/d18/d57/d8d/f137 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:1/912: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e [161238,28157] 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:1/913: creat df/d1b/dee/f124 x:0 0 0 2024-02-15T22:51:06.339 INFO:tasks.workunit.client.0.smithi138.stdout:1/914: readlink df/d41/lc5 0 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/0: truncate - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/1: dwrite - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/2: readlink - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/3: dread - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/4: read - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/5: write - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/6: stat - no entries 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/7: chown . 458 1 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/8: fsync - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/9: dwrite - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/10: fdatasync - no filename 2024-02-15T22:51:06.340 INFO:tasks.workunit.client.1.smithi170.stdout:0/11: unlink - no file 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:0/12: rmdir - no directory 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/0: dread - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/1: dwrite - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/2: rmdir - no directory 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/3: dread - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/4: dwrite - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/5: dread - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/6: write - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/7: fsync - no filename 2024-02-15T22:51:06.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/8: dread - no filename 2024-02-15T22:51:06.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/13: symlink l0 0 2024-02-15T22:51:06.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/14: dwrite - no filename 2024-02-15T22:51:06.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/15: read - no filename 2024-02-15T22:51:06.342 INFO:tasks.workunit.client.1.smithi170.stdout:1/9: symlink l0 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.0.smithi138.stdout:0/984: truncate d6/d10/f68 3173707 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.0.smithi138.stdout:5/889: dwrite df/f13 [0,4194304] 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.0.smithi138.stdout:5/890: truncate df/d18/d56/dae/d109/f118 601646 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.0.smithi138.stdout:5/891: truncate df/d18/d56/dae/fe6 520794 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.0.smithi138.stdout:1/915: truncate df/d1b/d1d/d25/d2e/d5b/d65/d80/f39 1038830 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.1.smithi170.stdout:0/16: creat f1 x:0 0 0 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.1.smithi170.stdout:0/17: chown l0 1049533 1 2024-02-15T22:51:06.343 INFO:tasks.workunit.client.1.smithi170.stdout:0/18: chown l0 562 1 2024-02-15T22:51:06.346 INFO:tasks.workunit.client.1.smithi170.stdout:2/0: mkdir d0 0 2024-02-15T22:51:06.346 INFO:tasks.workunit.client.0.smithi138.stdout:1/916: mkdir df/d41/de8/d125 0 2024-02-15T22:51:06.346 INFO:tasks.workunit.client.1.smithi170.stdout:2/1: write - no filename 2024-02-15T22:51:06.346 INFO:tasks.workunit.client.1.smithi170.stdout:2/2: unlink - no file 2024-02-15T22:51:06.347 INFO:tasks.workunit.client.1.smithi170.stdout:0/19: symlink l2 0 2024-02-15T22:51:06.347 INFO:tasks.workunit.client.1.smithi170.stdout:0/20: stat l0 0 2024-02-15T22:51:06.349 INFO:tasks.workunit.client.0.smithi138.stdout:1/917: getdents df/d1b 0 2024-02-15T22:51:06.349 INFO:tasks.workunit.client.0.smithi138.stdout:1/918: chown df/d1b/d21/l23 20289666 1 2024-02-15T22:51:06.349 INFO:tasks.workunit.client.0.smithi138.stdout:1/919: stat df/f79 0 2024-02-15T22:51:06.349 INFO:tasks.workunit.client.0.smithi138.stdout:1/920: chown df/d1b/d1d/d25/d2e/d5b/d65/d80/fa8 96876594 1 2024-02-15T22:51:06.349 INFO:tasks.workunit.client.1.smithi170.stdout:2/3: mkdir d0/d1 0 2024-02-15T22:51:06.350 INFO:tasks.workunit.client.1.smithi170.stdout:3/0: creat f0 x:0 0 0 2024-02-15T22:51:06.350 INFO:tasks.workunit.client.1.smithi170.stdout:3/1: rmdir - no directory 2024-02-15T22:51:06.351 INFO:tasks.workunit.client.0.smithi138.stdout:1/921: creat df/d1b/d1d/d25/d2e/d5b/f126 x:0 0 0 2024-02-15T22:51:06.351 INFO:tasks.workunit.client.0.smithi138.stdout:5/892: read df/d18/d3e/d60/d65/d7f/d9d/f10f [2269265,48086] 0 2024-02-15T22:51:06.352 INFO:tasks.workunit.client.1.smithi170.stdout:5/0: truncate - no filename 2024-02-15T22:51:06.352 INFO:tasks.workunit.client.1.smithi170.stdout:4/0: mkdir d0 0 2024-02-15T22:51:06.352 INFO:tasks.workunit.client.1.smithi170.stdout:4/1: fdatasync - no filename 2024-02-15T22:51:06.352 INFO:tasks.workunit.client.1.smithi170.stdout:4/2: fsync - no filename 2024-02-15T22:51:06.353 INFO:tasks.workunit.client.1.smithi170.stdout:2/4: symlink d0/d1/l2 0 2024-02-15T22:51:06.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/2: mknod c1 0 2024-02-15T22:51:06.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/3: dread - f0 zero size 2024-02-15T22:51:06.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/4: read - f0 zero size 2024-02-15T22:51:06.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/5: creat f2 x:0 0 0 2024-02-15T22:51:06.356 INFO:tasks.workunit.client.1.smithi170.stdout:6/0: dread - no filename 2024-02-15T22:51:06.357 INFO:tasks.workunit.client.1.smithi170.stdout:6/1: write - no filename 2024-02-15T22:51:06.357 INFO:tasks.workunit.client.1.smithi170.stdout:6/2: getdents . 0 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:5/1: creat f0 x:0 0 0 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:5/2: stat f0 0 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:5/3: creat f1 x:0 0 0 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:2/5: rmdir d0/d1 39 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:2/6: dread - no filename 2024-02-15T22:51:06.358 INFO:tasks.workunit.client.1.smithi170.stdout:2/7: chown d0 1378166 1 2024-02-15T22:51:06.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/6: mkdir d3 0 2024-02-15T22:51:06.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/7: chown c1 0 1 2024-02-15T22:51:06.361 INFO:tasks.workunit.client.0.smithi138.stdout:5/893: write df/d18/d3e/d60/d65/d7f/d9d/f117 [1879153,41348] 0 2024-02-15T22:51:06.361 INFO:tasks.workunit.client.0.smithi138.stdout:5/894: chown df/d18/d3e/d60/d65/dc2 1 1 2024-02-15T22:51:06.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/0: fdatasync - no filename 2024-02-15T22:51:06.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/1: dwrite - no filename 2024-02-15T22:51:06.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/2: getdents . 0 2024-02-15T22:51:06.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/3: creat f0 x:0 0 0 2024-02-15T22:51:06.363 INFO:tasks.workunit.client.1.smithi170.stdout:6/4: write f0 [724023,73043] 0 2024-02-15T22:51:06.363 INFO:tasks.workunit.client.1.smithi170.stdout:6/5: creat f1 x:0 0 0 2024-02-15T22:51:06.363 INFO:tasks.workunit.client.0.smithi138.stdout:5/895: mknod df/d18/d3e/d51/c122 0 2024-02-15T22:51:06.364 INFO:tasks.workunit.client.0.smithi138.stdout:5/896: readlink df/d18/d3e/d51/l6c 0 2024-02-15T22:51:06.364 INFO:tasks.workunit.client.1.smithi170.stdout:6/6: write f0 [475264,70840] 0 2024-02-15T22:51:06.364 INFO:tasks.workunit.client.1.smithi170.stdout:5/4: symlink l2 0 2024-02-15T22:51:06.364 INFO:tasks.workunit.client.1.smithi170.stdout:5/5: write f1 [561069,61549] 0 2024-02-15T22:51:06.365 INFO:tasks.workunit.client.1.smithi170.stdout:2/8: creat d0/f3 x:0 0 0 2024-02-15T22:51:06.365 INFO:tasks.workunit.client.0.smithi138.stdout:1/922: dread fa [0,4194304] 0 2024-02-15T22:51:06.365 INFO:tasks.workunit.client.0.smithi138.stdout:5/897: unlink df/d18/l2d 0 2024-02-15T22:51:06.365 INFO:tasks.workunit.client.0.smithi138.stdout:0/985: dwrite d6/d10/d18/d57/d8d/f137 [0,4194304] 0 2024-02-15T22:51:06.365 INFO:tasks.workunit.client.0.smithi138.stdout:5/898: write df/d18/d56/dae/fe6 [58187,44221] 0 2024-02-15T22:51:06.366 INFO:tasks.workunit.client.0.smithi138.stdout:1/923: creat df/d1b/d1d/d25/d8d/f127 x:0 0 0 2024-02-15T22:51:06.366 INFO:tasks.workunit.client.1.smithi170.stdout:3/8: unlink f2 0 2024-02-15T22:51:06.366 INFO:tasks.workunit.client.1.smithi170.stdout:3/9: readlink - no filename 2024-02-15T22:51:06.366 INFO:tasks.workunit.client.1.smithi170.stdout:3/10: dread - f0 zero size 2024-02-15T22:51:06.366 INFO:tasks.workunit.client.1.smithi170.stdout:3/11: chown f0 706 1 2024-02-15T22:51:06.367 INFO:tasks.workunit.client.1.smithi170.stdout:3/12: dread - f0 zero size 2024-02-15T22:51:06.367 INFO:tasks.workunit.client.1.smithi170.stdout:3/13: write f0 [513289,54278] 0 2024-02-15T22:51:06.367 INFO:tasks.workunit.client.1.smithi170.stdout:7/3: symlink l0 0 2024-02-15T22:51:06.367 INFO:tasks.workunit.client.1.smithi170.stdout:7/4: rmdir - no directory 2024-02-15T22:51:06.367 INFO:tasks.workunit.client.0.smithi138.stdout:0/986: symlink d6/d10/d18/d6e/l156 0 2024-02-15T22:51:06.369 INFO:tasks.workunit.client.0.smithi138.stdout:5/899: symlink df/d18/l123 0 2024-02-15T22:51:06.369 INFO:tasks.workunit.client.0.smithi138.stdout:5/900: chown df/d18/d3e/d51/dc9/d9c 0 1 2024-02-15T22:51:06.370 INFO:tasks.workunit.client.0.smithi138.stdout:1/924: link df/d1b/d1d/d25/d2e/d5b/d65/d86/le2 df/d1b/d1d/d25/d2e/l128 0 2024-02-15T22:51:06.371 INFO:tasks.workunit.client.1.smithi170.stdout:3/14: mknod d3/c4 0 2024-02-15T22:51:06.372 INFO:tasks.workunit.client.0.smithi138.stdout:1/925: creat df/d1b/d1d/d25/d2e/d5b/d65/d80/f129 x:0 0 0 2024-02-15T22:51:06.372 INFO:tasks.workunit.client.1.smithi170.stdout:9/0: read - no filename 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/1: link - no file 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/2: truncate - no filename 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/3: dread - no filename 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/4: dread - no filename 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/5: rename - no filename 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/6: rmdir - no directory 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/7: chown . 7385 1 2024-02-15T22:51:06.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/8: dwrite - no filename 2024-02-15T22:51:06.374 INFO:tasks.workunit.client.1.smithi170.stdout:8/0: creat f0 x:0 0 0 2024-02-15T22:51:06.374 INFO:tasks.workunit.client.1.smithi170.stdout:8/1: dread - f0 zero size 2024-02-15T22:51:06.375 INFO:tasks.workunit.client.1.smithi170.stdout:7/5: rename l0 to l1 0 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/6: dwrite - no filename 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/7: write - no filename 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/8: chown l1 174 1 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/9: dwrite - no filename 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/10: write - no filename 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:7/11: dread - no filename 2024-02-15T22:51:06.376 INFO:tasks.workunit.client.1.smithi170.stdout:3/15: dread f0 [0,4194304] 0 2024-02-15T22:51:06.377 INFO:tasks.workunit.client.1.smithi170.stdout:6/7: unlink f1 0 2024-02-15T22:51:06.377 INFO:tasks.workunit.client.1.smithi170.stdout:6/8: creat f2 x:0 0 0 2024-02-15T22:51:06.379 INFO:tasks.workunit.client.1.smithi170.stdout:9/9: creat f0 x:0 0 0 2024-02-15T22:51:06.379 INFO:tasks.workunit.client.1.smithi170.stdout:9/10: dread - f0 zero size 2024-02-15T22:51:06.380 INFO:tasks.workunit.client.0.smithi138.stdout:0/987: write d6/d10/d75/db1/f139 [3379638,37617] 0 2024-02-15T22:51:06.381 INFO:tasks.workunit.client.0.smithi138.stdout:0/988: creat d6/d10/d18/d6e/f157 x:0 0 0 2024-02-15T22:51:06.381 INFO:tasks.workunit.client.1.smithi170.stdout:8/2: rename f0 to f1 0 2024-02-15T22:51:06.381 INFO:tasks.workunit.client.1.smithi170.stdout:8/3: stat f1 0 2024-02-15T22:51:06.381 INFO:tasks.workunit.client.1.smithi170.stdout:8/4: rmdir - no directory 2024-02-15T22:51:06.381 INFO:tasks.workunit.client.1.smithi170.stdout:8/5: dread - f1 zero size 2024-02-15T22:51:06.382 INFO:tasks.workunit.client.0.smithi138.stdout:0/989: rename d6/d10/d75/db1/fae to d6/d10/d75/db1/f158 0 2024-02-15T22:51:06.383 INFO:tasks.workunit.client.0.smithi138.stdout:1/926: dread df/d1b/d1d/d24/d3a/f40 [0,4194304] 0 2024-02-15T22:51:06.384 INFO:tasks.workunit.client.1.smithi170.stdout:3/16: rename f0 to d3/f5 0 2024-02-15T22:51:06.385 INFO:tasks.workunit.client.0.smithi138.stdout:0/990: getdents d6/dba 0 2024-02-15T22:51:06.385 INFO:tasks.workunit.client.0.smithi138.stdout:0/991: chown d6/d10/d13/f69 328 1 2024-02-15T22:51:06.386 INFO:tasks.workunit.client.0.smithi138.stdout:0/992: dread - d6/dba/f12d zero size 2024-02-15T22:51:06.386 INFO:tasks.workunit.client.0.smithi138.stdout:0/993: stat d6/d10/d52/f12a 0 2024-02-15T22:51:06.391 INFO:tasks.workunit.client.1.smithi170.stdout:6/9: mkdir d3 0 2024-02-15T22:51:06.394 INFO:tasks.workunit.client.1.smithi170.stdout:2/9: dwrite d0/f3 [0,4194304] 0 2024-02-15T22:51:06.395 INFO:tasks.workunit.client.1.smithi170.stdout:5/6: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.396 INFO:tasks.workunit.client.1.smithi170.stdout:5/7: truncate f1 1580241 0 2024-02-15T22:51:06.396 INFO:tasks.workunit.client.1.smithi170.stdout:6/10: creat d3/f4 x:0 0 0 2024-02-15T22:51:06.401 INFO:tasks.workunit.client.1.smithi170.stdout:2/10: creat d0/d1/f4 x:0 0 0 2024-02-15T22:51:06.404 INFO:tasks.workunit.client.1.smithi170.stdout:5/8: symlink l3 0 2024-02-15T22:51:06.404 INFO:tasks.workunit.client.1.smithi170.stdout:5/9: chown f1 217756303 1 2024-02-15T22:51:06.417 INFO:tasks.workunit.client.1.smithi170.stdout:2/11: dread d0/f3 [0,4194304] 0 2024-02-15T22:51:06.422 INFO:tasks.workunit.client.1.smithi170.stdout:2/12: dread d0/f3 [0,4194304] 0 2024-02-15T22:51:06.422 INFO:tasks.workunit.client.1.smithi170.stdout:2/13: readlink d0/d1/l2 0 2024-02-15T22:51:06.422 INFO:tasks.workunit.client.1.smithi170.stdout:2/14: readlink d0/d1/l2 0 2024-02-15T22:51:06.423 INFO:tasks.workunit.client.1.smithi170.stdout:2/15: creat d0/d1/f5 x:0 0 0 2024-02-15T22:51:06.423 INFO:tasks.workunit.client.1.smithi170.stdout:2/16: chown d0/d1/f5 0 1 2024-02-15T22:51:06.430 INFO:tasks.workunit.client.1.smithi170.stdout:9/11: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.430 INFO:tasks.workunit.client.1.smithi170.stdout:3/17: dwrite d3/f5 [0,4194304] 0 2024-02-15T22:51:06.430 INFO:tasks.workunit.client.1.smithi170.stdout:5/10: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.431 INFO:tasks.workunit.client.0.smithi138.stdout:5/901: dwrite df/d18/d3e/d60/d65/d7f/d9d/f117 [0,4194304] 0 2024-02-15T22:51:06.431 INFO:tasks.workunit.client.0.smithi138.stdout:0/994: dwrite d6/fb [0,4194304] 0 2024-02-15T22:51:06.431 INFO:tasks.workunit.client.0.smithi138.stdout:5/902: mkdir df/d18/d56/dc6/d124 0 2024-02-15T22:51:06.431 INFO:tasks.workunit.client.0.smithi138.stdout:5/903: write df/d18/d3e/d60/d65/d7f/d90/fdb [1063931,89025] 0 2024-02-15T22:51:06.433 INFO:tasks.workunit.client.0.smithi138.stdout:0/995: rename d6/d10/d75/db1/f155 to d6/d10/d40/f159 0 2024-02-15T22:51:06.435 INFO:tasks.workunit.client.0.smithi138.stdout:5/904: mkdir df/d18/d3e/d125 0 2024-02-15T22:51:06.435 INFO:tasks.workunit.client.1.smithi170.stdout:3/18: creat d3/f6 x:0 0 0 2024-02-15T22:51:06.435 INFO:tasks.workunit.client.1.smithi170.stdout:3/19: fdatasync d3/f6 0 2024-02-15T22:51:06.435 INFO:tasks.workunit.client.1.smithi170.stdout:3/20: dread - d3/f6 zero size 2024-02-15T22:51:06.437 INFO:tasks.workunit.client.0.smithi138.stdout:0/996: link d6/d10/d52/d72/cc3 d6/d10/d52/c15a 0 2024-02-15T22:51:06.438 INFO:tasks.workunit.client.0.smithi138.stdout:5/905: readlink df/d18/d3e/d60/d65/d7f/d90/la3 0 2024-02-15T22:51:06.438 INFO:tasks.workunit.client.1.smithi170.stdout:5/11: write f0 [1260608,96547] 0 2024-02-15T22:51:06.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/12: unlink l3 0 2024-02-15T22:51:06.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/13: creat f4 x:0 0 0 2024-02-15T22:51:06.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/14: rmdir - no directory 2024-02-15T22:51:06.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/21: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:06.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/22: creat d3/f7 x:0 0 0 2024-02-15T22:51:06.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/23: chown d3/c4 5 1 2024-02-15T22:51:06.456 INFO:tasks.workunit.client.1.smithi170.stdout:9/12: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.463 INFO:tasks.workunit.client.1.smithi170.stdout:5/15: dread f1 [0,4194304] 0 2024-02-15T22:51:06.463 INFO:tasks.workunit.client.1.smithi170.stdout:5/16: chown l2 4298532 1 2024-02-15T22:51:06.463 INFO:tasks.workunit.client.1.smithi170.stdout:5/17: rmdir - no directory 2024-02-15T22:51:06.464 INFO:tasks.workunit.client.0.smithi138.stdout:0/997: dwrite d6/f6d [0,4194304] 0 2024-02-15T22:51:06.466 INFO:tasks.workunit.client.0.smithi138.stdout:5/906: dwrite df/f2e [0,4194304] 0 2024-02-15T22:51:06.466 INFO:tasks.workunit.client.0.smithi138.stdout:5/907: truncate df/d18/d3e/d60/d65/d7c/ff6 997492 0 2024-02-15T22:51:06.467 INFO:tasks.workunit.client.1.smithi170.stdout:9/13: read f0 [624911,86999] 0 2024-02-15T22:51:06.467 INFO:tasks.workunit.client.1.smithi170.stdout:3/24: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:06.467 INFO:tasks.workunit.client.1.smithi170.stdout:9/14: write f0 [884610,73750] 0 2024-02-15T22:51:06.467 INFO:tasks.workunit.client.0.smithi138.stdout:0/998: creat d6/d10/d75/d145/dc6/d12f/f15b x:0 0 0 2024-02-15T22:51:06.468 INFO:tasks.workunit.client.0.smithi138.stdout:5/908: unlink df/d18/f29 0 2024-02-15T22:51:06.468 INFO:tasks.workunit.client.0.smithi138.stdout:5/909: fdatasync df/d18/d56/dc6/f112 0 2024-02-15T22:51:06.468 INFO:tasks.workunit.client.0.smithi138.stdout:5/910: truncate df/d18/d56/fff 1044083 0 2024-02-15T22:51:06.468 INFO:tasks.workunit.client.0.smithi138.stdout:5/911: chown df/d18/d56/f5a 11725909 1 2024-02-15T22:51:06.470 INFO:tasks.workunit.client.0.smithi138.stdout:0/999: unlink d6/d10/d18/d57/d8d/l14f 0 2024-02-15T22:51:06.472 INFO:tasks.workunit.client.0.smithi138.stdout:5/912: truncate df/d18/d3e/d66/d82/fdf 1654684 0 2024-02-15T22:51:06.475 INFO:tasks.workunit.client.0.smithi138.stdout:5/913: rename df/d18/d3e/d60/d72/f7d to df/d18/d56/f126 0 2024-02-15T22:51:06.477 INFO:tasks.workunit.client.0.smithi138.stdout:5/914: dread df/d18/d56/dae/fbc [0,4194304] 0 2024-02-15T22:51:06.501 INFO:tasks.workunit.client.1.smithi170.stdout:5/18: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.501 INFO:tasks.workunit.client.1.smithi170.stdout:3/25: dwrite d3/f5 [0,4194304] 0 2024-02-15T22:51:06.502 INFO:tasks.workunit.client.1.smithi170.stdout:9/15: dwrite f0 [0,4194304] 0 2024-02-15T22:51:06.504 INFO:tasks.workunit.client.1.smithi170.stdout:5/19: mknod c5 0 2024-02-15T22:51:06.504 INFO:tasks.workunit.client.1.smithi170.stdout:5/20: chown c5 21321 1 2024-02-15T22:51:06.504 INFO:tasks.workunit.client.1.smithi170.stdout:5/21: chown f1 2548437 1 2024-02-15T22:51:06.504 INFO:tasks.workunit.client.1.smithi170.stdout:5/22: chown c5 452 1 2024-02-15T22:51:06.504 INFO:tasks.workunit.client.1.smithi170.stdout:5/23: chown f0 1442 1 2024-02-15T22:51:06.505 INFO:tasks.workunit.client.1.smithi170.stdout:5/24: mknod c6 0 2024-02-15T22:51:06.505 INFO:tasks.workunit.client.1.smithi170.stdout:5/25: creat f7 x:0 0 0 2024-02-15T22:51:06.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/26: write f0 [363179,50625] 0 2024-02-15T22:51:06.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/27: dread - f7 zero size 2024-02-15T22:51:06.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/28: read f0 [1404948,119943] 0 2024-02-15T22:51:06.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/29: creat f8 x:0 0 0 2024-02-15T22:51:06.514 INFO:tasks.workunit.client.1.smithi170.stdout:5/30: mknod c9 0 2024-02-15T22:51:06.514 INFO:tasks.workunit.client.1.smithi170.stdout:5/31: read - f7 zero size 2024-02-15T22:51:06.514 INFO:tasks.workunit.client.1.smithi170.stdout:9/16: write f0 [3218623,63033] 0 2024-02-15T22:51:06.522 INFO:tasks.workunit.client.1.smithi170.stdout:9/17: dread f0 [0,4194304] 0 2024-02-15T22:51:06.576 INFO:tasks.workunit.client.0.smithi138.stdout:1/927: sync 2024-02-15T22:51:06.588 INFO:tasks.workunit.client.0.smithi138.stdout:1/928: dwrite df/d1b/d1d/d25/fde [0,4194304] 0 2024-02-15T22:51:06.596 INFO:tasks.workunit.client.0.smithi138.stdout:1/929: write df/d1b/d1d/d24/d10f/dfd/f94 [102521,115588] 0 2024-02-15T22:51:06.597 INFO:tasks.workunit.client.0.smithi138.stdout:1/930: truncate df/d1b/d1d/d25/d2e/f84 1452839 0 2024-02-15T22:51:06.597 INFO:tasks.workunit.client.0.smithi138.stdout:1/931: chown df/d1b/d1d/d25/lc4 0 1 2024-02-15T22:51:06.659 INFO:tasks.workunit.client.0.smithi138.stdout:5/915: sync 2024-02-15T22:51:06.659 INFO:tasks.workunit.client.0.smithi138.stdout:5/916: write df/d18/d3e/f3f [1298430,27378] 0 2024-02-15T22:51:06.663 INFO:tasks.workunit.client.0.smithi138.stdout:5/917: unlink df/d18/d3e/d60/d65/d7c/ff6 0 2024-02-15T22:51:06.664 INFO:tasks.workunit.client.0.smithi138.stdout:5/918: creat df/d18/d56/dae/f127 x:0 0 0 2024-02-15T22:51:06.666 INFO:tasks.workunit.client.0.smithi138.stdout:5/919: rename df/d18/d3e/d60/d65/le7 to df/d18/d3e/d51/dc9/d10a/d111/l128 0 2024-02-15T22:51:06.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/920: dwrite df/d18/d56/dc6/fef [0,4194304] 0 2024-02-15T22:51:06.682 INFO:tasks.workunit.client.0.smithi138.stdout:5/921: truncate df/d18/d3e/d51/dc9/d9c/ff1 285605 0 2024-02-15T22:51:06.724 INFO:tasks.workunit.client.0.smithi138.stdout:5/922: mknod df/d18/d3e/d60/d65/d7f/d9d/c129 0 2024-02-15T22:51:06.724 INFO:tasks.workunit.client.0.smithi138.stdout:5/923: creat df/db5/f12a x:0 0 0 2024-02-15T22:51:06.726 INFO:tasks.workunit.client.0.smithi138.stdout:5/924: rename df/d18/d3e/d51/dc9/d9c/daf to df/d18/d3e/d51/dc9/d10a/d111/d12b 0 2024-02-15T22:51:06.727 INFO:tasks.workunit.client.0.smithi138.stdout:5/925: mkdir df/d18/d3e/d60/d65/d12c 0 2024-02-15T22:51:06.727 INFO:tasks.workunit.client.0.smithi138.stdout:5/926: stat df/d18/d3e/f4e 0 2024-02-15T22:51:06.728 INFO:tasks.workunit.client.0.smithi138.stdout:5/927: truncate df/f3a 516351 0 2024-02-15T22:51:06.731 INFO:tasks.workunit.client.0.smithi138.stdout:1/932: sync 2024-02-15T22:51:06.734 INFO:tasks.workunit.client.0.smithi138.stdout:1/933: rename df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/lf4 to df/d1b/d1d/d25/d8d/l12a 0 2024-02-15T22:51:06.743 INFO:tasks.workunit.client.0.smithi138.stdout:1/934: dread df/d1b/d1d/d25/d2e/f58 [4194304,4194304] 0 2024-02-15T22:51:06.744 INFO:tasks.workunit.client.0.smithi138.stdout:5/928: dwrite df/d18/d3e/d66/d82/f94 [0,4194304] 0 2024-02-15T22:51:06.753 INFO:tasks.workunit.client.0.smithi138.stdout:1/935: dread df/d1b/d1d/d25/d2e/d5b/fc9 [0,4194304] 0 2024-02-15T22:51:06.753 INFO:tasks.workunit.client.0.smithi138.stdout:1/936: fsync df/d1b/d1d/d25/d2e/d37/f3e 0 2024-02-15T22:51:06.755 INFO:tasks.workunit.client.0.smithi138.stdout:1/937: rename df/d1b/d1d/d24/d3a/c99 to df/d1b/d1d/d25/d2e/d37/c12b 0 2024-02-15T22:51:06.757 INFO:tasks.workunit.client.0.smithi138.stdout:1/938: rename df/d1b/d1d/d25/d2e/d5b/d65/fb5 to df/d1b/d1d/d25/f12c 0 2024-02-15T22:51:06.757 INFO:tasks.workunit.client.0.smithi138.stdout:1/939: dread - df/d1b/d1d/d24/fbf zero size 2024-02-15T22:51:06.758 INFO:tasks.workunit.client.0.smithi138.stdout:1/940: creat df/d1b/d1d/d25/d2e/d37/f12d x:0 0 0 2024-02-15T22:51:06.766 INFO:tasks.workunit.client.0.smithi138.stdout:5/929: dwrite df/d18/d3e/d51/f6a [0,4194304] 0 2024-02-15T22:51:06.775 INFO:tasks.workunit.client.0.smithi138.stdout:5/930: dread df/d18/f4a [0,4194304] 0 2024-02-15T22:51:06.776 INFO:tasks.workunit.client.0.smithi138.stdout:5/931: dread df/d18/d3e/d51/dc9/d9c/ff1 [0,4194304] 0 2024-02-15T22:51:06.778 INFO:tasks.workunit.client.0.smithi138.stdout:1/941: dwrite df/f53 [0,4194304] 0 2024-02-15T22:51:06.778 INFO:tasks.workunit.client.0.smithi138.stdout:1/942: creat df/d1b/d1d/d24/d3a/f12e x:0 0 0 2024-02-15T22:51:06.781 INFO:tasks.workunit.client.0.smithi138.stdout:1/943: unlink df/d1b/d1d/f28 0 2024-02-15T22:51:06.782 INFO:tasks.workunit.client.0.smithi138.stdout:1/944: truncate df/d1b/dee/ff2 2977971 0 2024-02-15T22:51:06.783 INFO:tasks.workunit.client.0.smithi138.stdout:1/945: mknod df/d41/c12f 0 2024-02-15T22:51:06.784 INFO:tasks.workunit.client.0.smithi138.stdout:1/946: mknod df/d41/de8/c130 0 2024-02-15T22:51:06.784 INFO:tasks.workunit.client.0.smithi138.stdout:1/947: stat df/d1b/fc7 0 2024-02-15T22:51:06.785 INFO:tasks.workunit.client.0.smithi138.stdout:1/948: rename df/d1b/l10c to df/d1b/d1d/d24/d10f/l131 0 2024-02-15T22:51:06.785 INFO:tasks.workunit.client.0.smithi138.stdout:1/949: chown df/d41/ddb/c11d 14 1 2024-02-15T22:51:06.790 INFO:tasks.workunit.client.0.smithi138.stdout:5/932: dwrite df/d18/d77/fab [0,4194304] 0 2024-02-15T22:51:06.791 INFO:tasks.workunit.client.0.smithi138.stdout:5/933: symlink df/d18/d3e/d60/d65/d7f/d104/l12d 0 2024-02-15T22:51:06.794 INFO:tasks.workunit.client.0.smithi138.stdout:1/950: dread fa [0,4194304] 0 2024-02-15T22:51:06.794 INFO:tasks.workunit.client.0.smithi138.stdout:1/951: readlink df/d1b/d1d/d25/d2e/d5b/d7b/l96 0 2024-02-15T22:51:06.794 INFO:tasks.workunit.client.0.smithi138.stdout:1/952: readlink df/d41/l105 0 2024-02-15T22:51:06.794 INFO:tasks.workunit.client.0.smithi138.stdout:1/953: chown df/d1b/d1d/d25/l2d 142846 1 2024-02-15T22:51:06.794 INFO:tasks.workunit.client.0.smithi138.stdout:1/954: truncate df/d1b/d1d/d25/d2e/f58 3732182 0 2024-02-15T22:51:06.796 INFO:tasks.workunit.client.0.smithi138.stdout:1/955: getdents df/d11a 0 2024-02-15T22:51:06.796 INFO:tasks.workunit.client.0.smithi138.stdout:1/956: write df/d1b/d1d/d25/d2e/d5b/d65/d80/f129 [1002059,31127] 0 2024-02-15T22:51:06.801 INFO:tasks.workunit.client.0.smithi138.stdout:5/934: dread df/d18/d77/fca [0,4194304] 0 2024-02-15T22:51:06.801 INFO:tasks.workunit.client.0.smithi138.stdout:5/935: chown df/d18/d3e/d60/d65/d7c/fb0 742676200 1 2024-02-15T22:51:06.803 INFO:tasks.workunit.client.0.smithi138.stdout:5/936: link df/d18/d3e/d51/f98 df/d18/d56/dae/f12e 0 2024-02-15T22:51:06.804 INFO:tasks.workunit.client.0.smithi138.stdout:1/957: write df/d1b/d1d/d25/d2e/d5b/fc9 [1782634,38772] 0 2024-02-15T22:51:06.806 INFO:tasks.workunit.client.0.smithi138.stdout:5/937: truncate fd 4320305 0 2024-02-15T22:51:06.808 INFO:tasks.workunit.client.0.smithi138.stdout:1/958: truncate df/d1b/d1d/d25/d2e/d5b/d65/d80/fd6 2005584 0 2024-02-15T22:51:06.808 INFO:tasks.workunit.client.0.smithi138.stdout:1/959: creat df/d1b/d1d/d25/f132 x:0 0 0 2024-02-15T22:51:06.810 INFO:tasks.workunit.client.0.smithi138.stdout:5/938: mkdir df/d18/d3e/d125/d12f 0 2024-02-15T22:51:06.812 INFO:tasks.workunit.client.0.smithi138.stdout:5/939: rename c1 to df/d18/d77/dfb/c130 0 2024-02-15T22:51:06.813 INFO:tasks.workunit.client.0.smithi138.stdout:5/940: symlink df/d18/d3e/d66/d82/l131 0 2024-02-15T22:51:06.815 INFO:tasks.workunit.client.0.smithi138.stdout:5/941: link df/d18/l45 df/d18/d3e/d66/de2/d10b/l132 0 2024-02-15T22:51:06.825 INFO:tasks.workunit.client.0.smithi138.stdout:1/960: dwrite df/d1b/d1d/d25/d2e/d5b/d65/f11e [0,4194304] 0 2024-02-15T22:51:06.829 INFO:tasks.workunit.client.0.smithi138.stdout:1/961: dread df/d1b/d1d/d25/d2e/d5b/d65/d86/fd1 [0,4194304] 0 2024-02-15T22:51:06.829 INFO:tasks.workunit.client.0.smithi138.stdout:1/962: dread - df/d1b/d1d/d25/d2e/f117 zero size 2024-02-15T22:51:06.830 INFO:tasks.workunit.client.0.smithi138.stdout:1/963: symlink df/d1b/d1d/d24/ddf/l133 0 2024-02-15T22:51:06.832 INFO:tasks.workunit.client.0.smithi138.stdout:1/964: rename df/d1b/d1d/d25/d2e/d5b/d65/f8c to df/d1b/d1d/d25/d8d/f134 0 2024-02-15T22:51:06.832 INFO:tasks.workunit.client.0.smithi138.stdout:1/965: chown df/c17 385039 1 2024-02-15T22:51:06.832 INFO:tasks.workunit.client.0.smithi138.stdout:1/966: mknod df/d41/de8/d125/c135 0 2024-02-15T22:51:06.838 INFO:tasks.workunit.client.0.smithi138.stdout:5/942: dwrite f5 [0,4194304] 0 2024-02-15T22:51:06.840 INFO:tasks.workunit.client.0.smithi138.stdout:5/943: mkdir df/d18/d56/dc6/d133 0 2024-02-15T22:51:06.841 INFO:tasks.workunit.client.0.smithi138.stdout:1/967: read df/d1b/d1d/d24/d3a/f70 [3061579,39466] 0 2024-02-15T22:51:06.849 INFO:tasks.workunit.client.0.smithi138.stdout:5/944: write df/d18/f110 [4148119,81558] 0 2024-02-15T22:51:06.851 INFO:tasks.workunit.client.0.smithi138.stdout:5/945: creat df/d18/d3e/d60/d65/d7f/d104/d114/f134 x:0 0 0 2024-02-15T22:51:06.851 INFO:tasks.workunit.client.0.smithi138.stdout:5/946: fsync df/d18/d3e/d60/d72/da5/fc7 0 2024-02-15T22:51:06.851 INFO:tasks.workunit.client.0.smithi138.stdout:5/947: chown df/d18/d3e/f48 15514 1 2024-02-15T22:51:06.866 INFO:tasks.workunit.client.0.smithi138.stdout:5/948: dwrite df/d18/d3e/d51/dc9/d10a/d111/d12b/fee [0,4194304] 0 2024-02-15T22:51:06.868 INFO:tasks.workunit.client.0.smithi138.stdout:5/949: rename df/d18/d3e/d125 to df/d18/d3e/d51/d105/d135 0 2024-02-15T22:51:06.869 INFO:tasks.workunit.client.0.smithi138.stdout:5/950: truncate df/d18/d77/fca 2927372 0 2024-02-15T22:51:06.871 INFO:tasks.workunit.client.0.smithi138.stdout:5/951: creat df/d18/d3e/d60/de1/f136 x:0 0 0 2024-02-15T22:51:06.871 INFO:tasks.workunit.client.0.smithi138.stdout:5/952: chown fb 939767 1 2024-02-15T22:51:06.874 INFO:tasks.workunit.client.0.smithi138.stdout:5/953: creat df/d18/d3e/d60/d65/f137 x:0 0 0 2024-02-15T22:51:06.874 INFO:tasks.workunit.client.0.smithi138.stdout:5/954: write df/f83 [3883740,110757] 0 2024-02-15T22:51:06.874 INFO:tasks.workunit.client.0.smithi138.stdout:5/955: fdatasync df/d18/d3e/d60/d65/d7f/d90/f92 0 2024-02-15T22:51:06.874 INFO:tasks.workunit.client.0.smithi138.stdout:5/956: creat df/d18/d56/dae/d109/f138 x:0 0 0 2024-02-15T22:51:06.874 INFO:tasks.workunit.client.0.smithi138.stdout:5/957: chown df/d18/d77/la4 5 1 2024-02-15T22:51:06.912 INFO:tasks.workunit.client.1.smithi170.stdout:0/21: getdents . 0 2024-02-15T22:51:06.934 INFO:tasks.workunit.client.1.smithi170.stdout:7/12: getdents . 0 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/6: unlink f1 0 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/7: rename - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/8: chown . 4974 1 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/9: dwrite - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/10: dread - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/11: write - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/12: write - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/13: dwrite - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/14: stat - no entries 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/15: dwrite - no filename 2024-02-15T22:51:06.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/16: fsync - no filename 2024-02-15T22:51:06.941 INFO:tasks.workunit.client.1.smithi170.stdout:8/17: fdatasync - no filename 2024-02-15T22:51:06.945 INFO:tasks.workunit.client.1.smithi170.stdout:6/11: getdents d3 0 2024-02-15T22:51:06.947 INFO:tasks.workunit.client.1.smithi170.stdout:2/17: write d0/f3 [4855348,90242] 0 2024-02-15T22:51:06.948 INFO:tasks.workunit.client.1.smithi170.stdout:6/12: dread f0 [0,4194304] 0 2024-02-15T22:51:06.965 INFO:tasks.workunit.client.1.smithi170.stdout:3/26: rmdir d3 39 2024-02-15T22:51:06.965 INFO:tasks.workunit.client.1.smithi170.stdout:3/27: write d3/f7 [712825,12172] 0 2024-02-15T22:51:06.967 INFO:tasks.workunit.client.1.smithi170.stdout:2/18: dwrite d0/d1/f4 [0,4194304] 0 2024-02-15T22:51:06.967 INFO:tasks.workunit.client.1.smithi170.stdout:2/19: creat d0/f6 x:0 0 0 2024-02-15T22:51:06.967 INFO:tasks.workunit.client.1.smithi170.stdout:2/20: stat d0/d1/f4 0 2024-02-15T22:51:06.973 INFO:tasks.workunit.client.1.smithi170.stdout:3/28: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:06.975 INFO:tasks.workunit.client.1.smithi170.stdout:5/32: getdents . 0 2024-02-15T22:51:06.976 INFO:tasks.workunit.client.1.smithi170.stdout:3/29: fsync d3/f7 0 2024-02-15T22:51:06.976 INFO:tasks.workunit.client.1.smithi170.stdout:3/30: chown d3/f5 472046641 1 2024-02-15T22:51:06.980 INFO:tasks.workunit.client.1.smithi170.stdout:3/31: write d3/f5 [2888016,123922] 0 2024-02-15T22:51:06.983 INFO:tasks.workunit.client.1.smithi170.stdout:2/21: dwrite d0/d1/f4 [0,4194304] 0 2024-02-15T22:51:06.998 INFO:tasks.workunit.client.1.smithi170.stdout:2/22: dwrite d0/f6 [0,4194304] 0 2024-02-15T22:51:06.998 INFO:tasks.workunit.client.1.smithi170.stdout:2/23: stat d0/f6 0 2024-02-15T22:51:07.005 INFO:tasks.workunit.client.1.smithi170.stdout:2/24: write d0/f6 [2547917,33781] 0 2024-02-15T22:51:07.091 INFO:tasks.workunit.client.0.smithi138.stdout:1/968: sync 2024-02-15T22:51:07.091 INFO:tasks.workunit.client.0.smithi138.stdout:1/969: write df/d1b/d1d/d25/f61 [1873510,95522] 0 2024-02-15T22:51:07.167 INFO:tasks.workunit.client.0.smithi138.stdout:1/970: creat df/d1b/d21/f136 x:0 0 0 2024-02-15T22:51:07.167 INFO:tasks.workunit.client.0.smithi138.stdout:1/971: stat df/d1b/d1d/d25/d2e/d5b/d65/db8/lbd 0 2024-02-15T22:51:07.180 INFO:tasks.workunit.client.0.smithi138.stdout:1/972: symlink df/d1b/d1d/d25/d2e/d5b/d65/db8/l137 0 2024-02-15T22:51:07.183 INFO:tasks.workunit.client.0.smithi138.stdout:1/973: dread df/d1b/d1d/d25/d2e/f84 [0,4194304] 0 2024-02-15T22:51:07.186 INFO:tasks.workunit.client.0.smithi138.stdout:1/974: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d11c/d138 0 2024-02-15T22:51:07.187 INFO:tasks.workunit.client.0.smithi138.stdout:1/975: dread df/d1b/d1d/d25/d2e/d5b/d7b/ff7 [0,4194304] 0 2024-02-15T22:51:07.187 INFO:tasks.workunit.client.0.smithi138.stdout:1/976: write df/d1b/d1d/d25/d2e/f84 [2283296,101266] 0 2024-02-15T22:51:07.189 INFO:tasks.workunit.client.0.smithi138.stdout:1/977: link df/d1b/d1d/d25/d2e/d5b/d65/d80/f2f df/d41/f139 0 2024-02-15T22:51:07.190 INFO:tasks.workunit.client.0.smithi138.stdout:1/978: rmdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d11c 39 2024-02-15T22:51:07.200 INFO:tasks.workunit.client.0.smithi138.stdout:1/979: dread df/d1b/d1d/d24/f38 [0,4194304] 0 2024-02-15T22:51:07.200 INFO:tasks.workunit.client.0.smithi138.stdout:1/980: readlink df/d1b/d1d/d25/d2e/d5b/d7b/ld3 0 2024-02-15T22:51:07.213 INFO:tasks.workunit.client.0.smithi138.stdout:1/981: dwrite df/d1b/f3d [0,4194304] 0 2024-02-15T22:51:07.213 INFO:tasks.workunit.client.0.smithi138.stdout:1/982: write df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e [246403,97091] 0 2024-02-15T22:51:07.213 INFO:tasks.workunit.client.0.smithi138.stdout:1/983: truncate df/d41/ddb/f123 195954 0 2024-02-15T22:51:07.215 INFO:tasks.workunit.client.0.smithi138.stdout:1/984: fdatasync df/d1b/d1d/d25/d2e/d5b/d65/d80/d3f/f6e 0 2024-02-15T22:51:07.215 INFO:tasks.workunit.client.0.smithi138.stdout:1/985: write f4 [8767708,39735] 0 2024-02-15T22:51:07.215 INFO:tasks.workunit.client.0.smithi138.stdout:1/986: chown df/d1b/d1d/fec 5901273 1 2024-02-15T22:51:07.233 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 228 MiB/s rd, 279 MiB/s wr, 747 op/s 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:06 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.236 INFO:tasks.workunit.client.0.smithi138.stdout:1/987: mkdir df/d1b/d1d/d25/d2e/d5b/d65/d80/d13a 0 2024-02-15T22:51:07.237 INFO:tasks.workunit.client.0.smithi138.stdout:1/988: rmdir df 39 2024-02-15T22:51:07.240 INFO:tasks.workunit.client.0.smithi138.stdout:1/989: dread df/d1b/d1d/d25/d2e/d5b/f67 [0,4194304] 0 2024-02-15T22:51:07.241 INFO:tasks.workunit.client.0.smithi138.stdout:1/990: creat df/d41/de8/d125/f13b x:0 0 0 2024-02-15T22:51:07.242 INFO:tasks.workunit.client.0.smithi138.stdout:1/991: write df/d1b/d1d/fae [88718,76929] 0 2024-02-15T22:51:07.243 INFO:tasks.workunit.client.0.smithi138.stdout:1/992: write df/d1b/d1d/d25/d2e/d5b/f67 [1118960,47856] 0 2024-02-15T22:51:07.243 INFO:tasks.workunit.client.0.smithi138.stdout:1/993: write f8 [3770539,130814] 0 2024-02-15T22:51:07.243 INFO:tasks.workunit.client.0.smithi138.stdout:1/994: read df/d1b/d1d/d25/d2e/d37/f4b [359037,63692] 0 2024-02-15T22:51:07.244 INFO:tasks.workunit.client.0.smithi138.stdout:1/995: write df/d1b/d1d/d24/d3a/f116 [681817,123870] 0 2024-02-15T22:51:07.247 INFO:tasks.workunit.client.0.smithi138.stdout:1/996: rmdir df/d1b/d1d/d25/d2e/d5b 39 2024-02-15T22:51:07.247 INFO:tasks.workunit.client.0.smithi138.stdout:1/997: truncate df/d1b/fff 513997 0 2024-02-15T22:51:07.251 INFO:tasks.workunit.client.0.smithi138.stdout:5/958: sync 2024-02-15T22:51:07.259 INFO:tasks.workunit.client.0.smithi138.stdout:5/959: read df/d18/d56/f5d [1302542,128008] 0 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 228 MiB/s rd, 279 MiB/s wr, 747 op/s 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:06 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:07.262 INFO:tasks.workunit.client.0.smithi138.stdout:1/998: dwrite df/d41/ddb/f9d [0,4194304] 0 2024-02-15T22:51:07.262 INFO:tasks.workunit.client.0.smithi138.stdout:1/999: stat df/d1b/d1d/d24/d3a/f77 0 2024-02-15T22:51:07.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/960: dwrite df/d18/d3e/d51/dc9/d10a/d111/d12b/fbe [0,4194304] 0 2024-02-15T22:51:07.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/961: stat df/d18/d56/f5a 0 2024-02-15T22:51:07.277 INFO:tasks.workunit.client.0.smithi138.stdout:5/962: fsync df/d18/d3e/d60/d65/dc2/fdd 0 2024-02-15T22:51:07.278 INFO:tasks.workunit.client.0.smithi138.stdout:5/963: symlink df/d18/d3e/d8a/l139 0 2024-02-15T22:51:07.279 INFO:tasks.workunit.client.0.smithi138.stdout:5/964: rename df/d18/d56/dae/f12e to df/d18/d3e/d60/d65/d7c/de5/f13a 0 2024-02-15T22:51:07.280 INFO:tasks.workunit.client.0.smithi138.stdout:5/965: symlink df/d18/d56/dc6/l13b 0 2024-02-15T22:51:07.280 INFO:tasks.workunit.client.0.smithi138.stdout:5/966: truncate df/d18/d56/dc6/fd1 480839 0 2024-02-15T22:51:07.282 INFO:tasks.workunit.client.0.smithi138.stdout:5/967: dread df/d18/d3e/f3f [0,4194304] 0 2024-02-15T22:51:07.286 INFO:tasks.workunit.client.0.smithi138.stdout:5/968: dread df/d18/d77/fca [0,4194304] 0 2024-02-15T22:51:07.301 INFO:tasks.workunit.client.0.smithi138.stdout:5/969: dwrite df/d18/d3e/d51/dc9/d10a/d111/d12b/fbe [0,4194304] 0 2024-02-15T22:51:07.302 INFO:tasks.workunit.client.0.smithi138.stdout:5/970: rmdir df/d18/d3e/d60/d65/d7f 39 2024-02-15T22:51:07.303 INFO:tasks.workunit.client.0.smithi138.stdout:5/971: link df/d18/d77/fdc df/d18/d56/f13c 0 2024-02-15T22:51:07.306 INFO:tasks.workunit.client.0.smithi138.stdout:5/972: rename df/d18/d56/f5a to df/d18/d56/dc6/d124/f13d 0 2024-02-15T22:51:07.306 INFO:tasks.workunit.client.0.smithi138.stdout:5/973: readlink df/d18/d3e/d60/d65/d7f/d90/l120 0 2024-02-15T22:51:07.307 INFO:tasks.workunit.client.0.smithi138.stdout:5/974: symlink df/d18/d3e/d60/d65/d12c/l13e 0 2024-02-15T22:51:07.308 INFO:tasks.workunit.client.0.smithi138.stdout:5/975: creat df/d18/d3e/d60/f13f x:0 0 0 2024-02-15T22:51:07.308 INFO:tasks.workunit.client.0.smithi138.stdout:5/976: readlink df/d18/l123 0 2024-02-15T22:51:07.310 INFO:tasks.workunit.client.0.smithi138.stdout:5/977: symlink df/d18/d3e/d66/d82/l140 0 2024-02-15T22:51:07.310 INFO:tasks.workunit.client.0.smithi138.stdout:5/978: symlink df/d18/d3e/d60/d72/da5/l141 0 2024-02-15T22:51:07.312 INFO:tasks.workunit.client.0.smithi138.stdout:5/979: mknod df/d18/d3e/d60/d65/d7c/deb/c142 0 2024-02-15T22:51:07.312 INFO:tasks.workunit.client.0.smithi138.stdout:5/980: rmdir df/d18/d3e/d60/d65/d7c/deb 39 2024-02-15T22:51:07.313 INFO:tasks.workunit.client.1.smithi170.stdout:0/22: mknod c3 0 2024-02-15T22:51:07.314 INFO:tasks.workunit.client.1.smithi170.stdout:7/13: rename l1 to l2 0 2024-02-15T22:51:07.314 INFO:tasks.workunit.client.1.smithi170.stdout:7/14: chown l2 527952996 1 2024-02-15T22:51:07.314 INFO:tasks.workunit.client.1.smithi170.stdout:8/18: mknod c2 0 2024-02-15T22:51:07.315 INFO:tasks.workunit.client.1.smithi170.stdout:8/19: dwrite - no filename 2024-02-15T22:51:07.315 INFO:tasks.workunit.client.0.smithi138.stdout:5/981: rename df/d18/d3e/d60/d65/d7c/dad to df/d18/d3e/d8a/d143 0 2024-02-15T22:51:07.316 INFO:tasks.workunit.client.1.smithi170.stdout:6/13: creat d3/f5 x:0 0 0 2024-02-15T22:51:07.316 INFO:tasks.workunit.client.1.smithi170.stdout:6/14: fdatasync f2 0 2024-02-15T22:51:07.319 INFO:tasks.workunit.client.1.smithi170.stdout:6/15: dread f0 [0,4194304] 0 2024-02-15T22:51:07.319 INFO:tasks.workunit.client.1.smithi170.stdout:5/33: creat fa x:0 0 0 2024-02-15T22:51:07.321 INFO:tasks.workunit.client.1.smithi170.stdout:3/32: rmdir d3 39 2024-02-15T22:51:07.322 INFO:tasks.workunit.client.1.smithi170.stdout:3/33: read d3/f7 [163060,111] 0 2024-02-15T22:51:07.324 INFO:tasks.workunit.client.1.smithi170.stdout:0/23: creat f4 x:0 0 0 2024-02-15T22:51:07.324 INFO:tasks.workunit.client.1.smithi170.stdout:0/24: creat f5 x:0 0 0 2024-02-15T22:51:07.325 INFO:tasks.workunit.client.1.smithi170.stdout:7/15: creat f3 x:0 0 0 2024-02-15T22:51:07.327 INFO:tasks.workunit.client.1.smithi170.stdout:8/20: symlink l3 0 2024-02-15T22:51:07.328 INFO:tasks.workunit.client.1.smithi170.stdout:6/16: mknod d3/c6 0 2024-02-15T22:51:07.328 INFO:tasks.workunit.client.1.smithi170.stdout:6/17: truncate d3/f4 767138 0 2024-02-15T22:51:07.328 INFO:tasks.workunit.client.1.smithi170.stdout:6/18: creat d3/f7 x:0 0 0 2024-02-15T22:51:07.328 INFO:tasks.workunit.client.1.smithi170.stdout:6/19: fsync d3/f4 0 2024-02-15T22:51:07.328 INFO:tasks.workunit.client.1.smithi170.stdout:6/20: rename d3 to d3/d8 22 2024-02-15T22:51:07.329 INFO:tasks.workunit.client.1.smithi170.stdout:5/34: chown f4 1101331 1 2024-02-15T22:51:07.330 INFO:tasks.workunit.client.1.smithi170.stdout:2/25: rmdir d0/d1 39 2024-02-15T22:51:07.330 INFO:tasks.workunit.client.1.smithi170.stdout:2/26: creat d0/f7 x:0 0 0 2024-02-15T22:51:07.330 INFO:tasks.workunit.client.1.smithi170.stdout:2/27: read - d0/d1/f5 zero size 2024-02-15T22:51:07.333 INFO:tasks.workunit.client.0.smithi138.stdout:5/982: dwrite df/d18/d3e/d60/d72/da5/fc1 [0,4194304] 0 2024-02-15T22:51:07.334 INFO:tasks.workunit.client.0.smithi138.stdout:5/983: readlink df/d18/d3e/d51/dc9/lb4 0 2024-02-15T22:51:07.334 INFO:tasks.workunit.client.1.smithi170.stdout:8/21: link c2 c4 0 2024-02-15T22:51:07.334 INFO:tasks.workunit.client.1.smithi170.stdout:8/22: creat f5 x:0 0 0 2024-02-15T22:51:07.338 INFO:tasks.workunit.client.1.smithi170.stdout:6/21: mkdir d3/d9 0 2024-02-15T22:51:07.340 INFO:tasks.workunit.client.1.smithi170.stdout:2/28: creat d0/d1/f8 x:0 0 0 2024-02-15T22:51:07.340 INFO:tasks.workunit.client.1.smithi170.stdout:2/29: chown d0/d1/f5 118830357 1 2024-02-15T22:51:07.341 INFO:tasks.workunit.client.1.smithi170.stdout:2/30: fdatasync d0/f7 0 2024-02-15T22:51:07.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/25: link f5 f6 0 2024-02-15T22:51:07.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/26: fsync f1 0 2024-02-15T22:51:07.343 INFO:tasks.workunit.client.1.smithi170.stdout:7/16: mknod c4 0 2024-02-15T22:51:07.344 INFO:tasks.workunit.client.0.smithi138.stdout:5/984: dread df/d18/f84 [0,4194304] 0 2024-02-15T22:51:07.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/22: rename f0 to d3/fa 0 2024-02-15T22:51:07.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/23: fdatasync d3/f5 0 2024-02-15T22:51:07.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/24: creat d3/fb x:0 0 0 2024-02-15T22:51:07.348 INFO:tasks.workunit.client.1.smithi170.stdout:5/35: dwrite fa [0,4194304] 0 2024-02-15T22:51:07.348 INFO:tasks.workunit.client.1.smithi170.stdout:3/34: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:07.352 INFO:tasks.workunit.client.1.smithi170.stdout:3/35: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:07.352 INFO:tasks.workunit.client.1.smithi170.stdout:6/25: creat d3/d9/fc x:0 0 0 2024-02-15T22:51:07.352 INFO:tasks.workunit.client.1.smithi170.stdout:6/26: chown d3/d9/fc 598112 1 2024-02-15T22:51:07.354 INFO:tasks.workunit.client.0.smithi138.stdout:5/985: dread df/f11 [0,4194304] 0 2024-02-15T22:51:07.356 INFO:tasks.workunit.client.1.smithi170.stdout:7/17: symlink l5 0 2024-02-15T22:51:07.356 INFO:tasks.workunit.client.1.smithi170.stdout:0/27: dwrite f1 [0,4194304] 0 2024-02-15T22:51:07.356 INFO:tasks.workunit.client.1.smithi170.stdout:0/28: stat f5 0 2024-02-15T22:51:07.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/36: creat d3/f8 x:0 0 0 2024-02-15T22:51:07.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/37: chown c1 103153524 1 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/27: mkdir d3/d9/dd 0 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/28: chown d3/f7 8260745 1 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/29: chown d3/d9/fc 0 1 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/30: stat d3/f5 0 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/31: creat d3/d9/fe x:0 0 0 2024-02-15T22:51:07.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/18: creat f6 x:0 0 0 2024-02-15T22:51:07.364 INFO:tasks.workunit.client.0.smithi138.stdout:5/986: dread fc [0,4194304] 0 2024-02-15T22:51:07.364 INFO:tasks.workunit.client.1.smithi170.stdout:0/29: mknod c7 0 2024-02-15T22:51:07.366 INFO:tasks.workunit.client.1.smithi170.stdout:5/36: unlink f8 0 2024-02-15T22:51:07.369 INFO:tasks.workunit.client.1.smithi170.stdout:5/37: fsync f0 0 2024-02-15T22:51:07.371 INFO:tasks.workunit.client.1.smithi170.stdout:7/19: rename f6 to f7 0 2024-02-15T22:51:07.371 INFO:tasks.workunit.client.0.smithi138.stdout:5/987: dread df/d18/d56/dc6/f112 [0,4194304] 0 2024-02-15T22:51:07.371 INFO:tasks.workunit.client.0.smithi138.stdout:5/988: getdents df/d18/d3e/d66/de2/d10b 0 2024-02-15T22:51:07.372 INFO:tasks.workunit.client.1.smithi170.stdout:0/30: read f1 [3848540,120299] 0 2024-02-15T22:51:07.372 INFO:tasks.workunit.client.1.smithi170.stdout:0/31: read - f4 zero size 2024-02-15T22:51:07.373 INFO:tasks.workunit.client.0.smithi138.stdout:5/989: symlink df/d18/d3e/d66/de2/d10b/d121/l144 0 2024-02-15T22:51:07.377 INFO:tasks.workunit.client.1.smithi170.stdout:5/38: symlink lb 0 2024-02-15T22:51:07.378 INFO:tasks.workunit.client.1.smithi170.stdout:0/32: mkdir d8 0 2024-02-15T22:51:07.379 INFO:tasks.workunit.client.1.smithi170.stdout:7/20: rename l5 to l8 0 2024-02-15T22:51:07.380 INFO:tasks.workunit.client.1.smithi170.stdout:5/39: creat fc x:0 0 0 2024-02-15T22:51:07.381 INFO:tasks.workunit.client.1.smithi170.stdout:0/33: mknod d8/c9 0 2024-02-15T22:51:07.381 INFO:tasks.workunit.client.1.smithi170.stdout:0/34: write f5 [557841,121092] 0 2024-02-15T22:51:07.381 INFO:tasks.workunit.client.0.smithi138.stdout:5/990: write df/d18/d3e/d60/d65/d7c/fb0 [901050,25493] 0 2024-02-15T22:51:07.384 INFO:tasks.workunit.client.1.smithi170.stdout:0/35: unlink d8/c9 0 2024-02-15T22:51:07.384 INFO:tasks.workunit.client.1.smithi170.stdout:0/36: chown l0 4955993 1 2024-02-15T22:51:07.386 INFO:tasks.workunit.client.1.smithi170.stdout:7/21: mknod c9 0 2024-02-15T22:51:07.387 INFO:tasks.workunit.client.1.smithi170.stdout:0/37: creat d8/fa x:0 0 0 2024-02-15T22:51:07.388 INFO:tasks.workunit.client.1.smithi170.stdout:0/38: mknod d8/cb 0 2024-02-15T22:51:07.388 INFO:tasks.workunit.client.1.smithi170.stdout:0/39: readlink l2 0 2024-02-15T22:51:07.389 INFO:tasks.workunit.client.1.smithi170.stdout:7/22: mkdir da 0 2024-02-15T22:51:07.389 INFO:tasks.workunit.client.1.smithi170.stdout:7/23: readlink l8 0 2024-02-15T22:51:07.389 INFO:tasks.workunit.client.1.smithi170.stdout:7/24: chown c9 3180282 1 2024-02-15T22:51:07.400 INFO:tasks.workunit.client.1.smithi170.stdout:7/25: dwrite f3 [0,4194304] 0 2024-02-15T22:51:07.404 INFO:tasks.workunit.client.1.smithi170.stdout:7/26: unlink f3 0 2024-02-15T22:51:07.421 INFO:tasks.workunit.client.1.smithi170.stdout:7/27: dwrite f7 [0,4194304] 0 2024-02-15T22:51:07.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/28: creat da/fb x:0 0 0 2024-02-15T22:51:07.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/29: creat da/fc x:0 0 0 2024-02-15T22:51:07.671 INFO:tasks.workunit.client.1.smithi170.stdout:7/30: dwrite da/fc [0,4194304] 0 2024-02-15T22:51:07.671 INFO:tasks.workunit.client.1.smithi170.stdout:7/31: fdatasync da/fb 0 2024-02-15T22:51:07.680 INFO:tasks.workunit.client.1.smithi170.stdout:6/32: getdents d3 0 2024-02-15T22:51:07.680 INFO:tasks.workunit.client.1.smithi170.stdout:6/33: readlink - no filename 2024-02-15T22:51:07.681 INFO:tasks.workunit.client.1.smithi170.stdout:2/31: truncate d0/d1/f4 2398808 0 2024-02-15T22:51:07.682 INFO:tasks.workunit.client.1.smithi170.stdout:2/32: creat d0/d1/f9 x:0 0 0 2024-02-15T22:51:07.682 INFO:tasks.workunit.client.1.smithi170.stdout:2/33: dread - d0/d1/f9 zero size 2024-02-15T22:51:07.682 INFO:tasks.workunit.client.1.smithi170.stdout:6/34: symlink d3/d9/lf 0 2024-02-15T22:51:07.682 INFO:tasks.workunit.client.1.smithi170.stdout:6/35: creat d3/d9/f10 x:0 0 0 2024-02-15T22:51:07.694 INFO:tasks.workunit.client.1.smithi170.stdout:5/40: write fa [4191620,33341] 0 2024-02-15T22:51:07.695 INFO:tasks.workunit.client.1.smithi170.stdout:5/41: write f7 [1030217,50981] 0 2024-02-15T22:51:07.695 INFO:tasks.workunit.client.1.smithi170.stdout:5/42: read fa [3254755,93437] 0 2024-02-15T22:51:07.695 INFO:tasks.workunit.client.1.smithi170.stdout:5/43: truncate fa 5267138 0 2024-02-15T22:51:07.695 INFO:tasks.workunit.client.1.smithi170.stdout:5/44: dread - fc zero size 2024-02-15T22:51:07.696 INFO:tasks.workunit.client.1.smithi170.stdout:6/36: dwrite d3/d9/fc [0,4194304] 0 2024-02-15T22:51:07.696 INFO:tasks.workunit.client.1.smithi170.stdout:6/37: dread - d3/d9/f10 zero size 2024-02-15T22:51:07.696 INFO:tasks.workunit.client.1.smithi170.stdout:6/38: truncate d3/d9/fe 573285 0 2024-02-15T22:51:07.697 INFO:tasks.workunit.client.1.smithi170.stdout:7/32: getdents da 0 2024-02-15T22:51:07.702 INFO:tasks.workunit.client.1.smithi170.stdout:7/33: rename da/fb to da/fd 0 2024-02-15T22:51:07.705 INFO:tasks.workunit.client.1.smithi170.stdout:7/34: link f7 da/fe 0 2024-02-15T22:51:07.707 INFO:tasks.workunit.client.1.smithi170.stdout:7/35: truncate da/fc 4154260 0 2024-02-15T22:51:07.729 INFO:tasks.workunit.client.1.smithi170.stdout:5/45: dwrite f7 [0,4194304] 0 2024-02-15T22:51:07.729 INFO:tasks.workunit.client.1.smithi170.stdout:6/39: dwrite d3/f7 [0,4194304] 0 2024-02-15T22:51:07.730 INFO:tasks.workunit.client.1.smithi170.stdout:5/46: write fa [4457833,18488] 0 2024-02-15T22:51:07.730 INFO:tasks.workunit.client.1.smithi170.stdout:7/36: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:07.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/37: truncate da/fc 4283363 0 2024-02-15T22:51:07.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/38: chown l8 599 1 2024-02-15T22:51:07.750 INFO:tasks.workunit.client.1.smithi170.stdout:6/40: dwrite d3/f7 [0,4194304] 0 2024-02-15T22:51:07.785 INFO:tasks.workunit.client.1.smithi170.stdout:5/47: creat fd x:0 0 0 2024-02-15T22:51:07.788 INFO:tasks.workunit.client.1.smithi170.stdout:6/41: unlink d3/fb 0 2024-02-15T22:51:07.791 INFO:tasks.workunit.client.1.smithi170.stdout:5/48: mkdir de 0 2024-02-15T22:51:07.791 INFO:tasks.workunit.client.1.smithi170.stdout:7/39: truncate da/fe 2555096 0 2024-02-15T22:51:07.793 INFO:tasks.workunit.client.1.smithi170.stdout:5/49: mknod de/cf 0 2024-02-15T22:51:07.793 INFO:tasks.workunit.client.1.smithi170.stdout:5/50: dread - fd zero size 2024-02-15T22:51:07.794 INFO:tasks.workunit.client.1.smithi170.stdout:5/51: mkdir de/d10 0 2024-02-15T22:51:07.795 INFO:tasks.workunit.client.1.smithi170.stdout:5/52: creat de/f11 x:0 0 0 2024-02-15T22:51:07.796 INFO:tasks.workunit.client.1.smithi170.stdout:5/53: mknod de/d10/c12 0 2024-02-15T22:51:07.807 INFO:tasks.workunit.client.1.smithi170.stdout:5/54: dread f7 [0,4194304] 0 2024-02-15T22:51:07.809 INFO:tasks.workunit.client.1.smithi170.stdout:5/55: rename f4 to de/d10/f13 0 2024-02-15T22:51:07.809 INFO:tasks.workunit.client.1.smithi170.stdout:5/56: symlink de/l14 0 2024-02-15T22:51:07.811 INFO:tasks.workunit.client.1.smithi170.stdout:5/57: rename fc to de/d10/f15 0 2024-02-15T22:51:07.811 INFO:tasks.workunit.client.1.smithi170.stdout:5/58: creat de/f16 x:0 0 0 2024-02-15T22:51:07.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/59: chown de 0 1 2024-02-15T22:51:07.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/60: write fd [625963,93952] 0 2024-02-15T22:51:07.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/61: readlink lb 0 2024-02-15T22:51:07.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/62: symlink de/l17 0 2024-02-15T22:51:07.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/63: write fa [6070767,1162] 0 2024-02-15T22:51:07.813 INFO:tasks.workunit.client.1.smithi170.stdout:5/64: creat de/d10/f18 x:0 0 0 2024-02-15T22:51:07.813 INFO:tasks.workunit.client.1.smithi170.stdout:5/65: write de/d10/f18 [642016,84369] 0 2024-02-15T22:51:07.813 INFO:tasks.workunit.client.1.smithi170.stdout:5/66: write de/d10/f18 [1156330,39152] 0 2024-02-15T22:51:07.819 INFO:tasks.workunit.client.1.smithi170.stdout:5/67: truncate fa 5463194 0 2024-02-15T22:51:07.820 INFO:tasks.workunit.client.1.smithi170.stdout:5/68: link fd de/d10/f19 0 2024-02-15T22:51:07.840 INFO:tasks.workunit.client.1.smithi170.stdout:5/69: dwrite f0 [4194304,4194304] 0 2024-02-15T22:51:07.845 INFO:tasks.workunit.client.1.smithi170.stdout:5/70: dread fd [0,4194304] 0 2024-02-15T22:51:07.861 INFO:tasks.workunit.client.1.smithi170.stdout:5/71: dwrite fd [0,4194304] 0 2024-02-15T22:51:07.861 INFO:tasks.workunit.client.1.smithi170.stdout:5/72: creat de/f1a x:0 0 0 2024-02-15T22:51:07.863 INFO:tasks.workunit.client.1.smithi170.stdout:5/73: fsync de/d10/f18 0 2024-02-15T22:51:07.866 INFO:tasks.workunit.client.1.smithi170.stdout:5/74: symlink de/d10/l1b 0 2024-02-15T22:51:07.886 INFO:tasks.workunit.client.1.smithi170.stdout:5/75: dwrite de/f11 [0,4194304] 0 2024-02-15T22:51:07.891 INFO:tasks.workunit.client.1.smithi170.stdout:5/76: read f7 [3735452,111465] 0 2024-02-15T22:51:07.899 INFO:tasks.workunit.client.1.smithi170.stdout:5/77: dread de/d10/f19 [0,4194304] 0 2024-02-15T22:51:07.900 INFO:tasks.workunit.client.1.smithi170.stdout:5/78: mknod de/d10/c1c 0 2024-02-15T22:51:07.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/79: mknod de/c1d 0 2024-02-15T22:51:07.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/80: readlink de/d10/l1b 0 2024-02-15T22:51:07.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/81: dread - de/d10/f13 zero size 2024-02-15T22:51:07.905 INFO:tasks.workunit.client.1.smithi170.stdout:5/82: getdents de 0 2024-02-15T22:51:07.905 INFO:tasks.workunit.client.1.smithi170.stdout:5/83: write f7 [749790,41628] 0 2024-02-15T22:51:07.906 INFO:tasks.workunit.client.1.smithi170.stdout:5/84: rmdir de/d10 39 2024-02-15T22:51:07.908 INFO:tasks.workunit.client.1.smithi170.stdout:5/85: rename de/d10/f15 to de/f1e 0 2024-02-15T22:51:07.909 INFO:tasks.workunit.client.1.smithi170.stdout:5/86: mknod de/c1f 0 2024-02-15T22:51:07.909 INFO:tasks.workunit.client.1.smithi170.stdout:5/87: read de/d10/f18 [1136027,90583] 0 2024-02-15T22:51:07.910 INFO:tasks.workunit.client.1.smithi170.stdout:5/88: fsync de/f1a 0 2024-02-15T22:51:07.910 INFO:tasks.workunit.client.1.smithi170.stdout:5/89: chown de/cf 4 1 2024-02-15T22:51:07.910 INFO:tasks.workunit.client.1.smithi170.stdout:5/90: write fa [1902209,103119] 0 2024-02-15T22:51:08.006 INFO:tasks.workunit.client.0.smithi138.stdout:5/991: sync 2024-02-15T22:51:08.013 INFO:tasks.workunit.client.0.smithi138.stdout:5/992: write df/ff4 [3333348,34783] 0 2024-02-15T22:51:08.132 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:07 smithi138 ceph-mon[29229]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:51:08.132 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:07 smithi138 ceph-mon[29229]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:51:08.209 INFO:tasks.workunit.client.0.smithi138.stdout:5/993: symlink df/d18/d3e/d8a/d143/l145 0 2024-02-15T22:51:08.210 INFO:tasks.workunit.client.0.smithi138.stdout:5/994: creat df/d18/d3e/d60/d65/dc2/f146 x:0 0 0 2024-02-15T22:51:08.211 INFO:tasks.workunit.client.0.smithi138.stdout:5/995: getdents df/d18/d3e/d60/d65/d7f/d104 0 2024-02-15T22:51:08.211 INFO:tasks.workunit.client.0.smithi138.stdout:5/996: chown df/d18/d3e/d51/c9a 220707405 1 2024-02-15T22:51:08.212 INFO:tasks.workunit.client.0.smithi138.stdout:5/997: truncate df/d18/f6f 1261271 0 2024-02-15T22:51:08.212 INFO:tasks.workunit.client.0.smithi138.stdout:5/998: readlink df/d18/l33 0 2024-02-15T22:51:08.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:07 smithi170 ceph-mon[35248]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:51:08.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:07 smithi170 ceph-mon[35248]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:51:08.299 INFO:tasks.workunit.client.0.smithi138.stdout:5/999: dwrite df/d18/d3e/d60/d72/da5/fc1 [4194304,4194304] 0 2024-02-15T22:51:08.301 INFO:tasks.workunit.client.0.smithi138.stderr:+ rm -rf -- ./tmp.LaR1thRtLF 2024-02-15T22:51:09.191 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:08 smithi138 ceph-mon[29229]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 151 MiB/s rd, 187 MiB/s wr, 693 op/s 2024-02-15T22:51:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:08 smithi170 ceph-mon[35248]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 151 MiB/s rd, 187 MiB/s wr, 693 op/s 2024-02-15T22:51:10.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:09 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:09 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:10.582 INFO:tasks.workunit.client.1.smithi170.stdout:1/10: sync 2024-02-15T22:51:10.582 INFO:tasks.workunit.client.1.smithi170.stdout:1/11: write - no filename 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/12: dwrite - no filename 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/13: symlink l1 0 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/14: fsync - no filename 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/15: dwrite - no filename 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/16: dread - no filename 2024-02-15T22:51:10.583 INFO:tasks.workunit.client.1.smithi170.stdout:1/17: dread - no filename 2024-02-15T22:51:10.584 INFO:tasks.workunit.client.1.smithi170.stdout:1/18: link l0 l2 0 2024-02-15T22:51:10.587 INFO:tasks.workunit.client.1.smithi170.stdout:1/19: getdents . 0 2024-02-15T22:51:10.588 INFO:tasks.workunit.client.1.smithi170.stdout:1/20: dread - no filename 2024-02-15T22:51:10.588 INFO:tasks.workunit.client.1.smithi170.stdout:1/21: truncate - no filename 2024-02-15T22:51:10.588 INFO:tasks.workunit.client.1.smithi170.stdout:1/22: chown l2 35052 1 2024-02-15T22:51:10.588 INFO:tasks.workunit.client.1.smithi170.stdout:1/23: mkdir d3 0 2024-02-15T22:51:10.590 INFO:tasks.workunit.client.1.smithi170.stdout:1/24: rename l1 to d3/l4 0 2024-02-15T22:51:10.590 INFO:tasks.workunit.client.1.smithi170.stdout:1/25: chown l0 5350 1 2024-02-15T22:51:10.591 INFO:tasks.workunit.client.1.smithi170.stdout:1/26: symlink d3/l5 0 2024-02-15T22:51:10.591 INFO:tasks.workunit.client.1.smithi170.stdout:1/27: truncate - no filename 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:2/34: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:7/40: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:3/38: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:2/35: rename d0/d1 to d0/d1/da 22 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:9/18: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:6/42: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:0/40: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:0/41: stat c7 0 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:4/3: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:3/39: write d3/f8 [47483,22748] 0 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:5/91: sync 2024-02-15T22:51:10.653 INFO:tasks.workunit.client.1.smithi170.stdout:8/23: sync 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:2/36: creat d0/fb x:0 0 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:9/19: creat f1 x:0 0 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:6/43: creat d3/d9/f11 x:0 0 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:9/20: chown f1 478685986 1 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:2/37: creat d0/d1/fc x:0 0 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:5/92: write de/d10/f13 [738068,24365] 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:9/21: write f0 [3234477,44261] 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:3/40: read d3/f8 [27717,4485] 0 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:7/41: rename da to da/df 22 2024-02-15T22:51:10.654 INFO:tasks.workunit.client.1.smithi170.stdout:0/42: link c3 d8/cc 0 2024-02-15T22:51:10.655 INFO:tasks.workunit.client.1.smithi170.stdout:4/4: symlink d0/l1 0 2024-02-15T22:51:10.655 INFO:tasks.workunit.client.1.smithi170.stdout:4/5: dwrite - no filename 2024-02-15T22:51:10.655 INFO:tasks.workunit.client.1.smithi170.stdout:4/6: read - no filename 2024-02-15T22:51:10.656 INFO:tasks.workunit.client.1.smithi170.stdout:8/24: mknod c6 0 2024-02-15T22:51:10.656 INFO:tasks.workunit.client.1.smithi170.stdout:8/25: chown c6 1826 1 2024-02-15T22:51:10.657 INFO:tasks.workunit.client.1.smithi170.stdout:6/44: creat d3/d9/dd/f12 x:0 0 0 2024-02-15T22:51:10.658 INFO:tasks.workunit.client.1.smithi170.stdout:2/38: mknod d0/cd 0 2024-02-15T22:51:10.659 INFO:tasks.workunit.client.1.smithi170.stdout:0/43: dread f1 [0,4194304] 0 2024-02-15T22:51:10.659 INFO:tasks.workunit.client.1.smithi170.stdout:0/44: creat d8/fd x:0 0 0 2024-02-15T22:51:10.659 INFO:tasks.workunit.client.1.smithi170.stdout:5/93: creat de/f20 x:0 0 0 2024-02-15T22:51:10.661 INFO:tasks.workunit.client.1.smithi170.stdout:3/41: link d3/f8 d3/f9 0 2024-02-15T22:51:10.661 INFO:tasks.workunit.client.1.smithi170.stdout:3/42: truncate d3/f8 132858 0 2024-02-15T22:51:10.663 INFO:tasks.workunit.client.1.smithi170.stdout:4/7: creat d0/f2 x:0 0 0 2024-02-15T22:51:10.666 INFO:tasks.workunit.client.1.smithi170.stdout:6/45: link d3/d9/f10 d3/d9/f13 0 2024-02-15T22:51:10.666 INFO:tasks.workunit.client.1.smithi170.stdout:6/46: chown d3 32131922 1 2024-02-15T22:51:10.667 INFO:tasks.workunit.client.1.smithi170.stdout:2/39: write d0/f3 [508673,11323] 0 2024-02-15T22:51:10.668 INFO:tasks.workunit.client.1.smithi170.stdout:3/43: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:10.669 INFO:tasks.workunit.client.1.smithi170.stdout:9/22: rename f1 to f2 0 2024-02-15T22:51:10.669 INFO:tasks.workunit.client.1.smithi170.stdout:9/23: stat f0 0 2024-02-15T22:51:10.670 INFO:tasks.workunit.client.1.smithi170.stdout:7/42: mknod da/c10 0 2024-02-15T22:51:10.672 INFO:tasks.workunit.client.1.smithi170.stdout:4/8: mkdir d0/d3 0 2024-02-15T22:51:10.672 INFO:tasks.workunit.client.1.smithi170.stdout:4/9: truncate d0/f2 598440 0 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:2/40: rename d0/d1/f5 to d0/d1/fe 0 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:2/41: creat d0/ff x:0 0 0 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:2/42: dread - d0/d1/fc zero size 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:2/43: dread - d0/fb zero size 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:2/44: write d0/fb [569607,112568] 0 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:3/44: mknod d3/ca 0 2024-02-15T22:51:10.674 INFO:tasks.workunit.client.1.smithi170.stdout:3/45: read d3/f8 [115300,112326] 0 2024-02-15T22:51:10.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/24: mknod c3 0 2024-02-15T22:51:10.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/25: creat f4 x:0 0 0 2024-02-15T22:51:10.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/26: chown f2 0 1 2024-02-15T22:51:10.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/27: chown c3 867866 1 2024-02-15T22:51:10.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/28: dread - f4 zero size 2024-02-15T22:51:10.680 INFO:tasks.workunit.client.1.smithi170.stdout:2/45: mknod d0/d1/c10 0 2024-02-15T22:51:10.682 INFO:tasks.workunit.client.1.smithi170.stdout:3/46: mkdir d3/db 0 2024-02-15T22:51:10.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/45: dwrite d8/fd [0,4194304] 0 2024-02-15T22:51:10.684 INFO:tasks.workunit.client.1.smithi170.stdout:5/94: dwrite fa [0,4194304] 0 2024-02-15T22:51:10.685 INFO:tasks.workunit.client.1.smithi170.stdout:7/43: symlink da/l11 0 2024-02-15T22:51:10.686 INFO:tasks.workunit.client.1.smithi170.stdout:3/47: truncate d3/f5 917883 0 2024-02-15T22:51:10.686 INFO:tasks.workunit.client.1.smithi170.stdout:3/48: truncate d3/f9 1112835 0 2024-02-15T22:51:10.686 INFO:tasks.workunit.client.1.smithi170.stdout:3/49: stat d3/f5 0 2024-02-15T22:51:10.686 INFO:tasks.workunit.client.1.smithi170.stdout:3/50: chown d3 833 1 2024-02-15T22:51:10.689 INFO:tasks.workunit.client.1.smithi170.stdout:4/10: fsync d0/f2 0 2024-02-15T22:51:10.689 INFO:tasks.workunit.client.1.smithi170.stdout:4/11: fsync d0/f2 0 2024-02-15T22:51:10.689 INFO:tasks.workunit.client.1.smithi170.stdout:4/12: write d0/f2 [1425590,88835] 0 2024-02-15T22:51:10.691 INFO:tasks.workunit.client.1.smithi170.stdout:5/95: creat de/f21 x:0 0 0 2024-02-15T22:51:10.693 INFO:tasks.workunit.client.1.smithi170.stdout:4/13: symlink d0/l4 0 2024-02-15T22:51:10.693 INFO:tasks.workunit.client.1.smithi170.stdout:4/14: write d0/f2 [1732118,32196] 0 2024-02-15T22:51:10.696 INFO:tasks.workunit.client.1.smithi170.stdout:9/29: dwrite f4 [0,4194304] 0 2024-02-15T22:51:10.697 INFO:tasks.workunit.client.1.smithi170.stdout:0/46: rmdir d8 39 2024-02-15T22:51:10.698 INFO:tasks.workunit.client.1.smithi170.stdout:5/96: symlink de/d10/l22 0 2024-02-15T22:51:10.704 INFO:tasks.workunit.client.1.smithi170.stdout:0/47: rename d8/fd to d8/fe 0 2024-02-15T22:51:10.705 INFO:tasks.workunit.client.1.smithi170.stdout:0/48: mkdir d8/df 0 2024-02-15T22:51:10.708 INFO:tasks.workunit.client.1.smithi170.stdout:2/46: dwrite d0/d1/f8 [0,4194304] 0 2024-02-15T22:51:10.712 INFO:tasks.workunit.client.1.smithi170.stdout:9/30: dread f0 [0,4194304] 0 2024-02-15T22:51:10.713 INFO:tasks.workunit.client.1.smithi170.stdout:2/47: mkdir d0/d1/d11 0 2024-02-15T22:51:10.713 INFO:tasks.workunit.client.1.smithi170.stdout:2/48: creat d0/d1/f12 x:0 0 0 2024-02-15T22:51:10.713 INFO:tasks.workunit.client.1.smithi170.stdout:7/44: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:10.721 INFO:tasks.workunit.client.1.smithi170.stdout:7/45: rename f7 to da/f12 0 2024-02-15T22:51:10.730 INFO:tasks.workunit.client.1.smithi170.stdout:5/97: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:10.732 INFO:tasks.workunit.client.1.smithi170.stdout:5/98: dread - de/f16 zero size 2024-02-15T22:51:10.732 INFO:tasks.workunit.client.1.smithi170.stdout:5/99: stat de/d10/l1b 0 2024-02-15T22:51:10.733 INFO:tasks.workunit.client.1.smithi170.stdout:5/100: creat de/d10/f23 x:0 0 0 2024-02-15T22:51:10.734 INFO:tasks.workunit.client.1.smithi170.stdout:7/46: write da/fc [3243485,56813] 0 2024-02-15T22:51:10.744 INFO:tasks.workunit.client.1.smithi170.stdout:0/49: dwrite f6 [0,4194304] 0 2024-02-15T22:51:10.750 INFO:tasks.workunit.client.1.smithi170.stdout:7/47: write da/fe [3532677,19908] 0 2024-02-15T22:51:10.752 INFO:tasks.workunit.client.1.smithi170.stdout:4/15: dwrite d0/f2 [0,4194304] 0 2024-02-15T22:51:10.753 INFO:tasks.workunit.client.1.smithi170.stdout:5/101: dwrite de/f1a [0,4194304] 0 2024-02-15T22:51:10.753 INFO:tasks.workunit.client.1.smithi170.stdout:2/49: dwrite d0/d1/f9 [0,4194304] 0 2024-02-15T22:51:10.753 INFO:tasks.workunit.client.1.smithi170.stdout:5/102: creat de/d10/f24 x:0 0 0 2024-02-15T22:51:10.754 INFO:tasks.workunit.client.1.smithi170.stdout:7/48: fsync da/fc 0 2024-02-15T22:51:10.755 INFO:tasks.workunit.client.1.smithi170.stdout:4/16: rename d0/f2 to d0/d3/f5 0 2024-02-15T22:51:10.755 INFO:tasks.workunit.client.1.smithi170.stdout:5/103: dread de/d10/f13 [0,4194304] 0 2024-02-15T22:51:10.761 INFO:tasks.workunit.client.1.smithi170.stdout:2/50: mkdir d0/d13 0 2024-02-15T22:51:10.761 INFO:tasks.workunit.client.1.smithi170.stdout:2/51: write d0/f3 [1717379,103412] 0 2024-02-15T22:51:10.761 INFO:tasks.workunit.client.1.smithi170.stdout:2/52: readlink d0/d1/l2 0 2024-02-15T22:51:10.761 INFO:tasks.workunit.client.1.smithi170.stdout:2/53: write d0/f3 [107126,62269] 0 2024-02-15T22:51:10.761 INFO:tasks.workunit.client.1.smithi170.stdout:2/54: getdents d0/d13 0 2024-02-15T22:51:10.764 INFO:tasks.workunit.client.1.smithi170.stdout:7/49: creat da/f13 x:0 0 0 2024-02-15T22:51:10.764 INFO:tasks.workunit.client.1.smithi170.stdout:4/17: write d0/d3/f5 [4794877,111432] 0 2024-02-15T22:51:10.768 INFO:tasks.workunit.client.1.smithi170.stdout:2/55: mknod d0/d13/c14 0 2024-02-15T22:51:10.768 INFO:tasks.workunit.client.1.smithi170.stdout:0/50: dwrite d8/fa [0,4194304] 0 2024-02-15T22:51:10.769 INFO:tasks.workunit.client.1.smithi170.stdout:4/18: fdatasync d0/d3/f5 0 2024-02-15T22:51:10.769 INFO:tasks.workunit.client.1.smithi170.stdout:2/56: symlink d0/d13/l15 0 2024-02-15T22:51:10.771 INFO:tasks.workunit.client.1.smithi170.stdout:7/50: fsync da/f12 0 2024-02-15T22:51:10.772 INFO:tasks.workunit.client.1.smithi170.stdout:0/51: getdents d8 0 2024-02-15T22:51:10.772 INFO:tasks.workunit.client.1.smithi170.stdout:0/52: dread - f4 zero size 2024-02-15T22:51:10.774 INFO:tasks.workunit.client.1.smithi170.stdout:2/57: mknod d0/c16 0 2024-02-15T22:51:10.774 INFO:tasks.workunit.client.1.smithi170.stdout:2/58: chown d0/f3 100839912 1 2024-02-15T22:51:10.774 INFO:tasks.workunit.client.1.smithi170.stdout:2/59: fdatasync d0/fb 0 2024-02-15T22:51:10.776 INFO:tasks.workunit.client.1.smithi170.stdout:7/51: creat da/f14 x:0 0 0 2024-02-15T22:51:10.779 INFO:tasks.workunit.client.1.smithi170.stdout:5/104: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:10.783 INFO:tasks.workunit.client.1.smithi170.stdout:4/19: write d0/d3/f5 [1234518,75435] 0 2024-02-15T22:51:10.783 INFO:tasks.workunit.client.1.smithi170.stdout:4/20: write d0/d3/f5 [440442,17348] 0 2024-02-15T22:51:10.783 INFO:tasks.workunit.client.1.smithi170.stdout:5/105: dread f0 [0,4194304] 0 2024-02-15T22:51:10.785 INFO:tasks.workunit.client.1.smithi170.stdout:5/106: creat de/f25 x:0 0 0 2024-02-15T22:51:10.786 INFO:tasks.workunit.client.1.smithi170.stdout:5/107: readlink de/l17 0 2024-02-15T22:51:10.786 INFO:tasks.workunit.client.1.smithi170.stdout:5/108: chown f0 228534012 1 2024-02-15T22:51:10.795 INFO:tasks.workunit.client.1.smithi170.stdout:4/21: truncate d0/d3/f5 407883 0 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:2/60: dwrite d0/ff [0,4194304] 0 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:2/61: write d0/d1/fc [226910,97485] 0 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:2/62: creat d0/f17 x:0 0 0 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:2/63: dread - d0/d1/f12 zero size 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:2/64: write d0/d1/f12 [583705,1922] 0 2024-02-15T22:51:10.802 INFO:tasks.workunit.client.1.smithi170.stdout:7/52: dwrite da/f12 [0,4194304] 0 2024-02-15T22:51:10.807 INFO:tasks.workunit.client.1.smithi170.stdout:2/65: mknod d0/d13/c18 0 2024-02-15T22:51:10.809 INFO:tasks.workunit.client.1.smithi170.stdout:7/53: mkdir da/d15 0 2024-02-15T22:51:10.809 INFO:tasks.workunit.client.1.smithi170.stdout:7/54: write da/fe [5116304,18658] 0 2024-02-15T22:51:10.809 INFO:tasks.workunit.client.1.smithi170.stdout:7/55: write da/fd [820480,92906] 0 2024-02-15T22:51:10.810 INFO:tasks.workunit.client.1.smithi170.stdout:2/66: dread d0/fb [0,4194304] 0 2024-02-15T22:51:10.810 INFO:tasks.workunit.client.1.smithi170.stdout:5/109: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:10.811 INFO:tasks.workunit.client.1.smithi170.stdout:7/56: creat da/f16 x:0 0 0 2024-02-15T22:51:10.813 INFO:tasks.workunit.client.1.smithi170.stdout:2/67: unlink d0/f6 0 2024-02-15T22:51:10.814 INFO:tasks.workunit.client.1.smithi170.stdout:5/110: creat de/f26 x:0 0 0 2024-02-15T22:51:10.815 INFO:tasks.workunit.client.1.smithi170.stdout:2/68: rename d0/d13/c18 to d0/d1/d11/c19 0 2024-02-15T22:51:10.816 INFO:tasks.workunit.client.1.smithi170.stdout:5/111: mkdir de/d10/d27 0 2024-02-15T22:51:10.816 INFO:tasks.workunit.client.1.smithi170.stdout:4/22: dwrite d0/d3/f5 [0,4194304] 0 2024-02-15T22:51:10.818 INFO:tasks.workunit.client.1.smithi170.stdout:5/112: mknod de/c28 0 2024-02-15T22:51:10.819 INFO:tasks.workunit.client.1.smithi170.stdout:7/57: dread da/fe [4194304,4194304] 0 2024-02-15T22:51:10.820 INFO:tasks.workunit.client.1.smithi170.stdout:5/113: write f1 [2330853,106110] 0 2024-02-15T22:51:10.830 INFO:tasks.workunit.client.1.smithi170.stdout:2/69: write d0/d1/f9 [1990755,79559] 0 2024-02-15T22:51:10.830 INFO:tasks.workunit.client.1.smithi170.stdout:2/70: creat d0/d1/f1a x:0 0 0 2024-02-15T22:51:10.834 INFO:tasks.workunit.client.1.smithi170.stdout:4/23: dwrite d0/d3/f5 [4194304,4194304] 0 2024-02-15T22:51:10.834 INFO:tasks.workunit.client.1.smithi170.stdout:4/24: chown d0 4889301 1 2024-02-15T22:51:10.843 INFO:tasks.workunit.client.1.smithi170.stdout:4/25: dread d0/d3/f5 [4194304,4194304] 0 2024-02-15T22:51:10.850 INFO:tasks.workunit.client.1.smithi170.stdout:2/71: unlink d0/f3 0 2024-02-15T22:51:10.855 INFO:tasks.workunit.client.1.smithi170.stdout:4/26: dwrite d0/d3/f5 [0,4194304] 0 2024-02-15T22:51:10.858 INFO:tasks.workunit.client.1.smithi170.stdout:2/72: mknod d0/d13/c1b 0 2024-02-15T22:51:10.861 INFO:tasks.workunit.client.1.smithi170.stdout:2/73: symlink d0/d13/l1c 0 2024-02-15T22:51:10.869 INFO:tasks.workunit.client.1.smithi170.stdout:4/27: dwrite d0/d3/f5 [0,4194304] 0 2024-02-15T22:51:10.869 INFO:tasks.workunit.client.1.smithi170.stdout:4/28: chown d0/l4 385218664 1 2024-02-15T22:51:10.877 INFO:tasks.workunit.client.1.smithi170.stdout:4/29: write d0/d3/f5 [2253067,107545] 0 2024-02-15T22:51:10.877 INFO:tasks.workunit.client.1.smithi170.stdout:2/74: dwrite d0/d1/f1a [0,4194304] 0 2024-02-15T22:51:10.879 INFO:tasks.workunit.client.1.smithi170.stdout:2/75: getdents d0/d1 0 2024-02-15T22:51:10.880 INFO:tasks.workunit.client.1.smithi170.stdout:2/76: truncate d0/d1/fe 945860 0 2024-02-15T22:51:10.880 INFO:tasks.workunit.client.1.smithi170.stdout:2/77: mkdir d0/d1d 0 2024-02-15T22:51:10.882 INFO:tasks.workunit.client.1.smithi170.stdout:2/78: creat d0/d13/f1e x:0 0 0 2024-02-15T22:51:10.882 INFO:tasks.workunit.client.1.smithi170.stdout:2/79: truncate d0/f7 909307 0 2024-02-15T22:51:10.883 INFO:tasks.workunit.client.1.smithi170.stdout:2/80: mknod d0/d1/c1f 0 2024-02-15T22:51:10.883 INFO:tasks.workunit.client.1.smithi170.stdout:2/81: chown d0/fb 115262330 1 2024-02-15T22:51:10.883 INFO:tasks.workunit.client.1.smithi170.stdout:2/82: mknod d0/c20 0 2024-02-15T22:51:10.884 INFO:tasks.workunit.client.1.smithi170.stdout:4/30: truncate d0/d3/f5 5070564 0 2024-02-15T22:51:10.888 INFO:tasks.workunit.client.1.smithi170.stdout:4/31: fsync d0/d3/f5 0 2024-02-15T22:51:10.889 INFO:tasks.workunit.client.1.smithi170.stdout:4/32: rename d0/d3 to d0/d6 0 2024-02-15T22:51:10.898 INFO:tasks.workunit.client.1.smithi170.stdout:4/33: rmdir d0 39 2024-02-15T22:51:10.899 INFO:tasks.workunit.client.1.smithi170.stdout:4/34: mknod d0/c7 0 2024-02-15T22:51:10.900 INFO:tasks.workunit.client.1.smithi170.stdout:4/35: write d0/d6/f5 [5088166,99786] 0 2024-02-15T22:51:10.904 INFO:tasks.workunit.client.1.smithi170.stdout:2/83: dwrite d0/ff [0,4194304] 0 2024-02-15T22:51:10.905 INFO:tasks.workunit.client.1.smithi170.stdout:2/84: mknod d0/d13/c21 0 2024-02-15T22:51:10.908 INFO:tasks.workunit.client.1.smithi170.stdout:2/85: dread d0/d1/fc [0,4194304] 0 2024-02-15T22:51:10.910 INFO:tasks.workunit.client.1.smithi170.stdout:2/86: rename d0/f7 to d0/d1d/f22 0 2024-02-15T22:51:10.918 INFO:tasks.workunit.client.1.smithi170.stdout:4/36: dwrite d0/d6/f5 [0,4194304] 0 2024-02-15T22:51:10.922 INFO:tasks.workunit.client.1.smithi170.stdout:2/87: dread d0/d1/f1a [0,4194304] 0 2024-02-15T22:51:10.922 INFO:tasks.workunit.client.1.smithi170.stdout:2/88: write d0/d1/f4 [3377583,62899] 0 2024-02-15T22:51:10.922 INFO:tasks.workunit.client.1.smithi170.stdout:2/89: truncate d0/d1/f12 657040 0 2024-02-15T22:51:10.927 INFO:tasks.workunit.client.1.smithi170.stdout:2/90: getdents d0/d1d 0 2024-02-15T22:51:10.928 INFO:tasks.workunit.client.1.smithi170.stdout:2/91: truncate d0/d1/fc 247595 0 2024-02-15T22:51:10.938 INFO:tasks.workunit.client.1.smithi170.stdout:4/37: dwrite d0/d6/f5 [4194304,4194304] 0 2024-02-15T22:51:10.938 INFO:tasks.workunit.client.1.smithi170.stdout:2/92: truncate d0/ff 3839081 0 2024-02-15T22:51:10.940 INFO:tasks.workunit.client.1.smithi170.stdout:2/93: symlink d0/l23 0 2024-02-15T22:51:10.945 INFO:tasks.workunit.client.1.smithi170.stdout:4/38: dread d0/d6/f5 [0,4194304] 0 2024-02-15T22:51:10.957 INFO:tasks.workunit.client.1.smithi170.stdout:2/94: dread d0/ff [0,4194304] 0 2024-02-15T22:51:10.958 INFO:tasks.workunit.client.1.smithi170.stdout:2/95: symlink d0/d1/l24 0 2024-02-15T22:51:10.963 INFO:tasks.workunit.client.1.smithi170.stdout:4/39: dwrite d0/d6/f5 [4194304,4194304] 0 2024-02-15T22:51:10.965 INFO:tasks.workunit.client.1.smithi170.stdout:4/40: mknod d0/d6/c8 0 2024-02-15T22:51:10.965 INFO:tasks.workunit.client.1.smithi170.stdout:2/96: truncate d0/d1d/f22 770499 0 2024-02-15T22:51:10.965 INFO:tasks.workunit.client.1.smithi170.stdout:2/97: creat d0/f25 x:0 0 0 2024-02-15T22:51:10.966 INFO:tasks.workunit.client.1.smithi170.stdout:4/41: rmdir d0 39 2024-02-15T22:51:10.968 INFO:tasks.workunit.client.1.smithi170.stdout:2/98: mkdir d0/d1/d11/d26 0 2024-02-15T22:51:10.968 INFO:tasks.workunit.client.1.smithi170.stdout:2/99: write d0/f25 [936641,10489] 0 2024-02-15T22:51:10.970 INFO:tasks.workunit.client.1.smithi170.stdout:2/100: rename d0/d13/f1e to d0/d1/f27 0 2024-02-15T22:51:10.975 INFO:tasks.workunit.client.1.smithi170.stdout:4/42: dread d0/d6/f5 [4194304,4194304] 0 2024-02-15T22:51:10.977 INFO:tasks.workunit.client.1.smithi170.stdout:4/43: rename d0/c7 to d0/d6/c9 0 2024-02-15T22:51:10.977 INFO:tasks.workunit.client.1.smithi170.stdout:4/44: fdatasync d0/d6/f5 0 2024-02-15T22:51:10.978 INFO:tasks.workunit.client.1.smithi170.stdout:2/101: dread d0/d1/f4 [0,4194304] 0 2024-02-15T22:51:10.980 INFO:tasks.workunit.client.1.smithi170.stdout:4/45: dread d0/d6/f5 [0,4194304] 0 2024-02-15T22:51:10.981 INFO:tasks.workunit.client.1.smithi170.stdout:2/102: fsync d0/f25 0 2024-02-15T22:51:10.981 INFO:tasks.workunit.client.1.smithi170.stdout:4/46: mkdir d0/d6/da 0 2024-02-15T22:51:10.982 INFO:tasks.workunit.client.1.smithi170.stdout:2/103: mkdir d0/d28 0 2024-02-15T22:51:10.982 INFO:tasks.workunit.client.1.smithi170.stdout:1/28: sync 2024-02-15T22:51:10.983 INFO:tasks.workunit.client.1.smithi170.stdout:1/29: stat d3 0 2024-02-15T22:51:10.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:10 smithi138 ceph-mon[29229]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 175 MiB/s wr, 678 op/s 2024-02-15T22:51:10.984 INFO:tasks.workunit.client.1.smithi170.stdout:4/47: mknod d0/d6/cb 0 2024-02-15T22:51:10.985 INFO:tasks.workunit.client.1.smithi170.stdout:1/30: creat d3/f6 x:0 0 0 2024-02-15T22:51:10.987 INFO:tasks.workunit.client.1.smithi170.stdout:1/31: mknod d3/c7 0 2024-02-15T22:51:10.987 INFO:tasks.workunit.client.1.smithi170.stdout:1/32: fdatasync d3/f6 0 2024-02-15T22:51:10.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/48: link d0/d6/c9 d0/cc 0 2024-02-15T22:51:11.003 INFO:tasks.workunit.client.1.smithi170.stdout:1/33: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:11.004 INFO:tasks.workunit.client.1.smithi170.stdout:2/104: dwrite d0/ff [0,4194304] 0 2024-02-15T22:51:11.011 INFO:tasks.workunit.client.1.smithi170.stdout:1/34: dread d3/f6 [0,4194304] 0 2024-02-15T22:51:11.012 INFO:tasks.workunit.client.1.smithi170.stdout:1/35: symlink d3/l8 0 2024-02-15T22:51:11.012 INFO:tasks.workunit.client.1.smithi170.stdout:1/36: chown l0 484 1 2024-02-15T22:51:11.013 INFO:tasks.workunit.client.1.smithi170.stdout:1/37: symlink d3/l9 0 2024-02-15T22:51:11.013 INFO:tasks.workunit.client.1.smithi170.stdout:1/38: write d3/f6 [4384082,98222] 0 2024-02-15T22:51:11.013 INFO:tasks.workunit.client.1.smithi170.stdout:1/39: chown d3/l4 8 1 2024-02-15T22:51:11.013 INFO:tasks.workunit.client.1.smithi170.stdout:1/40: stat d3 0 2024-02-15T22:51:11.019 INFO:tasks.workunit.client.1.smithi170.stdout:2/105: dwrite d0/d1/fe [0,4194304] 0 2024-02-15T22:51:11.035 INFO:tasks.workunit.client.1.smithi170.stdout:1/41: rename l0 to d3/la 0 2024-02-15T22:51:11.035 INFO:tasks.workunit.client.1.smithi170.stdout:1/42: chown d3/l4 86114118 1 2024-02-15T22:51:11.035 INFO:tasks.workunit.client.1.smithi170.stdout:1/43: chown d3 0 1 2024-02-15T22:51:11.038 INFO:tasks.workunit.client.1.smithi170.stdout:2/106: link d0/d1/fc d0/d1/d11/f29 0 2024-02-15T22:51:11.040 INFO:tasks.workunit.client.1.smithi170.stdout:1/44: unlink d3/l4 0 2024-02-15T22:51:11.041 INFO:tasks.workunit.client.1.smithi170.stdout:2/107: mkdir d0/d2a 0 2024-02-15T22:51:11.041 INFO:tasks.workunit.client.1.smithi170.stdout:2/108: fsync d0/d1/f9 0 2024-02-15T22:51:11.041 INFO:tasks.workunit.client.1.smithi170.stdout:2/109: write d0/fb [1668961,9551] 0 2024-02-15T22:51:11.041 INFO:tasks.workunit.client.1.smithi170.stdout:2/110: chown d0/l23 9 1 2024-02-15T22:51:11.044 INFO:tasks.workunit.client.1.smithi170.stdout:2/111: link d0/d1d/f22 d0/d2a/f2b 0 2024-02-15T22:51:11.045 INFO:tasks.workunit.client.1.smithi170.stdout:1/45: truncate d3/f6 1611488 0 2024-02-15T22:51:11.045 INFO:tasks.workunit.client.1.smithi170.stdout:1/46: chown d3/c7 1008 1 2024-02-15T22:51:11.045 INFO:tasks.workunit.client.1.smithi170.stdout:1/47: chown d3/c7 61 1 2024-02-15T22:51:11.047 INFO:tasks.workunit.client.1.smithi170.stdout:2/112: rename d0/fb to d0/f2c 0 2024-02-15T22:51:11.047 INFO:tasks.workunit.client.1.smithi170.stdout:2/113: write d0/f17 [834029,56238] 0 2024-02-15T22:51:11.047 INFO:tasks.workunit.client.1.smithi170.stdout:2/114: chown d0/d1/l2 690 1 2024-02-15T22:51:11.048 INFO:tasks.workunit.client.1.smithi170.stdout:1/48: stat l2 0 2024-02-15T22:51:11.049 INFO:tasks.workunit.client.1.smithi170.stdout:2/115: rename d0/f17 to d0/d1/d11/f2d 0 2024-02-15T22:51:11.049 INFO:tasks.workunit.client.1.smithi170.stdout:2/116: write d0/f2c [2367310,26388] 0 2024-02-15T22:51:11.051 INFO:tasks.workunit.client.1.smithi170.stdout:2/117: symlink d0/d2a/l2e 0 2024-02-15T22:51:11.053 INFO:tasks.workunit.client.1.smithi170.stdout:1/49: rmdir d3 39 2024-02-15T22:51:11.056 INFO:tasks.workunit.client.1.smithi170.stdout:1/50: creat d3/fb x:0 0 0 2024-02-15T22:51:11.058 INFO:tasks.workunit.client.1.smithi170.stdout:1/51: rename d3/l8 to d3/lc 0 2024-02-15T22:51:11.059 INFO:tasks.workunit.client.1.smithi170.stdout:1/52: symlink d3/ld 0 2024-02-15T22:51:11.059 INFO:tasks.workunit.client.1.smithi170.stdout:1/53: chown d3/f6 0 1 2024-02-15T22:51:11.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/54: mknod d3/ce 0 2024-02-15T22:51:11.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/55: read - d3/fb zero size 2024-02-15T22:51:11.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/56: write d3/f6 [2660054,85029] 0 2024-02-15T22:51:11.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/57: fsync d3/fb 0 2024-02-15T22:51:11.061 INFO:tasks.workunit.client.1.smithi170.stdout:1/58: symlink d3/lf 0 2024-02-15T22:51:11.061 INFO:tasks.workunit.client.1.smithi170.stdout:1/59: stat d3/ce 0 2024-02-15T22:51:11.061 INFO:tasks.workunit.client.1.smithi170.stdout:1/60: creat d3/f10 x:0 0 0 2024-02-15T22:51:11.062 INFO:tasks.workunit.client.1.smithi170.stdout:2/118: truncate d0/f2c 763328 0 2024-02-15T22:51:11.063 INFO:tasks.workunit.client.1.smithi170.stdout:2/119: mkdir d0/d28/d2f 0 2024-02-15T22:51:11.064 INFO:tasks.workunit.client.1.smithi170.stdout:2/120: read d0/d2a/f2b [289312,17922] 0 2024-02-15T22:51:11.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/61: truncate d3/f6 1549302 0 2024-02-15T22:51:11.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/62: dread - d3/f10 zero size 2024-02-15T22:51:11.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/63: chown d3/la 3812 1 2024-02-15T22:51:11.068 INFO:tasks.workunit.client.1.smithi170.stdout:2/121: write d0/f2c [456563,8176] 0 2024-02-15T22:51:11.070 INFO:tasks.workunit.client.1.smithi170.stdout:1/64: unlink d3/c7 0 2024-02-15T22:51:11.070 INFO:tasks.workunit.client.1.smithi170.stdout:1/65: readlink d3/l9 0 2024-02-15T22:51:11.071 INFO:tasks.workunit.client.1.smithi170.stdout:2/122: mknod d0/c30 0 2024-02-15T22:51:11.072 INFO:tasks.workunit.client.1.smithi170.stdout:2/123: mkdir d0/d1/d31 0 2024-02-15T22:51:11.073 INFO:tasks.workunit.client.1.smithi170.stdout:2/124: chown d0/d28/d2f 805222 1 2024-02-15T22:51:11.073 INFO:tasks.workunit.client.1.smithi170.stdout:2/125: write d0/f2c [1602076,29081] 0 2024-02-15T22:51:11.074 INFO:tasks.workunit.client.1.smithi170.stdout:2/126: creat d0/d1d/f32 x:0 0 0 2024-02-15T22:51:11.074 INFO:tasks.workunit.client.1.smithi170.stdout:2/127: write d0/d1/f27 [563455,471] 0 2024-02-15T22:51:11.075 INFO:tasks.workunit.client.1.smithi170.stdout:2/128: read d0/d1/fc [59940,89790] 0 2024-02-15T22:51:11.075 INFO:tasks.workunit.client.1.smithi170.stdout:2/129: write d0/d1/d11/f29 [658760,113905] 0 2024-02-15T22:51:11.076 INFO:tasks.workunit.client.1.smithi170.stdout:2/130: getdents d0/d13 0 2024-02-15T22:51:11.079 INFO:tasks.workunit.client.1.smithi170.stdout:2/131: rename d0/d1/l2 to d0/d2a/l33 0 2024-02-15T22:51:11.080 INFO:tasks.workunit.client.1.smithi170.stdout:2/132: rename d0/d1d/f32 to d0/d1/d31/f34 0 2024-02-15T22:51:11.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/133: dread d0/f25 [0,4194304] 0 2024-02-15T22:51:11.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/134: creat d0/d1d/f35 x:0 0 0 2024-02-15T22:51:11.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/135: readlink d0/d13/l15 0 2024-02-15T22:51:11.087 INFO:tasks.workunit.client.1.smithi170.stdout:1/66: dwrite d3/f10 [0,4194304] 0 2024-02-15T22:51:11.096 INFO:tasks.workunit.client.1.smithi170.stdout:1/67: write d3/f10 [2657016,105102] 0 2024-02-15T22:51:11.096 INFO:tasks.workunit.client.1.smithi170.stdout:1/68: chown d3/lf 60040044 1 2024-02-15T22:51:11.096 INFO:tasks.workunit.client.1.smithi170.stdout:1/69: chown d3/lf 343827 1 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:9/31: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:6/47: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:8/26: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:7/58: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:0/53: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:5/114: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:9/32: fdatasync f2 0 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:3/51: sync 2024-02-15T22:51:11.113 INFO:tasks.workunit.client.1.smithi170.stdout:9/33: readlink - no filename 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:3/52: getdents d3/db 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:3/53: readlink - no filename 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:8/27: creat f7 x:0 0 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:5/115: write de/f1a [4357765,92091] 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:7/59: write da/fc [881504,127055] 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:8/28: write f7 [491767,34359] 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:7/60: write da/f14 [126046,49503] 0 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:8/29: chown l3 29311185 1 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:7/61: chown da/f12 919 1 2024-02-15T22:51:11.114 INFO:tasks.workunit.client.1.smithi170.stdout:8/30: chown c2 0 1 2024-02-15T22:51:11.116 INFO:tasks.workunit.client.1.smithi170.stdout:8/31: fdatasync f7 0 2024-02-15T22:51:11.116 INFO:tasks.workunit.client.1.smithi170.stdout:8/32: readlink l3 0 2024-02-15T22:51:11.119 INFO:tasks.workunit.client.1.smithi170.stdout:6/48: dread d3/d9/fc [0,4194304] 0 2024-02-15T22:51:11.119 INFO:tasks.workunit.client.1.smithi170.stdout:6/49: write d3/d9/f13 [563942,11792] 0 2024-02-15T22:51:11.125 INFO:tasks.workunit.client.1.smithi170.stdout:7/62: dread da/fc [0,4194304] 0 2024-02-15T22:51:11.127 INFO:tasks.workunit.client.1.smithi170.stdout:9/34: write f4 [3670532,102886] 0 2024-02-15T22:51:11.127 INFO:tasks.workunit.client.1.smithi170.stdout:6/50: dread d3/f4 [0,4194304] 0 2024-02-15T22:51:11.127 INFO:tasks.workunit.client.1.smithi170.stdout:6/51: creat d3/d9/f14 x:0 0 0 2024-02-15T22:51:11.130 INFO:tasks.workunit.client.1.smithi170.stdout:7/63: dread da/fc [0,4194304] 0 2024-02-15T22:51:11.131 INFO:tasks.workunit.client.1.smithi170.stdout:7/64: chown da/f13 6 1 2024-02-15T22:51:11.131 INFO:tasks.workunit.client.1.smithi170.stdout:3/54: mkdir d3/dc 0 2024-02-15T22:51:11.132 INFO:tasks.workunit.client.1.smithi170.stdout:8/33: stat c2 0 2024-02-15T22:51:11.134 INFO:tasks.workunit.client.1.smithi170.stdout:8/34: read f7 [261502,14494] 0 2024-02-15T22:51:11.134 INFO:tasks.workunit.client.1.smithi170.stdout:8/35: truncate f5 780442 0 2024-02-15T22:51:11.134 INFO:tasks.workunit.client.1.smithi170.stdout:8/36: chown c4 7991 1 2024-02-15T22:51:11.134 INFO:tasks.workunit.client.1.smithi170.stdout:8/37: write f7 [1426812,11244] 0 2024-02-15T22:51:11.134 INFO:tasks.workunit.client.1.smithi170.stdout:9/35: symlink l5 0 2024-02-15T22:51:11.137 INFO:tasks.workunit.client.1.smithi170.stdout:3/55: creat d3/db/fd x:0 0 0 2024-02-15T22:51:11.138 INFO:tasks.workunit.client.1.smithi170.stdout:5/116: mkdir de/d29 0 2024-02-15T22:51:11.138 INFO:tasks.workunit.client.1.smithi170.stdout:5/117: chown de/f1a 10715 1 2024-02-15T22:51:11.141 INFO:tasks.workunit.client.1.smithi170.stdout:9/36: rename f0 to f6 0 2024-02-15T22:51:11.144 INFO:tasks.workunit.client.1.smithi170.stdout:7/65: mknod da/c17 0 2024-02-15T22:51:11.144 INFO:tasks.workunit.client.1.smithi170.stdout:7/66: fdatasync da/fd 0 2024-02-15T22:51:11.156 INFO:tasks.workunit.client.1.smithi170.stdout:7/67: dread da/fc [0,4194304] 0 2024-02-15T22:51:11.156 INFO:tasks.workunit.client.1.smithi170.stdout:7/68: write da/fd [1717325,72362] 0 2024-02-15T22:51:11.157 INFO:tasks.workunit.client.1.smithi170.stdout:7/69: rename da/f16 to da/d15/f18 0 2024-02-15T22:51:11.158 INFO:tasks.workunit.client.1.smithi170.stdout:3/56: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:11.158 INFO:tasks.workunit.client.1.smithi170.stdout:3/57: fsync d3/f7 0 2024-02-15T22:51:11.159 INFO:tasks.workunit.client.1.smithi170.stdout:7/70: unlink da/f14 0 2024-02-15T22:51:11.160 INFO:tasks.workunit.client.1.smithi170.stdout:3/58: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:11.161 INFO:tasks.workunit.client.1.smithi170.stdout:7/71: unlink da/fd 0 2024-02-15T22:51:11.162 INFO:tasks.workunit.client.1.smithi170.stdout:7/72: mkdir da/d15/d19 0 2024-02-15T22:51:11.163 INFO:tasks.workunit.client.1.smithi170.stdout:7/73: unlink da/c17 0 2024-02-15T22:51:11.165 INFO:tasks.workunit.client.1.smithi170.stdout:9/37: dwrite f2 [0,4194304] 0 2024-02-15T22:51:11.165 INFO:tasks.workunit.client.1.smithi170.stdout:9/38: chown c3 11654 1 2024-02-15T22:51:11.165 INFO:tasks.workunit.client.1.smithi170.stdout:9/39: creat f7 x:0 0 0 2024-02-15T22:51:11.166 INFO:tasks.workunit.client.1.smithi170.stdout:5/118: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:11.166 INFO:tasks.workunit.client.1.smithi170.stdout:5/119: chown de/f1e 8090187 1 2024-02-15T22:51:11.166 INFO:tasks.workunit.client.1.smithi170.stdout:5/120: stat de/d10/f13 0 2024-02-15T22:51:11.166 INFO:tasks.workunit.client.1.smithi170.stdout:5/121: write de/f21 [991585,22089] 0 2024-02-15T22:51:11.170 INFO:tasks.workunit.client.1.smithi170.stdout:5/122: creat de/d10/d27/f2a x:0 0 0 2024-02-15T22:51:11.170 INFO:tasks.workunit.client.1.smithi170.stdout:5/123: write de/f16 [601050,95893] 0 2024-02-15T22:51:11.171 INFO:tasks.workunit.client.1.smithi170.stdout:5/124: mknod de/c2b 0 2024-02-15T22:51:11.173 INFO:tasks.workunit.client.1.smithi170.stdout:5/125: symlink de/d10/l2c 0 2024-02-15T22:51:11.199 INFO:tasks.workunit.client.1.smithi170.stdout:3/59: dwrite d3/f7 [0,4194304] 0 2024-02-15T22:51:11.199 INFO:tasks.workunit.client.1.smithi170.stdout:3/60: chown d3/ca 2105108 1 2024-02-15T22:51:11.201 INFO:tasks.workunit.client.1.smithi170.stdout:3/61: unlink d3/db/fd 0 2024-02-15T22:51:11.203 INFO:tasks.workunit.client.1.smithi170.stdout:3/62: symlink d3/dc/le 0 2024-02-15T22:51:11.203 INFO:tasks.workunit.client.1.smithi170.stdout:3/63: fsync d3/f9 0 2024-02-15T22:51:11.203 INFO:tasks.workunit.client.1.smithi170.stdout:3/64: write d3/f6 [5011478,59792] 0 2024-02-15T22:51:11.203 INFO:tasks.workunit.client.1.smithi170.stdout:3/65: readlink d3/dc/le 0 2024-02-15T22:51:11.203 INFO:tasks.workunit.client.1.smithi170.stdout:3/66: creat d3/dc/ff x:0 0 0 2024-02-15T22:51:11.204 INFO:tasks.workunit.client.1.smithi170.stdout:3/67: symlink d3/dc/l10 0 2024-02-15T22:51:11.207 INFO:tasks.workunit.client.1.smithi170.stdout:9/40: dwrite f7 [0,4194304] 0 2024-02-15T22:51:11.207 INFO:tasks.workunit.client.1.smithi170.stdout:7/74: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:11.208 INFO:tasks.workunit.client.1.smithi170.stdout:5/126: dwrite fd [0,4194304] 0 2024-02-15T22:51:11.212 INFO:tasks.workunit.client.1.smithi170.stdout:7/75: unlink da/d15/f18 0 2024-02-15T22:51:11.219 INFO:tasks.workunit.client.1.smithi170.stdout:9/41: write f2 [3245316,17201] 0 2024-02-15T22:51:11.219 INFO:tasks.workunit.client.1.smithi170.stdout:9/42: creat f8 x:0 0 0 2024-02-15T22:51:11.221 INFO:tasks.workunit.client.1.smithi170.stdout:5/127: mkdir de/d10/d27/d2d 0 2024-02-15T22:51:11.222 INFO:tasks.workunit.client.1.smithi170.stdout:3/68: dwrite d3/f5 [0,4194304] 0 2024-02-15T22:51:11.222 INFO:tasks.workunit.client.1.smithi170.stdout:3/69: readlink d3/dc/l10 0 2024-02-15T22:51:11.222 INFO:tasks.workunit.client.1.smithi170.stdout:3/70: creat d3/db/f11 x:0 0 0 2024-02-15T22:51:11.224 INFO:tasks.workunit.client.1.smithi170.stdout:3/71: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:11.228 INFO:tasks.workunit.client.1.smithi170.stdout:7/76: dwrite da/f12 [4194304,4194304] 0 2024-02-15T22:51:11.231 INFO:tasks.workunit.client.1.smithi170.stdout:7/77: mkdir da/d1a 0 2024-02-15T22:51:11.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/78: mkdir da/d15/d1b 0 2024-02-15T22:51:11.233 INFO:tasks.workunit.client.1.smithi170.stdout:7/79: unlink da/l11 0 2024-02-15T22:51:11.234 INFO:tasks.workunit.client.1.smithi170.stdout:7/80: mknod da/d15/d1b/c1c 0 2024-02-15T22:51:11.235 INFO:tasks.workunit.client.1.smithi170.stdout:4/49: sync 2024-02-15T22:51:11.236 INFO:tasks.workunit.client.1.smithi170.stdout:5/128: rmdir de/d10/d27 39 2024-02-15T22:51:11.237 INFO:tasks.workunit.client.1.smithi170.stdout:4/50: unlink d0/l1 0 2024-02-15T22:51:11.238 INFO:tasks.workunit.client.1.smithi170.stdout:5/129: read de/f21 [472330,126461] 0 2024-02-15T22:51:11.238 INFO:tasks.workunit.client.1.smithi170.stdout:9/43: dwrite f7 [0,4194304] 0 2024-02-15T22:51:11.239 INFO:tasks.workunit.client.1.smithi170.stdout:4/51: creat d0/fd x:0 0 0 2024-02-15T22:51:11.239 INFO:tasks.workunit.client.1.smithi170.stdout:4/52: chown d0/cc 129745 1 2024-02-15T22:51:11.239 INFO:tasks.workunit.client.1.smithi170.stdout:4/53: chown d0/l4 52 1 2024-02-15T22:51:11.240 INFO:tasks.workunit.client.1.smithi170.stdout:9/44: mknod c9 0 2024-02-15T22:51:11.241 INFO:tasks.workunit.client.1.smithi170.stdout:9/45: mknod ca 0 2024-02-15T22:51:11.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/46: rename f8 to fb 0 2024-02-15T22:51:11.246 INFO:tasks.workunit.client.1.smithi170.stdout:3/72: getdents d3/db 0 2024-02-15T22:51:11.246 INFO:tasks.workunit.client.1.smithi170.stdout:3/73: chown d3/f5 502156 1 2024-02-15T22:51:11.248 INFO:tasks.workunit.client.1.smithi170.stdout:9/47: link f4 fc 0 2024-02-15T22:51:11.248 INFO:tasks.workunit.client.1.smithi170.stdout:9/48: fsync f7 0 2024-02-15T22:51:11.249 INFO:tasks.workunit.client.1.smithi170.stdout:3/74: creat d3/db/f12 x:0 0 0 2024-02-15T22:51:11.249 INFO:tasks.workunit.client.1.smithi170.stdout:3/75: write d3/f8 [1870157,86850] 0 2024-02-15T22:51:11.251 INFO:tasks.workunit.client.1.smithi170.stdout:7/81: truncate da/f12 3912651 0 2024-02-15T22:51:11.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/49: symlink ld 0 2024-02-15T22:51:11.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/50: chown f7 29300473 1 2024-02-15T22:51:11.252 INFO:tasks.workunit.client.1.smithi170.stdout:7/82: symlink da/d15/d1b/l1d 0 2024-02-15T22:51:11.254 INFO:tasks.workunit.client.1.smithi170.stdout:5/130: dwrite de/f26 [0,4194304] 0 2024-02-15T22:51:11.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/54: dwrite d0/fd [0,4194304] 0 2024-02-15T22:51:11.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/55: write d0/d6/f5 [9082512,78182] 0 2024-02-15T22:51:11.256 INFO:tasks.workunit.client.1.smithi170.stdout:9/51: unlink f6 0 2024-02-15T22:51:11.256 INFO:tasks.workunit.client.1.smithi170.stdout:9/52: chown f7 185399 1 2024-02-15T22:51:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:10 smithi170 ceph-mon[35248]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 140 MiB/s rd, 175 MiB/s wr, 678 op/s 2024-02-15T22:51:11.262 INFO:tasks.workunit.client.1.smithi170.stdout:9/53: mkdir de 0 2024-02-15T22:51:11.262 INFO:tasks.workunit.client.1.smithi170.stdout:9/54: fsync f4 0 2024-02-15T22:51:11.263 INFO:tasks.workunit.client.1.smithi170.stdout:9/55: creat de/ff x:0 0 0 2024-02-15T22:51:11.263 INFO:tasks.workunit.client.1.smithi170.stdout:9/56: write f4 [557141,102934] 0 2024-02-15T22:51:11.265 INFO:tasks.workunit.client.1.smithi170.stdout:9/57: mknod de/c10 0 2024-02-15T22:51:11.269 INFO:tasks.workunit.client.1.smithi170.stdout:4/56: dread d0/fd [0,4194304] 0 2024-02-15T22:51:11.275 INFO:tasks.workunit.client.1.smithi170.stdout:9/58: dread f2 [0,4194304] 0 2024-02-15T22:51:11.278 INFO:tasks.workunit.client.1.smithi170.stdout:3/76: dwrite d3/f9 [0,4194304] 0 2024-02-15T22:51:11.278 INFO:tasks.workunit.client.1.smithi170.stdout:3/77: stat d3/db 0 2024-02-15T22:51:11.278 INFO:tasks.workunit.client.1.smithi170.stdout:3/78: truncate d3/db/f12 631906 0 2024-02-15T22:51:11.280 INFO:tasks.workunit.client.1.smithi170.stdout:3/79: mkdir d3/dc/d13 0 2024-02-15T22:51:11.282 INFO:tasks.workunit.client.1.smithi170.stdout:3/80: dread d3/db/f12 [0,4194304] 0 2024-02-15T22:51:11.282 INFO:tasks.workunit.client.1.smithi170.stdout:3/81: creat d3/f14 x:0 0 0 2024-02-15T22:51:11.283 INFO:tasks.workunit.client.1.smithi170.stdout:4/57: dwrite d0/fd [0,4194304] 0 2024-02-15T22:51:11.287 INFO:tasks.workunit.client.1.smithi170.stdout:7/83: dread da/fe [0,4194304] 0 2024-02-15T22:51:11.287 INFO:tasks.workunit.client.1.smithi170.stdout:9/59: dread fc [0,4194304] 0 2024-02-15T22:51:11.287 INFO:tasks.workunit.client.1.smithi170.stdout:9/60: chown fb 0 1 2024-02-15T22:51:11.288 INFO:tasks.workunit.client.1.smithi170.stdout:4/58: write d0/d6/f5 [1381197,58679] 0 2024-02-15T22:51:11.288 INFO:tasks.workunit.client.1.smithi170.stdout:7/84: creat da/d1a/f1e x:0 0 0 2024-02-15T22:51:11.290 INFO:tasks.workunit.client.1.smithi170.stdout:7/85: mknod da/d15/d1b/c1f 0 2024-02-15T22:51:11.292 INFO:tasks.workunit.client.1.smithi170.stdout:3/82: rmdir d3/dc 39 2024-02-15T22:51:11.292 INFO:tasks.workunit.client.1.smithi170.stdout:3/83: fdatasync d3/db/f11 0 2024-02-15T22:51:11.293 INFO:tasks.workunit.client.1.smithi170.stdout:3/84: mknod d3/c15 0 2024-02-15T22:51:11.298 INFO:tasks.workunit.client.1.smithi170.stdout:4/59: dread d0/fd [0,4194304] 0 2024-02-15T22:51:11.301 INFO:tasks.workunit.client.1.smithi170.stdout:4/60: write d0/fd [981119,8903] 0 2024-02-15T22:51:11.310 INFO:tasks.workunit.client.1.smithi170.stdout:4/61: truncate d0/fd 3601934 0 2024-02-15T22:51:11.310 INFO:tasks.workunit.client.1.smithi170.stdout:4/62: creat d0/fe x:0 0 0 2024-02-15T22:51:11.311 INFO:tasks.workunit.client.1.smithi170.stdout:4/63: mkdir d0/d6/da/df 0 2024-02-15T22:51:11.311 INFO:tasks.workunit.client.1.smithi170.stdout:4/64: truncate d0/fe 989312 0 2024-02-15T22:51:11.312 INFO:tasks.workunit.client.1.smithi170.stdout:4/65: dread d0/fe [0,4194304] 0 2024-02-15T22:51:11.314 INFO:tasks.workunit.client.1.smithi170.stdout:7/86: dwrite da/d1a/f1e [0,4194304] 0 2024-02-15T22:51:11.314 INFO:tasks.workunit.client.1.smithi170.stdout:7/87: readlink da/d15/d1b/l1d 0 2024-02-15T22:51:11.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/85: dwrite d3/f8 [4194304,4194304] 0 2024-02-15T22:51:11.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/86: stat d3 0 2024-02-15T22:51:11.318 INFO:tasks.workunit.client.1.smithi170.stdout:0/54: sync 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:2/136: sync 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:7/88: write da/fe [3773848,41714] 0 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:2/137: write d0/d1/d11/f2d [1336225,92760] 0 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:4/66: dread d0/d6/f5 [0,4194304] 0 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:4/67: creat d0/f10 x:0 0 0 2024-02-15T22:51:11.319 INFO:tasks.workunit.client.1.smithi170.stdout:3/87: link d3/f14 d3/f16 0 2024-02-15T22:51:11.321 INFO:tasks.workunit.client.1.smithi170.stdout:0/55: creat d8/f10 x:0 0 0 2024-02-15T22:51:11.326 INFO:tasks.workunit.client.1.smithi170.stdout:4/68: getdents d0/d6 0 2024-02-15T22:51:11.327 INFO:tasks.workunit.client.1.smithi170.stdout:4/69: dread d0/fe [0,4194304] 0 2024-02-15T22:51:11.327 INFO:tasks.workunit.client.1.smithi170.stdout:4/70: chown d0/d6/c8 1295294 1 2024-02-15T22:51:11.328 INFO:tasks.workunit.client.1.smithi170.stdout:0/56: creat d8/df/f11 x:0 0 0 2024-02-15T22:51:11.331 INFO:tasks.workunit.client.1.smithi170.stdout:3/88: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:11.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/71: rename d0/d6/da/df to d0/d6/da/d11 0 2024-02-15T22:51:11.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/72: fdatasync d0/fd 0 2024-02-15T22:51:11.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/73: chown d0/d6/f5 294864149 1 2024-02-15T22:51:11.334 INFO:tasks.workunit.client.1.smithi170.stdout:7/89: dwrite da/f13 [0,4194304] 0 2024-02-15T22:51:11.335 INFO:tasks.workunit.client.1.smithi170.stdout:0/57: rename f4 to d8/df/f12 0 2024-02-15T22:51:11.335 INFO:tasks.workunit.client.1.smithi170.stdout:4/74: rename d0/d6 to d0/d6/d12 22 2024-02-15T22:51:11.336 INFO:tasks.workunit.client.1.smithi170.stdout:4/75: dread - d0/f10 zero size 2024-02-15T22:51:11.337 INFO:tasks.workunit.client.1.smithi170.stdout:3/89: creat d3/dc/f17 x:0 0 0 2024-02-15T22:51:11.340 INFO:tasks.workunit.client.1.smithi170.stdout:7/90: creat da/d15/d19/f20 x:0 0 0 2024-02-15T22:51:11.340 INFO:tasks.workunit.client.1.smithi170.stdout:7/91: write da/fe [441636,23488] 0 2024-02-15T22:51:11.346 INFO:tasks.workunit.client.1.smithi170.stdout:4/76: link d0/fd d0/d6/da/f13 0 2024-02-15T22:51:11.353 INFO:tasks.workunit.client.1.smithi170.stdout:0/58: getdents d8/df 0 2024-02-15T22:51:11.354 INFO:tasks.workunit.client.1.smithi170.stdout:3/90: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:11.354 INFO:tasks.workunit.client.1.smithi170.stdout:3/91: readlink d3/dc/le 0 2024-02-15T22:51:11.355 INFO:tasks.workunit.client.1.smithi170.stdout:0/59: mkdir d8/df/d13 0 2024-02-15T22:51:11.357 INFO:tasks.workunit.client.1.smithi170.stdout:0/60: mkdir d8/d14 0 2024-02-15T22:51:11.357 INFO:tasks.workunit.client.1.smithi170.stdout:0/61: dread - d8/df/f11 zero size 2024-02-15T22:51:11.357 INFO:tasks.workunit.client.1.smithi170.stdout:0/62: write f1 [3806459,93189] 0 2024-02-15T22:51:11.361 INFO:tasks.workunit.client.1.smithi170.stdout:0/63: mknod d8/df/c15 0 2024-02-15T22:51:11.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/92: rename da/d15 to da/d1a/d21 0 2024-02-15T22:51:11.363 INFO:tasks.workunit.client.1.smithi170.stdout:4/77: dwrite d0/fe [0,4194304] 0 2024-02-15T22:51:11.364 INFO:tasks.workunit.client.1.smithi170.stdout:4/78: fdatasync d0/d6/da/f13 0 2024-02-15T22:51:11.364 INFO:tasks.workunit.client.1.smithi170.stdout:0/64: rename d8/fa to d8/d14/f16 0 2024-02-15T22:51:11.364 INFO:tasks.workunit.client.1.smithi170.stdout:0/65: read - d8/df/f12 zero size 2024-02-15T22:51:11.366 INFO:tasks.workunit.client.1.smithi170.stdout:7/93: link l8 da/d1a/d21/l22 0 2024-02-15T22:51:11.368 INFO:tasks.workunit.client.1.smithi170.stdout:0/66: symlink d8/d14/l17 0 2024-02-15T22:51:11.373 INFO:tasks.workunit.client.1.smithi170.stdout:3/92: dwrite d3/db/f11 [0,4194304] 0 2024-02-15T22:51:11.373 INFO:tasks.workunit.client.1.smithi170.stdout:3/93: rename d3 to d3/dc/d13/d18 22 2024-02-15T22:51:11.373 INFO:tasks.workunit.client.1.smithi170.stdout:3/94: creat d3/db/f19 x:0 0 0 2024-02-15T22:51:11.374 INFO:tasks.workunit.client.1.smithi170.stdout:4/79: dread d0/fe [0,4194304] 0 2024-02-15T22:51:11.374 INFO:tasks.workunit.client.1.smithi170.stdout:4/80: fsync d0/fe 0 2024-02-15T22:51:11.377 INFO:tasks.workunit.client.1.smithi170.stdout:7/94: read da/f13 [404739,105212] 0 2024-02-15T22:51:11.377 INFO:tasks.workunit.client.1.smithi170.stdout:7/95: write da/fc [730598,88163] 0 2024-02-15T22:51:11.379 INFO:tasks.workunit.client.1.smithi170.stdout:4/81: write d0/d6/f5 [4204928,52998] 0 2024-02-15T22:51:11.379 INFO:tasks.workunit.client.1.smithi170.stdout:4/82: readlink d0/l4 0 2024-02-15T22:51:11.379 INFO:tasks.workunit.client.1.smithi170.stdout:4/83: fsync d0/d6/da/f13 0 2024-02-15T22:51:11.380 INFO:tasks.workunit.client.1.smithi170.stdout:3/95: mkdir d3/dc/d1a 0 2024-02-15T22:51:11.384 INFO:tasks.workunit.client.1.smithi170.stdout:7/96: rename da/d1a/d21/d1b/c1c to da/d1a/d21/c23 0 2024-02-15T22:51:11.384 INFO:tasks.workunit.client.1.smithi170.stdout:7/97: chown c4 253 1 2024-02-15T22:51:11.384 INFO:tasks.workunit.client.1.smithi170.stdout:7/98: stat da/fc 0 2024-02-15T22:51:11.384 INFO:tasks.workunit.client.1.smithi170.stdout:7/99: chown da/d1a 2481040 1 2024-02-15T22:51:11.384 INFO:tasks.workunit.client.1.smithi170.stdout:7/100: read da/f12 [389892,19962] 0 2024-02-15T22:51:11.385 INFO:tasks.workunit.client.1.smithi170.stdout:3/96: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:11.385 INFO:tasks.workunit.client.1.smithi170.stdout:4/84: creat d0/d6/f14 x:0 0 0 2024-02-15T22:51:11.388 INFO:tasks.workunit.client.1.smithi170.stdout:0/67: getdents d8/d14 0 2024-02-15T22:51:11.391 INFO:tasks.workunit.client.1.smithi170.stdout:3/97: mkdir d3/d1b 0 2024-02-15T22:51:11.393 INFO:tasks.workunit.client.1.smithi170.stdout:0/68: symlink d8/df/d13/l18 0 2024-02-15T22:51:11.395 INFO:tasks.workunit.client.1.smithi170.stdout:3/98: mkdir d3/dc/d1c 0 2024-02-15T22:51:11.396 INFO:tasks.workunit.client.1.smithi170.stdout:0/69: creat d8/df/f19 x:0 0 0 2024-02-15T22:51:11.398 INFO:tasks.workunit.client.1.smithi170.stdout:0/70: creat d8/d14/f1a x:0 0 0 2024-02-15T22:51:11.398 INFO:tasks.workunit.client.1.smithi170.stdout:0/71: creat d8/f1b x:0 0 0 2024-02-15T22:51:11.399 INFO:tasks.workunit.client.1.smithi170.stdout:3/99: rmdir d3/db 39 2024-02-15T22:51:11.403 INFO:tasks.workunit.client.1.smithi170.stdout:0/72: mkdir d8/d14/d1c 0 2024-02-15T22:51:11.406 INFO:tasks.workunit.client.1.smithi170.stdout:3/100: rename d3/f8 to d3/dc/f1d 0 2024-02-15T22:51:11.408 INFO:tasks.workunit.client.1.smithi170.stdout:0/73: symlink d8/df/d13/l1d 0 2024-02-15T22:51:11.408 INFO:tasks.workunit.client.1.smithi170.stdout:0/74: getdents d8/d14/d1c 0 2024-02-15T22:51:11.408 INFO:tasks.workunit.client.1.smithi170.stdout:4/85: getdents d0/d6 0 2024-02-15T22:51:11.410 INFO:tasks.workunit.client.1.smithi170.stdout:8/38: sync 2024-02-15T22:51:11.410 INFO:tasks.workunit.client.1.smithi170.stdout:6/52: sync 2024-02-15T22:51:11.410 INFO:tasks.workunit.client.1.smithi170.stdout:6/53: fsync f2 0 2024-02-15T22:51:11.410 INFO:tasks.workunit.client.1.smithi170.stdout:6/54: readlink d3/d9/lf 0 2024-02-15T22:51:11.411 INFO:tasks.workunit.client.1.smithi170.stdout:1/70: sync 2024-02-15T22:51:11.411 INFO:tasks.workunit.client.1.smithi170.stdout:1/71: creat d3/f11 x:0 0 0 2024-02-15T22:51:11.412 INFO:tasks.workunit.client.1.smithi170.stdout:8/39: dread f5 [0,4194304] 0 2024-02-15T22:51:11.412 INFO:tasks.workunit.client.1.smithi170.stdout:8/40: read f7 [39225,53274] 0 2024-02-15T22:51:11.412 INFO:tasks.workunit.client.1.smithi170.stdout:8/41: rmdir - no directory 2024-02-15T22:51:11.413 INFO:tasks.workunit.client.1.smithi170.stdout:6/55: mkdir d3/d15 0 2024-02-15T22:51:11.419 INFO:tasks.workunit.client.1.smithi170.stdout:1/72: link d3/ld d3/l12 0 2024-02-15T22:51:11.419 INFO:tasks.workunit.client.1.smithi170.stdout:1/73: write d3/fb [293694,62643] 0 2024-02-15T22:51:11.421 INFO:tasks.workunit.client.1.smithi170.stdout:8/42: link c2 c8 0 2024-02-15T22:51:11.421 INFO:tasks.workunit.client.1.smithi170.stdout:8/43: chown f7 11489 1 2024-02-15T22:51:11.431 INFO:tasks.workunit.client.1.smithi170.stdout:8/44: dread f7 [0,4194304] 0 2024-02-15T22:51:11.431 INFO:tasks.workunit.client.1.smithi170.stdout:8/45: fsync f5 0 2024-02-15T22:51:11.433 INFO:tasks.workunit.client.1.smithi170.stdout:8/46: mkdir d9 0 2024-02-15T22:51:11.433 INFO:tasks.workunit.client.1.smithi170.stdout:8/47: fdatasync f5 0 2024-02-15T22:51:11.434 INFO:tasks.workunit.client.1.smithi170.stdout:8/48: symlink d9/la 0 2024-02-15T22:51:11.434 INFO:tasks.workunit.client.1.smithi170.stdout:8/49: write f7 [2365129,107073] 0 2024-02-15T22:51:11.434 INFO:tasks.workunit.client.1.smithi170.stdout:8/50: chown c8 1 1 2024-02-15T22:51:11.434 INFO:tasks.workunit.client.1.smithi170.stdout:8/51: stat c4 0 2024-02-15T22:51:11.435 INFO:tasks.workunit.client.1.smithi170.stdout:8/52: symlink d9/lb 0 2024-02-15T22:51:11.436 INFO:tasks.workunit.client.1.smithi170.stdout:8/53: rename d9/la to d9/lc 0 2024-02-15T22:51:11.436 INFO:tasks.workunit.client.1.smithi170.stdout:8/54: read f5 [458409,101145] 0 2024-02-15T22:51:11.441 INFO:tasks.workunit.client.1.smithi170.stdout:0/75: dwrite d8/d14/f1a [0,4194304] 0 2024-02-15T22:51:11.443 INFO:tasks.workunit.client.1.smithi170.stdout:3/101: dwrite d3/f7 [0,4194304] 0 2024-02-15T22:51:11.444 INFO:tasks.workunit.client.1.smithi170.stdout:0/76: rename d8/fe to d8/d14/d1c/f1e 0 2024-02-15T22:51:11.444 INFO:tasks.workunit.client.1.smithi170.stdout:0/77: write d8/df/f19 [396436,28452] 0 2024-02-15T22:51:11.444 INFO:tasks.workunit.client.1.smithi170.stdout:6/56: dwrite d3/d9/f14 [0,4194304] 0 2024-02-15T22:51:11.445 INFO:tasks.workunit.client.1.smithi170.stdout:1/74: dwrite d3/f6 [0,4194304] 0 2024-02-15T22:51:11.447 INFO:tasks.workunit.client.1.smithi170.stdout:3/102: rename d3/f6 to d3/dc/d1c/f1e 0 2024-02-15T22:51:11.450 INFO:tasks.workunit.client.1.smithi170.stdout:0/78: creat d8/df/d13/f1f x:0 0 0 2024-02-15T22:51:11.450 INFO:tasks.workunit.client.1.smithi170.stdout:0/79: creat d8/df/d13/f20 x:0 0 0 2024-02-15T22:51:11.455 INFO:tasks.workunit.client.1.smithi170.stdout:6/57: creat d3/f16 x:0 0 0 2024-02-15T22:51:11.455 INFO:tasks.workunit.client.1.smithi170.stdout:6/58: creat d3/f17 x:0 0 0 2024-02-15T22:51:11.456 INFO:tasks.workunit.client.1.smithi170.stdout:1/75: dread d3/f6 [0,4194304] 0 2024-02-15T22:51:11.456 INFO:tasks.workunit.client.1.smithi170.stdout:1/76: chown d3/ce 57582907 1 2024-02-15T22:51:11.466 INFO:tasks.workunit.client.1.smithi170.stdout:0/80: dread d8/df/f19 [0,4194304] 0 2024-02-15T22:51:11.466 INFO:tasks.workunit.client.1.smithi170.stdout:0/81: write d8/df/d13/f20 [40144,54105] 0 2024-02-15T22:51:11.467 INFO:tasks.workunit.client.1.smithi170.stdout:8/55: getdents d9 0 2024-02-15T22:51:11.469 INFO:tasks.workunit.client.1.smithi170.stdout:3/103: dwrite d3/db/f12 [0,4194304] 0 2024-02-15T22:51:11.469 INFO:tasks.workunit.client.1.smithi170.stdout:0/82: dread d8/df/f19 [0,4194304] 0 2024-02-15T22:51:11.469 INFO:tasks.workunit.client.1.smithi170.stdout:8/56: creat d9/fd x:0 0 0 2024-02-15T22:51:11.469 INFO:tasks.workunit.client.1.smithi170.stdout:8/57: read f7 [1860518,115827] 0 2024-02-15T22:51:11.475 INFO:tasks.workunit.client.1.smithi170.stdout:3/104: mkdir d3/db/d1f 0 2024-02-15T22:51:11.475 INFO:tasks.workunit.client.1.smithi170.stdout:3/105: readlink d3/dc/le 0 2024-02-15T22:51:11.476 INFO:tasks.workunit.client.1.smithi170.stdout:0/83: creat d8/d14/d1c/f21 x:0 0 0 2024-02-15T22:51:11.476 INFO:tasks.workunit.client.1.smithi170.stdout:1/77: dwrite d3/fb [0,4194304] 0 2024-02-15T22:51:11.478 INFO:tasks.workunit.client.1.smithi170.stdout:0/84: mkdir d8/df/d13/d22 0 2024-02-15T22:51:11.478 INFO:tasks.workunit.client.1.smithi170.stdout:0/85: write d8/df/f12 [605503,42489] 0 2024-02-15T22:51:11.481 INFO:tasks.workunit.client.1.smithi170.stdout:8/58: mknod d9/ce 0 2024-02-15T22:51:11.481 INFO:tasks.workunit.client.1.smithi170.stdout:8/59: write f7 [2656651,51434] 0 2024-02-15T22:51:11.481 INFO:tasks.workunit.client.1.smithi170.stdout:8/60: truncate d9/fd 436047 0 2024-02-15T22:51:11.483 INFO:tasks.workunit.client.1.smithi170.stdout:1/78: rmdir d3 39 2024-02-15T22:51:11.483 INFO:tasks.workunit.client.1.smithi170.stdout:1/79: chown d3/fb 52390 1 2024-02-15T22:51:11.483 INFO:tasks.workunit.client.1.smithi170.stdout:1/80: chown l2 23959 1 2024-02-15T22:51:11.484 INFO:tasks.workunit.client.1.smithi170.stdout:6/59: dwrite d3/fa [0,4194304] 0 2024-02-15T22:51:11.484 INFO:tasks.workunit.client.1.smithi170.stdout:6/60: stat d3/d9/fc 0 2024-02-15T22:51:11.484 INFO:tasks.workunit.client.1.smithi170.stdout:6/61: chown d3 555677 1 2024-02-15T22:51:11.486 INFO:tasks.workunit.client.1.smithi170.stdout:6/62: mknod d3/c18 0 2024-02-15T22:51:11.487 INFO:tasks.workunit.client.1.smithi170.stdout:3/106: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:11.489 INFO:tasks.workunit.client.1.smithi170.stdout:3/107: symlink d3/dc/d1a/l20 0 2024-02-15T22:51:11.490 INFO:tasks.workunit.client.1.smithi170.stdout:6/63: getdents d3/d9 0 2024-02-15T22:51:11.490 INFO:tasks.workunit.client.1.smithi170.stdout:0/86: dread d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:11.490 INFO:tasks.workunit.client.1.smithi170.stdout:0/87: readlink l0 0 2024-02-15T22:51:11.491 INFO:tasks.workunit.client.1.smithi170.stdout:0/88: dread d8/df/d13/f20 [0,4194304] 0 2024-02-15T22:51:11.494 INFO:tasks.workunit.client.1.smithi170.stdout:3/108: mknod d3/c21 0 2024-02-15T22:51:11.497 INFO:tasks.workunit.client.1.smithi170.stdout:6/64: rename d3/d9/f10 to d3/d9/dd/f19 0 2024-02-15T22:51:11.497 INFO:tasks.workunit.client.1.smithi170.stdout:6/65: chown d3 40041 1 2024-02-15T22:51:11.504 INFO:tasks.workunit.client.1.smithi170.stdout:8/61: getdents d9 0 2024-02-15T22:51:11.505 INFO:tasks.workunit.client.1.smithi170.stdout:0/89: truncate d8/d14/d1c/f1e 1615383 0 2024-02-15T22:51:11.505 INFO:tasks.workunit.client.1.smithi170.stdout:0/90: chown f5 349742856 1 2024-02-15T22:51:11.508 INFO:tasks.workunit.client.1.smithi170.stdout:3/109: link d3/dc/d1c/f1e d3/db/f22 0 2024-02-15T22:51:11.510 INFO:tasks.workunit.client.1.smithi170.stdout:6/66: mkdir d3/d1a 0 2024-02-15T22:51:11.511 INFO:tasks.workunit.client.1.smithi170.stdout:8/62: creat d9/ff x:0 0 0 2024-02-15T22:51:11.512 INFO:tasks.workunit.client.1.smithi170.stdout:0/91: mknod d8/df/d13/d22/c23 0 2024-02-15T22:51:11.512 INFO:tasks.workunit.client.1.smithi170.stdout:0/92: creat d8/d14/d1c/f24 x:0 0 0 2024-02-15T22:51:11.512 INFO:tasks.workunit.client.1.smithi170.stdout:1/81: truncate d3/fb 322897 0 2024-02-15T22:51:11.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/63: creat d9/f10 x:0 0 0 2024-02-15T22:51:11.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/64: fdatasync f5 0 2024-02-15T22:51:11.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/65: fdatasync d9/ff 0 2024-02-15T22:51:11.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/66: dread - d9/ff zero size 2024-02-15T22:51:11.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/67: chown f5 28378 1 2024-02-15T22:51:11.518 INFO:tasks.workunit.client.1.smithi170.stdout:3/110: write d3/f5 [631625,79419] 0 2024-02-15T22:51:11.518 INFO:tasks.workunit.client.1.smithi170.stdout:3/111: write d3/f16 [473765,60266] 0 2024-02-15T22:51:11.520 INFO:tasks.workunit.client.1.smithi170.stdout:6/67: write d3/f7 [3968890,76493] 0 2024-02-15T22:51:11.520 INFO:tasks.workunit.client.1.smithi170.stdout:6/68: write d3/f16 [389823,99375] 0 2024-02-15T22:51:11.521 INFO:tasks.workunit.client.1.smithi170.stdout:3/112: symlink d3/dc/d13/l23 0 2024-02-15T22:51:11.522 INFO:tasks.workunit.client.1.smithi170.stdout:1/82: dread d3/f6 [0,4194304] 0 2024-02-15T22:51:11.524 INFO:tasks.workunit.client.1.smithi170.stdout:3/113: truncate d3/dc/f1d 4233941 0 2024-02-15T22:51:11.525 INFO:tasks.workunit.client.1.smithi170.stdout:1/83: creat d3/f13 x:0 0 0 2024-02-15T22:51:11.525 INFO:tasks.workunit.client.1.smithi170.stdout:1/84: fdatasync d3/f13 0 2024-02-15T22:51:11.525 INFO:tasks.workunit.client.1.smithi170.stdout:1/85: dread - d3/f11 zero size 2024-02-15T22:51:11.526 INFO:tasks.workunit.client.1.smithi170.stdout:1/86: dread - d3/f11 zero size 2024-02-15T22:51:11.526 INFO:tasks.workunit.client.1.smithi170.stdout:1/87: symlink d3/l14 0 2024-02-15T22:51:11.529 INFO:tasks.workunit.client.1.smithi170.stdout:1/88: rename d3/f11 to d3/f15 0 2024-02-15T22:51:11.531 INFO:tasks.workunit.client.1.smithi170.stdout:1/89: rename d3/l14 to d3/l16 0 2024-02-15T22:51:11.533 INFO:tasks.workunit.client.1.smithi170.stdout:6/69: dread d3/d9/f14 [0,4194304] 0 2024-02-15T22:51:11.533 INFO:tasks.workunit.client.1.smithi170.stdout:0/93: dread d8/d14/d1c/f1e [0,4194304] 0 2024-02-15T22:51:11.533 INFO:tasks.workunit.client.1.smithi170.stdout:0/94: readlink d8/df/d13/l1d 0 2024-02-15T22:51:11.533 INFO:tasks.workunit.client.1.smithi170.stdout:0/95: dread - d8/df/f11 zero size 2024-02-15T22:51:11.536 INFO:tasks.workunit.client.1.smithi170.stdout:0/96: truncate d8/d14/f1a 1145246 0 2024-02-15T22:51:11.537 INFO:tasks.workunit.client.1.smithi170.stdout:0/97: creat d8/d14/d1c/f25 x:0 0 0 2024-02-15T22:51:11.538 INFO:tasks.workunit.client.1.smithi170.stdout:6/70: mkdir d3/d9/dd/d1b 0 2024-02-15T22:51:11.539 INFO:tasks.workunit.client.1.smithi170.stdout:8/68: dwrite d9/f10 [0,4194304] 0 2024-02-15T22:51:11.541 INFO:tasks.workunit.client.1.smithi170.stdout:0/98: symlink d8/d14/l26 0 2024-02-15T22:51:11.543 INFO:tasks.workunit.client.1.smithi170.stdout:6/71: mknod d3/d15/c1c 0 2024-02-15T22:51:11.543 INFO:tasks.workunit.client.1.smithi170.stdout:6/72: chown d3/fa 320402 1 2024-02-15T22:51:11.545 INFO:tasks.workunit.client.1.smithi170.stdout:8/69: creat d9/f11 x:0 0 0 2024-02-15T22:51:11.549 INFO:tasks.workunit.client.1.smithi170.stdout:0/99: mkdir d8/df/d13/d22/d27 0 2024-02-15T22:51:11.549 INFO:tasks.workunit.client.1.smithi170.stdout:0/100: chown d8/d14/l17 6260 1 2024-02-15T22:51:11.551 INFO:tasks.workunit.client.1.smithi170.stdout:0/101: rmdir d8/df/d13/d22/d27 0 2024-02-15T22:51:11.553 INFO:tasks.workunit.client.1.smithi170.stdout:8/70: mknod d9/c12 0 2024-02-15T22:51:11.553 INFO:tasks.workunit.client.1.smithi170.stdout:8/71: fsync d9/f10 0 2024-02-15T22:51:11.554 INFO:tasks.workunit.client.1.smithi170.stdout:8/72: truncate d9/ff 1044273 0 2024-02-15T22:51:11.561 INFO:tasks.workunit.client.1.smithi170.stdout:8/73: dread f7 [0,4194304] 0 2024-02-15T22:51:11.562 INFO:tasks.workunit.client.1.smithi170.stdout:8/74: write f7 [2280955,41287] 0 2024-02-15T22:51:11.565 INFO:tasks.workunit.client.1.smithi170.stdout:8/75: rename f5 to d9/f13 0 2024-02-15T22:51:11.567 INFO:tasks.workunit.client.1.smithi170.stdout:3/114: dwrite d3/dc/f1d [0,4194304] 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/90: dwrite d3/f10 [0,4194304] 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/91: write d3/f15 [156102,79187] 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:6/73: dwrite d3/f16 [0,4194304] 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/92: write d3/f13 [593995,126200] 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/93: creat d3/f17 x:0 0 0 2024-02-15T22:51:11.568 INFO:tasks.workunit.client.1.smithi170.stdout:3/115: creat d3/dc/d13/f24 x:0 0 0 2024-02-15T22:51:11.576 INFO:tasks.workunit.client.1.smithi170.stdout:1/94: symlink d3/l18 0 2024-02-15T22:51:11.576 INFO:tasks.workunit.client.1.smithi170.stdout:1/95: chown l2 317 1 2024-02-15T22:51:11.576 INFO:tasks.workunit.client.1.smithi170.stdout:1/96: readlink d3/lc 0 2024-02-15T22:51:11.576 INFO:tasks.workunit.client.1.smithi170.stdout:1/97: chown d3/l12 6538 1 2024-02-15T22:51:11.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/116: symlink d3/db/l25 0 2024-02-15T22:51:11.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/117: chown d3/dc/d1c/f1e 91897 1 2024-02-15T22:51:11.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/118: chown d3/db/d1f 1621933057 1 2024-02-15T22:51:11.582 INFO:tasks.workunit.client.1.smithi170.stdout:6/74: rename d3/d9/dd to d3/d1d 0 2024-02-15T22:51:11.585 INFO:tasks.workunit.client.1.smithi170.stdout:6/75: mknod d3/c1e 0 2024-02-15T22:51:11.585 INFO:tasks.workunit.client.1.smithi170.stdout:9/61: sync 2024-02-15T22:51:11.585 INFO:tasks.workunit.client.1.smithi170.stdout:5/131: sync 2024-02-15T22:51:11.592 INFO:tasks.workunit.client.1.smithi170.stdout:5/132: creat de/d10/d27/f2e x:0 0 0 2024-02-15T22:51:11.595 INFO:tasks.workunit.client.1.smithi170.stdout:9/62: getdents de 0 2024-02-15T22:51:11.599 INFO:tasks.workunit.client.1.smithi170.stdout:5/133: rename de/d10/l22 to de/l2f 0 2024-02-15T22:51:11.599 INFO:tasks.workunit.client.1.smithi170.stdout:5/134: dread - de/d10/d27/f2e zero size 2024-02-15T22:51:11.600 INFO:tasks.workunit.client.1.smithi170.stdout:5/135: creat de/d29/f30 x:0 0 0 2024-02-15T22:51:11.602 INFO:tasks.workunit.client.1.smithi170.stdout:1/98: dwrite d3/f6 [4194304,4194304] 0 2024-02-15T22:51:11.602 INFO:tasks.workunit.client.1.smithi170.stdout:1/99: creat d3/f19 x:0 0 0 2024-02-15T22:51:11.602 INFO:tasks.workunit.client.1.smithi170.stdout:9/63: dread f2 [0,4194304] 0 2024-02-15T22:51:11.605 INFO:tasks.workunit.client.1.smithi170.stdout:1/100: mknod d3/c1a 0 2024-02-15T22:51:11.605 INFO:tasks.workunit.client.1.smithi170.stdout:3/119: dwrite d3/f16 [0,4194304] 0 2024-02-15T22:51:11.606 INFO:tasks.workunit.client.1.smithi170.stdout:9/64: symlink de/l11 0 2024-02-15T22:51:11.606 INFO:tasks.workunit.client.1.smithi170.stdout:1/101: mknod d3/c1b 0 2024-02-15T22:51:11.606 INFO:tasks.workunit.client.1.smithi170.stdout:1/102: stat d3/f19 0 2024-02-15T22:51:11.606 INFO:tasks.workunit.client.1.smithi170.stdout:1/103: creat d3/f1c x:0 0 0 2024-02-15T22:51:11.607 INFO:tasks.workunit.client.1.smithi170.stdout:6/76: dwrite d3/d9/fc [0,4194304] 0 2024-02-15T22:51:11.609 INFO:tasks.workunit.client.1.smithi170.stdout:9/65: truncate fc 2854648 0 2024-02-15T22:51:11.610 INFO:tasks.workunit.client.1.smithi170.stdout:6/77: symlink d3/d15/l1f 0 2024-02-15T22:51:11.611 INFO:tasks.workunit.client.1.smithi170.stdout:6/78: write d3/f5 [154815,88508] 0 2024-02-15T22:51:11.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/136: dread de/d10/f19 [0,4194304] 0 2024-02-15T22:51:11.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/137: chown de/d10/f18 49170 1 2024-02-15T22:51:11.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/138: chown de/d10/d27/d2d 729424 1 2024-02-15T22:51:11.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/139: chown fa 31556198 1 2024-02-15T22:51:11.616 INFO:tasks.workunit.client.1.smithi170.stdout:6/79: creat d3/d15/f20 x:0 0 0 2024-02-15T22:51:11.618 INFO:tasks.workunit.client.1.smithi170.stdout:5/140: creat de/d10/d27/d2d/f31 x:0 0 0 2024-02-15T22:51:11.618 INFO:tasks.workunit.client.1.smithi170.stdout:5/141: dread - de/d10/d27/f2a zero size 2024-02-15T22:51:11.618 INFO:tasks.workunit.client.1.smithi170.stdout:5/142: write de/f16 [660399,78217] 0 2024-02-15T22:51:11.619 INFO:tasks.workunit.client.1.smithi170.stdout:3/120: read d3/f14 [1270074,14028] 0 2024-02-15T22:51:11.619 INFO:tasks.workunit.client.1.smithi170.stdout:6/80: truncate d3/f16 1713100 0 2024-02-15T22:51:11.624 INFO:tasks.workunit.client.1.smithi170.stdout:3/121: mkdir d3/dc/d1c/d26 0 2024-02-15T22:51:11.624 INFO:tasks.workunit.client.1.smithi170.stdout:3/122: chown d3/ca 611310413 1 2024-02-15T22:51:11.624 INFO:tasks.workunit.client.1.smithi170.stdout:1/104: dwrite d3/f19 [0,4194304] 0 2024-02-15T22:51:11.624 INFO:tasks.workunit.client.1.smithi170.stdout:1/105: creat d3/f1d x:0 0 0 2024-02-15T22:51:11.624 INFO:tasks.workunit.client.1.smithi170.stdout:1/106: creat d3/f1e x:0 0 0 2024-02-15T22:51:11.627 INFO:tasks.workunit.client.1.smithi170.stdout:3/123: truncate d3/db/f22 3914874 0 2024-02-15T22:51:11.627 INFO:tasks.workunit.client.1.smithi170.stdout:3/124: write d3/f5 [3501831,123338] 0 2024-02-15T22:51:11.633 INFO:tasks.workunit.client.1.smithi170.stdout:5/143: rmdir de/d10 39 2024-02-15T22:51:11.633 INFO:tasks.workunit.client.1.smithi170.stdout:5/144: write de/d29/f30 [55297,31007] 0 2024-02-15T22:51:11.634 INFO:tasks.workunit.client.1.smithi170.stdout:6/81: rmdir d3 39 2024-02-15T22:51:11.635 INFO:tasks.workunit.client.1.smithi170.stdout:5/145: creat de/d10/f32 x:0 0 0 2024-02-15T22:51:11.635 INFO:tasks.workunit.client.1.smithi170.stdout:5/146: write de/f16 [1126445,30032] 0 2024-02-15T22:51:11.635 INFO:tasks.workunit.client.1.smithi170.stdout:5/147: chown de 31 1 2024-02-15T22:51:11.636 INFO:tasks.workunit.client.1.smithi170.stdout:5/148: mkdir de/d10/d33 0 2024-02-15T22:51:11.639 INFO:tasks.workunit.client.1.smithi170.stdout:5/149: symlink de/d10/d27/l34 0 2024-02-15T22:51:11.641 INFO:tasks.workunit.client.1.smithi170.stdout:5/150: creat de/d10/d27/d2d/f35 x:0 0 0 2024-02-15T22:51:11.641 INFO:tasks.workunit.client.1.smithi170.stdout:5/151: truncate de/d29/f30 821771 0 2024-02-15T22:51:11.643 INFO:tasks.workunit.client.1.smithi170.stdout:3/125: read d3/db/f11 [2776561,105306] 0 2024-02-15T22:51:11.643 INFO:tasks.workunit.client.1.smithi170.stdout:5/152: mkdir de/d36 0 2024-02-15T22:51:11.645 INFO:tasks.workunit.client.1.smithi170.stdout:6/82: read d3/f4 [493004,68739] 0 2024-02-15T22:51:11.645 INFO:tasks.workunit.client.1.smithi170.stdout:5/153: rename de/d10/d27/l34 to de/d10/d27/d2d/l37 0 2024-02-15T22:51:11.646 INFO:tasks.workunit.client.1.smithi170.stdout:1/107: dwrite d3/f1e [0,4194304] 0 2024-02-15T22:51:11.646 INFO:tasks.workunit.client.1.smithi170.stdout:1/108: creat d3/f1f x:0 0 0 2024-02-15T22:51:11.646 INFO:tasks.workunit.client.1.smithi170.stdout:1/109: creat d3/f20 x:0 0 0 2024-02-15T22:51:11.646 INFO:tasks.workunit.client.1.smithi170.stdout:1/110: creat d3/f21 x:0 0 0 2024-02-15T22:51:11.646 INFO:tasks.workunit.client.1.smithi170.stdout:1/111: dread - d3/f21 zero size 2024-02-15T22:51:11.647 INFO:tasks.workunit.client.1.smithi170.stdout:6/83: mknod d3/c21 0 2024-02-15T22:51:11.653 INFO:tasks.workunit.client.1.smithi170.stdout:3/126: write d3/dc/f1d [867869,39240] 0 2024-02-15T22:51:11.653 INFO:tasks.workunit.client.1.smithi170.stdout:3/127: write d3/dc/f17 [438647,80169] 0 2024-02-15T22:51:11.654 INFO:tasks.workunit.client.1.smithi170.stdout:9/66: dwrite f4 [0,4194304] 0 2024-02-15T22:51:11.655 INFO:tasks.workunit.client.1.smithi170.stdout:5/154: getdents de/d10 0 2024-02-15T22:51:11.658 INFO:tasks.workunit.client.1.smithi170.stdout:3/128: truncate d3/db/f11 40416 0 2024-02-15T22:51:11.662 INFO:tasks.workunit.client.1.smithi170.stdout:6/84: link d3/f4 d3/d9/f22 0 2024-02-15T22:51:11.663 INFO:tasks.workunit.client.1.smithi170.stdout:3/129: mknod d3/d1b/c27 0 2024-02-15T22:51:11.663 INFO:tasks.workunit.client.1.smithi170.stdout:3/130: chown d3/d1b 4 1 2024-02-15T22:51:11.663 INFO:tasks.workunit.client.1.smithi170.stdout:3/131: chown d3/dc/d1a 22108474 1 2024-02-15T22:51:11.664 INFO:tasks.workunit.client.1.smithi170.stdout:1/112: dwrite d3/f17 [0,4194304] 0 2024-02-15T22:51:11.665 INFO:tasks.workunit.client.1.smithi170.stdout:5/155: mknod de/c38 0 2024-02-15T22:51:11.666 INFO:tasks.workunit.client.1.smithi170.stdout:6/85: mkdir d3/d1d/d1b/d23 0 2024-02-15T22:51:11.666 INFO:tasks.workunit.client.1.smithi170.stdout:6/86: chown d3/fa 27912 1 2024-02-15T22:51:11.671 INFO:tasks.workunit.client.1.smithi170.stdout:1/113: unlink d3/l5 0 2024-02-15T22:51:11.671 INFO:tasks.workunit.client.1.smithi170.stdout:1/114: creat d3/f22 x:0 0 0 2024-02-15T22:51:11.671 INFO:tasks.workunit.client.1.smithi170.stdout:1/115: fsync d3/f20 0 2024-02-15T22:51:11.671 INFO:tasks.workunit.client.1.smithi170.stdout:1/116: fsync d3/f6 0 2024-02-15T22:51:11.672 INFO:tasks.workunit.client.1.smithi170.stdout:6/87: write d3/d9/fe [1591007,81588] 0 2024-02-15T22:51:11.677 INFO:tasks.workunit.client.1.smithi170.stdout:9/67: dwrite f7 [0,4194304] 0 2024-02-15T22:51:11.677 INFO:tasks.workunit.client.1.smithi170.stdout:9/68: chown de/c10 6 1 2024-02-15T22:51:11.680 INFO:tasks.workunit.client.1.smithi170.stdout:1/117: rename d3/c1b to d3/c23 0 2024-02-15T22:51:11.681 INFO:tasks.workunit.client.1.smithi170.stdout:6/88: mkdir d3/d24 0 2024-02-15T22:51:11.683 INFO:tasks.workunit.client.1.smithi170.stdout:9/69: creat de/f12 x:0 0 0 2024-02-15T22:51:11.683 INFO:tasks.workunit.client.1.smithi170.stdout:9/70: write fb [336515,65949] 0 2024-02-15T22:51:11.684 INFO:tasks.workunit.client.1.smithi170.stdout:6/89: mknod d3/d1d/c25 0 2024-02-15T22:51:11.685 INFO:tasks.workunit.client.1.smithi170.stdout:9/71: rename ld to de/l13 0 2024-02-15T22:51:11.685 INFO:tasks.workunit.client.1.smithi170.stdout:9/72: creat de/f14 x:0 0 0 2024-02-15T22:51:11.685 INFO:tasks.workunit.client.1.smithi170.stdout:6/90: creat d3/d9/f26 x:0 0 0 2024-02-15T22:51:11.686 INFO:tasks.workunit.client.1.smithi170.stdout:5/156: dwrite fa [0,4194304] 0 2024-02-15T22:51:11.686 INFO:tasks.workunit.client.1.smithi170.stdout:5/157: fdatasync fd 0 2024-02-15T22:51:11.687 INFO:tasks.workunit.client.1.smithi170.stdout:6/91: mkdir d3/d1d/d27 0 2024-02-15T22:51:11.688 INFO:tasks.workunit.client.1.smithi170.stdout:5/158: write f1 [2058169,54737] 0 2024-02-15T22:51:11.689 INFO:tasks.workunit.client.1.smithi170.stdout:9/73: dread fb [0,4194304] 0 2024-02-15T22:51:11.689 INFO:tasks.workunit.client.1.smithi170.stdout:9/74: dread - de/ff zero size 2024-02-15T22:51:11.693 INFO:tasks.workunit.client.1.smithi170.stdout:6/92: truncate d3/d1d/f19 470572 0 2024-02-15T22:51:11.693 INFO:tasks.workunit.client.1.smithi170.stdout:5/159: dread de/f21 [0,4194304] 0 2024-02-15T22:51:11.695 INFO:tasks.workunit.client.1.smithi170.stdout:6/93: mkdir d3/d1d/d28 0 2024-02-15T22:51:11.696 INFO:tasks.workunit.client.1.smithi170.stdout:5/160: rename de/f20 to de/d10/d27/d2d/f39 0 2024-02-15T22:51:11.702 INFO:tasks.workunit.client.1.smithi170.stdout:9/75: rmdir de 39 2024-02-15T22:51:11.702 INFO:tasks.workunit.client.1.smithi170.stdout:9/76: readlink de/l13 0 2024-02-15T22:51:11.703 INFO:tasks.workunit.client.1.smithi170.stdout:7/101: sync 2024-02-15T22:51:11.703 INFO:tasks.workunit.client.1.smithi170.stdout:2/138: sync 2024-02-15T22:51:11.704 INFO:tasks.workunit.client.1.smithi170.stdout:2/139: mknod d0/d2a/c36 0 2024-02-15T22:51:11.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/140: read d0/f2c [514547,122179] 0 2024-02-15T22:51:11.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/141: write d0/d1/f12 [1003416,80210] 0 2024-02-15T22:51:11.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/142: stat d0/d1/f12 0 2024-02-15T22:51:11.709 INFO:tasks.workunit.client.1.smithi170.stdout:2/143: dread d0/d1/f4 [0,4194304] 0 2024-02-15T22:51:11.710 INFO:tasks.workunit.client.1.smithi170.stdout:2/144: fdatasync d0/d1/f8 0 2024-02-15T22:51:11.710 INFO:tasks.workunit.client.1.smithi170.stdout:6/94: read d3/d1d/f19 [325559,65042] 0 2024-02-15T22:51:11.710 INFO:tasks.workunit.client.1.smithi170.stdout:6/95: getdents d3/d1d/d1b/d23 0 2024-02-15T22:51:11.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/145: mkdir d0/d28/d2f/d37 0 2024-02-15T22:51:11.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/146: fsync d0/d1/f1a 0 2024-02-15T22:51:11.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/147: write d0/d1/f12 [1517398,117858] 0 2024-02-15T22:51:11.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/148: creat d0/d1/d11/f38 x:0 0 0 2024-02-15T22:51:11.712 INFO:tasks.workunit.client.1.smithi170.stdout:2/149: write d0/f2c [1807007,21588] 0 2024-02-15T22:51:11.718 INFO:tasks.workunit.client.1.smithi170.stdout:6/96: read d3/d9/fc [3497041,51922] 0 2024-02-15T22:51:11.719 INFO:tasks.workunit.client.1.smithi170.stdout:6/97: symlink d3/d1d/d28/l29 0 2024-02-15T22:51:11.720 INFO:tasks.workunit.client.1.smithi170.stdout:6/98: symlink d3/d1d/d1b/l2a 0 2024-02-15T22:51:11.720 INFO:tasks.workunit.client.1.smithi170.stdout:6/99: chown d3/d15 22 1 2024-02-15T22:51:11.741 INFO:tasks.workunit.client.1.smithi170.stdout:7/102: dwrite da/f12 [0,4194304] 0 2024-02-15T22:51:11.743 INFO:tasks.workunit.client.1.smithi170.stdout:7/103: symlink da/d1a/d21/d19/l24 0 2024-02-15T22:51:11.754 INFO:tasks.workunit.client.1.smithi170.stdout:7/104: dread da/fe [0,4194304] 0 2024-02-15T22:51:11.754 INFO:tasks.workunit.client.1.smithi170.stdout:7/105: chown c9 25 1 2024-02-15T22:51:11.767 INFO:tasks.workunit.client.1.smithi170.stdout:5/161: dwrite de/d10/d27/f2a [0,4194304] 0 2024-02-15T22:51:11.772 INFO:tasks.workunit.client.1.smithi170.stdout:2/150: dwrite d0/d1/f27 [0,4194304] 0 2024-02-15T22:51:11.775 INFO:tasks.workunit.client.1.smithi170.stdout:7/106: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:11.776 INFO:tasks.workunit.client.1.smithi170.stdout:2/151: mknod d0/d28/d2f/c39 0 2024-02-15T22:51:11.776 INFO:tasks.workunit.client.1.smithi170.stdout:9/77: dwrite f4 [0,4194304] 0 2024-02-15T22:51:11.777 INFO:tasks.workunit.client.1.smithi170.stdout:2/152: dread d0/d1d/f22 [0,4194304] 0 2024-02-15T22:51:11.777 INFO:tasks.workunit.client.1.smithi170.stdout:2/153: stat d0/d1/d31 0 2024-02-15T22:51:11.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/100: dwrite d3/f4 [0,4194304] 0 2024-02-15T22:51:11.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/101: write d3/d1d/f19 [876812,58837] 0 2024-02-15T22:51:11.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/102: truncate d3/d9/fc 4883337 0 2024-02-15T22:51:11.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/103: chown d3/f16 226002 1 2024-02-15T22:51:11.779 INFO:tasks.workunit.client.1.smithi170.stdout:7/107: truncate da/d1a/f1e 869785 0 2024-02-15T22:51:11.781 INFO:tasks.workunit.client.1.smithi170.stdout:2/154: creat d0/d13/f3a x:0 0 0 2024-02-15T22:51:11.785 INFO:tasks.workunit.client.1.smithi170.stdout:6/104: creat d3/d15/f2b x:0 0 0 2024-02-15T22:51:11.786 INFO:tasks.workunit.client.1.smithi170.stdout:9/78: read f7 [2590876,72712] 0 2024-02-15T22:51:11.786 INFO:tasks.workunit.client.1.smithi170.stdout:7/108: creat da/f25 x:0 0 0 2024-02-15T22:51:11.787 INFO:tasks.workunit.client.1.smithi170.stdout:2/155: symlink d0/d1/d11/d26/l3b 0 2024-02-15T22:51:11.787 INFO:tasks.workunit.client.1.smithi170.stdout:2/156: stat d0/c16 0 2024-02-15T22:51:11.788 INFO:tasks.workunit.client.1.smithi170.stdout:6/105: readlink d3/d9/lf 0 2024-02-15T22:51:11.790 INFO:tasks.workunit.client.1.smithi170.stdout:9/79: mkdir de/d15 0 2024-02-15T22:51:11.790 INFO:tasks.workunit.client.1.smithi170.stdout:5/162: dwrite f7 [0,4194304] 0 2024-02-15T22:51:11.792 INFO:tasks.workunit.client.1.smithi170.stdout:6/106: link d3/f5 d3/d1d/d28/f2c 0 2024-02-15T22:51:11.794 INFO:tasks.workunit.client.1.smithi170.stdout:9/80: rmdir de/d15 0 2024-02-15T22:51:11.794 INFO:tasks.workunit.client.1.smithi170.stdout:9/81: read f2 [3818754,41426] 0 2024-02-15T22:51:11.795 INFO:tasks.workunit.client.1.smithi170.stdout:5/163: mknod de/d10/d27/c3a 0 2024-02-15T22:51:11.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/107: creat d3/d1d/d27/f2d x:0 0 0 2024-02-15T22:51:11.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/108: creat d3/d1d/d27/f2e x:0 0 0 2024-02-15T22:51:11.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/109: write d3/d9/f26 [512837,31334] 0 2024-02-15T22:51:11.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/110: write d3/d1d/d27/f2e [508167,124220] 0 2024-02-15T22:51:11.798 INFO:tasks.workunit.client.1.smithi170.stdout:5/164: rmdir de/d10/d27 39 2024-02-15T22:51:11.801 INFO:tasks.workunit.client.1.smithi170.stdout:5/165: dread de/d10/f18 [0,4194304] 0 2024-02-15T22:51:11.801 INFO:tasks.workunit.client.1.smithi170.stdout:6/111: rename d3/d1d/d1b/d23 to d3/d15/d2f 0 2024-02-15T22:51:11.801 INFO:tasks.workunit.client.1.smithi170.stdout:6/112: dread - d3/d15/f20 zero size 2024-02-15T22:51:11.801 INFO:tasks.workunit.client.1.smithi170.stdout:6/113: fdatasync d3/d1d/d28/f2c 0 2024-02-15T22:51:11.802 INFO:tasks.workunit.client.1.smithi170.stdout:6/114: read - d3/d1d/f12 zero size 2024-02-15T22:51:11.802 INFO:tasks.workunit.client.1.smithi170.stdout:9/82: truncate f4 2728242 0 2024-02-15T22:51:11.803 INFO:tasks.workunit.client.1.smithi170.stdout:5/166: unlink de/d10/d27/d2d/l37 0 2024-02-15T22:51:11.817 INFO:tasks.workunit.client.1.smithi170.stdout:6/115: write d3/d9/f22 [590171,21968] 0 2024-02-15T22:51:11.818 INFO:tasks.workunit.client.1.smithi170.stdout:6/116: link d3/d15/l1f d3/d15/l30 0 2024-02-15T22:51:11.823 INFO:tasks.workunit.client.1.smithi170.stdout:2/157: dwrite d0/d1/d11/f2d [0,4194304] 0 2024-02-15T22:51:11.825 INFO:tasks.workunit.client.1.smithi170.stdout:6/117: dread d3/d9/fe [0,4194304] 0 2024-02-15T22:51:11.825 INFO:tasks.workunit.client.1.smithi170.stdout:6/118: write d3/d9/fe [1998991,74305] 0 2024-02-15T22:51:11.825 INFO:tasks.workunit.client.1.smithi170.stdout:6/119: chown d3/d1d/d27 189255 1 2024-02-15T22:51:11.827 INFO:tasks.workunit.client.1.smithi170.stdout:2/158: rename d0/d1/d11/d26/l3b to d0/d1d/l3c 0 2024-02-15T22:51:11.827 INFO:tasks.workunit.client.1.smithi170.stdout:2/159: write d0/d1/f8 [4625557,94201] 0 2024-02-15T22:51:11.829 INFO:tasks.workunit.client.1.smithi170.stdout:6/120: dread d3/f16 [0,4194304] 0 2024-02-15T22:51:11.830 INFO:tasks.workunit.client.1.smithi170.stdout:2/160: dread d0/f25 [0,4194304] 0 2024-02-15T22:51:11.830 INFO:tasks.workunit.client.1.smithi170.stdout:2/161: chown d0/d1/f4 3956 1 2024-02-15T22:51:11.830 INFO:tasks.workunit.client.1.smithi170.stdout:2/162: truncate d0/d1/fe 4600318 0 2024-02-15T22:51:11.831 INFO:tasks.workunit.client.1.smithi170.stdout:6/121: unlink d3/c21 0 2024-02-15T22:51:11.832 INFO:tasks.workunit.client.1.smithi170.stdout:2/163: mkdir d0/d1d/d3d 0 2024-02-15T22:51:11.833 INFO:tasks.workunit.client.1.smithi170.stdout:2/164: write d0/d1/f9 [5196532,18401] 0 2024-02-15T22:51:11.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/167: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:11.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/83: getdents de 0 2024-02-15T22:51:11.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/84: readlink l5 0 2024-02-15T22:51:11.835 INFO:tasks.workunit.client.1.smithi170.stdout:2/165: mkdir d0/d28/d3e 0 2024-02-15T22:51:11.835 INFO:tasks.workunit.client.1.smithi170.stdout:6/122: truncate d3/d1d/f19 345024 0 2024-02-15T22:51:11.844 INFO:tasks.workunit.client.1.smithi170.stdout:5/168: creat de/d10/f3b x:0 0 0 2024-02-15T22:51:11.846 INFO:tasks.workunit.client.1.smithi170.stdout:9/85: symlink de/l16 0 2024-02-15T22:51:11.847 INFO:tasks.workunit.client.1.smithi170.stdout:2/166: mknod d0/d2a/c3f 0 2024-02-15T22:51:11.847 INFO:tasks.workunit.client.1.smithi170.stdout:2/167: chown d0/d13/c14 924 1 2024-02-15T22:51:11.849 INFO:tasks.workunit.client.1.smithi170.stdout:6/123: mkdir d3/d24/d31 0 2024-02-15T22:51:11.850 INFO:tasks.workunit.client.1.smithi170.stdout:5/169: chown l2 49247690 1 2024-02-15T22:51:11.850 INFO:tasks.workunit.client.1.smithi170.stdout:5/170: getdents de/d36 0 2024-02-15T22:51:11.851 INFO:tasks.workunit.client.1.smithi170.stdout:6/124: mknod d3/d15/c32 0 2024-02-15T22:51:11.852 INFO:tasks.workunit.client.1.smithi170.stdout:6/125: fdatasync d3/d15/f2b 0 2024-02-15T22:51:11.852 INFO:tasks.workunit.client.1.smithi170.stdout:6/126: write d3/d1d/d27/f2e [482386,20456] 0 2024-02-15T22:51:11.853 INFO:tasks.workunit.client.1.smithi170.stdout:6/127: chown d3/d9/f26 266 1 2024-02-15T22:51:11.853 INFO:tasks.workunit.client.1.smithi170.stdout:6/128: chown d3/d9 911 1 2024-02-15T22:51:11.855 INFO:tasks.workunit.client.1.smithi170.stdout:2/168: read d0/d1/fe [2629255,48130] 0 2024-02-15T22:51:11.855 INFO:tasks.workunit.client.1.smithi170.stdout:2/169: getdents d0/d28/d3e 0 2024-02-15T22:51:11.856 INFO:tasks.workunit.client.1.smithi170.stdout:6/129: rename d3/d1d/d28/f2c to d3/d1a/f33 0 2024-02-15T22:51:11.858 INFO:tasks.workunit.client.1.smithi170.stdout:2/170: symlink d0/d1d/l40 0 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:2/171: mknod d0/d13/c41 0 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/86: sync 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/87: write d0/d6/f5 [3690080,10009] 0 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/88: chown d0/d6/da 695606622 1 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/89: chown d0/d6/f14 7533565 1 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/90: dread - d0/f10 zero size 2024-02-15T22:51:11.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/91: chown d0/d6/da/d11 1827658 1 2024-02-15T22:51:11.860 INFO:tasks.workunit.client.1.smithi170.stdout:6/130: dread d3/d9/fc [0,4194304] 0 2024-02-15T22:51:11.862 INFO:tasks.workunit.client.1.smithi170.stdout:6/131: creat d3/d24/d31/f34 x:0 0 0 2024-02-15T22:51:11.862 INFO:tasks.workunit.client.1.smithi170.stdout:6/132: fsync d3/d9/fe 0 2024-02-15T22:51:11.864 INFO:tasks.workunit.client.1.smithi170.stdout:6/133: creat d3/d24/f35 x:0 0 0 2024-02-15T22:51:11.865 INFO:tasks.workunit.client.1.smithi170.stdout:6/134: fdatasync d3/d24/d31/f34 0 2024-02-15T22:51:11.868 INFO:tasks.workunit.client.1.smithi170.stdout:2/172: read d0/d1/d11/f2d [2245016,40987] 0 2024-02-15T22:51:11.869 INFO:tasks.workunit.client.1.smithi170.stdout:6/135: rename d3/d9 to d3/d1d/d36 0 2024-02-15T22:51:11.871 INFO:tasks.workunit.client.1.smithi170.stdout:2/173: symlink d0/l42 0 2024-02-15T22:51:11.872 INFO:tasks.workunit.client.1.smithi170.stdout:4/92: dwrite d0/f10 [0,4194304] 0 2024-02-15T22:51:11.881 INFO:tasks.workunit.client.1.smithi170.stdout:4/93: dread d0/d6/f5 [4194304,4194304] 0 2024-02-15T22:51:11.881 INFO:tasks.workunit.client.1.smithi170.stdout:4/94: fsync d0/d6/f14 0 2024-02-15T22:51:11.881 INFO:tasks.workunit.client.1.smithi170.stdout:4/95: stat d0/d6/da 0 2024-02-15T22:51:11.888 INFO:tasks.workunit.client.1.smithi170.stdout:6/136: dwrite d3/d1d/f12 [0,4194304] 0 2024-02-15T22:51:11.889 INFO:tasks.workunit.client.1.smithi170.stdout:4/96: write d0/fe [3665697,941] 0 2024-02-15T22:51:11.889 INFO:tasks.workunit.client.1.smithi170.stdout:4/97: write d0/fd [3258040,85503] 0 2024-02-15T22:51:11.889 INFO:tasks.workunit.client.1.smithi170.stdout:4/98: dread - d0/d6/f14 zero size 2024-02-15T22:51:11.890 INFO:tasks.workunit.client.1.smithi170.stdout:6/137: creat d3/d15/d2f/f37 x:0 0 0 2024-02-15T22:51:11.892 INFO:tasks.workunit.client.1.smithi170.stdout:4/99: mknod d0/d6/c15 0 2024-02-15T22:51:11.894 INFO:tasks.workunit.client.1.smithi170.stdout:4/100: creat d0/d6/da/f16 x:0 0 0 2024-02-15T22:51:11.895 INFO:tasks.workunit.client.1.smithi170.stdout:4/101: mknod d0/d6/da/d11/c17 0 2024-02-15T22:51:11.895 INFO:tasks.workunit.client.1.smithi170.stdout:4/102: creat d0/d6/da/f18 x:0 0 0 2024-02-15T22:51:11.898 INFO:tasks.workunit.client.1.smithi170.stdout:4/103: rename d0/d6/c9 to d0/d6/da/c19 0 2024-02-15T22:51:11.904 INFO:tasks.workunit.client.1.smithi170.stdout:6/138: dwrite f2 [0,4194304] 0 2024-02-15T22:51:11.907 INFO:tasks.workunit.client.1.smithi170.stdout:6/139: symlink d3/d15/d2f/l38 0 2024-02-15T22:51:11.908 INFO:tasks.workunit.client.1.smithi170.stdout:6/140: rename d3/d15/c32 to d3/d1d/d28/c39 0 2024-02-15T22:51:11.909 INFO:tasks.workunit.client.1.smithi170.stdout:6/141: rmdir d3/d1a 39 2024-02-15T22:51:11.913 INFO:tasks.workunit.client.1.smithi170.stdout:4/104: dwrite d0/f10 [0,4194304] 0 2024-02-15T22:51:11.914 INFO:tasks.workunit.client.1.smithi170.stdout:4/105: creat d0/d6/da/d11/f1a x:0 0 0 2024-02-15T22:51:11.914 INFO:tasks.workunit.client.1.smithi170.stdout:4/106: creat d0/d6/da/f1b x:0 0 0 2024-02-15T22:51:11.915 INFO:tasks.workunit.client.1.smithi170.stdout:4/107: rename d0/d6/da/f1b to d0/d6/da/d11/f1c 0 2024-02-15T22:51:11.919 INFO:tasks.workunit.client.1.smithi170.stdout:4/108: dread d0/d6/da/f13 [0,4194304] 0 2024-02-15T22:51:11.920 INFO:tasks.workunit.client.1.smithi170.stdout:4/109: mkdir d0/d6/da/d1d 0 2024-02-15T22:51:11.923 INFO:tasks.workunit.client.1.smithi170.stdout:4/110: dread d0/fd [0,4194304] 0 2024-02-15T22:51:11.923 INFO:tasks.workunit.client.1.smithi170.stdout:4/111: write d0/d6/da/f13 [587533,46746] 0 2024-02-15T22:51:11.924 INFO:tasks.workunit.client.1.smithi170.stdout:4/112: creat d0/d6/da/d11/f1e x:0 0 0 2024-02-15T22:51:11.924 INFO:tasks.workunit.client.1.smithi170.stdout:4/113: truncate d0/d6/f14 66742 0 2024-02-15T22:51:11.927 INFO:tasks.workunit.client.1.smithi170.stdout:6/142: dwrite d3/f4 [0,4194304] 0 2024-02-15T22:51:11.927 INFO:tasks.workunit.client.1.smithi170.stdout:6/143: write d3/d1d/d36/fc [1556116,40776] 0 2024-02-15T22:51:11.928 INFO:tasks.workunit.client.1.smithi170.stdout:6/144: fdatasync d3/d1a/f33 0 2024-02-15T22:51:11.938 INFO:tasks.workunit.client.1.smithi170.stdout:4/114: dwrite d0/d6/da/d11/f1a [0,4194304] 0 2024-02-15T22:51:11.938 INFO:tasks.workunit.client.1.smithi170.stdout:4/115: rename d0/d6 to d0/d6/d1f 22 2024-02-15T22:51:11.939 INFO:tasks.workunit.client.1.smithi170.stdout:6/145: read d3/f4 [3787672,67519] 0 2024-02-15T22:51:11.941 INFO:tasks.workunit.client.1.smithi170.stdout:6/146: rename d3/c6 to d3/d24/c3a 0 2024-02-15T22:51:11.941 INFO:tasks.workunit.client.1.smithi170.stdout:6/147: stat d3/d1d/d36/f22 0 2024-02-15T22:51:11.942 INFO:tasks.workunit.client.1.smithi170.stdout:6/148: truncate d3/d1d/d36/f26 674255 0 2024-02-15T22:51:11.942 INFO:tasks.workunit.client.1.smithi170.stdout:6/149: truncate d3/d1a/f33 1124589 0 2024-02-15T22:51:11.942 INFO:tasks.workunit.client.1.smithi170.stdout:6/150: chown d3/d1d/d36/lf 4106 1 2024-02-15T22:51:11.943 INFO:tasks.workunit.client.1.smithi170.stdout:6/151: read d3/f16 [1611484,57913] 0 2024-02-15T22:51:11.944 INFO:tasks.workunit.client.1.smithi170.stdout:6/152: fdatasync d3/f5 0 2024-02-15T22:51:11.944 INFO:tasks.workunit.client.1.smithi170.stdout:4/116: read d0/f10 [2758030,81565] 0 2024-02-15T22:51:11.945 INFO:tasks.workunit.client.1.smithi170.stdout:4/117: mkdir d0/d6/da/d11/d20 0 2024-02-15T22:51:11.949 INFO:tasks.workunit.client.1.smithi170.stdout:4/118: unlink d0/fe 0 2024-02-15T22:51:11.949 INFO:tasks.workunit.client.1.smithi170.stdout:4/119: creat d0/f21 x:0 0 0 2024-02-15T22:51:11.949 INFO:tasks.workunit.client.1.smithi170.stdout:4/120: fsync d0/d6/da/f16 0 2024-02-15T22:51:11.949 INFO:tasks.workunit.client.1.smithi170.stdout:4/121: write d0/f10 [4155902,111561] 0 2024-02-15T22:51:11.950 INFO:tasks.workunit.client.1.smithi170.stdout:6/153: rename d3/d15 to d3/d1d/d28/d3b 0 2024-02-15T22:51:11.950 INFO:tasks.workunit.client.1.smithi170.stdout:6/154: write d3/d1d/d36/fc [2200118,31348] 0 2024-02-15T22:51:11.958 INFO:tasks.workunit.client.1.smithi170.stdout:6/155: write d3/d1d/d36/f14 [460065,18609] 0 2024-02-15T22:51:11.961 INFO:tasks.workunit.client.1.smithi170.stdout:6/156: rmdir d3/d1d/d28 39 2024-02-15T22:51:11.962 INFO:tasks.workunit.client.1.smithi170.stdout:6/157: mkdir d3/d1d/d1b/d3c 0 2024-02-15T22:51:11.964 INFO:tasks.workunit.client.1.smithi170.stdout:6/158: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:11.964 INFO:tasks.workunit.client.1.smithi170.stdout:6/159: chown d3/c1e 14502 1 2024-02-15T22:51:11.965 INFO:tasks.workunit.client.1.smithi170.stdout:6/160: fsync d3/d1d/d36/f13 0 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/161: dread d3/fa [0,4194304] 0 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/162: write d3/d1d/d27/f2d [518887,33657] 0 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/163: creat d3/d24/f3d x:0 0 0 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/164: write d3/f17 [873596,100560] 0 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/165: chown d3/d1d/d28/d3b/l30 1002 1 2024-02-15T22:51:11.976 INFO:tasks.workunit.client.1.smithi170.stdout:6/166: fdatasync d3/d1d/d36/fe 0 2024-02-15T22:51:11.978 INFO:tasks.workunit.client.1.smithi170.stdout:4/122: rename d0/d6 to d0/d22 0 2024-02-15T22:51:11.980 INFO:tasks.workunit.client.1.smithi170.stdout:6/167: mkdir d3/d1d/d1b/d3e 0 2024-02-15T22:51:11.980 INFO:tasks.workunit.client.1.smithi170.stdout:6/168: chown d3/d24/d31/f34 56677945 1 2024-02-15T22:51:11.982 INFO:tasks.workunit.client.1.smithi170.stdout:4/123: creat d0/d22/da/d11/d20/f23 x:0 0 0 2024-02-15T22:51:11.983 INFO:tasks.workunit.client.1.smithi170.stdout:6/169: dread d3/d1d/d36/fe [0,4194304] 0 2024-02-15T22:51:11.985 INFO:tasks.workunit.client.1.smithi170.stdout:6/170: mkdir d3/d24/d31/d3f 0 2024-02-15T22:51:11.987 INFO:tasks.workunit.client.1.smithi170.stdout:6/171: unlink d3/d1d/d36/f26 0 2024-02-15T22:51:11.989 INFO:tasks.workunit.client.1.smithi170.stdout:6/172: rename d3/f17 to d3/d1a/f40 0 2024-02-15T22:51:11.990 INFO:tasks.workunit.client.1.smithi170.stdout:6/173: symlink d3/l41 0 2024-02-15T22:51:11.991 INFO:tasks.workunit.client.1.smithi170.stdout:4/124: truncate d0/fd 3237552 0 2024-02-15T22:51:11.991 INFO:tasks.workunit.client.1.smithi170.stdout:4/125: chown d0/d22/da/d11 1968 1 2024-02-15T22:51:11.993 INFO:tasks.workunit.client.1.smithi170.stdout:0/102: sync 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:8/76: sync 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:1/118: sync 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:3/132: sync 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:3/133: dread - d3/dc/ff zero size 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:0/103: creat d8/d14/f28 x:0 0 0 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:3/134: read d3/f9 [1890359,27210] 0 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:0/104: creat d8/f29 x:0 0 0 2024-02-15T22:51:11.994 INFO:tasks.workunit.client.1.smithi170.stdout:3/135: creat d3/dc/d13/f28 x:0 0 0 2024-02-15T22:51:12.000 INFO:tasks.workunit.client.1.smithi170.stdout:4/126: write d0/fd [3490136,58150] 0 2024-02-15T22:51:12.001 INFO:tasks.workunit.client.1.smithi170.stdout:4/127: readlink d0/l4 0 2024-02-15T22:51:12.001 INFO:tasks.workunit.client.1.smithi170.stdout:3/136: getdents d3/dc/d1a 0 2024-02-15T22:51:12.002 INFO:tasks.workunit.client.1.smithi170.stdout:8/77: symlink d9/l14 0 2024-02-15T22:51:12.003 INFO:tasks.workunit.client.1.smithi170.stdout:8/78: chown d9/f13 49171428 1 2024-02-15T22:51:12.003 INFO:tasks.workunit.client.1.smithi170.stdout:4/128: mknod d0/d22/c24 0 2024-02-15T22:51:12.003 INFO:tasks.workunit.client.1.smithi170.stdout:4/129: chown d0/d22/f5 56 1 2024-02-15T22:51:12.004 INFO:tasks.workunit.client.1.smithi170.stdout:8/79: readlink d9/lb 0 2024-02-15T22:51:12.006 INFO:tasks.workunit.client.1.smithi170.stdout:4/130: creat d0/d22/da/d1d/f25 x:0 0 0 2024-02-15T22:51:12.006 INFO:tasks.workunit.client.1.smithi170.stdout:4/131: write d0/f21 [125891,74930] 0 2024-02-15T22:51:12.006 INFO:tasks.workunit.client.1.smithi170.stdout:4/132: read - d0/d22/da/d11/f1e zero size 2024-02-15T22:51:12.006 INFO:tasks.workunit.client.1.smithi170.stdout:4/133: dread - d0/d22/da/f16 zero size 2024-02-15T22:51:12.007 INFO:tasks.workunit.client.1.smithi170.stdout:8/80: truncate d9/f10 2834544 0 2024-02-15T22:51:12.007 INFO:tasks.workunit.client.1.smithi170.stdout:8/81: truncate d9/f13 869030 0 2024-02-15T22:51:12.008 INFO:tasks.workunit.client.1.smithi170.stdout:4/134: creat d0/d22/da/d11/f26 x:0 0 0 2024-02-15T22:51:12.010 INFO:tasks.workunit.client.1.smithi170.stdout:4/135: creat d0/d22/da/f27 x:0 0 0 2024-02-15T22:51:12.010 INFO:tasks.workunit.client.1.smithi170.stdout:4/136: dread - d0/d22/da/d11/d20/f23 zero size 2024-02-15T22:51:12.017 INFO:tasks.workunit.client.1.smithi170.stdout:4/137: dread d0/d22/da/d11/f1a [0,4194304] 0 2024-02-15T22:51:12.017 INFO:tasks.workunit.client.1.smithi170.stdout:4/138: chown d0/d22/da/f16 0 1 2024-02-15T22:51:12.018 INFO:tasks.workunit.client.1.smithi170.stdout:4/139: write d0/d22/da/d11/d20/f23 [47007,103995] 0 2024-02-15T22:51:12.018 INFO:tasks.workunit.client.1.smithi170.stdout:4/140: readlink d0/l4 0 2024-02-15T22:51:12.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/141: symlink d0/d22/l28 0 2024-02-15T22:51:12.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/142: chown d0/cc 9735 1 2024-02-15T22:51:12.021 INFO:tasks.workunit.client.1.smithi170.stdout:6/174: dwrite d3/d1d/d36/f14 [4194304,4194304] 0 2024-02-15T22:51:12.023 INFO:tasks.workunit.client.1.smithi170.stdout:0/105: getdents d8/d14 0 2024-02-15T22:51:12.023 INFO:tasks.workunit.client.1.smithi170.stdout:0/106: creat d8/f2a x:0 0 0 2024-02-15T22:51:12.025 INFO:tasks.workunit.client.1.smithi170.stdout:1/119: dwrite d3/f13 [0,4194304] 0 2024-02-15T22:51:12.025 INFO:tasks.workunit.client.1.smithi170.stdout:3/137: write d3/db/f12 [2727194,25926] 0 2024-02-15T22:51:12.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/107: dread d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:12.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/108: write d8/d14/f16 [4234982,35267] 0 2024-02-15T22:51:12.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/109: fsync d8/df/f12 0 2024-02-15T22:51:12.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/110: dread - d8/f29 zero size 2024-02-15T22:51:12.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/111: dread - d8/f1b zero size 2024-02-15T22:51:12.038 INFO:tasks.workunit.client.1.smithi170.stdout:3/138: truncate d3/dc/d1c/f1e 1977451 0 2024-02-15T22:51:12.038 INFO:tasks.workunit.client.1.smithi170.stdout:1/120: read d3/f13 [3550900,14184] 0 2024-02-15T22:51:12.038 INFO:tasks.workunit.client.1.smithi170.stdout:1/121: readlink d3/l9 0 2024-02-15T22:51:12.041 INFO:tasks.workunit.client.1.smithi170.stdout:4/143: dwrite d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:12.041 INFO:tasks.workunit.client.1.smithi170.stdout:4/144: chown d0/f10 1 1 2024-02-15T22:51:12.041 INFO:tasks.workunit.client.1.smithi170.stdout:4/145: chown d0/d22/da/f16 6 1 2024-02-15T22:51:12.041 INFO:tasks.workunit.client.1.smithi170.stdout:4/146: write d0/d22/f5 [9930072,52514] 0 2024-02-15T22:51:12.041 INFO:tasks.workunit.client.1.smithi170.stdout:4/147: creat d0/d22/da/f29 x:0 0 0 2024-02-15T22:51:12.042 INFO:tasks.workunit.client.1.smithi170.stdout:0/112: rename d8/f10 to d8/d14/d1c/f2b 0 2024-02-15T22:51:12.044 INFO:tasks.workunit.client.1.smithi170.stdout:3/139: mknod d3/dc/d1a/c29 0 2024-02-15T22:51:12.046 INFO:tasks.workunit.client.1.smithi170.stdout:4/148: dread d0/f21 [0,4194304] 0 2024-02-15T22:51:12.048 INFO:tasks.workunit.client.1.smithi170.stdout:6/175: dwrite d3/d24/f3d [0,4194304] 0 2024-02-15T22:51:12.051 INFO:tasks.workunit.client.1.smithi170.stdout:3/140: symlink d3/dc/d13/l2a 0 2024-02-15T22:51:12.056 INFO:tasks.workunit.client.1.smithi170.stdout:3/141: mkdir d3/d2b 0 2024-02-15T22:51:12.058 INFO:tasks.workunit.client.1.smithi170.stdout:3/142: mkdir d3/d1b/d2c 0 2024-02-15T22:51:12.065 INFO:tasks.workunit.client.1.smithi170.stdout:1/122: dwrite d3/f20 [0,4194304] 0 2024-02-15T22:51:12.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/123: dread d3/fb [0,4194304] 0 2024-02-15T22:51:12.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/124: truncate d3/f22 503354 0 2024-02-15T22:51:12.068 INFO:tasks.workunit.client.1.smithi170.stdout:1/125: write d3/f15 [503815,34606] 0 2024-02-15T22:51:12.069 INFO:tasks.workunit.client.1.smithi170.stdout:1/126: mkdir d3/d24 0 2024-02-15T22:51:12.071 INFO:tasks.workunit.client.1.smithi170.stdout:1/127: rename d3/f6 to d3/d24/f25 0 2024-02-15T22:51:12.071 INFO:tasks.workunit.client.1.smithi170.stdout:1/128: write d3/f13 [369053,25697] 0 2024-02-15T22:51:12.072 INFO:tasks.workunit.client.1.smithi170.stdout:1/129: symlink d3/l26 0 2024-02-15T22:51:12.074 INFO:tasks.workunit.client.1.smithi170.stdout:4/149: dwrite d0/d22/da/d11/f1a [0,4194304] 0 2024-02-15T22:51:12.075 INFO:tasks.workunit.client.1.smithi170.stdout:6/176: dwrite d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:12.075 INFO:tasks.workunit.client.1.smithi170.stdout:0/113: dwrite d8/d14/d1c/f24 [0,4194304] 0 2024-02-15T22:51:12.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/150: mknod d0/d22/da/d11/d20/c2a 0 2024-02-15T22:51:12.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/151: fdatasync d0/d22/da/d11/d20/f23 0 2024-02-15T22:51:12.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/152: fsync d0/d22/da/d11/d20/f23 0 2024-02-15T22:51:12.080 INFO:tasks.workunit.client.1.smithi170.stdout:0/114: truncate d8/d14/f1a 1012790 0 2024-02-15T22:51:12.082 INFO:tasks.workunit.client.1.smithi170.stdout:4/153: mkdir d0/d22/da/d1d/d2b 0 2024-02-15T22:51:12.082 INFO:tasks.workunit.client.1.smithi170.stdout:4/154: read - d0/d22/da/f18 zero size 2024-02-15T22:51:12.084 INFO:tasks.workunit.client.1.smithi170.stdout:3/143: dwrite d3/dc/f1d [0,4194304] 0 2024-02-15T22:51:12.084 INFO:tasks.workunit.client.1.smithi170.stdout:0/115: rmdir d8/d14/d1c 39 2024-02-15T22:51:12.092 INFO:tasks.workunit.client.1.smithi170.stdout:3/144: mknod d3/dc/c2d 0 2024-02-15T22:51:12.092 INFO:tasks.workunit.client.1.smithi170.stdout:3/145: stat d3 0 2024-02-15T22:51:12.094 INFO:tasks.workunit.client.1.smithi170.stdout:6/177: dwrite d3/d1d/d36/fc [4194304,4194304] 0 2024-02-15T22:51:12.097 INFO:tasks.workunit.client.1.smithi170.stdout:1/130: link d3/d24/f25 d3/d24/f27 0 2024-02-15T22:51:12.099 INFO:tasks.workunit.client.1.smithi170.stdout:6/178: symlink d3/d1d/l42 0 2024-02-15T22:51:12.099 INFO:tasks.workunit.client.1.smithi170.stdout:4/155: dwrite d0/d22/da/f27 [0,4194304] 0 2024-02-15T22:51:12.099 INFO:tasks.workunit.client.1.smithi170.stdout:4/156: write d0/d22/da/f16 [525073,80327] 0 2024-02-15T22:51:12.100 INFO:tasks.workunit.client.1.smithi170.stdout:3/146: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:12.100 INFO:tasks.workunit.client.1.smithi170.stdout:3/147: dread - d3/dc/d13/f24 zero size 2024-02-15T22:51:12.105 INFO:tasks.workunit.client.1.smithi170.stdout:6/179: rename d3/d1d/d36/fe to d3/d1d/d27/f43 0 2024-02-15T22:51:12.105 INFO:tasks.workunit.client.1.smithi170.stdout:6/180: fdatasync d3/d24/d31/f34 0 2024-02-15T22:51:12.105 INFO:tasks.workunit.client.1.smithi170.stdout:6/181: creat d3/d24/d31/f44 x:0 0 0 2024-02-15T22:51:12.105 INFO:tasks.workunit.client.1.smithi170.stdout:6/182: write d3/d1d/d36/f13 [672448,111418] 0 2024-02-15T22:51:12.105 INFO:tasks.workunit.client.1.smithi170.stdout:3/148: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:12.107 INFO:tasks.workunit.client.1.smithi170.stdout:4/157: rename d0/d22/c8 to d0/d22/da/d1d/c2c 0 2024-02-15T22:51:12.108 INFO:tasks.workunit.client.1.smithi170.stdout:4/158: creat d0/d22/da/f2d x:0 0 0 2024-02-15T22:51:12.108 INFO:tasks.workunit.client.1.smithi170.stdout:4/159: chown d0/l4 79881616 1 2024-02-15T22:51:12.110 INFO:tasks.workunit.client.1.smithi170.stdout:6/183: rmdir d3/d24/d31/d3f 0 2024-02-15T22:51:12.110 INFO:tasks.workunit.client.1.smithi170.stdout:6/184: fsync d3/f7 0 2024-02-15T22:51:12.111 INFO:tasks.workunit.client.1.smithi170.stdout:3/149: symlink d3/dc/d1c/l2e 0 2024-02-15T22:51:12.113 INFO:tasks.workunit.client.1.smithi170.stdout:1/131: truncate d3/f13 688426 0 2024-02-15T22:51:12.114 INFO:tasks.workunit.client.1.smithi170.stdout:4/160: mknod d0/d22/da/d11/c2e 0 2024-02-15T22:51:12.115 INFO:tasks.workunit.client.1.smithi170.stdout:6/185: mknod d3/d24/d31/c45 0 2024-02-15T22:51:12.115 INFO:tasks.workunit.client.1.smithi170.stdout:6/186: dread - d3/d1d/d28/d3b/f2b zero size 2024-02-15T22:51:12.116 INFO:tasks.workunit.client.1.smithi170.stdout:3/150: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:12.116 INFO:tasks.workunit.client.1.smithi170.stdout:3/151: write d3/dc/d13/f28 [886821,121972] 0 2024-02-15T22:51:12.116 INFO:tasks.workunit.client.1.smithi170.stdout:1/132: mknod d3/c28 0 2024-02-15T22:51:12.119 INFO:tasks.workunit.client.1.smithi170.stdout:6/187: rename d3/d1d/d36/lf to d3/d1d/d28/d3b/d2f/l46 0 2024-02-15T22:51:12.121 INFO:tasks.workunit.client.1.smithi170.stdout:1/133: truncate d3/d24/f25 5260141 0 2024-02-15T22:51:12.123 INFO:tasks.workunit.client.1.smithi170.stdout:6/188: rename d3/d1d/f19 to d3/d1d/d28/f47 0 2024-02-15T22:51:12.125 INFO:tasks.workunit.client.1.smithi170.stdout:1/134: mknod d3/d24/c29 0 2024-02-15T22:51:12.127 INFO:tasks.workunit.client.1.smithi170.stdout:3/152: rename d3/f7 to d3/db/d1f/f2f 0 2024-02-15T22:51:12.127 INFO:tasks.workunit.client.1.smithi170.stdout:3/153: stat d3/db/l25 0 2024-02-15T22:51:12.127 INFO:tasks.workunit.client.1.smithi170.stdout:3/154: readlink d3/dc/d13/l23 0 2024-02-15T22:51:12.128 INFO:tasks.workunit.client.1.smithi170.stdout:4/161: dwrite d0/f10 [0,4194304] 0 2024-02-15T22:51:12.128 INFO:tasks.workunit.client.1.smithi170.stdout:3/155: dread d3/db/f11 [0,4194304] 0 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/189: mknod d3/d24/c48 0 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/190: write d3/d1d/d28/f47 [672626,111156] 0 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/191: creat d3/d24/d31/f49 x:0 0 0 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/192: chown d3/d1d/d27/f2d 369058251 1 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:4/162: dread d0/d22/f14 [0,4194304] 0 2024-02-15T22:51:12.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/193: creat d3/d1d/d27/f4a x:0 0 0 2024-02-15T22:51:12.131 INFO:tasks.workunit.client.1.smithi170.stdout:1/135: creat d3/d24/f2a x:0 0 0 2024-02-15T22:51:12.133 INFO:tasks.workunit.client.1.smithi170.stdout:1/136: dread d3/f15 [0,4194304] 0 2024-02-15T22:51:12.135 INFO:tasks.workunit.client.1.smithi170.stdout:3/156: creat d3/d1b/d2c/f30 x:0 0 0 2024-02-15T22:51:12.139 INFO:tasks.workunit.client.1.smithi170.stdout:7/109: sync 2024-02-15T22:51:12.139 INFO:tasks.workunit.client.1.smithi170.stdout:7/110: stat da/c10 0 2024-02-15T22:51:12.139 INFO:tasks.workunit.client.1.smithi170.stdout:7/111: chown da/d1a/d21/d19/l24 14 1 2024-02-15T22:51:12.140 INFO:tasks.workunit.client.1.smithi170.stdout:4/163: mknod d0/d22/da/c2f 0 2024-02-15T22:51:12.142 INFO:tasks.workunit.client.1.smithi170.stdout:1/137: unlink d3/f19 0 2024-02-15T22:51:12.147 INFO:tasks.workunit.client.1.smithi170.stdout:3/157: rename d3/db/f19 to d3/dc/f31 0 2024-02-15T22:51:12.147 INFO:tasks.workunit.client.1.smithi170.stdout:3/158: stat d3/dc/f1d 0 2024-02-15T22:51:12.147 INFO:tasks.workunit.client.1.smithi170.stdout:3/159: truncate d3/dc/f31 480592 0 2024-02-15T22:51:12.149 INFO:tasks.workunit.client.1.smithi170.stdout:4/164: creat d0/d22/da/d11/f30 x:0 0 0 2024-02-15T22:51:12.149 INFO:tasks.workunit.client.1.smithi170.stdout:4/165: chown d0/d22/da/d1d 1011 1 2024-02-15T22:51:12.151 INFO:tasks.workunit.client.1.smithi170.stdout:1/138: rename d3/f1d to d3/d24/f2b 0 2024-02-15T22:51:12.152 INFO:tasks.workunit.client.1.smithi170.stdout:7/112: symlink da/l26 0 2024-02-15T22:51:12.154 INFO:tasks.workunit.client.1.smithi170.stdout:4/166: symlink d0/d22/l31 0 2024-02-15T22:51:12.154 INFO:tasks.workunit.client.1.smithi170.stdout:4/167: chown d0/d22/l28 2389 1 2024-02-15T22:51:12.154 INFO:tasks.workunit.client.1.smithi170.stdout:4/168: dread - d0/d22/da/f2d zero size 2024-02-15T22:51:12.156 INFO:tasks.workunit.client.1.smithi170.stdout:7/113: rmdir da/d1a/d21/d1b 39 2024-02-15T22:51:12.158 INFO:tasks.workunit.client.1.smithi170.stdout:4/169: mkdir d0/d22/da/d32 0 2024-02-15T22:51:12.162 INFO:tasks.workunit.client.1.smithi170.stdout:4/170: dread d0/d22/da/f13 [0,4194304] 0 2024-02-15T22:51:12.162 INFO:tasks.workunit.client.1.smithi170.stdout:3/160: dwrite d3/dc/d13/f28 [0,4194304] 0 2024-02-15T22:51:12.163 INFO:tasks.workunit.client.1.smithi170.stdout:4/171: creat d0/d22/da/d11/f33 x:0 0 0 2024-02-15T22:51:12.165 INFO:tasks.workunit.client.1.smithi170.stdout:4/172: dread d0/d22/da/d11/d20/f23 [0,4194304] 0 2024-02-15T22:51:12.167 INFO:tasks.workunit.client.1.smithi170.stdout:3/161: rename d3/d1b/c27 to d3/dc/d13/c32 0 2024-02-15T22:51:12.168 INFO:tasks.workunit.client.1.smithi170.stdout:1/139: getdents d3 0 2024-02-15T22:51:12.171 INFO:tasks.workunit.client.1.smithi170.stdout:4/173: unlink d0/d22/da/d11/c17 0 2024-02-15T22:51:12.171 INFO:tasks.workunit.client.1.smithi170.stdout:4/174: read d0/d22/da/f13 [1886438,115996] 0 2024-02-15T22:51:12.174 INFO:tasks.workunit.client.1.smithi170.stdout:4/175: link d0/d22/da/f13 d0/d22/f34 0 2024-02-15T22:51:12.178 INFO:tasks.workunit.client.1.smithi170.stdout:7/114: dwrite da/fc [0,4194304] 0 2024-02-15T22:51:12.178 INFO:tasks.workunit.client.1.smithi170.stdout:7/115: creat da/d1a/f27 x:0 0 0 2024-02-15T22:51:12.178 INFO:tasks.workunit.client.1.smithi170.stdout:7/116: chown da/d1a/d21/d1b 55675 1 2024-02-15T22:51:12.178 INFO:tasks.workunit.client.1.smithi170.stdout:4/176: dread d0/d22/f34 [0,4194304] 0 2024-02-15T22:51:12.181 INFO:tasks.workunit.client.1.smithi170.stdout:4/177: unlink d0/d22/da/d11/f1a 0 2024-02-15T22:51:12.182 INFO:tasks.workunit.client.1.smithi170.stdout:7/117: dread da/d1a/f1e [0,4194304] 0 2024-02-15T22:51:12.183 INFO:tasks.workunit.client.1.smithi170.stdout:4/178: link d0/d22/da/f29 d0/d22/da/d11/d20/f35 0 2024-02-15T22:51:12.184 INFO:tasks.workunit.client.1.smithi170.stdout:7/118: truncate da/d1a/f1e 376811 0 2024-02-15T22:51:12.186 INFO:tasks.workunit.client.1.smithi170.stdout:7/119: mkdir da/d1a/d28 0 2024-02-15T22:51:12.187 INFO:tasks.workunit.client.1.smithi170.stdout:7/120: mknod da/d1a/d28/c29 0 2024-02-15T22:51:12.187 INFO:tasks.workunit.client.1.smithi170.stdout:1/140: dwrite d3/f17 [0,4194304] 0 2024-02-15T22:51:12.189 INFO:tasks.workunit.client.1.smithi170.stdout:1/141: mkdir d3/d24/d2c 0 2024-02-15T22:51:12.189 INFO:tasks.workunit.client.1.smithi170.stdout:1/142: creat d3/d24/f2d x:0 0 0 2024-02-15T22:51:12.190 INFO:tasks.workunit.client.1.smithi170.stdout:3/162: dwrite d3/dc/d13/f24 [0,4194304] 0 2024-02-15T22:51:12.191 INFO:tasks.workunit.client.1.smithi170.stdout:1/143: creat d3/f2e x:0 0 0 2024-02-15T22:51:12.197 INFO:tasks.workunit.client.1.smithi170.stdout:3/163: link d3/dc/l10 d3/dc/d1a/l33 0 2024-02-15T22:51:12.199 INFO:tasks.workunit.client.1.smithi170.stdout:3/164: rename d3/db/l25 to d3/dc/d1c/l34 0 2024-02-15T22:51:12.202 INFO:tasks.workunit.client.1.smithi170.stdout:7/121: getdents da/d1a 0 2024-02-15T22:51:12.205 INFO:tasks.workunit.client.1.smithi170.stdout:4/179: dwrite d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:12.208 INFO:tasks.workunit.client.1.smithi170.stdout:4/180: dread d0/d22/da/f13 [0,4194304] 0 2024-02-15T22:51:12.208 INFO:tasks.workunit.client.1.smithi170.stdout:4/181: stat d0/d22/f14 0 2024-02-15T22:51:12.209 INFO:tasks.workunit.client.1.smithi170.stdout:4/182: creat d0/d22/da/d11/f36 x:0 0 0 2024-02-15T22:51:12.209 INFO:tasks.workunit.client.1.smithi170.stdout:4/183: write d0/d22/f34 [2311146,80994] 0 2024-02-15T22:51:12.210 INFO:tasks.workunit.client.1.smithi170.stdout:1/144: dwrite d3/f17 [0,4194304] 0 2024-02-15T22:51:12.210 INFO:tasks.workunit.client.1.smithi170.stdout:1/145: stat d3/f22 0 2024-02-15T22:51:12.213 INFO:tasks.workunit.client.1.smithi170.stdout:1/146: rename d3/d24/f2d to d3/d24/d2c/f2f 0 2024-02-15T22:51:12.214 INFO:tasks.workunit.client.1.smithi170.stdout:1/147: dread - d3/f1f zero size 2024-02-15T22:51:12.215 INFO:tasks.workunit.client.1.smithi170.stdout:1/148: creat d3/d24/d2c/f30 x:0 0 0 2024-02-15T22:51:12.216 INFO:tasks.workunit.client.1.smithi170.stdout:1/149: rename d3/ld to d3/l31 0 2024-02-15T22:51:12.219 INFO:tasks.workunit.client.1.smithi170.stdout:1/150: dread - d3/d24/d2c/f2f zero size 2024-02-15T22:51:12.220 INFO:tasks.workunit.client.1.smithi170.stdout:7/122: write da/fc [3266928,125392] 0 2024-02-15T22:51:12.220 INFO:tasks.workunit.client.1.smithi170.stdout:7/123: write da/d1a/f1e [489196,125273] 0 2024-02-15T22:51:12.220 INFO:tasks.workunit.client.1.smithi170.stdout:1/151: dread d3/f22 [0,4194304] 0 2024-02-15T22:51:12.220 INFO:tasks.workunit.client.1.smithi170.stdout:7/124: mknod da/d1a/c2a 0 2024-02-15T22:51:12.220 INFO:tasks.workunit.client.1.smithi170.stdout:7/125: stat da/f12 0 2024-02-15T22:51:12.221 INFO:tasks.workunit.client.1.smithi170.stdout:1/152: mknod d3/c32 0 2024-02-15T22:51:12.221 INFO:tasks.workunit.client.1.smithi170.stdout:1/153: write d3/f1c [471113,50518] 0 2024-02-15T22:51:12.224 INFO:tasks.workunit.client.1.smithi170.stdout:1/154: getdents d3/d24 0 2024-02-15T22:51:12.224 INFO:tasks.workunit.client.1.smithi170.stdout:1/155: readlink d3/l9 0 2024-02-15T22:51:12.225 INFO:tasks.workunit.client.1.smithi170.stdout:4/184: dwrite d0/d22/da/d11/d20/f35 [0,4194304] 0 2024-02-15T22:51:12.225 INFO:tasks.workunit.client.1.smithi170.stdout:4/185: dread - d0/d22/da/d11/f26 zero size 2024-02-15T22:51:12.226 INFO:tasks.workunit.client.1.smithi170.stdout:4/186: dread d0/f21 [0,4194304] 0 2024-02-15T22:51:12.227 INFO:tasks.workunit.client.1.smithi170.stdout:4/187: symlink d0/d22/da/d32/l37 0 2024-02-15T22:51:12.229 INFO:tasks.workunit.client.1.smithi170.stdout:4/188: creat d0/d22/da/d32/f38 x:0 0 0 2024-02-15T22:51:12.230 INFO:tasks.workunit.client.1.smithi170.stdout:4/189: mkdir d0/d22/da/d11/d39 0 2024-02-15T22:51:12.230 INFO:tasks.workunit.client.1.smithi170.stdout:4/190: write d0/d22/da/d32/f38 [151891,87345] 0 2024-02-15T22:51:12.230 INFO:tasks.workunit.client.1.smithi170.stdout:7/126: read da/fe [2357237,124580] 0 2024-02-15T22:51:12.232 INFO:tasks.workunit.client.1.smithi170.stdout:1/156: dread d3/d24/f27 [0,4194304] 0 2024-02-15T22:51:12.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/127: symlink da/l2b 0 2024-02-15T22:51:12.233 INFO:tasks.workunit.client.1.smithi170.stdout:1/157: symlink d3/d24/l33 0 2024-02-15T22:51:12.233 INFO:tasks.workunit.client.1.smithi170.stdout:4/191: fdatasync d0/d22/f34 0 2024-02-15T22:51:12.234 INFO:tasks.workunit.client.1.smithi170.stdout:7/128: mkdir da/d1a/d21/d2c 0 2024-02-15T22:51:12.235 INFO:tasks.workunit.client.1.smithi170.stdout:1/158: truncate d3/d24/f25 2411187 0 2024-02-15T22:51:12.237 INFO:tasks.workunit.client.1.smithi170.stdout:4/192: rename d0/d22/da/f18 to d0/d22/da/d1d/f3a 0 2024-02-15T22:51:12.237 INFO:tasks.workunit.client.1.smithi170.stdout:4/193: write d0/d22/da/d1d/f3a [856939,38268] 0 2024-02-15T22:51:12.255 INFO:tasks.workunit.client.1.smithi170.stdout:9/86: sync 2024-02-15T22:51:12.255 INFO:tasks.workunit.client.1.smithi170.stdout:2/174: sync 2024-02-15T22:51:12.255 INFO:tasks.workunit.client.1.smithi170.stdout:5/171: sync 2024-02-15T22:51:12.257 INFO:tasks.workunit.client.1.smithi170.stdout:2/175: creat d0/d28/d3e/f43 x:0 0 0 2024-02-15T22:51:12.257 INFO:tasks.workunit.client.1.smithi170.stdout:2/176: creat d0/d28/d3e/f44 x:0 0 0 2024-02-15T22:51:12.257 INFO:tasks.workunit.client.1.smithi170.stdout:5/172: rename de/d10/c12 to de/d36/c3c 0 2024-02-15T22:51:12.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/173: unlink de/l17 0 2024-02-15T22:51:12.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/174: truncate de/f25 190430 0 2024-02-15T22:51:12.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/175: fdatasync fd 0 2024-02-15T22:51:12.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/176: fsync de/d10/d27/f2e 0 2024-02-15T22:51:12.261 INFO:tasks.workunit.client.1.smithi170.stdout:5/177: link f7 de/d10/d27/f3d 0 2024-02-15T22:51:12.261 INFO:tasks.workunit.client.1.smithi170.stdout:5/178: symlink de/d10/d33/l3e 0 2024-02-15T22:51:12.264 INFO:tasks.workunit.client.1.smithi170.stdout:1/159: dwrite d3/d24/f2a [0,4194304] 0 2024-02-15T22:51:12.265 INFO:tasks.workunit.client.1.smithi170.stdout:2/177: dread d0/d1/f1a [0,4194304] 0 2024-02-15T22:51:12.266 INFO:tasks.workunit.client.1.smithi170.stdout:7/129: dwrite da/fc [0,4194304] 0 2024-02-15T22:51:12.268 INFO:tasks.workunit.client.1.smithi170.stdout:7/130: mknod da/d1a/d21/c2d 0 2024-02-15T22:51:12.268 INFO:tasks.workunit.client.1.smithi170.stdout:7/131: dread - da/d1a/d21/d19/f20 zero size 2024-02-15T22:51:12.292 INFO:tasks.workunit.client.1.smithi170.stdout:4/194: dwrite d0/d22/da/d1d/f3a [0,4194304] 0 2024-02-15T22:51:12.294 INFO:tasks.workunit.client.1.smithi170.stdout:4/195: creat d0/d22/da/d11/f3b x:0 0 0 2024-02-15T22:51:12.294 INFO:tasks.workunit.client.1.smithi170.stdout:4/196: dread - d0/d22/da/f2d zero size 2024-02-15T22:51:12.295 INFO:tasks.workunit.client.1.smithi170.stdout:4/197: creat d0/d22/da/d11/f3c x:0 0 0 2024-02-15T22:51:12.295 INFO:tasks.workunit.client.1.smithi170.stdout:4/198: truncate d0/d22/da/d11/f33 182802 0 2024-02-15T22:51:12.296 INFO:tasks.workunit.client.1.smithi170.stdout:9/87: dwrite f4 [0,4194304] 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:5/179: dwrite f1 [0,4194304] 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:5/180: truncate de/d10/d27/f2e 905653 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:5/181: dread - de/d10/f24 zero size 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:4/199: creat d0/d22/da/d11/d20/f3d x:0 0 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:7/132: dwrite da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:7/133: write da/d1a/f1e [1408079,76963] 0 2024-02-15T22:51:12.297 INFO:tasks.workunit.client.1.smithi170.stdout:2/178: dwrite d0/d1/fe [0,4194304] 0 2024-02-15T22:51:12.299 INFO:tasks.workunit.client.1.smithi170.stdout:5/182: getdents de/d10/d27 0 2024-02-15T22:51:12.304 INFO:tasks.workunit.client.1.smithi170.stdout:7/134: mkdir da/d1a/d21/d2c/d2e 0 2024-02-15T22:51:12.305 INFO:tasks.workunit.client.1.smithi170.stdout:5/183: creat de/f3f x:0 0 0 2024-02-15T22:51:12.305 INFO:tasks.workunit.client.1.smithi170.stdout:5/184: stat de/f16 0 2024-02-15T22:51:12.306 INFO:tasks.workunit.client.1.smithi170.stdout:7/135: creat da/d1a/f2f x:0 0 0 2024-02-15T22:51:12.308 INFO:tasks.workunit.client.1.smithi170.stdout:7/136: symlink da/d1a/d21/d2c/d2e/l30 0 2024-02-15T22:51:12.308 INFO:tasks.workunit.client.1.smithi170.stdout:7/137: dread - da/d1a/f2f zero size 2024-02-15T22:51:12.309 INFO:tasks.workunit.client.1.smithi170.stdout:7/138: rename da/d1a/d21/l22 to da/d1a/d21/l31 0 2024-02-15T22:51:12.310 INFO:tasks.workunit.client.1.smithi170.stdout:7/139: write da/d1a/f1e [1299306,121423] 0 2024-02-15T22:51:12.310 INFO:tasks.workunit.client.1.smithi170.stdout:7/140: readlink da/d1a/d21/d2c/d2e/l30 0 2024-02-15T22:51:12.310 INFO:tasks.workunit.client.1.smithi170.stdout:7/141: chown c4 43513724 1 2024-02-15T22:51:12.312 INFO:tasks.workunit.client.1.smithi170.stdout:7/142: creat da/d1a/d28/f32 x:0 0 0 2024-02-15T22:51:12.312 INFO:tasks.workunit.client.1.smithi170.stdout:7/143: chown da/fc 164909921 1 2024-02-15T22:51:12.312 INFO:tasks.workunit.client.1.smithi170.stdout:7/144: chown da/d1a/d21/d2c/d2e 0 1 2024-02-15T22:51:12.313 INFO:tasks.workunit.client.1.smithi170.stdout:9/88: dread f4 [0,4194304] 0 2024-02-15T22:51:12.313 INFO:tasks.workunit.client.1.smithi170.stdout:7/145: creat da/d1a/d21/d19/f33 x:0 0 0 2024-02-15T22:51:12.322 INFO:tasks.workunit.client.1.smithi170.stdout:5/185: read de/f1e [3827478,52787] 0 2024-02-15T22:51:12.322 INFO:tasks.workunit.client.1.smithi170.stdout:5/186: write de/d29/f30 [1492148,59767] 0 2024-02-15T22:51:12.323 INFO:tasks.workunit.client.1.smithi170.stdout:5/187: mkdir de/d29/d40 0 2024-02-15T22:51:12.328 INFO:tasks.workunit.client.1.smithi170.stdout:4/200: dwrite d0/d22/da/d11/f1e [0,4194304] 0 2024-02-15T22:51:12.328 INFO:tasks.workunit.client.1.smithi170.stdout:4/201: fdatasync d0/d22/da/d11/f3c 0 2024-02-15T22:51:12.328 INFO:tasks.workunit.client.1.smithi170.stdout:2/179: dwrite d0/d13/f3a [0,4194304] 0 2024-02-15T22:51:12.344 INFO:tasks.workunit.client.1.smithi170.stdout:7/146: dwrite da/d1a/d21/d19/f20 [0,4194304] 0 2024-02-15T22:51:12.345 INFO:tasks.workunit.client.1.smithi170.stdout:9/89: dwrite fc [0,4194304] 0 2024-02-15T22:51:12.346 INFO:tasks.workunit.client.1.smithi170.stdout:5/188: getdents de 0 2024-02-15T22:51:12.348 INFO:tasks.workunit.client.1.smithi170.stdout:5/189: dread de/f25 [0,4194304] 0 2024-02-15T22:51:12.351 INFO:tasks.workunit.client.1.smithi170.stdout:7/147: unlink da/d1a/c2a 0 2024-02-15T22:51:12.351 INFO:tasks.workunit.client.1.smithi170.stdout:7/148: dread - da/f25 zero size 2024-02-15T22:51:12.351 INFO:tasks.workunit.client.1.smithi170.stdout:7/149: dread - da/f25 zero size 2024-02-15T22:51:12.354 INFO:tasks.workunit.client.1.smithi170.stdout:9/90: creat de/f17 x:0 0 0 2024-02-15T22:51:12.357 INFO:tasks.workunit.client.1.smithi170.stdout:7/150: unlink da/fc 0 2024-02-15T22:51:12.357 INFO:tasks.workunit.client.1.smithi170.stdout:7/151: readlink da/l2b 0 2024-02-15T22:51:12.357 INFO:tasks.workunit.client.1.smithi170.stdout:5/190: dread f1 [0,4194304] 0 2024-02-15T22:51:12.357 INFO:tasks.workunit.client.1.smithi170.stdout:5/191: write de/f16 [1968964,37569] 0 2024-02-15T22:51:12.358 INFO:tasks.workunit.client.1.smithi170.stdout:7/152: symlink da/d1a/d28/l34 0 2024-02-15T22:51:12.359 INFO:tasks.workunit.client.1.smithi170.stdout:5/192: unlink de/d10/d27/f2e 0 2024-02-15T22:51:12.360 INFO:tasks.workunit.client.1.smithi170.stdout:5/193: stat f0 0 2024-02-15T22:51:12.360 INFO:tasks.workunit.client.1.smithi170.stdout:5/194: fsync de/f25 0 2024-02-15T22:51:12.360 INFO:tasks.workunit.client.1.smithi170.stdout:7/153: creat da/d1a/d21/d2c/d2e/f35 x:0 0 0 2024-02-15T22:51:12.360 INFO:tasks.workunit.client.1.smithi170.stdout:7/154: write da/f13 [2172720,33027] 0 2024-02-15T22:51:12.361 INFO:tasks.workunit.client.1.smithi170.stdout:5/195: creat de/d36/f41 x:0 0 0 2024-02-15T22:51:12.362 INFO:tasks.workunit.client.1.smithi170.stdout:7/155: symlink da/d1a/d21/l36 0 2024-02-15T22:51:12.364 INFO:tasks.workunit.client.1.smithi170.stdout:2/180: dwrite d0/ff [0,4194304] 0 2024-02-15T22:51:12.367 INFO:tasks.workunit.client.1.smithi170.stdout:5/196: dread de/f1e [0,4194304] 0 2024-02-15T22:51:12.367 INFO:tasks.workunit.client.1.smithi170.stdout:2/181: symlink d0/d13/l45 0 2024-02-15T22:51:12.369 INFO:tasks.workunit.client.1.smithi170.stdout:2/182: symlink d0/d2a/l46 0 2024-02-15T22:51:12.369 INFO:tasks.workunit.client.1.smithi170.stdout:4/202: dwrite d0/d22/da/d1d/f3a [0,4194304] 0 2024-02-15T22:51:12.370 INFO:tasks.workunit.client.1.smithi170.stdout:2/183: link d0/d2a/c3f d0/d28/c47 0 2024-02-15T22:51:12.371 INFO:tasks.workunit.client.1.smithi170.stdout:2/184: read d0/d1/fc [534267,63823] 0 2024-02-15T22:51:12.373 INFO:tasks.workunit.client.1.smithi170.stdout:4/203: rmdir d0/d22/da/d11/d39 0 2024-02-15T22:51:12.373 INFO:tasks.workunit.client.1.smithi170.stdout:4/204: write d0/d22/da/d11/f36 [880155,66236] 0 2024-02-15T22:51:12.375 INFO:tasks.workunit.client.1.smithi170.stdout:2/185: unlink d0/ff 0 2024-02-15T22:51:12.375 INFO:tasks.workunit.client.1.smithi170.stdout:2/186: truncate d0/d1/d11/f38 386558 0 2024-02-15T22:51:12.377 INFO:tasks.workunit.client.1.smithi170.stdout:4/205: symlink d0/d22/da/l3e 0 2024-02-15T22:51:12.377 INFO:tasks.workunit.client.1.smithi170.stdout:9/91: dwrite f4 [0,4194304] 0 2024-02-15T22:51:12.382 INFO:tasks.workunit.client.1.smithi170.stdout:9/92: readlink de/l11 0 2024-02-15T22:51:12.382 INFO:tasks.workunit.client.1.smithi170.stdout:9/93: chown c9 153154850 1 2024-02-15T22:51:12.383 INFO:tasks.workunit.client.1.smithi170.stdout:9/94: creat de/f18 x:0 0 0 2024-02-15T22:51:12.387 INFO:tasks.workunit.client.1.smithi170.stdout:5/197: dwrite de/f25 [0,4194304] 0 2024-02-15T22:51:12.403 INFO:tasks.workunit.client.1.smithi170.stdout:9/95: write fc [3928800,68101] 0 2024-02-15T22:51:12.405 INFO:tasks.workunit.client.1.smithi170.stdout:9/96: creat de/f19 x:0 0 0 2024-02-15T22:51:12.405 INFO:tasks.workunit.client.1.smithi170.stdout:9/97: creat de/f1a x:0 0 0 2024-02-15T22:51:12.406 INFO:tasks.workunit.client.1.smithi170.stdout:4/206: dwrite d0/d22/da/d11/f3c [0,4194304] 0 2024-02-15T22:51:12.408 INFO:tasks.workunit.client.1.smithi170.stdout:7/156: dwrite da/d1a/f1e [0,4194304] 0 2024-02-15T22:51:12.408 INFO:tasks.workunit.client.1.smithi170.stdout:2/187: dwrite d0/d1/fe [0,4194304] 0 2024-02-15T22:51:12.412 INFO:tasks.workunit.client.1.smithi170.stdout:9/98: mkdir de/d1b 0 2024-02-15T22:51:12.412 INFO:tasks.workunit.client.1.smithi170.stdout:2/188: read d0/d1/f1a [844232,73872] 0 2024-02-15T22:51:12.417 INFO:tasks.workunit.client.1.smithi170.stdout:4/207: dread d0/d22/da/d1d/f3a [0,4194304] 0 2024-02-15T22:51:12.417 INFO:tasks.workunit.client.1.smithi170.stdout:4/208: chown d0/d22/da/d1d/f25 81721 1 2024-02-15T22:51:12.417 INFO:tasks.workunit.client.1.smithi170.stdout:9/99: mkdir de/d1b/d1c 0 2024-02-15T22:51:12.417 INFO:tasks.workunit.client.1.smithi170.stdout:4/209: chown d0/d22/da/d1d/c2c 128 1 2024-02-15T22:51:12.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/100: fdatasync de/f17 0 2024-02-15T22:51:12.418 INFO:tasks.workunit.client.1.smithi170.stdout:2/189: rmdir d0/d28 39 2024-02-15T22:51:12.421 INFO:tasks.workunit.client.1.smithi170.stdout:7/157: symlink da/l37 0 2024-02-15T22:51:12.424 INFO:tasks.workunit.client.1.smithi170.stdout:9/101: symlink de/d1b/l1d 0 2024-02-15T22:51:12.426 INFO:tasks.workunit.client.1.smithi170.stdout:4/210: getdents d0 0 2024-02-15T22:51:12.428 INFO:tasks.workunit.client.1.smithi170.stdout:9/102: creat de/f1e x:0 0 0 2024-02-15T22:51:12.430 INFO:tasks.workunit.client.1.smithi170.stdout:4/211: mknod d0/d22/da/d32/c3f 0 2024-02-15T22:51:12.432 INFO:tasks.workunit.client.1.smithi170.stdout:8/82: sync 2024-02-15T22:51:12.434 INFO:tasks.workunit.client.1.smithi170.stdout:8/83: unlink c6 0 2024-02-15T22:51:12.436 INFO:tasks.workunit.client.1.smithi170.stdout:9/103: dread f2 [0,4194304] 0 2024-02-15T22:51:12.436 INFO:tasks.workunit.client.1.smithi170.stdout:9/104: dread - de/f18 zero size 2024-02-15T22:51:12.437 INFO:tasks.workunit.client.1.smithi170.stdout:8/84: getdents d9 0 2024-02-15T22:51:12.439 INFO:tasks.workunit.client.1.smithi170.stdout:9/105: mkdir de/d1b/d1c/d1f 0 2024-02-15T22:51:12.440 INFO:tasks.workunit.client.1.smithi170.stdout:9/106: fdatasync f7 0 2024-02-15T22:51:12.441 INFO:tasks.workunit.client.1.smithi170.stdout:9/107: mkdir de/d1b/d1c/d1f/d20 0 2024-02-15T22:51:12.443 INFO:tasks.workunit.client.1.smithi170.stdout:4/212: dread d0/d22/da/d11/f1e [0,4194304] 0 2024-02-15T22:51:12.445 INFO:tasks.workunit.client.1.smithi170.stdout:9/108: rename de/ff to de/d1b/d1c/d1f/d20/f21 0 2024-02-15T22:51:12.445 INFO:tasks.workunit.client.1.smithi170.stdout:7/158: dwrite da/d1a/d21/d19/f20 [4194304,4194304] 0 2024-02-15T22:51:12.446 INFO:tasks.workunit.client.1.smithi170.stdout:4/213: dread d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:12.446 INFO:tasks.workunit.client.1.smithi170.stdout:4/214: fdatasync d0/d22/da/d11/f1e 0 2024-02-15T22:51:12.446 INFO:tasks.workunit.client.1.smithi170.stdout:4/215: truncate d0/d22/da/d11/f1e 4562347 0 2024-02-15T22:51:12.448 INFO:tasks.workunit.client.1.smithi170.stdout:9/109: link f4 de/d1b/d1c/d1f/d20/f22 0 2024-02-15T22:51:12.448 INFO:tasks.workunit.client.1.smithi170.stdout:9/110: readlink l5 0 2024-02-15T22:51:12.451 INFO:tasks.workunit.client.1.smithi170.stdout:9/111: symlink de/d1b/l23 0 2024-02-15T22:51:12.451 INFO:tasks.workunit.client.1.smithi170.stdout:9/112: truncate de/d1b/d1c/d1f/d20/f21 890765 0 2024-02-15T22:51:12.476 INFO:tasks.workunit.client.1.smithi170.stdout:7/159: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:12.477 INFO:tasks.workunit.client.1.smithi170.stdout:9/113: dwrite f4 [0,4194304] 0 2024-02-15T22:51:12.495 INFO:tasks.workunit.client.1.smithi170.stdout:7/160: dread da/fe [0,4194304] 0 2024-02-15T22:51:12.495 INFO:tasks.workunit.client.1.smithi170.stdout:7/161: write da/d1a/f2f [623863,18040] 0 2024-02-15T22:51:12.497 INFO:tasks.workunit.client.1.smithi170.stdout:7/162: rename da/d1a/d21/d19/f33 to da/f38 0 2024-02-15T22:51:12.498 INFO:tasks.workunit.client.1.smithi170.stdout:9/114: dwrite de/f12 [0,4194304] 0 2024-02-15T22:51:12.498 INFO:tasks.workunit.client.1.smithi170.stdout:7/163: symlink da/d1a/d28/l39 0 2024-02-15T22:51:12.501 INFO:tasks.workunit.client.1.smithi170.stdout:9/115: creat de/f24 x:0 0 0 2024-02-15T22:51:12.501 INFO:tasks.workunit.client.1.smithi170.stdout:9/116: fsync de/f18 0 2024-02-15T22:51:12.501 INFO:tasks.workunit.client.1.smithi170.stdout:9/117: readlink l5 0 2024-02-15T22:51:12.501 INFO:tasks.workunit.client.1.smithi170.stdout:9/118: read - de/f17 zero size 2024-02-15T22:51:12.501 INFO:tasks.workunit.client.1.smithi170.stdout:9/119: truncate de/f18 309731 0 2024-02-15T22:51:12.502 INFO:tasks.workunit.client.1.smithi170.stdout:7/164: link l8 da/d1a/d21/d2c/d2e/l3a 0 2024-02-15T22:51:12.503 INFO:tasks.workunit.client.1.smithi170.stdout:7/165: dread - da/f38 zero size 2024-02-15T22:51:12.504 INFO:tasks.workunit.client.1.smithi170.stdout:9/120: rmdir de/d1b/d1c 39 2024-02-15T22:51:12.523 INFO:tasks.workunit.client.1.smithi170.stdout:7/166: dwrite da/d1a/f27 [4194304,4194304] 0 2024-02-15T22:51:12.524 INFO:tasks.workunit.client.1.smithi170.stdout:7/167: creat da/f3b x:0 0 0 2024-02-15T22:51:12.526 INFO:tasks.workunit.client.1.smithi170.stdout:9/121: dwrite de/f14 [0,4194304] 0 2024-02-15T22:51:12.526 INFO:tasks.workunit.client.1.smithi170.stdout:9/122: chown l5 467982 1 2024-02-15T22:51:12.533 INFO:tasks.workunit.client.1.smithi170.stdout:7/168: dread da/f13 [0,4194304] 0 2024-02-15T22:51:12.537 INFO:tasks.workunit.client.1.smithi170.stdout:7/169: symlink da/d1a/l3c 0 2024-02-15T22:51:12.537 INFO:tasks.workunit.client.1.smithi170.stdout:7/170: fsync da/d1a/d28/f32 0 2024-02-15T22:51:12.539 INFO:tasks.workunit.client.1.smithi170.stdout:9/123: unlink de/c10 0 2024-02-15T22:51:12.540 INFO:tasks.workunit.client.1.smithi170.stdout:9/124: creat de/d1b/f25 x:0 0 0 2024-02-15T22:51:12.541 INFO:tasks.workunit.client.1.smithi170.stdout:9/125: unlink de/f19 0 2024-02-15T22:51:12.541 INFO:tasks.workunit.client.1.smithi170.stdout:9/126: fdatasync de/d1b/f25 0 2024-02-15T22:51:12.541 INFO:tasks.workunit.client.1.smithi170.stdout:9/127: write de/f17 [8955,9689] 0 2024-02-15T22:51:12.542 INFO:tasks.workunit.client.1.smithi170.stdout:9/128: chown de/f14 227988 1 2024-02-15T22:51:12.542 INFO:tasks.workunit.client.1.smithi170.stdout:9/129: mknod de/d1b/d1c/d1f/c26 0 2024-02-15T22:51:12.542 INFO:tasks.workunit.client.1.smithi170.stdout:9/130: mkdir de/d1b/d1c/d1f/d20/d27 0 2024-02-15T22:51:12.542 INFO:tasks.workunit.client.1.smithi170.stdout:9/131: truncate de/d1b/f25 978986 0 2024-02-15T22:51:12.543 INFO:tasks.workunit.client.1.smithi170.stdout:9/132: mkdir de/d1b/d1c/d1f/d20/d27/d28 0 2024-02-15T22:51:12.545 INFO:tasks.workunit.client.1.smithi170.stdout:9/133: link f7 de/d1b/d1c/d1f/d20/d27/f29 0 2024-02-15T22:51:12.557 INFO:tasks.workunit.client.1.smithi170.stdout:7/171: dwrite da/f12 [0,4194304] 0 2024-02-15T22:51:12.557 INFO:tasks.workunit.client.1.smithi170.stdout:7/172: fsync da/f12 0 2024-02-15T22:51:12.557 INFO:tasks.workunit.client.1.smithi170.stdout:7/173: readlink da/l2b 0 2024-02-15T22:51:12.558 INFO:tasks.workunit.client.1.smithi170.stdout:9/134: dwrite fb [0,4194304] 0 2024-02-15T22:51:12.559 INFO:tasks.workunit.client.1.smithi170.stdout:7/174: rename da/l26 to da/d1a/l3d 0 2024-02-15T22:51:12.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/135: creat de/f2a x:0 0 0 2024-02-15T22:51:12.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/136: creat de/d1b/f2b x:0 0 0 2024-02-15T22:51:12.561 INFO:tasks.workunit.client.1.smithi170.stdout:7/175: mknod da/d1a/c3e 0 2024-02-15T22:51:12.564 INFO:tasks.workunit.client.1.smithi170.stdout:9/137: mkdir de/d1b/d1c/d1f/d20/d27/d2c 0 2024-02-15T22:51:12.564 INFO:tasks.workunit.client.1.smithi170.stdout:9/138: chown de/l16 6 1 2024-02-15T22:51:12.564 INFO:tasks.workunit.client.1.smithi170.stdout:9/139: truncate de/d1b/d1c/d1f/d20/f21 1140518 0 2024-02-15T22:51:12.565 INFO:tasks.workunit.client.1.smithi170.stdout:7/176: creat da/f3f x:0 0 0 2024-02-15T22:51:12.567 INFO:tasks.workunit.client.1.smithi170.stdout:9/140: creat de/d1b/d1c/f2d x:0 0 0 2024-02-15T22:51:12.567 INFO:tasks.workunit.client.1.smithi170.stdout:9/141: chown de/d1b/d1c 513 1 2024-02-15T22:51:12.567 INFO:tasks.workunit.client.1.smithi170.stdout:9/142: fsync de/d1b/d1c/d1f/d20/f21 0 2024-02-15T22:51:12.570 INFO:tasks.workunit.client.1.smithi170.stdout:9/143: mkdir de/d1b/d2e 0 2024-02-15T22:51:12.571 INFO:tasks.workunit.client.1.smithi170.stdout:9/144: creat de/f2f x:0 0 0 2024-02-15T22:51:12.572 INFO:tasks.workunit.client.1.smithi170.stdout:7/177: read da/d1a/f1e [3142939,81738] 0 2024-02-15T22:51:12.572 INFO:tasks.workunit.client.1.smithi170.stdout:7/178: write da/d1a/f1e [4038588,63170] 0 2024-02-15T22:51:12.574 INFO:tasks.workunit.client.1.smithi170.stdout:7/179: mknod da/c40 0 2024-02-15T22:51:12.576 INFO:tasks.workunit.client.1.smithi170.stdout:7/180: symlink da/l41 0 2024-02-15T22:51:12.577 INFO:tasks.workunit.client.1.smithi170.stdout:9/145: dread fb [0,4194304] 0 2024-02-15T22:51:12.587 INFO:tasks.workunit.client.1.smithi170.stdout:0/116: sync 2024-02-15T22:51:12.587 INFO:tasks.workunit.client.1.smithi170.stdout:0/117: chown c3 146433613 1 2024-02-15T22:51:12.589 INFO:tasks.workunit.client.1.smithi170.stdout:0/118: getdents d8/df 0 2024-02-15T22:51:12.596 INFO:tasks.workunit.client.1.smithi170.stdout:0/119: dread d8/d14/f1a [0,4194304] 0 2024-02-15T22:51:12.596 INFO:tasks.workunit.client.1.smithi170.stdout:9/146: dwrite de/f12 [0,4194304] 0 2024-02-15T22:51:12.597 INFO:tasks.workunit.client.1.smithi170.stdout:0/120: getdents d8/df/d13/d22 0 2024-02-15T22:51:12.598 INFO:tasks.workunit.client.1.smithi170.stdout:9/147: mkdir de/d1b/d1c/d1f/d20/d27/d28/d30 0 2024-02-15T22:51:12.599 INFO:tasks.workunit.client.1.smithi170.stdout:0/121: rename l0 to d8/df/l2c 0 2024-02-15T22:51:12.599 INFO:tasks.workunit.client.1.smithi170.stdout:0/122: write d8/f2a [263474,118506] 0 2024-02-15T22:51:12.600 INFO:tasks.workunit.client.1.smithi170.stdout:9/148: mknod de/d1b/d1c/d1f/d20/d27/d2c/c31 0 2024-02-15T22:51:12.601 INFO:tasks.workunit.client.1.smithi170.stdout:0/123: symlink d8/d14/l2d 0 2024-02-15T22:51:12.601 INFO:tasks.workunit.client.1.smithi170.stdout:0/124: readlink d8/d14/l17 0 2024-02-15T22:51:12.601 INFO:tasks.workunit.client.1.smithi170.stdout:0/125: write d8/df/d13/f1f [774350,46320] 0 2024-02-15T22:51:12.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/126: stat d8/d14/d1c/f24 0 2024-02-15T22:51:12.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/127: chown f5 723610 1 2024-02-15T22:51:12.602 INFO:tasks.workunit.client.1.smithi170.stdout:9/149: truncate de/d1b/d1c/d1f/d20/f21 657720 0 2024-02-15T22:51:12.603 INFO:tasks.workunit.client.1.smithi170.stdout:9/150: creat de/d1b/d1c/d1f/d20/d27/d2c/f32 x:0 0 0 2024-02-15T22:51:12.603 INFO:tasks.workunit.client.1.smithi170.stdout:9/151: dread - de/d1b/d1c/d1f/d20/d27/d2c/f32 zero size 2024-02-15T22:51:12.607 INFO:tasks.workunit.client.1.smithi170.stdout:0/128: getdents d8/d14 0 2024-02-15T22:51:12.607 INFO:tasks.workunit.client.1.smithi170.stdout:0/129: readlink l2 0 2024-02-15T22:51:12.613 INFO:tasks.workunit.client.1.smithi170.stdout:0/130: dread d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:12.613 INFO:tasks.workunit.client.1.smithi170.stdout:0/131: creat d8/df/d13/f2e x:0 0 0 2024-02-15T22:51:12.617 INFO:tasks.workunit.client.1.smithi170.stdout:9/152: dwrite f2 [0,4194304] 0 2024-02-15T22:51:12.618 INFO:tasks.workunit.client.1.smithi170.stdout:9/153: readlink de/l13 0 2024-02-15T22:51:12.641 INFO:tasks.workunit.client.1.smithi170.stdout:0/132: dwrite d8/d14/f1a [0,4194304] 0 2024-02-15T22:51:12.641 INFO:tasks.workunit.client.1.smithi170.stdout:0/133: chown d8/df/f19 109 1 2024-02-15T22:51:12.642 INFO:tasks.workunit.client.1.smithi170.stdout:9/154: dwrite de/f2f [0,4194304] 0 2024-02-15T22:51:12.642 INFO:tasks.workunit.client.1.smithi170.stdout:9/155: readlink de/l13 0 2024-02-15T22:51:12.642 INFO:tasks.workunit.client.1.smithi170.stdout:9/156: readlink de/d1b/l23 0 2024-02-15T22:51:12.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/134: dwrite d8/df/f19 [0,4194304] 0 2024-02-15T22:51:12.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/135: dread - d8/d14/d1c/f2b zero size 2024-02-15T22:51:12.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/136: write d8/d14/d1c/f2b [158249,619] 0 2024-02-15T22:51:12.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/137: creat d8/df/d13/f2f x:0 0 0 2024-02-15T22:51:12.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/138: creat d8/df/d13/f30 x:0 0 0 2024-02-15T22:51:12.675 INFO:tasks.workunit.client.1.smithi170.stdout:6/194: sync 2024-02-15T22:51:12.676 INFO:tasks.workunit.client.1.smithi170.stdout:6/195: mknod d3/d1d/d1b/d3c/c4b 0 2024-02-15T22:51:12.677 INFO:tasks.workunit.client.1.smithi170.stdout:6/196: truncate f2 2018951 0 2024-02-15T22:51:12.677 INFO:tasks.workunit.client.1.smithi170.stdout:6/197: readlink d3/d1d/d28/d3b/d2f/l46 0 2024-02-15T22:51:12.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/139: getdents d8/df/d13 0 2024-02-15T22:51:12.680 INFO:tasks.workunit.client.1.smithi170.stdout:0/140: unlink d8/d14/d1c/f25 0 2024-02-15T22:51:12.681 INFO:tasks.workunit.client.1.smithi170.stdout:0/141: getdents d8/df 0 2024-02-15T22:51:12.682 INFO:tasks.workunit.client.1.smithi170.stdout:0/142: dread - d8/df/f11 zero size 2024-02-15T22:51:12.682 INFO:tasks.workunit.client.1.smithi170.stdout:0/143: fsync d8/df/f12 0 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/144: symlink d8/df/d13/d22/l31 0 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/145: write d8/df/d13/f20 [191542,39307] 0 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/146: read - d8/f1b zero size 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/147: readlink d8/d14/l26 0 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:6/198: dread d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:12.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/148: mkdir d8/d14/d32 0 2024-02-15T22:51:12.685 INFO:tasks.workunit.client.1.smithi170.stdout:6/199: rmdir d3/d1d/d28 39 2024-02-15T22:51:12.685 INFO:tasks.workunit.client.1.smithi170.stdout:6/200: write d3/d1d/d27/f4a [514114,39086] 0 2024-02-15T22:51:12.687 INFO:tasks.workunit.client.1.smithi170.stdout:6/201: mknod d3/d1d/d28/d3b/d2f/c4c 0 2024-02-15T22:51:12.687 INFO:tasks.workunit.client.1.smithi170.stdout:6/202: fdatasync d3/fa 0 2024-02-15T22:51:12.687 INFO:tasks.workunit.client.1.smithi170.stdout:6/203: write f2 [2685798,18906] 0 2024-02-15T22:51:12.687 INFO:tasks.workunit.client.1.smithi170.stdout:6/204: truncate d3/d24/d31/f49 250005 0 2024-02-15T22:51:12.688 INFO:tasks.workunit.client.1.smithi170.stdout:6/205: mknod d3/d1d/c4d 0 2024-02-15T22:51:12.689 INFO:tasks.workunit.client.1.smithi170.stdout:6/206: symlink d3/d1a/l4e 0 2024-02-15T22:51:12.703 INFO:tasks.workunit.client.1.smithi170.stdout:6/207: dwrite d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:12.705 INFO:tasks.workunit.client.1.smithi170.stdout:6/208: dread d3/d1d/d27/f43 [0,4194304] 0 2024-02-15T22:51:12.705 INFO:tasks.workunit.client.1.smithi170.stdout:6/209: fdatasync d3/d1d/d36/f14 0 2024-02-15T22:51:12.705 INFO:tasks.workunit.client.1.smithi170.stdout:6/210: chown d3/d1d/d28/d3b/l1f 217146225 1 2024-02-15T22:51:12.705 INFO:tasks.workunit.client.1.smithi170.stdout:6/211: chown d3/d1a/l4e 39 1 2024-02-15T22:51:12.707 INFO:tasks.workunit.client.1.smithi170.stdout:6/212: write d3/d1d/d27/f43 [321522,93813] 0 2024-02-15T22:51:12.708 INFO:tasks.workunit.client.1.smithi170.stdout:6/213: unlink d3/d1d/d28/d3b/d2f/f37 0 2024-02-15T22:51:12.708 INFO:tasks.workunit.client.1.smithi170.stdout:6/214: write d3/f16 [2420521,78893] 0 2024-02-15T22:51:12.709 INFO:tasks.workunit.client.1.smithi170.stdout:6/215: symlink d3/l4f 0 2024-02-15T22:51:12.711 INFO:tasks.workunit.client.1.smithi170.stdout:6/216: fdatasync d3/f16 0 2024-02-15T22:51:12.717 INFO:tasks.workunit.client.1.smithi170.stdout:6/217: write d3/d1d/d36/fc [4386375,116052] 0 2024-02-15T22:51:12.719 INFO:tasks.workunit.client.1.smithi170.stdout:6/218: mknod d3/d1d/d36/c50 0 2024-02-15T22:51:12.725 INFO:tasks.workunit.client.1.smithi170.stdout:6/219: write d3/d1a/f40 [2021989,115426] 0 2024-02-15T22:51:12.745 INFO:tasks.workunit.client.1.smithi170.stdout:6/220: dwrite d3/d1d/d27/f2e [0,4194304] 0 2024-02-15T22:51:12.745 INFO:tasks.workunit.client.1.smithi170.stdout:6/221: read d3/d1d/d36/f14 [2406832,36893] 0 2024-02-15T22:51:12.766 INFO:tasks.workunit.client.1.smithi170.stdout:6/222: dwrite d3/d1d/d36/f14 [8388608,4194304] 0 2024-02-15T22:51:12.773 INFO:tasks.workunit.client.1.smithi170.stdout:6/223: mkdir d3/d1d/d36/d51 0 2024-02-15T22:51:12.773 INFO:tasks.workunit.client.1.smithi170.stdout:6/224: creat d3/d1d/d27/f52 x:0 0 0 2024-02-15T22:51:12.773 INFO:tasks.workunit.client.1.smithi170.stdout:6/225: chown d3/d1d/d27/f43 1522 1 2024-02-15T22:51:12.773 INFO:tasks.workunit.client.1.smithi170.stdout:6/226: dread - d3/d1d/d28/d3b/f2b zero size 2024-02-15T22:51:12.773 INFO:tasks.workunit.client.1.smithi170.stdout:6/227: write d3/d24/d31/f44 [361048,106782] 0 2024-02-15T22:51:12.774 INFO:tasks.workunit.client.1.smithi170.stdout:3/165: sync 2024-02-15T22:51:12.774 INFO:tasks.workunit.client.1.smithi170.stdout:6/228: dread d3/d1a/f33 [0,4194304] 0 2024-02-15T22:51:12.775 INFO:tasks.workunit.client.1.smithi170.stdout:6/229: truncate d3/d1d/d36/f11 567102 0 2024-02-15T22:51:12.775 INFO:tasks.workunit.client.1.smithi170.stdout:6/230: chown d3/f4 11475 1 2024-02-15T22:51:12.780 INFO:tasks.workunit.client.1.smithi170.stdout:6/231: dread d3/d1d/d36/fc [4194304,4194304] 0 2024-02-15T22:51:12.781 INFO:tasks.workunit.client.1.smithi170.stdout:6/232: mkdir d3/d1d/d53 0 2024-02-15T22:51:12.782 INFO:tasks.workunit.client.1.smithi170.stdout:6/233: mkdir d3/d1d/d36/d51/d54 0 2024-02-15T22:51:12.782 INFO:tasks.workunit.client.1.smithi170.stdout:6/234: fsync d3/d1d/d27/f4a 0 2024-02-15T22:51:12.783 INFO:tasks.workunit.client.1.smithi170.stdout:6/235: stat d3/d1a 0 2024-02-15T22:51:12.784 INFO:tasks.workunit.client.1.smithi170.stdout:6/236: mkdir d3/d1d/d28/d3b/d55 0 2024-02-15T22:51:12.784 INFO:tasks.workunit.client.1.smithi170.stdout:6/237: fdatasync d3/d1d/d28/d3b/f2b 0 2024-02-15T22:51:12.786 INFO:tasks.workunit.client.1.smithi170.stdout:6/238: dread d3/d1d/d27/f2d [0,4194304] 0 2024-02-15T22:51:12.787 INFO:tasks.workunit.client.1.smithi170.stdout:6/239: truncate d3/f7 1464240 0 2024-02-15T22:51:12.788 INFO:tasks.workunit.client.1.smithi170.stdout:6/240: rmdir d3/d1d 39 2024-02-15T22:51:12.790 INFO:tasks.workunit.client.1.smithi170.stdout:3/166: dwrite d3/f9 [0,4194304] 0 2024-02-15T22:51:12.801 INFO:tasks.workunit.client.1.smithi170.stdout:6/241: dwrite d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:8/85: sync 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:5/198: sync 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:7/181: sync 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:1/160: sync 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:4/216: sync 2024-02-15T22:51:12.802 INFO:tasks.workunit.client.1.smithi170.stdout:1/161: chown d3/f20 24 1 2024-02-15T22:51:12.803 INFO:tasks.workunit.client.1.smithi170.stdout:2/190: sync 2024-02-15T22:51:12.803 INFO:tasks.workunit.client.1.smithi170.stdout:2/191: write d0/d1/f27 [5064849,85659] 0 2024-02-15T22:51:12.803 INFO:tasks.workunit.client.1.smithi170.stdout:2/192: chown d0/d1/l24 200 1 2024-02-15T22:51:12.803 INFO:tasks.workunit.client.1.smithi170.stdout:9/157: sync 2024-02-15T22:51:12.804 INFO:tasks.workunit.client.1.smithi170.stdout:7/182: truncate da/d1a/f2f 451323 0 2024-02-15T22:51:12.804 INFO:tasks.workunit.client.1.smithi170.stdout:7/183: fdatasync da/f3b 0 2024-02-15T22:51:12.805 INFO:tasks.workunit.client.1.smithi170.stdout:4/217: getdents d0/d22/da/d11 0 2024-02-15T22:51:12.805 INFO:tasks.workunit.client.1.smithi170.stdout:4/218: fsync d0/d22/da/d11/f30 0 2024-02-15T22:51:12.805 INFO:tasks.workunit.client.1.smithi170.stdout:4/219: readlink d0/l4 0 2024-02-15T22:51:12.807 INFO:tasks.workunit.client.1.smithi170.stdout:9/158: link de/f1a de/d1b/d1c/d1f/d20/d27/d28/f33 0 2024-02-15T22:51:12.807 INFO:tasks.workunit.client.1.smithi170.stdout:9/159: stat c9 0 2024-02-15T22:51:12.808 INFO:tasks.workunit.client.1.smithi170.stdout:7/184: creat da/d1a/d21/f42 x:0 0 0 2024-02-15T22:51:12.810 INFO:tasks.workunit.client.1.smithi170.stdout:7/185: mknod da/d1a/d21/d19/c43 0 2024-02-15T22:51:12.810 INFO:tasks.workunit.client.1.smithi170.stdout:7/186: readlink da/d1a/d28/l34 0 2024-02-15T22:51:12.810 INFO:tasks.workunit.client.1.smithi170.stdout:7/187: truncate da/d1a/d21/d2c/d2e/f35 845922 0 2024-02-15T22:51:12.813 INFO:tasks.workunit.client.1.smithi170.stdout:7/188: read da/d1a/f2f [158394,99062] 0 2024-02-15T22:51:12.814 INFO:tasks.workunit.client.1.smithi170.stdout:4/220: write d0/d22/da/d11/f3c [770255,120453] 0 2024-02-15T22:51:12.815 INFO:tasks.workunit.client.1.smithi170.stdout:4/221: stat d0/d22/da/d11/f3b 0 2024-02-15T22:51:12.815 INFO:tasks.workunit.client.1.smithi170.stdout:4/222: creat d0/d22/da/d1d/f40 x:0 0 0 2024-02-15T22:51:12.815 INFO:tasks.workunit.client.1.smithi170.stdout:4/223: read - d0/d22/da/d11/d20/f3d zero size 2024-02-15T22:51:12.815 INFO:tasks.workunit.client.1.smithi170.stdout:7/189: truncate da/d1a/d21/d19/f20 6119791 0 2024-02-15T22:51:12.816 INFO:tasks.workunit.client.1.smithi170.stdout:8/86: dread f7 [0,4194304] 0 2024-02-15T22:51:12.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/87: fsync d9/f13 0 2024-02-15T22:51:12.818 INFO:tasks.workunit.client.1.smithi170.stdout:7/190: unlink da/d1a/d21/d2c/d2e/l30 0 2024-02-15T22:51:12.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/191: mknod da/d1a/d21/d19/c44 0 2024-02-15T22:51:12.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/192: dread - da/f3b zero size 2024-02-15T22:51:12.821 INFO:tasks.workunit.client.1.smithi170.stdout:8/88: mknod d9/c15 0 2024-02-15T22:51:12.822 INFO:tasks.workunit.client.1.smithi170.stdout:7/193: truncate da/d1a/f1e 601270 0 2024-02-15T22:51:12.822 INFO:tasks.workunit.client.1.smithi170.stdout:7/194: truncate da/d1a/d21/f42 345849 0 2024-02-15T22:51:12.822 INFO:tasks.workunit.client.1.smithi170.stdout:2/193: dread d0/d13/f3a [0,4194304] 0 2024-02-15T22:51:12.823 INFO:tasks.workunit.client.1.smithi170.stdout:8/89: unlink c4 0 2024-02-15T22:51:12.823 INFO:tasks.workunit.client.1.smithi170.stdout:6/242: dread d3/d1d/f12 [0,4194304] 0 2024-02-15T22:51:12.824 INFO:tasks.workunit.client.1.smithi170.stdout:8/90: dread d9/ff [0,4194304] 0 2024-02-15T22:51:12.824 INFO:tasks.workunit.client.1.smithi170.stdout:8/91: fdatasync d9/f11 0 2024-02-15T22:51:12.824 INFO:tasks.workunit.client.1.smithi170.stdout:2/194: creat d0/d1/f48 x:0 0 0 2024-02-15T22:51:12.824 INFO:tasks.workunit.client.1.smithi170.stdout:2/195: stat d0/f25 0 2024-02-15T22:51:12.825 INFO:tasks.workunit.client.1.smithi170.stdout:8/92: unlink d9/l14 0 2024-02-15T22:51:12.826 INFO:tasks.workunit.client.1.smithi170.stdout:2/196: creat d0/d1/d31/f49 x:0 0 0 2024-02-15T22:51:12.827 INFO:tasks.workunit.client.1.smithi170.stdout:6/243: mkdir d3/d1d/d36/d56 0 2024-02-15T22:51:12.828 INFO:tasks.workunit.client.1.smithi170.stdout:9/160: dwrite de/d1b/f25 [0,4194304] 0 2024-02-15T22:51:12.828 INFO:tasks.workunit.client.1.smithi170.stdout:5/199: dwrite de/d36/f41 [0,4194304] 0 2024-02-15T22:51:12.829 INFO:tasks.workunit.client.1.smithi170.stdout:5/200: truncate de/d10/d27/d2d/f39 420060 0 2024-02-15T22:51:12.829 INFO:tasks.workunit.client.1.smithi170.stdout:2/197: mkdir d0/d28/d3e/d4a 0 2024-02-15T22:51:12.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/93: link d9/fd d9/f16 0 2024-02-15T22:51:12.835 INFO:tasks.workunit.client.1.smithi170.stdout:9/161: rmdir de/d1b/d1c/d1f/d20/d27/d28/d30 0 2024-02-15T22:51:12.836 INFO:tasks.workunit.client.1.smithi170.stdout:8/94: dread d9/f10 [0,4194304] 0 2024-02-15T22:51:12.839 INFO:tasks.workunit.client.1.smithi170.stdout:5/201: rename de/d29/f30 to de/d10/d33/f42 0 2024-02-15T22:51:12.839 INFO:tasks.workunit.client.1.smithi170.stdout:5/202: creat de/d36/f43 x:0 0 0 2024-02-15T22:51:12.840 INFO:tasks.workunit.client.1.smithi170.stdout:2/198: mknod d0/d28/d2f/d37/c4b 0 2024-02-15T22:51:12.842 INFO:tasks.workunit.client.1.smithi170.stdout:9/162: mknod de/d1b/d1c/d1f/d20/d27/d28/c34 0 2024-02-15T22:51:12.844 INFO:tasks.workunit.client.1.smithi170.stdout:7/195: dread da/d1a/f1e [0,4194304] 0 2024-02-15T22:51:12.844 INFO:tasks.workunit.client.1.smithi170.stdout:8/95: creat d9/f17 x:0 0 0 2024-02-15T22:51:12.844 INFO:tasks.workunit.client.1.smithi170.stdout:8/96: write d9/f13 [986200,108099] 0 2024-02-15T22:51:12.845 INFO:tasks.workunit.client.1.smithi170.stdout:6/244: getdents d3/d1d/d36 0 2024-02-15T22:51:12.846 INFO:tasks.workunit.client.1.smithi170.stdout:2/199: creat d0/d1d/d3d/f4c x:0 0 0 2024-02-15T22:51:12.850 INFO:tasks.workunit.client.1.smithi170.stdout:9/163: dread de/f14 [0,4194304] 0 2024-02-15T22:51:12.851 INFO:tasks.workunit.client.1.smithi170.stdout:9/164: chown de/l11 5 1 2024-02-15T22:51:12.854 INFO:tasks.workunit.client.1.smithi170.stdout:7/196: unlink c9 0 2024-02-15T22:51:12.854 INFO:tasks.workunit.client.1.smithi170.stdout:9/165: read de/d1b/d1c/d1f/d20/f21 [255799,94532] 0 2024-02-15T22:51:12.854 INFO:tasks.workunit.client.1.smithi170.stdout:9/166: write de/d1b/f2b [846892,115248] 0 2024-02-15T22:51:12.854 INFO:tasks.workunit.client.1.smithi170.stdout:7/197: write da/d1a/d21/d2c/d2e/f35 [193732,62281] 0 2024-02-15T22:51:12.854 INFO:tasks.workunit.client.1.smithi170.stdout:7/198: readlink da/d1a/d21/d19/l24 0 2024-02-15T22:51:12.856 INFO:tasks.workunit.client.1.smithi170.stdout:6/245: symlink d3/d1d/d28/l57 0 2024-02-15T22:51:12.857 INFO:tasks.workunit.client.1.smithi170.stdout:9/167: symlink de/d1b/d1c/d1f/l35 0 2024-02-15T22:51:12.858 INFO:tasks.workunit.client.1.smithi170.stdout:7/199: link l2 da/d1a/d21/d1b/l45 0 2024-02-15T22:51:12.859 INFO:tasks.workunit.client.1.smithi170.stdout:7/200: chown da/d1a/d21/d19 41 1 2024-02-15T22:51:12.859 INFO:tasks.workunit.client.1.smithi170.stdout:7/201: write da/f38 [679093,48345] 0 2024-02-15T22:51:12.859 INFO:tasks.workunit.client.1.smithi170.stdout:7/202: stat da/f12 0 2024-02-15T22:51:12.861 INFO:tasks.workunit.client.1.smithi170.stdout:6/246: creat d3/d1d/d36/f58 x:0 0 0 2024-02-15T22:51:12.861 INFO:tasks.workunit.client.1.smithi170.stdout:6/247: write d3/d1d/d36/f14 [99020,106080] 0 2024-02-15T22:51:12.861 INFO:tasks.workunit.client.1.smithi170.stdout:5/203: dwrite de/d10/d27/d2d/f31 [0,4194304] 0 2024-02-15T22:51:12.861 INFO:tasks.workunit.client.1.smithi170.stdout:2/200: dwrite d0/d1/f12 [0,4194304] 0 2024-02-15T22:51:12.862 INFO:tasks.workunit.client.1.smithi170.stdout:2/201: creat d0/d1/f4d x:0 0 0 2024-02-15T22:51:12.862 INFO:tasks.workunit.client.1.smithi170.stdout:9/168: creat de/d1b/d1c/d1f/f36 x:0 0 0 2024-02-15T22:51:12.862 INFO:tasks.workunit.client.1.smithi170.stdout:6/248: dread d3/d24/d31/f49 [0,4194304] 0 2024-02-15T22:51:12.864 INFO:tasks.workunit.client.1.smithi170.stdout:7/203: rename da/d1a/f2f to da/d1a/d21/f46 0 2024-02-15T22:51:12.870 INFO:tasks.workunit.client.1.smithi170.stdout:5/204: mknod de/d10/d27/d2d/c44 0 2024-02-15T22:51:12.877 INFO:tasks.workunit.client.1.smithi170.stdout:9/169: dwrite de/d1b/d1c/d1f/d20/f21 [0,4194304] 0 2024-02-15T22:51:12.879 INFO:tasks.workunit.client.1.smithi170.stdout:7/204: mknod da/d1a/d21/d2c/c47 0 2024-02-15T22:51:12.879 INFO:tasks.workunit.client.1.smithi170.stdout:7/205: readlink da/d1a/d21/l31 0 2024-02-15T22:51:12.880 INFO:tasks.workunit.client.1.smithi170.stdout:7/206: creat da/d1a/f48 x:0 0 0 2024-02-15T22:51:12.881 INFO:tasks.workunit.client.1.smithi170.stdout:5/205: creat de/d10/d33/f45 x:0 0 0 2024-02-15T22:51:12.885 INFO:tasks.workunit.client.1.smithi170.stdout:8/97: truncate d9/f13 465114 0 2024-02-15T22:51:12.886 INFO:tasks.workunit.client.1.smithi170.stdout:2/202: getdents d0/d1d 0 2024-02-15T22:51:12.888 INFO:tasks.workunit.client.1.smithi170.stdout:5/206: symlink de/d36/l46 0 2024-02-15T22:51:12.888 INFO:tasks.workunit.client.1.smithi170.stdout:5/207: truncate de/d10/f19 4885808 0 2024-02-15T22:51:12.890 INFO:tasks.workunit.client.1.smithi170.stdout:2/203: creat d0/d1d/f4e x:0 0 0 2024-02-15T22:51:12.891 INFO:tasks.workunit.client.1.smithi170.stdout:5/208: rmdir de 39 2024-02-15T22:51:12.891 INFO:tasks.workunit.client.1.smithi170.stdout:5/209: creat de/d10/d27/d2d/f47 x:0 0 0 2024-02-15T22:51:12.891 INFO:tasks.workunit.client.1.smithi170.stdout:8/98: mkdir d9/d18 0 2024-02-15T22:51:12.892 INFO:tasks.workunit.client.1.smithi170.stdout:2/204: creat d0/d28/d2f/d37/f4f x:0 0 0 2024-02-15T22:51:12.894 INFO:tasks.workunit.client.1.smithi170.stdout:5/210: mknod de/d36/c48 0 2024-02-15T22:51:12.894 INFO:tasks.workunit.client.1.smithi170.stdout:5/211: dread - de/d10/d33/f45 zero size 2024-02-15T22:51:12.895 INFO:tasks.workunit.client.1.smithi170.stdout:8/99: creat d9/d18/f19 x:0 0 0 2024-02-15T22:51:12.896 INFO:tasks.workunit.client.1.smithi170.stdout:2/205: rename d0/d13/f3a to d0/d1/d11/f50 0 2024-02-15T22:51:12.897 INFO:tasks.workunit.client.1.smithi170.stdout:2/206: stat d0/d13/l1c 0 2024-02-15T22:51:12.897 INFO:tasks.workunit.client.1.smithi170.stdout:2/207: truncate d0/d1/f9 5904078 0 2024-02-15T22:51:12.897 INFO:tasks.workunit.client.1.smithi170.stdout:5/212: unlink de/c1f 0 2024-02-15T22:51:12.900 INFO:tasks.workunit.client.1.smithi170.stdout:5/213: creat de/d10/d27/f49 x:0 0 0 2024-02-15T22:51:12.900 INFO:tasks.workunit.client.1.smithi170.stdout:5/214: symlink de/d29/l4a 0 2024-02-15T22:51:12.902 INFO:tasks.workunit.client.1.smithi170.stdout:5/215: creat de/f4b x:0 0 0 2024-02-15T22:51:12.902 INFO:tasks.workunit.client.1.smithi170.stdout:5/216: fdatasync de/f11 0 2024-02-15T22:51:12.902 INFO:tasks.workunit.client.1.smithi170.stdout:5/217: chown fd 17871 1 2024-02-15T22:51:12.902 INFO:tasks.workunit.client.1.smithi170.stdout:5/218: write de/d10/d27/d2d/f35 [63941,10010] 0 2024-02-15T22:51:12.902 INFO:tasks.workunit.client.1.smithi170.stdout:0/149: sync 2024-02-15T22:51:12.903 INFO:tasks.workunit.client.1.smithi170.stdout:0/150: creat d8/df/d13/d22/f33 x:0 0 0 2024-02-15T22:51:12.904 INFO:tasks.workunit.client.1.smithi170.stdout:8/100: unlink d9/f13 0 2024-02-15T22:51:12.906 INFO:tasks.workunit.client.1.smithi170.stdout:8/101: creat d9/f1a x:0 0 0 2024-02-15T22:51:12.906 INFO:tasks.workunit.client.1.smithi170.stdout:8/102: write d9/d18/f19 [777896,71212] 0 2024-02-15T22:51:12.906 INFO:tasks.workunit.client.1.smithi170.stdout:8/103: stat d9/f16 0 2024-02-15T22:51:12.907 INFO:tasks.workunit.client.1.smithi170.stdout:8/104: write d9/f11 [117466,92901] 0 2024-02-15T22:51:12.912 INFO:tasks.workunit.client.1.smithi170.stdout:5/219: write fd [1987378,2904] 0 2024-02-15T22:51:12.912 INFO:tasks.workunit.client.1.smithi170.stdout:5/220: truncate de/d10/d27/f49 5165 0 2024-02-15T22:51:12.912 INFO:tasks.workunit.client.1.smithi170.stdout:8/105: dread d9/f16 [0,4194304] 0 2024-02-15T22:51:12.913 INFO:tasks.workunit.client.1.smithi170.stdout:8/106: rename c2 to d9/d18/c1b 0 2024-02-15T22:51:12.914 INFO:tasks.workunit.client.1.smithi170.stdout:8/107: read d9/f16 [147148,96651] 0 2024-02-15T22:51:12.914 INFO:tasks.workunit.client.1.smithi170.stdout:8/108: write d9/d18/f19 [1119868,97662] 0 2024-02-15T22:51:12.919 INFO:tasks.workunit.client.1.smithi170.stdout:5/221: write de/d10/d27/f2a [899693,99659] 0 2024-02-15T22:51:12.919 INFO:tasks.workunit.client.1.smithi170.stdout:5/222: chown de/d10/f19 196158637 1 2024-02-15T22:51:12.920 INFO:tasks.workunit.client.1.smithi170.stdout:8/109: link d9/d18/c1b d9/d18/c1c 0 2024-02-15T22:51:12.923 INFO:tasks.workunit.client.1.smithi170.stdout:8/110: link d9/d18/f19 d9/f1d 0 2024-02-15T22:51:12.923 INFO:tasks.workunit.client.1.smithi170.stdout:8/111: dread - d9/f17 zero size 2024-02-15T22:51:12.927 INFO:tasks.workunit.client.1.smithi170.stdout:0/151: dwrite f6 [0,4194304] 0 2024-02-15T22:51:12.930 INFO:tasks.workunit.client.1.smithi170.stdout:8/112: write f7 [1230098,14276] 0 2024-02-15T22:51:12.932 INFO:tasks.workunit.client.1.smithi170.stdout:8/113: link d9/f16 d9/d18/f1e 0 2024-02-15T22:51:12.932 INFO:tasks.workunit.client.1.smithi170.stdout:8/114: symlink d9/d18/l1f 0 2024-02-15T22:51:12.937 INFO:tasks.workunit.client.1.smithi170.stdout:8/115: link d9/d18/l1f d9/d18/l20 0 2024-02-15T22:51:12.942 INFO:tasks.workunit.client.1.smithi170.stdout:2/208: write d0/d1/fe [408459,7219] 0 2024-02-15T22:51:12.943 INFO:tasks.workunit.client.1.smithi170.stdout:8/116: symlink d9/l21 0 2024-02-15T22:51:12.944 INFO:tasks.workunit.client.1.smithi170.stdout:8/117: dread d9/ff [0,4194304] 0 2024-02-15T22:51:12.945 INFO:tasks.workunit.client.1.smithi170.stdout:2/209: symlink d0/d28/d3e/d4a/l51 0 2024-02-15T22:51:12.945 INFO:tasks.workunit.client.1.smithi170.stdout:2/210: stat d0/d13/l15 0 2024-02-15T22:51:12.947 INFO:tasks.workunit.client.1.smithi170.stdout:2/211: unlink d0/d1/f1a 0 2024-02-15T22:51:12.947 INFO:tasks.workunit.client.1.smithi170.stdout:2/212: chown d0/d13/l1c 7298823 1 2024-02-15T22:51:12.947 INFO:tasks.workunit.client.1.smithi170.stdout:9/170: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:12.948 INFO:tasks.workunit.client.1.smithi170.stdout:9/171: truncate de/d1b/d1c/f2d 132062 0 2024-02-15T22:51:12.948 INFO:tasks.workunit.client.1.smithi170.stdout:7/207: dwrite da/d1a/d21/f42 [0,4194304] 0 2024-02-15T22:51:12.948 INFO:tasks.workunit.client.1.smithi170.stdout:5/223: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:12.948 INFO:tasks.workunit.client.1.smithi170.stdout:8/118: symlink d9/l22 0 2024-02-15T22:51:12.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/213: unlink d0/d1/d11/c19 0 2024-02-15T22:51:12.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/214: creat d0/d13/f52 x:0 0 0 2024-02-15T22:51:12.953 INFO:tasks.workunit.client.1.smithi170.stdout:9/172: mkdir de/d1b/d37 0 2024-02-15T22:51:12.954 INFO:tasks.workunit.client.1.smithi170.stdout:9/173: read de/d1b/f2b [744707,6771] 0 2024-02-15T22:51:12.955 INFO:tasks.workunit.client.1.smithi170.stdout:9/174: dread - de/d1b/d1c/d1f/d20/d27/d2c/f32 zero size 2024-02-15T22:51:12.963 INFO:tasks.workunit.client.1.smithi170.stdout:7/208: mknod da/d1a/d28/c49 0 2024-02-15T22:51:12.964 INFO:tasks.workunit.client.1.smithi170.stdout:8/119: dwrite d9/f1d [0,4194304] 0 2024-02-15T22:51:12.965 INFO:tasks.workunit.client.1.smithi170.stdout:5/224: unlink de/f25 0 2024-02-15T22:51:12.968 INFO:tasks.workunit.client.1.smithi170.stdout:2/215: mkdir d0/d1/d53 0 2024-02-15T22:51:12.968 INFO:tasks.workunit.client.1.smithi170.stdout:2/216: chown d0/d1/d11 0 1 2024-02-15T22:51:12.970 INFO:tasks.workunit.client.1.smithi170.stdout:7/209: getdents da/d1a/d21/d1b 0 2024-02-15T22:51:12.974 INFO:tasks.workunit.client.1.smithi170.stdout:5/225: mkdir de/d10/d27/d4c 0 2024-02-15T22:51:12.974 INFO:tasks.workunit.client.1.smithi170.stdout:5/226: stat de/f21 0 2024-02-15T22:51:12.975 INFO:tasks.workunit.client.1.smithi170.stdout:9/175: mknod de/c38 0 2024-02-15T22:51:12.980 INFO:tasks.workunit.client.1.smithi170.stdout:5/227: dread f1 [0,4194304] 0 2024-02-15T22:51:12.983 INFO:tasks.workunit.client.1.smithi170.stdout:5/228: mkdir de/d29/d4d 0 2024-02-15T22:51:12.983 INFO:tasks.workunit.client.1.smithi170.stdout:5/229: readlink de/l14 0 2024-02-15T22:51:12.984 INFO:tasks.workunit.client.1.smithi170.stdout:5/230: mknod de/d29/d40/c4e 0 2024-02-15T22:51:12.984 INFO:tasks.workunit.client.1.smithi170.stdout:5/231: creat de/d10/d27/f4f x:0 0 0 2024-02-15T22:51:12.985 INFO:tasks.workunit.client.1.smithi170.stdout:9/176: dread f2 [0,4194304] 0 2024-02-15T22:51:12.987 INFO:tasks.workunit.client.1.smithi170.stdout:9/177: mknod de/d1b/d1c/d1f/d20/c39 0 2024-02-15T22:51:12.987 INFO:tasks.workunit.client.1.smithi170.stdout:9/178: write de/f24 [915597,73862] 0 2024-02-15T22:51:12.987 INFO:tasks.workunit.client.1.smithi170.stdout:9/179: dread - de/f2a zero size 2024-02-15T22:51:12.987 INFO:tasks.workunit.client.1.smithi170.stdout:8/120: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:12.987 INFO:tasks.workunit.client.1.smithi170.stdout:8/121: truncate d9/f1a 715605 0 2024-02-15T22:51:12.989 INFO:tasks.workunit.client.1.smithi170.stdout:5/232: rename c9 to de/d10/d27/d2d/c50 0 2024-02-15T22:51:12.989 INFO:tasks.workunit.client.1.smithi170.stdout:5/233: fsync de/f11 0 2024-02-15T22:51:12.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/180: dread de/f14 [0,4194304] 0 2024-02-15T22:51:12.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/181: chown de/f18 3349145 1 2024-02-15T22:51:12.993 INFO:tasks.workunit.client.1.smithi170.stdout:9/182: rename c9 to de/d1b/d1c/d1f/d20/d27/d28/c3a 0 2024-02-15T22:51:12.993 INFO:tasks.workunit.client.1.smithi170.stdout:9/183: write f7 [10774,68718] 0 2024-02-15T22:51:12.994 INFO:tasks.workunit.client.1.smithi170.stdout:9/184: creat de/d1b/d37/f3b x:0 0 0 2024-02-15T22:51:12.995 INFO:tasks.workunit.client.1.smithi170.stdout:9/185: mknod de/d1b/d1c/c3c 0 2024-02-15T22:51:12.995 INFO:tasks.workunit.client.1.smithi170.stdout:9/186: write de/f1a [808034,129795] 0 2024-02-15T22:51:12.998 INFO:tasks.workunit.client.1.smithi170.stdout:2/217: dwrite d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:12.998 INFO:tasks.workunit.client.1.smithi170.stdout:2/218: chown d0/cd 27512 1 2024-02-15T22:51:12.998 INFO:tasks.workunit.client.1.smithi170.stdout:7/210: dwrite da/f38 [0,4194304] 0 2024-02-15T22:51:12.998 INFO:tasks.workunit.client.1.smithi170.stdout:7/211: truncate da/d1a/d28/f32 1041341 0 2024-02-15T22:51:13.004 INFO:tasks.workunit.client.1.smithi170.stdout:8/122: dread d9/d18/f19 [0,4194304] 0 2024-02-15T22:51:13.004 INFO:tasks.workunit.client.1.smithi170.stdout:8/123: creat d9/d18/f23 x:0 0 0 2024-02-15T22:51:13.008 INFO:tasks.workunit.client.1.smithi170.stdout:7/212: dread da/d1a/d21/d19/f20 [4194304,4194304] 0 2024-02-15T22:51:13.008 INFO:tasks.workunit.client.1.smithi170.stdout:7/213: readlink da/d1a/d28/l39 0 2024-02-15T22:51:13.008 INFO:tasks.workunit.client.1.smithi170.stdout:7/214: fdatasync da/d1a/d28/f32 0 2024-02-15T22:51:13.008 INFO:tasks.workunit.client.1.smithi170.stdout:7/215: write da/d1a/d21/d2c/d2e/f35 [1508404,63472] 0 2024-02-15T22:51:13.010 INFO:tasks.workunit.client.1.smithi170.stdout:9/187: dread f4 [0,4194304] 0 2024-02-15T22:51:13.011 INFO:tasks.workunit.client.1.smithi170.stdout:7/216: symlink da/d1a/l4a 0 2024-02-15T22:51:13.011 INFO:tasks.workunit.client.1.smithi170.stdout:7/217: write da/f3f [965105,69925] 0 2024-02-15T22:51:13.012 INFO:tasks.workunit.client.1.smithi170.stdout:5/234: dwrite de/f3f [0,4194304] 0 2024-02-15T22:51:13.012 INFO:tasks.workunit.client.1.smithi170.stdout:5/235: dread - de/f4b zero size 2024-02-15T22:51:13.013 INFO:tasks.workunit.client.1.smithi170.stdout:9/188: symlink de/d1b/d1c/d1f/d20/l3d 0 2024-02-15T22:51:13.013 INFO:tasks.workunit.client.1.smithi170.stdout:8/124: dread f7 [0,4194304] 0 2024-02-15T22:51:13.015 INFO:tasks.workunit.client.1.smithi170.stdout:7/218: rename da/d1a/l3d to da/d1a/d21/d1b/l4b 0 2024-02-15T22:51:13.015 INFO:tasks.workunit.client.1.smithi170.stdout:7/219: rename da to da/d1a/d21/d4c 22 2024-02-15T22:51:13.015 INFO:tasks.workunit.client.1.smithi170.stdout:7/220: fsync da/d1a/d21/d19/f20 0 2024-02-15T22:51:13.015 INFO:tasks.workunit.client.1.smithi170.stdout:2/219: dwrite d0/d13/f52 [0,4194304] 0 2024-02-15T22:51:13.019 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:12 smithi138 ceph-mon[29229]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 168 MiB/s rd, 211 MiB/s wr, 768 op/s 2024-02-15T22:51:13.020 INFO:tasks.workunit.client.1.smithi170.stdout:8/125: mknod d9/d18/c24 0 2024-02-15T22:51:13.029 INFO:tasks.workunit.client.1.smithi170.stdout:5/236: rmdir de/d36 39 2024-02-15T22:51:13.029 INFO:tasks.workunit.client.1.smithi170.stdout:5/237: readlink de/d29/l4a 0 2024-02-15T22:51:13.030 INFO:tasks.workunit.client.1.smithi170.stdout:9/189: getdents de/d1b/d37 0 2024-02-15T22:51:13.030 INFO:tasks.workunit.client.1.smithi170.stdout:9/190: write de/f2a [365522,126852] 0 2024-02-15T22:51:13.039 INFO:tasks.workunit.client.1.smithi170.stdout:9/191: write de/f1e [3027742,1407] 0 2024-02-15T22:51:13.040 INFO:tasks.workunit.client.1.smithi170.stdout:9/192: truncate de/f2f 4164616 0 2024-02-15T22:51:13.044 INFO:tasks.workunit.client.1.smithi170.stdout:7/221: dwrite da/fe [4194304,4194304] 0 2024-02-15T22:51:13.044 INFO:tasks.workunit.client.1.smithi170.stdout:9/193: rmdir de/d1b/d2e 0 2024-02-15T22:51:13.044 INFO:tasks.workunit.client.1.smithi170.stdout:7/222: rmdir da/d1a/d21/d19 39 2024-02-15T22:51:13.046 INFO:tasks.workunit.client.1.smithi170.stdout:2/220: dwrite d0/d28/d3e/f44 [0,4194304] 0 2024-02-15T22:51:13.046 INFO:tasks.workunit.client.1.smithi170.stdout:2/221: readlink d0/d13/l45 0 2024-02-15T22:51:13.046 INFO:tasks.workunit.client.1.smithi170.stdout:7/223: mkdir da/d1a/d21/d4d 0 2024-02-15T22:51:13.046 INFO:tasks.workunit.client.1.smithi170.stdout:7/224: fdatasync da/f12 0 2024-02-15T22:51:13.048 INFO:tasks.workunit.client.1.smithi170.stdout:2/222: mknod d0/d28/d2f/c54 0 2024-02-15T22:51:13.048 INFO:tasks.workunit.client.1.smithi170.stdout:8/126: dwrite d9/f1d [0,4194304] 0 2024-02-15T22:51:13.048 INFO:tasks.workunit.client.1.smithi170.stdout:7/225: symlink da/d1a/l4e 0 2024-02-15T22:51:13.049 INFO:tasks.workunit.client.1.smithi170.stdout:8/127: mknod d9/d18/c25 0 2024-02-15T22:51:13.050 INFO:tasks.workunit.client.1.smithi170.stdout:7/226: symlink da/l4f 0 2024-02-15T22:51:13.051 INFO:tasks.workunit.client.1.smithi170.stdout:9/194: dread de/d1b/d1c/d1f/d20/f21 [0,4194304] 0 2024-02-15T22:51:13.052 INFO:tasks.workunit.client.1.smithi170.stdout:8/128: getdents d9 0 2024-02-15T22:51:13.052 INFO:tasks.workunit.client.1.smithi170.stdout:5/238: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:13.052 INFO:tasks.workunit.client.1.smithi170.stdout:5/239: fsync de/d10/d27/d2d/f39 0 2024-02-15T22:51:13.053 INFO:tasks.workunit.client.1.smithi170.stdout:7/227: creat da/d1a/d21/d19/f50 x:0 0 0 2024-02-15T22:51:13.053 INFO:tasks.workunit.client.1.smithi170.stdout:7/228: write da/d1a/d21/f42 [4223902,112143] 0 2024-02-15T22:51:13.053 INFO:tasks.workunit.client.1.smithi170.stdout:7/229: chown l8 7179 1 2024-02-15T22:51:13.054 INFO:tasks.workunit.client.1.smithi170.stdout:9/195: symlink de/d1b/d1c/d1f/d20/l3e 0 2024-02-15T22:51:13.057 INFO:tasks.workunit.client.1.smithi170.stdout:5/240: mkdir de/d10/d27/d2d/d51 0 2024-02-15T22:51:13.059 INFO:tasks.workunit.client.1.smithi170.stdout:9/196: write fb [3770955,37516] 0 2024-02-15T22:51:13.059 INFO:tasks.workunit.client.1.smithi170.stdout:3/167: sync 2024-02-15T22:51:13.059 INFO:tasks.workunit.client.1.smithi170.stdout:3/168: write d3/f5 [3705930,106659] 0 2024-02-15T22:51:13.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/162: sync 2024-02-15T22:51:13.060 INFO:tasks.workunit.client.1.smithi170.stdout:1/163: read - d3/f21 zero size 2024-02-15T22:51:13.060 INFO:tasks.workunit.client.1.smithi170.stdout:7/230: rename da/d1a/d21/f42 to da/d1a/d21/f51 0 2024-02-15T22:51:13.060 INFO:tasks.workunit.client.1.smithi170.stdout:2/223: dread d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:13.062 INFO:tasks.workunit.client.1.smithi170.stdout:8/129: getdents d9/d18 0 2024-02-15T22:51:13.062 INFO:tasks.workunit.client.1.smithi170.stdout:8/130: write d9/fd [38385,110298] 0 2024-02-15T22:51:13.063 INFO:tasks.workunit.client.1.smithi170.stdout:5/241: mkdir de/d10/d52 0 2024-02-15T22:51:13.064 INFO:tasks.workunit.client.1.smithi170.stdout:9/197: mknod de/d1b/c3f 0 2024-02-15T22:51:13.065 INFO:tasks.workunit.client.1.smithi170.stdout:3/169: link d3/f9 d3/db/f35 0 2024-02-15T22:51:13.067 INFO:tasks.workunit.client.1.smithi170.stdout:7/231: symlink da/d1a/l52 0 2024-02-15T22:51:13.067 INFO:tasks.workunit.client.1.smithi170.stdout:7/232: chown da/d1a/d28/l34 7493691 1 2024-02-15T22:51:13.068 INFO:tasks.workunit.client.1.smithi170.stdout:2/224: symlink d0/d28/d2f/l55 0 2024-02-15T22:51:13.071 INFO:tasks.workunit.client.1.smithi170.stdout:8/131: mkdir d9/d18/d26 0 2024-02-15T22:51:13.074 INFO:tasks.workunit.client.1.smithi170.stdout:5/242: mkdir de/d10/d27/d4c/d53 0 2024-02-15T22:51:13.076 INFO:tasks.workunit.client.1.smithi170.stdout:3/170: creat d3/db/d1f/f36 x:0 0 0 2024-02-15T22:51:13.076 INFO:tasks.workunit.client.1.smithi170.stdout:1/164: rmdir d3/d24/d2c 39 2024-02-15T22:51:13.076 INFO:tasks.workunit.client.1.smithi170.stdout:1/165: chown d3/l31 81 1 2024-02-15T22:51:13.078 INFO:tasks.workunit.client.1.smithi170.stdout:2/225: creat d0/d28/f56 x:0 0 0 2024-02-15T22:51:13.079 INFO:tasks.workunit.client.1.smithi170.stdout:8/132: symlink d9/d18/d26/l27 0 2024-02-15T22:51:13.080 INFO:tasks.workunit.client.1.smithi170.stdout:9/198: link de/d1b/d1c/d1f/l35 de/l40 0 2024-02-15T22:51:13.081 INFO:tasks.workunit.client.1.smithi170.stdout:1/166: mkdir d3/d24/d34 0 2024-02-15T22:51:13.082 INFO:tasks.workunit.client.1.smithi170.stdout:7/233: symlink da/l53 0 2024-02-15T22:51:13.084 INFO:tasks.workunit.client.1.smithi170.stdout:5/243: write de/d36/f41 [1989680,8251] 0 2024-02-15T22:51:13.084 INFO:tasks.workunit.client.1.smithi170.stdout:5/244: chown de/d10/l2c 0 1 2024-02-15T22:51:13.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/226: rename d0/d1/c1f to d0/c57 0 2024-02-15T22:51:13.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/227: fdatasync d0/d28/d2f/d37/f4f 0 2024-02-15T22:51:13.084 INFO:tasks.workunit.client.1.smithi170.stdout:2/228: readlink d0/d28/d2f/l55 0 2024-02-15T22:51:13.085 INFO:tasks.workunit.client.1.smithi170.stdout:2/229: fsync d0/d1/f4d 0 2024-02-15T22:51:13.085 INFO:tasks.workunit.client.1.smithi170.stdout:8/133: rmdir d9/d18/d26 39 2024-02-15T22:51:13.085 INFO:tasks.workunit.client.1.smithi170.stdout:8/134: write d9/f16 [218292,130217] 0 2024-02-15T22:51:13.086 INFO:tasks.workunit.client.1.smithi170.stdout:1/167: mkdir d3/d24/d2c/d35 0 2024-02-15T22:51:13.088 INFO:tasks.workunit.client.1.smithi170.stdout:5/245: truncate de/d10/f13 1909103 0 2024-02-15T22:51:13.088 INFO:tasks.workunit.client.1.smithi170.stdout:5/246: creat de/d10/d27/f54 x:0 0 0 2024-02-15T22:51:13.089 INFO:tasks.workunit.client.1.smithi170.stdout:7/234: rename da/d1a/d28/l39 to da/d1a/d21/d19/l54 0 2024-02-15T22:51:13.089 INFO:tasks.workunit.client.1.smithi170.stdout:7/235: fsync da/d1a/d28/f32 0 2024-02-15T22:51:13.090 INFO:tasks.workunit.client.1.smithi170.stdout:7/236: readlink da/l37 0 2024-02-15T22:51:13.090 INFO:tasks.workunit.client.1.smithi170.stdout:2/230: mkdir d0/d28/d2f/d37/d58 0 2024-02-15T22:51:13.090 INFO:tasks.workunit.client.1.smithi170.stdout:2/231: chown d0/d28/d3e/d4a 7 1 2024-02-15T22:51:13.092 INFO:tasks.workunit.client.1.smithi170.stdout:8/135: rmdir d9/d18/d26 39 2024-02-15T22:51:13.092 INFO:tasks.workunit.client.1.smithi170.stdout:8/136: fsync d9/f11 0 2024-02-15T22:51:13.094 INFO:tasks.workunit.client.1.smithi170.stdout:9/199: link de/l16 de/l41 0 2024-02-15T22:51:13.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/168: creat d3/d24/f36 x:0 0 0 2024-02-15T22:51:13.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/169: truncate d3/f21 54656 0 2024-02-15T22:51:13.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/170: stat d3 0 2024-02-15T22:51:13.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/171: stat d3/d24/d34 0 2024-02-15T22:51:13.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/172: write d3/f13 [1211863,72409] 0 2024-02-15T22:51:13.096 INFO:tasks.workunit.client.1.smithi170.stdout:1/173: dread d3/fb [0,4194304] 0 2024-02-15T22:51:13.097 INFO:tasks.workunit.client.1.smithi170.stdout:5/247: rmdir de/d36 39 2024-02-15T22:51:13.098 INFO:tasks.workunit.client.1.smithi170.stdout:2/232: stat d0/d2a/c3f 0 2024-02-15T22:51:13.099 INFO:tasks.workunit.client.1.smithi170.stdout:8/137: rmdir d9/d18/d26 39 2024-02-15T22:51:13.099 INFO:tasks.workunit.client.1.smithi170.stdout:4/224: sync 2024-02-15T22:51:13.101 INFO:tasks.workunit.client.1.smithi170.stdout:9/200: truncate de/f2a 1519 0 2024-02-15T22:51:13.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/248: rename de/d29/d40 to de/d10/d27/d4c/d53/d55 0 2024-02-15T22:51:13.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/249: chown de/d36/c3c 29528950 1 2024-02-15T22:51:13.106 INFO:tasks.workunit.client.1.smithi170.stdout:2/233: dread d0/d1/d11/f2d [0,4194304] 0 2024-02-15T22:51:13.106 INFO:tasks.workunit.client.1.smithi170.stdout:4/225: mknod d0/c41 0 2024-02-15T22:51:13.106 INFO:tasks.workunit.client.1.smithi170.stdout:4/226: stat d0/d22/l31 0 2024-02-15T22:51:13.108 INFO:tasks.workunit.client.1.smithi170.stdout:9/201: creat de/d1b/d1c/d1f/d20/f42 x:0 0 0 2024-02-15T22:51:13.111 INFO:tasks.workunit.client.1.smithi170.stdout:2/234: fdatasync d0/d1d/f22 0 2024-02-15T22:51:13.112 INFO:tasks.workunit.client.1.smithi170.stdout:4/227: dread d0/d22/da/d1d/f3a [0,4194304] 0 2024-02-15T22:51:13.113 INFO:tasks.workunit.client.1.smithi170.stdout:9/202: getdents de/d1b/d1c/d1f/d20/d27/d28 0 2024-02-15T22:51:13.113 INFO:tasks.workunit.client.1.smithi170.stdout:9/203: read - de/d1b/d1c/d1f/d20/f42 zero size 2024-02-15T22:51:13.114 INFO:tasks.workunit.client.1.smithi170.stdout:2/235: mkdir d0/d13/d59 0 2024-02-15T22:51:13.116 INFO:tasks.workunit.client.1.smithi170.stdout:4/228: rename d0/c41 to d0/d22/da/d11/d20/c42 0 2024-02-15T22:51:13.116 INFO:tasks.workunit.client.1.smithi170.stdout:4/229: creat d0/d22/da/f43 x:0 0 0 2024-02-15T22:51:13.117 INFO:tasks.workunit.client.1.smithi170.stdout:9/204: getdents de/d1b/d1c/d1f/d20/d27 0 2024-02-15T22:51:13.117 INFO:tasks.workunit.client.1.smithi170.stdout:9/205: chown de/f24 1777800801 1 2024-02-15T22:51:13.118 INFO:tasks.workunit.client.1.smithi170.stdout:2/236: truncate d0/d1/f8 2054563 0 2024-02-15T22:51:13.120 INFO:tasks.workunit.client.1.smithi170.stdout:5/250: dwrite de/d10/f32 [0,4194304] 0 2024-02-15T22:51:13.120 INFO:tasks.workunit.client.1.smithi170.stdout:8/138: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:13.120 INFO:tasks.workunit.client.1.smithi170.stdout:4/230: link d0/d22/da/d32/l37 d0/d22/da/d1d/d2b/l44 0 2024-02-15T22:51:13.127 INFO:tasks.workunit.client.1.smithi170.stdout:8/139: rmdir d9/d18 39 2024-02-15T22:51:13.129 INFO:tasks.workunit.client.1.smithi170.stdout:4/231: rename d0/fd to d0/d22/da/d11/f45 0 2024-02-15T22:51:13.130 INFO:tasks.workunit.client.1.smithi170.stdout:9/206: symlink de/l43 0 2024-02-15T22:51:13.130 INFO:tasks.workunit.client.1.smithi170.stdout:9/207: stat de/d1b/d1c/d1f/d20 0 2024-02-15T22:51:13.131 INFO:tasks.workunit.client.1.smithi170.stdout:5/251: read f7 [230739,16208] 0 2024-02-15T22:51:13.132 INFO:tasks.workunit.client.1.smithi170.stdout:8/140: mknod d9/d18/d26/c28 0 2024-02-15T22:51:13.134 INFO:tasks.workunit.client.1.smithi170.stdout:5/252: creat de/d10/d52/f56 x:0 0 0 2024-02-15T22:51:13.135 INFO:tasks.workunit.client.1.smithi170.stdout:2/237: dwrite d0/d1/fe [0,4194304] 0 2024-02-15T22:51:13.135 INFO:tasks.workunit.client.1.smithi170.stdout:2/238: fsync d0/d28/d3e/f43 0 2024-02-15T22:51:13.135 INFO:tasks.workunit.client.1.smithi170.stdout:8/141: chown d9/ce 46637 1 2024-02-15T22:51:13.137 INFO:tasks.workunit.client.1.smithi170.stdout:9/208: rmdir de/d1b/d1c/d1f/d20 39 2024-02-15T22:51:13.137 INFO:tasks.workunit.client.1.smithi170.stdout:9/209: chown de/d1b/d1c/d1f 67569 1 2024-02-15T22:51:13.138 INFO:tasks.workunit.client.1.smithi170.stdout:5/253: symlink de/d29/l57 0 2024-02-15T22:51:13.138 INFO:tasks.workunit.client.1.smithi170.stdout:8/142: chown d9/d18/l1f 995709 1 2024-02-15T22:51:13.138 INFO:tasks.workunit.client.1.smithi170.stdout:8/143: chown d9/c12 4 1 2024-02-15T22:51:13.139 INFO:tasks.workunit.client.1.smithi170.stdout:9/210: rmdir de/d1b/d1c/d1f/d20/d27/d28 39 2024-02-15T22:51:13.140 INFO:tasks.workunit.client.1.smithi170.stdout:5/254: rmdir de/d10/d27/d4c/d53/d55 39 2024-02-15T22:51:13.142 INFO:tasks.workunit.client.1.smithi170.stdout:8/144: mknod d9/d18/c29 0 2024-02-15T22:51:13.142 INFO:tasks.workunit.client.1.smithi170.stdout:8/145: stat d9/d18/f23 0 2024-02-15T22:51:13.143 INFO:tasks.workunit.client.1.smithi170.stdout:8/146: write d9/f17 [696622,88503] 0 2024-02-15T22:51:13.143 INFO:tasks.workunit.client.1.smithi170.stdout:2/239: dread d0/d1/f8 [0,4194304] 0 2024-02-15T22:51:13.147 INFO:tasks.workunit.client.1.smithi170.stdout:5/255: dread de/f16 [0,4194304] 0 2024-02-15T22:51:13.151 INFO:tasks.workunit.client.1.smithi170.stdout:9/211: dread de/d1b/f25 [0,4194304] 0 2024-02-15T22:51:13.160 INFO:tasks.workunit.client.1.smithi170.stdout:5/256: dread de/d10/f32 [0,4194304] 0 2024-02-15T22:51:13.162 INFO:tasks.workunit.client.1.smithi170.stdout:5/257: mknod de/d10/d33/c58 0 2024-02-15T22:51:13.163 INFO:tasks.workunit.client.1.smithi170.stdout:5/258: truncate de/d10/d27/f3d 1194488 0 2024-02-15T22:51:13.164 INFO:tasks.workunit.client.1.smithi170.stdout:5/259: unlink de/d10/d27/f49 0 2024-02-15T22:51:13.168 INFO:tasks.workunit.client.1.smithi170.stdout:2/240: dwrite d0/d1/f12 [0,4194304] 0 2024-02-15T22:51:13.169 INFO:tasks.workunit.client.1.smithi170.stdout:9/212: dwrite de/f24 [0,4194304] 0 2024-02-15T22:51:13.169 INFO:tasks.workunit.client.1.smithi170.stdout:8/147: dwrite d9/f1a [0,4194304] 0 2024-02-15T22:51:13.171 INFO:tasks.workunit.client.1.smithi170.stdout:2/241: truncate d0/d1d/f35 762419 0 2024-02-15T22:51:13.171 INFO:tasks.workunit.client.1.smithi170.stdout:2/242: chown d0/d2a/c36 0 1 2024-02-15T22:51:13.171 INFO:tasks.workunit.client.1.smithi170.stdout:2/243: creat d0/d1/d31/f5a x:0 0 0 2024-02-15T22:51:13.173 INFO:tasks.workunit.client.1.smithi170.stdout:9/213: dread de/f17 [0,4194304] 0 2024-02-15T22:51:13.173 INFO:tasks.workunit.client.1.smithi170.stdout:9/214: read - de/d1b/d1c/d1f/f36 zero size 2024-02-15T22:51:13.174 INFO:tasks.workunit.client.1.smithi170.stdout:2/244: dread d0/f2c [0,4194304] 0 2024-02-15T22:51:13.178 INFO:tasks.workunit.client.1.smithi170.stdout:9/215: truncate f2 2962939 0 2024-02-15T22:51:13.179 INFO:tasks.workunit.client.1.smithi170.stdout:2/245: symlink d0/d1/d11/l5b 0 2024-02-15T22:51:13.179 INFO:tasks.workunit.client.1.smithi170.stdout:2/246: chown d0/d1/d11/f2d 696 1 2024-02-15T22:51:13.180 INFO:tasks.workunit.client.1.smithi170.stdout:2/247: creat d0/d1d/d3d/f5c x:0 0 0 2024-02-15T22:51:13.180 INFO:tasks.workunit.client.1.smithi170.stdout:2/248: stat d0/d1/f27 0 2024-02-15T22:51:13.180 INFO:tasks.workunit.client.1.smithi170.stdout:2/249: write d0/d1/d31/f49 [564140,114449] 0 2024-02-15T22:51:13.180 INFO:tasks.workunit.client.1.smithi170.stdout:2/250: creat d0/d28/f5d x:0 0 0 2024-02-15T22:51:13.184 INFO:tasks.workunit.client.1.smithi170.stdout:2/251: symlink d0/d1/l5e 0 2024-02-15T22:51:13.190 INFO:tasks.workunit.client.1.smithi170.stdout:5/260: dwrite de/d10/d27/f4f [0,4194304] 0 2024-02-15T22:51:13.190 INFO:tasks.workunit.client.1.smithi170.stdout:8/148: dwrite d9/f11 [0,4194304] 0 2024-02-15T22:51:13.196 INFO:tasks.workunit.client.1.smithi170.stdout:8/149: dread f7 [0,4194304] 0 2024-02-15T22:51:13.196 INFO:tasks.workunit.client.1.smithi170.stdout:8/150: fsync d9/f1d 0 2024-02-15T22:51:13.196 INFO:tasks.workunit.client.1.smithi170.stdout:2/252: getdents d0/d1d/d3d 0 2024-02-15T22:51:13.196 INFO:tasks.workunit.client.1.smithi170.stdout:2/253: stat d0/d28/d3e 0 2024-02-15T22:51:13.199 INFO:tasks.workunit.client.1.smithi170.stdout:2/254: mkdir d0/d1/d5f 0 2024-02-15T22:51:13.199 INFO:tasks.workunit.client.1.smithi170.stdout:2/255: creat d0/d28/d3e/f60 x:0 0 0 2024-02-15T22:51:13.201 INFO:tasks.workunit.client.1.smithi170.stdout:2/256: mknod d0/d28/d2f/d37/c61 0 2024-02-15T22:51:13.220 INFO:tasks.workunit.client.1.smithi170.stdout:2/257: rename d0/d1d/f35 to d0/d28/d2f/f62 0 2024-02-15T22:51:13.221 INFO:tasks.workunit.client.1.smithi170.stdout:2/258: rename d0/c20 to d0/d1/d53/c63 0 2024-02-15T22:51:13.222 INFO:tasks.workunit.client.1.smithi170.stdout:2/259: readlink d0/d1/d11/l5b 0 2024-02-15T22:51:13.222 INFO:tasks.workunit.client.1.smithi170.stdout:6/249: sync 2024-02-15T22:51:13.222 INFO:tasks.workunit.client.1.smithi170.stdout:0/152: sync 2024-02-15T22:51:13.222 INFO:tasks.workunit.client.1.smithi170.stdout:0/153: chown d8/d14/l26 316346531 1 2024-02-15T22:51:13.224 INFO:tasks.workunit.client.1.smithi170.stdout:6/250: truncate d3/d1a/f33 374686 0 2024-02-15T22:51:13.225 INFO:tasks.workunit.client.1.smithi170.stdout:2/260: link d0/d1d/l40 d0/d28/d3e/d4a/l64 0 2024-02-15T22:51:13.226 INFO:tasks.workunit.client.1.smithi170.stdout:6/251: creat d3/d1d/d36/d56/f59 x:0 0 0 2024-02-15T22:51:13.227 INFO:tasks.workunit.client.1.smithi170.stdout:2/261: creat d0/d28/d2f/f65 x:0 0 0 2024-02-15T22:51:13.228 INFO:tasks.workunit.client.1.smithi170.stdout:2/262: mknod d0/d1d/d3d/c66 0 2024-02-15T22:51:13.228 INFO:tasks.workunit.client.1.smithi170.stdout:2/263: chown d0/d2a/l33 11 1 2024-02-15T22:51:13.228 INFO:tasks.workunit.client.1.smithi170.stdout:2/264: creat d0/f67 x:0 0 0 2024-02-15T22:51:13.228 INFO:tasks.workunit.client.1.smithi170.stdout:2/265: write d0/d28/d3e/f60 [170667,112897] 0 2024-02-15T22:51:13.228 INFO:tasks.workunit.client.1.smithi170.stdout:2/266: dread - d0/d1/f4d zero size 2024-02-15T22:51:13.229 INFO:tasks.workunit.client.1.smithi170.stdout:5/261: dwrite de/d10/f24 [0,4194304] 0 2024-02-15T22:51:13.230 INFO:tasks.workunit.client.1.smithi170.stdout:2/267: mknod d0/d1/d11/d26/c68 0 2024-02-15T22:51:13.230 INFO:tasks.workunit.client.1.smithi170.stdout:2/268: dread - d0/d28/f5d zero size 2024-02-15T22:51:13.230 INFO:tasks.workunit.client.1.smithi170.stdout:2/269: chown d0/d28/d3e/f44 606797239 1 2024-02-15T22:51:13.234 INFO:tasks.workunit.client.1.smithi170.stdout:5/262: mknod de/d10/d27/d2d/c59 0 2024-02-15T22:51:13.234 INFO:tasks.workunit.client.1.smithi170.stdout:5/263: creat de/d29/f5a x:0 0 0 2024-02-15T22:51:13.234 INFO:tasks.workunit.client.1.smithi170.stdout:5/264: write de/d29/f5a [715110,2262] 0 2024-02-15T22:51:13.234 INFO:tasks.workunit.client.1.smithi170.stdout:5/265: creat de/d10/f5b x:0 0 0 2024-02-15T22:51:13.236 INFO:tasks.workunit.client.1.smithi170.stdout:2/270: mknod d0/d1d/d3d/c69 0 2024-02-15T22:51:13.236 INFO:tasks.workunit.client.1.smithi170.stdout:2/271: chown d0/d1d/d3d/f5c 1020433 1 2024-02-15T22:51:13.241 INFO:tasks.workunit.client.1.smithi170.stdout:0/154: dwrite d8/f29 [0,4194304] 0 2024-02-15T22:51:13.241 INFO:tasks.workunit.client.1.smithi170.stdout:0/155: creat d8/f34 x:0 0 0 2024-02-15T22:51:13.245 INFO:tasks.workunit.client.1.smithi170.stdout:0/156: link d8/df/d13/f1f d8/d14/d1c/f35 0 2024-02-15T22:51:13.245 INFO:tasks.workunit.client.1.smithi170.stdout:0/157: chown f6 101554 1 2024-02-15T22:51:13.246 INFO:tasks.workunit.client.1.smithi170.stdout:0/158: chown d8/df/d13/d22/l31 3418 1 2024-02-15T22:51:13.246 INFO:tasks.workunit.client.1.smithi170.stdout:0/159: fsync d8/f1b 0 2024-02-15T22:51:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:12 smithi170 ceph-mon[35248]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 168 MiB/s rd, 211 MiB/s wr, 768 op/s 2024-02-15T22:51:13.267 INFO:tasks.workunit.client.1.smithi170.stdout:0/160: dwrite f5 [0,4194304] 0 2024-02-15T22:51:13.267 INFO:tasks.workunit.client.1.smithi170.stdout:0/161: stat d8/d14/d1c/f2b 0 2024-02-15T22:51:13.267 INFO:tasks.workunit.client.1.smithi170.stdout:0/162: readlink d8/d14/l2d 0 2024-02-15T22:51:13.268 INFO:tasks.workunit.client.1.smithi170.stdout:0/163: mkdir d8/df/d13/d36 0 2024-02-15T22:51:13.268 INFO:tasks.workunit.client.1.smithi170.stdout:0/164: write d8/df/d13/f1f [1130584,50943] 0 2024-02-15T22:51:13.269 INFO:tasks.workunit.client.1.smithi170.stdout:0/165: getdents d8/df/d13/d22 0 2024-02-15T22:51:13.270 INFO:tasks.workunit.client.1.smithi170.stdout:0/166: creat d8/d14/f37 x:0 0 0 2024-02-15T22:51:13.270 INFO:tasks.workunit.client.1.smithi170.stdout:0/167: getdents d8/d14/d32 0 2024-02-15T22:51:13.270 INFO:tasks.workunit.client.1.smithi170.stdout:0/168: creat d8/f38 x:0 0 0 2024-02-15T22:51:13.270 INFO:tasks.workunit.client.1.smithi170.stdout:0/169: chown d8/df/d13/d22/f33 3340033 1 2024-02-15T22:51:13.279 INFO:tasks.workunit.client.1.smithi170.stdout:0/170: write d8/d14/d1c/f24 [48922,41639] 0 2024-02-15T22:51:13.279 INFO:tasks.workunit.client.1.smithi170.stdout:0/171: write d8/d14/d1c/f24 [367349,97390] 0 2024-02-15T22:51:13.283 INFO:tasks.workunit.client.1.smithi170.stdout:0/172: rmdir d8/d14 39 2024-02-15T22:51:13.284 INFO:tasks.workunit.client.1.smithi170.stdout:0/173: stat d8 0 2024-02-15T22:51:13.284 INFO:tasks.workunit.client.1.smithi170.stdout:0/174: write d8/df/d13/f20 [1127404,103347] 0 2024-02-15T22:51:13.285 INFO:tasks.workunit.client.1.smithi170.stdout:0/175: mkdir d8/df/d13/d22/d39 0 2024-02-15T22:51:13.299 INFO:tasks.workunit.client.1.smithi170.stdout:0/176: dwrite d8/d14/d1c/f1e [0,4194304] 0 2024-02-15T22:51:13.299 INFO:tasks.workunit.client.1.smithi170.stdout:0/177: dread - d8/df/d13/f2f zero size 2024-02-15T22:51:13.320 INFO:tasks.workunit.client.1.smithi170.stdout:0/178: dwrite d8/d14/f1a [4194304,4194304] 0 2024-02-15T22:51:13.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/179: dwrite d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:13.342 INFO:tasks.workunit.client.1.smithi170.stdout:0/180: fsync d8/f34 0 2024-02-15T22:51:13.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/181: link c7 d8/d14/c3a 0 2024-02-15T22:51:13.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/182: write d8/f34 [382461,127879] 0 2024-02-15T22:51:13.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/183: getdents d8/df/d13/d36 0 2024-02-15T22:51:13.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/184: write d8/d14/d1c/f35 [2164889,129994] 0 2024-02-15T22:51:13.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/185: chown d8/df/f19 7000876 1 2024-02-15T22:51:13.381 INFO:tasks.workunit.client.1.smithi170.stdout:0/186: dwrite d8/f1b [0,4194304] 0 2024-02-15T22:51:13.384 INFO:tasks.workunit.client.1.smithi170.stdout:0/187: truncate d8/df/f19 3930016 0 2024-02-15T22:51:13.384 INFO:tasks.workunit.client.1.smithi170.stdout:0/188: creat d8/f3b x:0 0 0 2024-02-15T22:51:13.403 INFO:tasks.workunit.client.1.smithi170.stdout:0/189: dwrite d8/d14/d1c/f2b [0,4194304] 0 2024-02-15T22:51:13.404 INFO:tasks.workunit.client.1.smithi170.stdout:0/190: rename d8/df to d8/df/d13/d3c 22 2024-02-15T22:51:13.405 INFO:tasks.workunit.client.1.smithi170.stdout:0/191: creat d8/d14/d1c/f3d x:0 0 0 2024-02-15T22:51:13.406 INFO:tasks.workunit.client.1.smithi170.stdout:0/192: dread - d8/f3b zero size 2024-02-15T22:51:13.419 INFO:tasks.workunit.client.1.smithi170.stdout:3/171: sync 2024-02-15T22:51:13.419 INFO:tasks.workunit.client.1.smithi170.stdout:3/172: write d3/dc/ff [215832,42124] 0 2024-02-15T22:51:13.427 INFO:tasks.workunit.client.1.smithi170.stdout:3/173: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:13.428 INFO:tasks.workunit.client.1.smithi170.stdout:0/193: dwrite d8/d14/d1c/f1e [0,4194304] 0 2024-02-15T22:51:13.428 INFO:tasks.workunit.client.1.smithi170.stdout:0/194: mknod d8/df/d13/d36/c3e 0 2024-02-15T22:51:13.429 INFO:tasks.workunit.client.1.smithi170.stdout:0/195: mkdir d8/d14/d1c/d3f 0 2024-02-15T22:51:13.430 INFO:tasks.workunit.client.1.smithi170.stdout:0/196: chown d8/df/d13/f2e 10460 1 2024-02-15T22:51:13.430 INFO:tasks.workunit.client.1.smithi170.stdout:0/197: readlink d8/d14/l26 0 2024-02-15T22:51:13.452 INFO:tasks.workunit.client.1.smithi170.stdout:3/174: dwrite d3/db/d1f/f36 [0,4194304] 0 2024-02-15T22:51:13.452 INFO:tasks.workunit.client.1.smithi170.stdout:3/175: truncate d3/db/f11 350191 0 2024-02-15T22:51:13.452 INFO:tasks.workunit.client.1.smithi170.stdout:3/176: chown d3/dc/f17 26054578 1 2024-02-15T22:51:13.453 INFO:tasks.workunit.client.1.smithi170.stdout:3/177: fsync d3/dc/ff 0 2024-02-15T22:51:13.453 INFO:tasks.workunit.client.1.smithi170.stdout:3/178: stat d3/db/d1f/f36 0 2024-02-15T22:51:13.453 INFO:tasks.workunit.client.1.smithi170.stdout:3/179: creat d3/db/d1f/f37 x:0 0 0 2024-02-15T22:51:13.455 INFO:tasks.workunit.client.1.smithi170.stdout:3/180: mknod d3/d1b/d2c/c38 0 2024-02-15T22:51:13.455 INFO:tasks.workunit.client.1.smithi170.stdout:0/198: dwrite d8/df/d13/f2e [0,4194304] 0 2024-02-15T22:51:13.457 INFO:tasks.workunit.client.1.smithi170.stdout:3/181: rename d3/dc/le to d3/db/l39 0 2024-02-15T22:51:13.457 INFO:tasks.workunit.client.1.smithi170.stdout:3/182: truncate d3/dc/d1c/f1e 2658118 0 2024-02-15T22:51:13.459 INFO:tasks.workunit.client.1.smithi170.stdout:3/183: mknod d3/c3a 0 2024-02-15T22:51:13.460 INFO:tasks.workunit.client.1.smithi170.stdout:3/184: truncate d3/dc/f31 225577 0 2024-02-15T22:51:13.475 INFO:tasks.workunit.client.1.smithi170.stdout:3/185: dwrite d3/dc/d1c/f1e [0,4194304] 0 2024-02-15T22:51:13.478 INFO:tasks.workunit.client.1.smithi170.stdout:3/186: rename d3/dc/d1a/l33 to d3/dc/d1c/l3b 0 2024-02-15T22:51:13.478 INFO:tasks.workunit.client.1.smithi170.stdout:3/187: dread - d3/db/d1f/f37 zero size 2024-02-15T22:51:13.478 INFO:tasks.workunit.client.1.smithi170.stdout:3/188: read d3/f5 [1521611,95540] 0 2024-02-15T22:51:13.478 INFO:tasks.workunit.client.1.smithi170.stdout:3/189: readlink d3/dc/d1a/l20 0 2024-02-15T22:51:13.480 INFO:tasks.workunit.client.1.smithi170.stdout:3/190: rename d3/db/d1f/f37 to d3/f3c 0 2024-02-15T22:51:13.481 INFO:tasks.workunit.client.1.smithi170.stdout:3/191: mkdir d3/dc/d1c/d3d 0 2024-02-15T22:51:13.481 INFO:tasks.workunit.client.1.smithi170.stdout:3/192: write d3/db/f22 [5139680,2617] 0 2024-02-15T22:51:13.482 INFO:tasks.workunit.client.1.smithi170.stdout:3/193: mknod d3/dc/d1c/c3e 0 2024-02-15T22:51:13.482 INFO:tasks.workunit.client.1.smithi170.stdout:3/194: fsync d3/dc/f1d 0 2024-02-15T22:51:13.483 INFO:tasks.workunit.client.1.smithi170.stdout:3/195: creat d3/f3f x:0 0 0 2024-02-15T22:51:13.484 INFO:tasks.workunit.client.1.smithi170.stdout:3/196: mknod d3/db/c40 0 2024-02-15T22:51:13.507 INFO:tasks.workunit.client.1.smithi170.stdout:3/197: dwrite d3/db/f22 [0,4194304] 0 2024-02-15T22:51:13.508 INFO:tasks.workunit.client.1.smithi170.stdout:3/198: creat d3/db/d1f/f41 x:0 0 0 2024-02-15T22:51:13.520 INFO:tasks.workunit.client.1.smithi170.stdout:3/199: rmdir d3 39 2024-02-15T22:51:13.520 INFO:tasks.workunit.client.1.smithi170.stdout:3/200: stat d3/dc/d1c/l34 0 2024-02-15T22:51:13.522 INFO:tasks.workunit.client.1.smithi170.stdout:3/201: creat d3/f42 x:0 0 0 2024-02-15T22:51:13.522 INFO:tasks.workunit.client.1.smithi170.stdout:3/202: stat d3/dc/d1c/l34 0 2024-02-15T22:51:13.522 INFO:tasks.workunit.client.1.smithi170.stdout:3/203: creat d3/dc/d13/f43 x:0 0 0 2024-02-15T22:51:13.524 INFO:tasks.workunit.client.1.smithi170.stdout:3/204: rename d3/db/l39 to d3/dc/d1c/d26/l44 0 2024-02-15T22:51:13.524 INFO:tasks.workunit.client.1.smithi170.stdout:3/205: fdatasync d3/f14 0 2024-02-15T22:51:13.550 INFO:tasks.workunit.client.1.smithi170.stdout:3/206: dwrite d3/f42 [0,4194304] 0 2024-02-15T22:51:13.552 INFO:tasks.workunit.client.1.smithi170.stdout:3/207: unlink d3/d1b/d2c/f30 0 2024-02-15T22:51:13.552 INFO:tasks.workunit.client.1.smithi170.stdout:3/208: chown d3/dc/d1c/d26 605 1 2024-02-15T22:51:13.553 INFO:tasks.workunit.client.1.smithi170.stdout:7/237: sync 2024-02-15T22:51:13.553 INFO:tasks.workunit.client.1.smithi170.stdout:3/209: symlink d3/dc/d1c/d3d/l45 0 2024-02-15T22:51:13.554 INFO:tasks.workunit.client.1.smithi170.stdout:7/238: mknod da/d1a/d21/d4d/c55 0 2024-02-15T22:51:13.555 INFO:tasks.workunit.client.1.smithi170.stdout:3/210: truncate d3/db/f35 1263263 0 2024-02-15T22:51:13.555 INFO:tasks.workunit.client.1.smithi170.stdout:7/239: symlink da/d1a/d21/d2c/d2e/l56 0 2024-02-15T22:51:13.558 INFO:tasks.workunit.client.1.smithi170.stdout:7/240: mkdir da/d57 0 2024-02-15T22:51:13.558 INFO:tasks.workunit.client.1.smithi170.stdout:7/241: truncate da/d1a/d21/d19/f50 42837 0 2024-02-15T22:51:13.568 INFO:tasks.workunit.client.1.smithi170.stdout:7/242: write da/d1a/d21/f51 [2724212,45412] 0 2024-02-15T22:51:13.568 INFO:tasks.workunit.client.1.smithi170.stdout:7/243: fdatasync da/d1a/f48 0 2024-02-15T22:51:13.569 INFO:tasks.workunit.client.1.smithi170.stdout:7/244: truncate da/d1a/d21/d19/f20 5312980 0 2024-02-15T22:51:13.571 INFO:tasks.workunit.client.1.smithi170.stdout:3/211: dwrite d3/f3f [0,4194304] 0 2024-02-15T22:51:13.571 INFO:tasks.workunit.client.1.smithi170.stdout:3/212: write d3/f3c [1017635,119759] 0 2024-02-15T22:51:13.571 INFO:tasks.workunit.client.1.smithi170.stdout:3/213: write d3/db/f35 [2064951,96963] 0 2024-02-15T22:51:13.571 INFO:tasks.workunit.client.1.smithi170.stdout:7/245: mknod da/d1a/d21/d1b/c58 0 2024-02-15T22:51:13.576 INFO:tasks.workunit.client.1.smithi170.stdout:3/214: link d3/dc/ff d3/dc/d1c/d26/f46 0 2024-02-15T22:51:13.597 INFO:tasks.workunit.client.1.smithi170.stdout:7/246: dwrite da/f38 [0,4194304] 0 2024-02-15T22:51:13.600 INFO:tasks.workunit.client.1.smithi170.stdout:7/247: mkdir da/d1a/d21/d4d/d59 0 2024-02-15T22:51:13.601 INFO:tasks.workunit.client.1.smithi170.stdout:7/248: mknod da/d1a/d21/d2c/c5a 0 2024-02-15T22:51:13.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/215: dwrite d3/f14 [0,4194304] 0 2024-02-15T22:51:13.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/216: fdatasync d3/dc/ff 0 2024-02-15T22:51:13.602 INFO:tasks.workunit.client.1.smithi170.stdout:3/217: read d3/dc/ff [160231,7724] 0 2024-02-15T22:51:13.609 INFO:tasks.workunit.client.1.smithi170.stdout:3/218: read d3/dc/d1c/f1e [1841302,127988] 0 2024-02-15T22:51:13.610 INFO:tasks.workunit.client.1.smithi170.stdout:3/219: symlink d3/d1b/d2c/l47 0 2024-02-15T22:51:13.611 INFO:tasks.workunit.client.1.smithi170.stdout:3/220: creat d3/dc/d1c/f48 x:0 0 0 2024-02-15T22:51:13.611 INFO:tasks.workunit.client.1.smithi170.stdout:3/221: chown d3/f3f 2090560088 1 2024-02-15T22:51:13.611 INFO:tasks.workunit.client.1.smithi170.stdout:3/222: stat d3/db/f35 0 2024-02-15T22:51:13.611 INFO:tasks.workunit.client.1.smithi170.stdout:3/223: write d3/db/f12 [3859706,54357] 0 2024-02-15T22:51:13.621 INFO:tasks.workunit.client.1.smithi170.stdout:3/224: dread d3/f14 [0,4194304] 0 2024-02-15T22:51:13.624 INFO:tasks.workunit.client.1.smithi170.stdout:7/249: dwrite da/f25 [0,4194304] 0 2024-02-15T22:51:13.642 INFO:tasks.workunit.client.1.smithi170.stdout:3/225: dwrite d3/dc/d1c/f1e [0,4194304] 0 2024-02-15T22:51:13.643 INFO:tasks.workunit.client.1.smithi170.stdout:3/226: truncate d3/dc/ff 69716 0 2024-02-15T22:51:13.644 INFO:tasks.workunit.client.1.smithi170.stdout:3/227: getdents d3 0 2024-02-15T22:51:13.644 INFO:tasks.workunit.client.1.smithi170.stdout:3/228: chown d3/dc 279399 1 2024-02-15T22:51:13.651 INFO:tasks.workunit.client.1.smithi170.stdout:7/250: dwrite da/fe [0,4194304] 0 2024-02-15T22:51:13.666 INFO:tasks.workunit.client.1.smithi170.stdout:3/229: dwrite d3/dc/d1c/d26/f46 [0,4194304] 0 2024-02-15T22:51:13.678 INFO:tasks.workunit.client.1.smithi170.stdout:3/230: dwrite d3/f9 [0,4194304] 0 2024-02-15T22:51:13.679 INFO:tasks.workunit.client.1.smithi170.stdout:3/231: write d3/f3c [1232393,125263] 0 2024-02-15T22:51:13.679 INFO:tasks.workunit.client.1.smithi170.stdout:3/232: mknod d3/db/d1f/c49 0 2024-02-15T22:51:13.679 INFO:tasks.workunit.client.1.smithi170.stdout:3/233: fdatasync d3/db/f12 0 2024-02-15T22:51:13.694 INFO:tasks.workunit.client.1.smithi170.stdout:3/234: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:13.694 INFO:tasks.workunit.client.1.smithi170.stdout:3/235: write d3/db/d1f/f41 [776318,1747] 0 2024-02-15T22:51:13.694 INFO:tasks.workunit.client.1.smithi170.stdout:3/236: creat d3/dc/d13/f4a x:0 0 0 2024-02-15T22:51:13.700 INFO:tasks.workunit.client.1.smithi170.stdout:3/237: write d3/f3f [3743527,61140] 0 2024-02-15T22:51:13.700 INFO:tasks.workunit.client.1.smithi170.stdout:3/238: write d3/dc/f31 [1181186,68715] 0 2024-02-15T22:51:13.701 INFO:tasks.workunit.client.1.smithi170.stdout:1/174: sync 2024-02-15T22:51:13.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/232: sync 2024-02-15T22:51:13.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/233: fdatasync d0/d22/da/d11/d20/f23 0 2024-02-15T22:51:13.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/234: write d0/d22/da/d11/f45 [4417338,127320] 0 2024-02-15T22:51:13.702 INFO:tasks.workunit.client.1.smithi170.stdout:4/235: chown d0/d22/f14 16180711 1 2024-02-15T22:51:13.702 INFO:tasks.workunit.client.1.smithi170.stdout:3/239: link d3/dc/f1d d3/d1b/d2c/f4b 0 2024-02-15T22:51:13.702 INFO:tasks.workunit.client.1.smithi170.stdout:3/240: write d3/dc/d1c/f48 [986495,12714] 0 2024-02-15T22:51:13.702 INFO:tasks.workunit.client.1.smithi170.stdout:3/241: chown d3/dc/d1c/l34 505 1 2024-02-15T22:51:13.703 INFO:tasks.workunit.client.1.smithi170.stdout:3/242: mknod d3/d1b/d2c/c4c 0 2024-02-15T22:51:13.703 INFO:tasks.workunit.client.1.smithi170.stdout:4/236: getdents d0/d22/da/d11/d20 0 2024-02-15T22:51:13.704 INFO:tasks.workunit.client.1.smithi170.stdout:3/243: creat d3/dc/d1c/d3d/f4d x:0 0 0 2024-02-15T22:51:13.705 INFO:tasks.workunit.client.1.smithi170.stdout:4/237: creat d0/d22/da/d11/f46 x:0 0 0 2024-02-15T22:51:13.717 INFO:tasks.workunit.client.1.smithi170.stdout:3/244: dread d3/f42 [0,4194304] 0 2024-02-15T22:51:13.718 INFO:tasks.workunit.client.1.smithi170.stdout:1/175: dread d3/f10 [0,4194304] 0 2024-02-15T22:51:13.719 INFO:tasks.workunit.client.1.smithi170.stdout:1/176: mknod d3/d24/d2c/c37 0 2024-02-15T22:51:13.721 INFO:tasks.workunit.client.1.smithi170.stdout:1/177: creat d3/d24/d2c/d35/f38 x:0 0 0 2024-02-15T22:51:13.721 INFO:tasks.workunit.client.1.smithi170.stdout:1/178: write d3/d24/d2c/f30 [884016,119066] 0 2024-02-15T22:51:13.722 INFO:tasks.workunit.client.1.smithi170.stdout:4/238: dread d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:13.722 INFO:tasks.workunit.client.1.smithi170.stdout:4/239: chown d0/d22/da/d11/d20/f23 6826590 1 2024-02-15T22:51:13.722 INFO:tasks.workunit.client.1.smithi170.stdout:4/240: write d0/d22/f5 [1701259,21536] 0 2024-02-15T22:51:13.723 INFO:tasks.workunit.client.1.smithi170.stdout:1/179: creat d3/d24/d34/f39 x:0 0 0 2024-02-15T22:51:13.723 INFO:tasks.workunit.client.1.smithi170.stdout:1/180: readlink d3/la 0 2024-02-15T22:51:13.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/181: unlink d3/l9 0 2024-02-15T22:51:13.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/182: creat d3/d24/f3a x:0 0 0 2024-02-15T22:51:13.727 INFO:tasks.workunit.client.1.smithi170.stdout:1/183: dread d3/f15 [0,4194304] 0 2024-02-15T22:51:13.730 INFO:tasks.workunit.client.1.smithi170.stdout:4/241: rename d0/d22/da/d1d to d0/d22/da/d32/d47 0 2024-02-15T22:51:13.730 INFO:tasks.workunit.client.1.smithi170.stdout:4/242: dread - d0/d22/da/f2d zero size 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/243: dread d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/244: stat d0/f10 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/245: chown d0/d22/da/c2f 704981 1 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/246: read - d0/d22/da/d11/f30 zero size 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/247: creat d0/d22/da/d32/f48 x:0 0 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/248: fsync d0/d22/da/f13 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/249: fdatasync d0/f10 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:4/250: write d0/d22/f34 [4612124,106389] 0 2024-02-15T22:51:13.733 INFO:tasks.workunit.client.1.smithi170.stdout:1/184: rename d3/f13 to d3/d24/d34/f3b 0 2024-02-15T22:51:13.738 INFO:tasks.workunit.client.1.smithi170.stdout:4/251: dread d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:13.738 INFO:tasks.workunit.client.1.smithi170.stdout:4/252: truncate d0/f10 4745910 0 2024-02-15T22:51:13.739 INFO:tasks.workunit.client.1.smithi170.stdout:1/185: mknod d3/c3c 0 2024-02-15T22:51:13.741 INFO:tasks.workunit.client.1.smithi170.stdout:3/245: dwrite d3/f5 [0,4194304] 0 2024-02-15T22:51:13.743 INFO:tasks.workunit.client.1.smithi170.stdout:1/186: rename d3/d24/c29 to d3/d24/c3d 0 2024-02-15T22:51:13.757 INFO:tasks.workunit.client.1.smithi170.stdout:4/253: dwrite d0/d22/da/d32/d47/f40 [0,4194304] 0 2024-02-15T22:51:13.759 INFO:tasks.workunit.client.1.smithi170.stdout:4/254: truncate d0/d22/da/d11/f1c 3528980 0 2024-02-15T22:51:13.766 INFO:tasks.workunit.client.1.smithi170.stdout:4/255: dread d0/d22/da/d11/f3c [0,4194304] 0 2024-02-15T22:51:13.768 INFO:tasks.workunit.client.1.smithi170.stdout:3/246: dwrite d3/f3f [4194304,4194304] 0 2024-02-15T22:51:13.768 INFO:tasks.workunit.client.1.smithi170.stdout:1/187: dwrite d3/f22 [0,4194304] 0 2024-02-15T22:51:13.774 INFO:tasks.workunit.client.1.smithi170.stdout:3/247: truncate d3/db/d1f/f2f 2304260 0 2024-02-15T22:51:13.774 INFO:tasks.workunit.client.1.smithi170.stdout:3/248: write d3/db/f11 [448415,88885] 0 2024-02-15T22:51:13.784 INFO:tasks.workunit.client.1.smithi170.stdout:1/188: dwrite d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:13.786 INFO:tasks.workunit.client.1.smithi170.stdout:1/189: mknod d3/c3e 0 2024-02-15T22:51:13.786 INFO:tasks.workunit.client.1.smithi170.stdout:1/190: write d3/d24/f2a [5039217,114377] 0 2024-02-15T22:51:13.795 INFO:tasks.workunit.client.1.smithi170.stdout:3/249: dwrite d3/f42 [0,4194304] 0 2024-02-15T22:51:13.799 INFO:tasks.workunit.client.1.smithi170.stdout:3/250: dread d3/dc/f31 [0,4194304] 0 2024-02-15T22:51:13.800 INFO:tasks.workunit.client.1.smithi170.stdout:3/251: stat d3/dc/d1c/c3e 0 2024-02-15T22:51:13.801 INFO:tasks.workunit.client.1.smithi170.stdout:3/252: creat d3/db/d1f/f4e x:0 0 0 2024-02-15T22:51:13.801 INFO:tasks.workunit.client.1.smithi170.stdout:1/191: write d3/f1e [4049839,102448] 0 2024-02-15T22:51:13.802 INFO:tasks.workunit.client.1.smithi170.stdout:3/253: creat d3/d2b/f4f x:0 0 0 2024-02-15T22:51:13.804 INFO:tasks.workunit.client.1.smithi170.stdout:3/254: creat d3/d1b/d2c/f50 x:0 0 0 2024-02-15T22:51:13.824 INFO:tasks.workunit.client.1.smithi170.stdout:3/255: dwrite d3/f14 [0,4194304] 0 2024-02-15T22:51:13.825 INFO:tasks.workunit.client.1.smithi170.stdout:3/256: mkdir d3/d1b/d51 0 2024-02-15T22:51:13.825 INFO:tasks.workunit.client.1.smithi170.stdout:3/257: chown d3/dc 0 1 2024-02-15T22:51:13.842 INFO:tasks.workunit.client.1.smithi170.stdout:9/216: sync 2024-02-15T22:51:13.843 INFO:tasks.workunit.client.1.smithi170.stdout:6/252: sync 2024-02-15T22:51:13.843 INFO:tasks.workunit.client.1.smithi170.stdout:8/151: sync 2024-02-15T22:51:13.844 INFO:tasks.workunit.client.1.smithi170.stdout:3/258: link d3/dc/f1d d3/dc/d1c/d26/f52 0 2024-02-15T22:51:13.844 INFO:tasks.workunit.client.1.smithi170.stdout:6/253: mknod d3/d1d/d53/c5a 0 2024-02-15T22:51:13.844 INFO:tasks.workunit.client.1.smithi170.stdout:6/254: fdatasync d3/fa 0 2024-02-15T22:51:13.846 INFO:tasks.workunit.client.1.smithi170.stdout:9/217: rename de/f24 to de/d1b/d1c/d1f/d20/d27/d2c/f44 0 2024-02-15T22:51:13.852 INFO:tasks.workunit.client.1.smithi170.stdout:8/152: write d9/f1a [1598718,120347] 0 2024-02-15T22:51:13.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/153: link d9/d18/d26/c28 d9/d18/c2a 0 2024-02-15T22:51:13.859 INFO:tasks.workunit.client.1.smithi170.stdout:6/255: dread d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:13.859 INFO:tasks.workunit.client.1.smithi170.stdout:6/256: creat d3/d1d/d27/f5b x:0 0 0 2024-02-15T22:51:13.859 INFO:tasks.workunit.client.1.smithi170.stdout:6/257: write d3/f5 [1026878,57969] 0 2024-02-15T22:51:13.861 INFO:tasks.workunit.client.1.smithi170.stdout:6/258: truncate d3/d1d/d27/f43 164097 0 2024-02-15T22:51:13.871 INFO:tasks.workunit.client.1.smithi170.stdout:9/218: dwrite de/d1b/d1c/d1f/d20/f21 [4194304,4194304] 0 2024-02-15T22:51:13.874 INFO:tasks.workunit.client.1.smithi170.stdout:9/219: symlink de/l45 0 2024-02-15T22:51:13.874 INFO:tasks.workunit.client.1.smithi170.stdout:9/220: write de/d1b/f25 [4777140,92333] 0 2024-02-15T22:51:13.874 INFO:tasks.workunit.client.1.smithi170.stdout:9/221: write de/f1e [4476912,75011] 0 2024-02-15T22:51:13.879 INFO:tasks.workunit.client.1.smithi170.stdout:3/259: dwrite d3/dc/f1d [0,4194304] 0 2024-02-15T22:51:13.879 INFO:tasks.workunit.client.1.smithi170.stdout:3/260: creat d3/dc/d1c/d3d/f53 x:0 0 0 2024-02-15T22:51:13.886 INFO:tasks.workunit.client.1.smithi170.stdout:3/261: dread d3/f3f [0,4194304] 0 2024-02-15T22:51:13.886 INFO:tasks.workunit.client.1.smithi170.stdout:8/154: dwrite d9/fd [0,4194304] 0 2024-02-15T22:51:13.886 INFO:tasks.workunit.client.1.smithi170.stdout:6/259: dwrite d3/d1d/d27/f4a [0,4194304] 0 2024-02-15T22:51:13.891 INFO:tasks.workunit.client.1.smithi170.stdout:9/222: dwrite de/d1b/f2b [0,4194304] 0 2024-02-15T22:51:13.891 INFO:tasks.workunit.client.1.smithi170.stdout:9/223: creat de/d1b/d1c/f46 x:0 0 0 2024-02-15T22:51:13.893 INFO:tasks.workunit.client.1.smithi170.stdout:6/260: mknod d3/d1a/c5c 0 2024-02-15T22:51:13.893 INFO:tasks.workunit.client.1.smithi170.stdout:6/261: write d3/f7 [2236718,41204] 0 2024-02-15T22:51:13.902 INFO:tasks.workunit.client.1.smithi170.stdout:6/262: rename d3/d1d/d28/d3b/d55 to d3/d1d/d1b/d3e/d5d 0 2024-02-15T22:51:13.903 INFO:tasks.workunit.client.1.smithi170.stdout:8/155: rename d9/d18/c1c to d9/d18/c2b 0 2024-02-15T22:51:13.904 INFO:tasks.workunit.client.1.smithi170.stdout:6/263: rename d3/d1d/d28/d3b/f20 to d3/d1a/f5e 0 2024-02-15T22:51:13.904 INFO:tasks.workunit.client.1.smithi170.stdout:8/156: fsync d9/d18/f19 0 2024-02-15T22:51:13.906 INFO:tasks.workunit.client.1.smithi170.stdout:6/264: unlink d3/d1d/d27/f2e 0 2024-02-15T22:51:13.906 INFO:tasks.workunit.client.1.smithi170.stdout:6/265: fdatasync d3/d1a/f40 0 2024-02-15T22:51:13.907 INFO:tasks.workunit.client.1.smithi170.stdout:6/266: read d3/d1d/d36/f13 [744573,110000] 0 2024-02-15T22:51:13.907 INFO:tasks.workunit.client.1.smithi170.stdout:6/267: read d3/f16 [122272,26376] 0 2024-02-15T22:51:13.907 INFO:tasks.workunit.client.1.smithi170.stdout:6/268: chown d3/d24/d31/f44 24056 1 2024-02-15T22:51:13.907 INFO:tasks.workunit.client.1.smithi170.stdout:8/157: rename d9/c12 to d9/d18/d26/c2c 0 2024-02-15T22:51:13.908 INFO:tasks.workunit.client.1.smithi170.stdout:8/158: truncate d9/f11 963692 0 2024-02-15T22:51:13.908 INFO:tasks.workunit.client.1.smithi170.stdout:8/159: chown d9/d18/c24 134445 1 2024-02-15T22:51:13.910 INFO:tasks.workunit.client.1.smithi170.stdout:8/160: creat d9/f2d x:0 0 0 2024-02-15T22:51:13.910 INFO:tasks.workunit.client.1.smithi170.stdout:8/161: stat d9/lb 0 2024-02-15T22:51:13.911 INFO:tasks.workunit.client.1.smithi170.stdout:0/199: sync 2024-02-15T22:51:13.911 INFO:tasks.workunit.client.1.smithi170.stdout:7/251: sync 2024-02-15T22:51:13.911 INFO:tasks.workunit.client.1.smithi170.stdout:2/272: sync 2024-02-15T22:51:13.911 INFO:tasks.workunit.client.1.smithi170.stdout:5/266: sync 2024-02-15T22:51:13.911 INFO:tasks.workunit.client.1.smithi170.stdout:2/273: dread - d0/d1d/d3d/f5c zero size 2024-02-15T22:51:13.912 INFO:tasks.workunit.client.1.smithi170.stdout:2/274: truncate d0/d1/f9 6409840 0 2024-02-15T22:51:13.912 INFO:tasks.workunit.client.1.smithi170.stdout:0/200: creat d8/d14/d1c/f40 x:0 0 0 2024-02-15T22:51:13.917 INFO:tasks.workunit.client.1.smithi170.stdout:6/269: write d3/d1d/d36/f14 [7946487,57503] 0 2024-02-15T22:51:13.917 INFO:tasks.workunit.client.1.smithi170.stdout:3/262: dwrite d3/dc/d1c/d3d/f4d [0,4194304] 0 2024-02-15T22:51:13.917 INFO:tasks.workunit.client.1.smithi170.stdout:3/263: creat d3/dc/d1c/d3d/f54 x:0 0 0 2024-02-15T22:51:13.918 INFO:tasks.workunit.client.1.smithi170.stdout:2/275: mknod d0/d28/c6a 0 2024-02-15T22:51:13.918 INFO:tasks.workunit.client.1.smithi170.stdout:2/276: chown d0/d28/d2f/f62 1302 1 2024-02-15T22:51:13.924 INFO:tasks.workunit.client.1.smithi170.stdout:5/267: write de/f1a [2444882,80335] 0 2024-02-15T22:51:13.926 INFO:tasks.workunit.client.1.smithi170.stdout:8/162: write d9/d18/f1e [3912373,14807] 0 2024-02-15T22:51:13.928 INFO:tasks.workunit.client.1.smithi170.stdout:6/270: mkdir d3/d1d/d53/d5f 0 2024-02-15T22:51:13.930 INFO:tasks.workunit.client.1.smithi170.stdout:6/271: dread d3/d24/d31/f49 [0,4194304] 0 2024-02-15T22:51:13.930 INFO:tasks.workunit.client.1.smithi170.stdout:3/264: mkdir d3/dc/d1c/d26/d55 0 2024-02-15T22:51:13.931 INFO:tasks.workunit.client.1.smithi170.stdout:2/277: truncate d0/d1/f27 2016008 0 2024-02-15T22:51:13.931 INFO:tasks.workunit.client.1.smithi170.stdout:2/278: chown d0/d1d/f4e 39 1 2024-02-15T22:51:13.931 INFO:tasks.workunit.client.1.smithi170.stdout:2/279: chown d0/d28 8121540 1 2024-02-15T22:51:13.933 INFO:tasks.workunit.client.1.smithi170.stdout:8/163: chown d9/d18/c1b 1024 1 2024-02-15T22:51:13.933 INFO:tasks.workunit.client.1.smithi170.stdout:3/265: dread d3/db/d1f/f2f [0,4194304] 0 2024-02-15T22:51:13.933 INFO:tasks.workunit.client.1.smithi170.stdout:8/164: write d9/f16 [3232308,80221] 0 2024-02-15T22:51:13.935 INFO:tasks.workunit.client.1.smithi170.stdout:6/272: rename d3/d1d/c25 to d3/c60 0 2024-02-15T22:51:13.937 INFO:tasks.workunit.client.1.smithi170.stdout:3/266: creat d3/db/f56 x:0 0 0 2024-02-15T22:51:13.937 INFO:tasks.workunit.client.1.smithi170.stdout:3/267: chown d3/dc/d1a 918 1 2024-02-15T22:51:13.938 INFO:tasks.workunit.client.1.smithi170.stdout:6/273: symlink d3/l61 0 2024-02-15T22:51:13.938 INFO:tasks.workunit.client.1.smithi170.stdout:6/274: write d3/f5 [1294403,49437] 0 2024-02-15T22:51:13.939 INFO:tasks.workunit.client.1.smithi170.stdout:8/165: link d9/d18/c2a d9/c2e 0 2024-02-15T22:51:13.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/166: truncate d9/f10 243733 0 2024-02-15T22:51:13.948 INFO:tasks.workunit.client.1.smithi170.stdout:6/275: write d3/d1d/f12 [757146,66351] 0 2024-02-15T22:51:13.950 INFO:tasks.workunit.client.1.smithi170.stdout:6/276: mkdir d3/d1d/d53/d5f/d62 0 2024-02-15T22:51:13.951 INFO:tasks.workunit.client.1.smithi170.stdout:6/277: creat d3/d1d/d36/d51/f63 x:0 0 0 2024-02-15T22:51:13.951 INFO:tasks.workunit.client.1.smithi170.stdout:6/278: creat d3/d1d/d36/d56/f64 x:0 0 0 2024-02-15T22:51:13.951 INFO:tasks.workunit.client.1.smithi170.stdout:3/268: write d3/dc/d1c/d26/f46 [2838596,14017] 0 2024-02-15T22:51:13.952 INFO:tasks.workunit.client.1.smithi170.stdout:6/279: symlink d3/d24/l65 0 2024-02-15T22:51:13.953 INFO:tasks.workunit.client.1.smithi170.stdout:6/280: chown d3/f16 117763979 1 2024-02-15T22:51:13.953 INFO:tasks.workunit.client.1.smithi170.stdout:6/281: fsync d3/d1d/d36/f13 0 2024-02-15T22:51:13.953 INFO:tasks.workunit.client.1.smithi170.stdout:3/269: rename d3/db/f56 to d3/d2b/f57 0 2024-02-15T22:51:13.954 INFO:tasks.workunit.client.1.smithi170.stdout:3/270: chown d3/dc/d1c/l2e 141130 1 2024-02-15T22:51:13.954 INFO:tasks.workunit.client.1.smithi170.stdout:3/271: chown d3/dc/d13/f4a 378 1 2024-02-15T22:51:13.954 INFO:tasks.workunit.client.1.smithi170.stdout:6/282: mkdir d3/d1d/d28/d66 0 2024-02-15T22:51:13.955 INFO:tasks.workunit.client.1.smithi170.stdout:0/201: dwrite d8/d14/d1c/f35 [0,4194304] 0 2024-02-15T22:51:13.956 INFO:tasks.workunit.client.1.smithi170.stdout:7/252: dwrite da/d1a/d21/d19/f50 [0,4194304] 0 2024-02-15T22:51:13.956 INFO:tasks.workunit.client.1.smithi170.stdout:7/253: chown da/d57 28986408 1 2024-02-15T22:51:13.956 INFO:tasks.workunit.client.1.smithi170.stdout:3/272: link d3/dc/f17 d3/dc/d1c/d3d/f58 0 2024-02-15T22:51:13.957 INFO:tasks.workunit.client.1.smithi170.stdout:5/268: dwrite de/d36/f43 [0,4194304] 0 2024-02-15T22:51:13.957 INFO:tasks.workunit.client.1.smithi170.stdout:6/283: mknod d3/d1d/d28/d3b/c67 0 2024-02-15T22:51:13.957 INFO:tasks.workunit.client.1.smithi170.stdout:8/167: read d9/f1d [2961562,108338] 0 2024-02-15T22:51:13.958 INFO:tasks.workunit.client.1.smithi170.stdout:0/202: symlink d8/df/l41 0 2024-02-15T22:51:13.965 INFO:tasks.workunit.client.1.smithi170.stdout:7/254: rename da/d1a/d21/d4d/c55 to da/d1a/c5b 0 2024-02-15T22:51:13.967 INFO:tasks.workunit.client.1.smithi170.stdout:6/284: creat d3/d1d/d28/d66/f68 x:0 0 0 2024-02-15T22:51:13.969 INFO:tasks.workunit.client.1.smithi170.stdout:5/269: dwrite fa [4194304,4194304] 0 2024-02-15T22:51:13.969 INFO:tasks.workunit.client.1.smithi170.stdout:5/270: fsync de/f1e 0 2024-02-15T22:51:13.970 INFO:tasks.workunit.client.1.smithi170.stdout:0/203: unlink d8/df/d13/f20 0 2024-02-15T22:51:13.973 INFO:tasks.workunit.client.1.smithi170.stdout:3/273: rename d3/dc/c2d to d3/dc/d1c/d3d/c59 0 2024-02-15T22:51:13.973 INFO:tasks.workunit.client.1.smithi170.stdout:3/274: getdents d3/dc/d1c/d26/d55 0 2024-02-15T22:51:13.975 INFO:tasks.workunit.client.1.smithi170.stdout:6/285: write d3/fa [3484356,15329] 0 2024-02-15T22:51:13.976 INFO:tasks.workunit.client.1.smithi170.stdout:0/204: creat d8/df/d13/f42 x:0 0 0 2024-02-15T22:51:13.976 INFO:tasks.workunit.client.1.smithi170.stdout:0/205: chown d8/df/d13/f42 873360007 1 2024-02-15T22:51:13.980 INFO:tasks.workunit.client.1.smithi170.stdout:7/255: rename da/d1a/d21/d2c/d2e/l3a to da/d1a/d21/d19/l5c 0 2024-02-15T22:51:13.981 INFO:tasks.workunit.client.1.smithi170.stdout:8/168: write d9/f10 [814253,56801] 0 2024-02-15T22:51:13.983 INFO:tasks.workunit.client.1.smithi170.stdout:0/206: symlink d8/d14/d1c/l43 0 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: Upgrade: Need to upgrade myself (mgr.smithi170.gczrzt) 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: Upgrade: Need to upgrade myself (mgr.smithi170.gczrzt) 2024-02-15T22:51:13.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:13 smithi138 ceph-mon[29229]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 84 MiB/s rd, 113 MiB/s wr, 620 op/s 2024-02-15T22:51:13.986 INFO:tasks.workunit.client.1.smithi170.stdout:6/286: rename d3/d1d/d28/d3b/l30 to d3/d24/d31/l69 0 2024-02-15T22:51:13.986 INFO:tasks.workunit.client.1.smithi170.stdout:6/287: read d3/d1d/d28/f47 [132396,13368] 0 2024-02-15T22:51:13.987 INFO:tasks.workunit.client.1.smithi170.stdout:5/271: dwrite de/d10/d52/f56 [0,4194304] 0 2024-02-15T22:51:13.987 INFO:tasks.workunit.client.1.smithi170.stdout:5/272: write de/f16 [655028,120894] 0 2024-02-15T22:51:13.988 INFO:tasks.workunit.client.1.smithi170.stdout:5/273: chown de/d29/f5a 110797 1 2024-02-15T22:51:13.988 INFO:tasks.workunit.client.1.smithi170.stdout:7/256: unlink da/d1a/f1e 0 2024-02-15T22:51:13.990 INFO:tasks.workunit.client.1.smithi170.stdout:0/207: mkdir d8/d14/d44 0 2024-02-15T22:51:13.993 INFO:tasks.workunit.client.1.smithi170.stdout:3/275: dwrite d3/d2b/f57 [0,4194304] 0 2024-02-15T22:51:14.009 INFO:tasks.workunit.client.1.smithi170.stdout:7/257: dwrite da/d1a/d28/f32 [0,4194304] 0 2024-02-15T22:51:14.010 INFO:tasks.workunit.client.1.smithi170.stdout:3/276: dwrite d3/dc/d1c/f48 [0,4194304] 0 2024-02-15T22:51:14.024 INFO:tasks.workunit.client.1.smithi170.stdout:3/277: dwrite d3/dc/d1c/d26/f52 [0,4194304] 0 2024-02-15T22:51:14.037 INFO:tasks.workunit.client.1.smithi170.stdout:3/278: dwrite d3/dc/d1c/d3d/f54 [0,4194304] 0 2024-02-15T22:51:14.075 INFO:tasks.workunit.client.1.smithi170.stdout:6/288: symlink d3/d1d/d28/l6a 0 2024-02-15T22:51:14.084 INFO:tasks.workunit.client.1.smithi170.stdout:5/274: symlink de/d10/l5c 0 2024-02-15T22:51:14.085 INFO:tasks.workunit.client.1.smithi170.stdout:5/275: creat de/d10/d33/f5d x:0 0 0 2024-02-15T22:51:14.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/208: symlink d8/d14/l45 0 2024-02-15T22:51:14.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/209: dread - d8/d14/d1c/f3d zero size 2024-02-15T22:51:14.088 INFO:tasks.workunit.client.1.smithi170.stdout:5/276: write f1 [1918194,70001] 0 2024-02-15T22:51:14.098 INFO:tasks.workunit.client.1.smithi170.stdout:3/279: mknod d3/dc/d13/c5a 0 2024-02-15T22:51:14.098 INFO:tasks.workunit.client.1.smithi170.stdout:3/280: write d3/d1b/d2c/f4b [4929143,36471] 0 2024-02-15T22:51:14.102 INFO:tasks.workunit.client.1.smithi170.stdout:6/289: mknod d3/d1d/d28/d3b/d2f/c6b 0 2024-02-15T22:51:14.106 INFO:tasks.workunit.client.1.smithi170.stdout:5/277: dwrite de/f4b [0,4194304] 0 2024-02-15T22:51:14.107 INFO:tasks.workunit.client.1.smithi170.stdout:0/210: rename d8/d14/f37 to d8/f46 0 2024-02-15T22:51:14.110 INFO:tasks.workunit.client.1.smithi170.stdout:7/258: symlink da/l5d 0 2024-02-15T22:51:14.110 INFO:tasks.workunit.client.1.smithi170.stdout:7/259: write da/d1a/d21/f51 [2343544,80490] 0 2024-02-15T22:51:14.113 INFO:tasks.workunit.client.1.smithi170.stdout:4/256: sync 2024-02-15T22:51:14.113 INFO:tasks.workunit.client.1.smithi170.stdout:4/257: truncate d0/d22/da/f16 1175056 0 2024-02-15T22:51:14.113 INFO:tasks.workunit.client.1.smithi170.stdout:5/278: creat de/d36/f5e x:0 0 0 2024-02-15T22:51:14.114 INFO:tasks.workunit.client.1.smithi170.stdout:0/211: getdents d8/df/d13/d36 0 2024-02-15T22:51:14.120 INFO:tasks.workunit.client.1.smithi170.stdout:0/212: link d8/d14/d1c/l43 d8/df/d13/d36/l47 0 2024-02-15T22:51:14.124 INFO:tasks.workunit.client.1.smithi170.stdout:6/290: dwrite d3/d1d/d28/f47 [0,4194304] 0 2024-02-15T22:51:14.128 INFO:tasks.workunit.client.1.smithi170.stdout:3/281: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:14.128 INFO:tasks.workunit.client.1.smithi170.stdout:0/213: read d8/d14/d1c/f35 [2146682,118350] 0 2024-02-15T22:51:14.128 INFO:tasks.workunit.client.1.smithi170.stdout:0/214: write d8/d14/d1c/f2b [4947864,114933] 0 2024-02-15T22:51:14.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/291: mkdir d3/d1d/d36/d56/d6c 0 2024-02-15T22:51:14.129 INFO:tasks.workunit.client.1.smithi170.stdout:4/258: dread d0/d22/da/f27 [0,4194304] 0 2024-02-15T22:51:14.129 INFO:tasks.workunit.client.1.smithi170.stdout:6/292: readlink d3/d1d/d28/d3b/l1f 0 2024-02-15T22:51:14.129 INFO:tasks.workunit.client.1.smithi170.stdout:4/259: read - d0/d22/da/d11/f30 zero size 2024-02-15T22:51:14.129 INFO:tasks.workunit.client.1.smithi170.stdout:4/260: fsync d0/d22/da/d11/f3c 0 2024-02-15T22:51:14.130 INFO:tasks.workunit.client.1.smithi170.stdout:3/282: creat d3/dc/f5b x:0 0 0 2024-02-15T22:51:14.132 INFO:tasks.workunit.client.1.smithi170.stdout:7/260: getdents da 0 2024-02-15T22:51:14.132 INFO:tasks.workunit.client.1.smithi170.stdout:4/261: dread d0/d22/da/d11/f45 [0,4194304] 0 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:14.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: Upgrade: Need to upgrade myself (mgr.smithi170.gczrzt) 2024-02-15T22:51:14.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: Upgrade: Need to upgrade myself (mgr.smithi170.gczrzt) 2024-02-15T22:51:14.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:13 smithi170 ceph-mon[35248]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 84 MiB/s rd, 113 MiB/s wr, 620 op/s 2024-02-15T22:51:14.135 INFO:tasks.workunit.client.1.smithi170.stdout:0/215: rename d8/df/f19 to d8/d14/d1c/d3f/f48 0 2024-02-15T22:51:14.135 INFO:tasks.workunit.client.1.smithi170.stdout:0/216: fsync d8/df/d13/f42 0 2024-02-15T22:51:14.136 INFO:tasks.workunit.client.1.smithi170.stdout:0/217: fdatasync d8/d14/f1a 0 2024-02-15T22:51:14.138 INFO:tasks.workunit.client.1.smithi170.stdout:6/293: mkdir d3/d1a/d6d 0 2024-02-15T22:51:14.138 INFO:tasks.workunit.client.1.smithi170.stdout:6/294: chown d3/d1d/d53/c5a 33841 1 2024-02-15T22:51:14.138 INFO:tasks.workunit.client.1.smithi170.stdout:6/295: dread - d3/d24/f35 zero size 2024-02-15T22:51:14.139 INFO:tasks.workunit.client.1.smithi170.stdout:7/261: truncate da/f25 1023827 0 2024-02-15T22:51:14.140 INFO:tasks.workunit.client.1.smithi170.stdout:5/279: rmdir de/d36 39 2024-02-15T22:51:14.144 INFO:tasks.workunit.client.1.smithi170.stdout:6/296: symlink d3/d1d/d53/d5f/d62/l6e 0 2024-02-15T22:51:14.145 INFO:tasks.workunit.client.1.smithi170.stdout:6/297: dread - d3/d1d/d36/f58 zero size 2024-02-15T22:51:14.146 INFO:tasks.workunit.client.1.smithi170.stdout:7/262: creat da/d1a/d21/d4d/d59/f5e x:0 0 0 2024-02-15T22:51:14.147 INFO:tasks.workunit.client.1.smithi170.stdout:5/280: creat de/d10/d27/d4c/d53/f5f x:0 0 0 2024-02-15T22:51:14.148 INFO:tasks.workunit.client.1.smithi170.stdout:5/281: dread - de/d10/d33/f5d zero size 2024-02-15T22:51:14.148 INFO:tasks.workunit.client.1.smithi170.stdout:5/282: readlink de/d36/l46 0 2024-02-15T22:51:14.148 INFO:tasks.workunit.client.1.smithi170.stdout:5/283: stat de/d10/d27/d4c 0 2024-02-15T22:51:14.148 INFO:tasks.workunit.client.1.smithi170.stdout:5/284: write de/d10/d33/f45 [184647,53225] 0 2024-02-15T22:51:14.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/298: creat d3/d1d/d1b/d3c/f6f x:0 0 0 2024-02-15T22:51:14.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/299: fdatasync d3/d1d/d28/d3b/f2b 0 2024-02-15T22:51:14.151 INFO:tasks.workunit.client.1.smithi170.stdout:7/263: unlink da/c10 0 2024-02-15T22:51:14.151 INFO:tasks.workunit.client.1.smithi170.stdout:3/283: dwrite d3/db/d1f/f4e [0,4194304] 0 2024-02-15T22:51:14.153 INFO:tasks.workunit.client.1.smithi170.stdout:6/300: read d3/d1a/f40 [3256268,109352] 0 2024-02-15T22:51:14.156 INFO:tasks.workunit.client.1.smithi170.stdout:7/264: link da/d1a/d21/d1b/c1f da/d1a/d21/d2c/c5f 0 2024-02-15T22:51:14.156 INFO:tasks.workunit.client.1.smithi170.stdout:7/265: truncate da/d1a/d28/f32 4693499 0 2024-02-15T22:51:14.163 INFO:tasks.workunit.client.1.smithi170.stdout:3/284: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:14.164 INFO:tasks.workunit.client.1.smithi170.stdout:6/301: mkdir d3/d1d/d27/d70 0 2024-02-15T22:51:14.164 INFO:tasks.workunit.client.1.smithi170.stdout:6/302: readlink d3/d1d/d28/l57 0 2024-02-15T22:51:14.165 INFO:tasks.workunit.client.1.smithi170.stdout:3/285: mknod d3/c5c 0 2024-02-15T22:51:14.165 INFO:tasks.workunit.client.1.smithi170.stdout:3/286: chown d3/dc/d1c/d26/f52 7338 1 2024-02-15T22:51:14.165 INFO:tasks.workunit.client.1.smithi170.stdout:3/287: stat d3/c21 0 2024-02-15T22:51:14.166 INFO:tasks.workunit.client.1.smithi170.stdout:6/303: mknod d3/d1d/d27/c71 0 2024-02-15T22:51:14.167 INFO:tasks.workunit.client.1.smithi170.stdout:3/288: mkdir d3/dc/d1c/d3d/d5d 0 2024-02-15T22:51:14.168 INFO:tasks.workunit.client.1.smithi170.stdout:6/304: rename d3/d1d/c4d to d3/d1a/d6d/c72 0 2024-02-15T22:51:14.168 INFO:tasks.workunit.client.1.smithi170.stdout:6/305: write d3/f7 [182500,56017] 0 2024-02-15T22:51:14.169 INFO:tasks.workunit.client.1.smithi170.stdout:3/289: rmdir d3/db 39 2024-02-15T22:51:14.171 INFO:tasks.workunit.client.1.smithi170.stdout:6/306: dread d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:14.172 INFO:tasks.workunit.client.1.smithi170.stdout:6/307: symlink d3/d1d/d27/l73 0 2024-02-15T22:51:14.173 INFO:tasks.workunit.client.1.smithi170.stdout:6/308: mknod d3/d1d/d53/d5f/d62/c74 0 2024-02-15T22:51:14.173 INFO:tasks.workunit.client.1.smithi170.stdout:0/218: dwrite d8/df/d13/f2e [0,4194304] 0 2024-02-15T22:51:14.173 INFO:tasks.workunit.client.1.smithi170.stdout:0/219: readlink l2 0 2024-02-15T22:51:14.173 INFO:tasks.workunit.client.1.smithi170.stdout:4/262: dwrite d0/d22/f5 [4194304,4194304] 0 2024-02-15T22:51:14.174 INFO:tasks.workunit.client.1.smithi170.stdout:4/263: chown d0/d22/da/d11/f46 422 1 2024-02-15T22:51:14.174 INFO:tasks.workunit.client.1.smithi170.stdout:5/285: dwrite de/f1a [0,4194304] 0 2024-02-15T22:51:14.174 INFO:tasks.workunit.client.1.smithi170.stdout:6/309: creat d3/d1d/d28/f75 x:0 0 0 2024-02-15T22:51:14.174 INFO:tasks.workunit.client.1.smithi170.stdout:6/310: chown d3/d1d/d1b/d3c/c4b 4734110 1 2024-02-15T22:51:14.174 INFO:tasks.workunit.client.1.smithi170.stdout:6/311: stat d3/d1d/d27/f5b 0 2024-02-15T22:51:14.178 INFO:tasks.workunit.client.1.smithi170.stdout:0/220: creat d8/df/f49 x:0 0 0 2024-02-15T22:51:14.179 INFO:tasks.workunit.client.1.smithi170.stdout:3/290: write d3/d2b/f57 [3456776,117246] 0 2024-02-15T22:51:14.179 INFO:tasks.workunit.client.1.smithi170.stdout:0/221: rename d8/d14/l2d to d8/df/l4a 0 2024-02-15T22:51:14.183 INFO:tasks.workunit.client.1.smithi170.stdout:0/222: link d8/d14/d1c/f24 d8/df/d13/d22/f4b 0 2024-02-15T22:51:14.184 INFO:tasks.workunit.client.1.smithi170.stdout:4/264: dread d0/d22/da/f29 [0,4194304] 0 2024-02-15T22:51:14.184 INFO:tasks.workunit.client.1.smithi170.stdout:4/265: readlink d0/l4 0 2024-02-15T22:51:14.186 INFO:tasks.workunit.client.1.smithi170.stdout:0/223: creat d8/d14/d44/f4c x:0 0 0 2024-02-15T22:51:14.187 INFO:tasks.workunit.client.1.smithi170.stdout:4/266: mkdir d0/d22/da/d11/d20/d49 0 2024-02-15T22:51:14.188 INFO:tasks.workunit.client.1.smithi170.stdout:1/192: sync 2024-02-15T22:51:14.188 INFO:tasks.workunit.client.1.smithi170.stdout:1/193: fsync d3/d24/f2b 0 2024-02-15T22:51:14.190 INFO:tasks.workunit.client.1.smithi170.stdout:1/194: symlink d3/d24/l3f 0 2024-02-15T22:51:14.190 INFO:tasks.workunit.client.1.smithi170.stdout:1/195: creat d3/d24/d2c/d35/f40 x:0 0 0 2024-02-15T22:51:14.190 INFO:tasks.workunit.client.1.smithi170.stdout:1/196: truncate d3/f21 178367 0 2024-02-15T22:51:14.190 INFO:tasks.workunit.client.1.smithi170.stdout:1/197: chown l2 936 1 2024-02-15T22:51:14.192 INFO:tasks.workunit.client.1.smithi170.stdout:1/198: mknod d3/d24/d2c/c41 0 2024-02-15T22:51:14.195 INFO:tasks.workunit.client.1.smithi170.stdout:1/199: rmdir d3/d24/d34 39 2024-02-15T22:51:14.195 INFO:tasks.workunit.client.1.smithi170.stdout:1/200: fdatasync d3/f10 0 2024-02-15T22:51:14.195 INFO:tasks.workunit.client.1.smithi170.stdout:1/201: fsync d3/fb 0 2024-02-15T22:51:14.197 INFO:tasks.workunit.client.1.smithi170.stdout:1/202: rename d3/d24/d2c/c37 to d3/d24/d2c/d35/c42 0 2024-02-15T22:51:14.198 INFO:tasks.workunit.client.1.smithi170.stdout:1/203: write d3/d24/f36 [550419,102143] 0 2024-02-15T22:51:14.198 INFO:tasks.workunit.client.1.smithi170.stdout:1/204: truncate d3/d24/f2b 473812 0 2024-02-15T22:51:14.198 INFO:tasks.workunit.client.1.smithi170.stdout:1/205: write d3/d24/d2c/d35/f40 [729464,18793] 0 2024-02-15T22:51:14.203 INFO:tasks.workunit.client.1.smithi170.stdout:1/206: read d3/d24/f2a [783508,43360] 0 2024-02-15T22:51:14.233 INFO:tasks.workunit.client.1.smithi170.stdout:0/224: write d8/df/f12 [547908,31150] 0 2024-02-15T22:51:14.234 INFO:tasks.workunit.client.1.smithi170.stdout:0/225: chown d8/cb 52652 1 2024-02-15T22:51:14.235 INFO:tasks.workunit.client.1.smithi170.stdout:0/226: symlink d8/df/d13/d36/l4d 0 2024-02-15T22:51:14.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/227: unlink d8/df/d13/f2f 0 2024-02-15T22:51:14.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/228: fsync f1 0 2024-02-15T22:51:14.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/229: creat d8/d14/d1c/d3f/f4e x:0 0 0 2024-02-15T22:51:14.243 INFO:tasks.workunit.client.1.smithi170.stdout:4/267: read d0/d22/da/d11/f1e [2829027,93863] 0 2024-02-15T22:51:14.244 INFO:tasks.workunit.client.1.smithi170.stdout:4/268: link d0/d22/da/d11/d20/f23 d0/d22/da/d11/d20/d49/f4a 0 2024-02-15T22:51:14.245 INFO:tasks.workunit.client.1.smithi170.stdout:4/269: rename d0/d22/da/d32/d47/f40 to d0/d22/da/d32/d47/f4b 0 2024-02-15T22:51:14.246 INFO:tasks.workunit.client.1.smithi170.stdout:4/270: link d0/d22/da/d11/f26 d0/d22/da/d32/d47/d2b/f4c 0 2024-02-15T22:51:14.247 INFO:tasks.workunit.client.1.smithi170.stdout:4/271: creat d0/d22/da/d11/d20/f4d x:0 0 0 2024-02-15T22:51:14.250 INFO:tasks.workunit.client.1.smithi170.stdout:5/286: dwrite de/f21 [0,4194304] 0 2024-02-15T22:51:14.250 INFO:tasks.workunit.client.1.smithi170.stdout:6/312: dwrite d3/d24/d31/f49 [0,4194304] 0 2024-02-15T22:51:14.251 INFO:tasks.workunit.client.1.smithi170.stdout:6/313: chown d3/d1d/d28/d3b/l1f 5 1 2024-02-15T22:51:14.251 INFO:tasks.workunit.client.1.smithi170.stdout:6/314: write d3/d1d/d28/f75 [194598,130016] 0 2024-02-15T22:51:14.251 INFO:tasks.workunit.client.1.smithi170.stdout:1/207: dwrite d3/f15 [0,4194304] 0 2024-02-15T22:51:14.256 INFO:tasks.workunit.client.1.smithi170.stdout:5/287: unlink de/d10/d52/f56 0 2024-02-15T22:51:14.256 INFO:tasks.workunit.client.1.smithi170.stdout:5/288: dread - de/d36/f5e zero size 2024-02-15T22:51:14.256 INFO:tasks.workunit.client.1.smithi170.stdout:5/289: write de/d10/d27/d2d/f39 [234115,97430] 0 2024-02-15T22:51:14.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/315: link d3/l41 d3/d24/l76 0 2024-02-15T22:51:14.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/316: dread - d3/d1d/d36/d56/f59 zero size 2024-02-15T22:51:14.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/317: chown d3/d24/c48 0 1 2024-02-15T22:51:14.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/318: creat d3/d24/f77 x:0 0 0 2024-02-15T22:51:14.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/290: dread de/d10/f18 [0,4194304] 0 2024-02-15T22:51:14.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/291: readlink de/d10/d33/l3e 0 2024-02-15T22:51:14.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/292: fdatasync de/f3f 0 2024-02-15T22:51:14.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/293: creat de/d10/d27/d4c/d53/f60 x:0 0 0 2024-02-15T22:51:14.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/294: creat de/d29/f61 x:0 0 0 2024-02-15T22:51:14.261 INFO:tasks.workunit.client.1.smithi170.stdout:1/208: link d3/l26 d3/d24/l43 0 2024-02-15T22:51:14.263 INFO:tasks.workunit.client.1.smithi170.stdout:6/319: mkdir d3/d1d/d36/d51/d54/d78 0 2024-02-15T22:51:14.266 INFO:tasks.workunit.client.1.smithi170.stdout:1/209: creat d3/d24/d34/f44 x:0 0 0 2024-02-15T22:51:14.266 INFO:tasks.workunit.client.1.smithi170.stdout:1/210: stat d3/f20 0 2024-02-15T22:51:14.267 INFO:tasks.workunit.client.1.smithi170.stdout:6/320: rmdir d3/d1d/d36/d51/d54/d78 0 2024-02-15T22:51:14.267 INFO:tasks.workunit.client.1.smithi170.stdout:6/321: chown d3/fa 5697567 1 2024-02-15T22:51:14.269 INFO:tasks.workunit.client.1.smithi170.stdout:6/322: rename d3/d1d/d28/d3b/d2f/c4c to d3/d1d/d27/c79 0 2024-02-15T22:51:14.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/323: fsync d3/d1d/d36/d56/f64 0 2024-02-15T22:51:14.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/324: readlink d3/d1d/d28/d3b/d2f/l38 0 2024-02-15T22:51:14.270 INFO:tasks.workunit.client.1.smithi170.stdout:5/295: write de/f21 [3020752,33067] 0 2024-02-15T22:51:14.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/325: creat d3/d24/f7a x:0 0 0 2024-02-15T22:51:14.270 INFO:tasks.workunit.client.1.smithi170.stdout:5/296: chown de/l14 1926926 1 2024-02-15T22:51:14.273 INFO:tasks.workunit.client.1.smithi170.stdout:1/211: write d3/f10 [504043,99322] 0 2024-02-15T22:51:14.273 INFO:tasks.workunit.client.1.smithi170.stdout:5/297: symlink de/d10/d27/d2d/d51/l62 0 2024-02-15T22:51:14.277 INFO:tasks.workunit.client.1.smithi170.stdout:5/298: rmdir de/d29/d4d 0 2024-02-15T22:51:14.277 INFO:tasks.workunit.client.1.smithi170.stdout:5/299: creat de/d10/d27/d4c/d53/f63 x:0 0 0 2024-02-15T22:51:14.286 INFO:tasks.workunit.client.1.smithi170.stdout:5/300: rename de/d10/d27/d4c/d53/d55/c4e to de/d10/d27/d4c/d53/d55/c64 0 2024-02-15T22:51:14.286 INFO:tasks.workunit.client.1.smithi170.stdout:5/301: creat de/d10/d27/d2d/f65 x:0 0 0 2024-02-15T22:51:14.287 INFO:tasks.workunit.client.1.smithi170.stdout:5/302: symlink de/d10/d27/d2d/d51/l66 0 2024-02-15T22:51:14.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/303: mkdir de/d10/d33/d67 0 2024-02-15T22:51:14.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/304: stat de/c28 0 2024-02-15T22:51:14.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/305: getdents de/d10/d27/d4c 0 2024-02-15T22:51:14.290 INFO:tasks.workunit.client.1.smithi170.stdout:5/306: symlink de/d29/l68 0 2024-02-15T22:51:14.291 INFO:tasks.workunit.client.1.smithi170.stdout:5/307: creat de/d10/d27/d2d/d51/f69 x:0 0 0 2024-02-15T22:51:14.291 INFO:tasks.workunit.client.1.smithi170.stdout:1/212: getdents d3/d24/d34 0 2024-02-15T22:51:14.294 INFO:tasks.workunit.client.1.smithi170.stdout:1/213: truncate d3/d24/d2c/d35/f40 164319 0 2024-02-15T22:51:14.297 INFO:tasks.workunit.client.1.smithi170.stdout:1/214: unlink d3/d24/l3f 0 2024-02-15T22:51:14.299 INFO:tasks.workunit.client.1.smithi170.stdout:1/215: mknod d3/d24/d2c/d35/c45 0 2024-02-15T22:51:14.299 INFO:tasks.workunit.client.1.smithi170.stdout:1/216: fsync d3/f10 0 2024-02-15T22:51:14.301 INFO:tasks.workunit.client.1.smithi170.stdout:1/217: dread d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:14.302 INFO:tasks.workunit.client.1.smithi170.stdout:1/218: creat d3/d24/d34/f46 x:0 0 0 2024-02-15T22:51:14.303 INFO:tasks.workunit.client.1.smithi170.stdout:1/219: unlink d3/d24/f3a 0 2024-02-15T22:51:14.304 INFO:tasks.workunit.client.1.smithi170.stdout:1/220: truncate d3/d24/d2c/f30 438999 0 2024-02-15T22:51:14.305 INFO:tasks.workunit.client.1.smithi170.stdout:5/308: dwrite de/d10/d27/d2d/f47 [0,4194304] 0 2024-02-15T22:51:14.306 INFO:tasks.workunit.client.1.smithi170.stdout:5/309: write de/f21 [3777958,87872] 0 2024-02-15T22:51:14.307 INFO:tasks.workunit.client.1.smithi170.stdout:1/221: unlink d3/d24/f2a 0 2024-02-15T22:51:14.307 INFO:tasks.workunit.client.1.smithi170.stdout:1/222: write d3/d24/f36 [1408707,74473] 0 2024-02-15T22:51:14.311 INFO:tasks.workunit.client.1.smithi170.stdout:1/223: creat d3/d24/d2c/f47 x:0 0 0 2024-02-15T22:51:14.311 INFO:tasks.workunit.client.1.smithi170.stdout:1/224: creat d3/d24/d2c/d35/f48 x:0 0 0 2024-02-15T22:51:14.312 INFO:tasks.workunit.client.1.smithi170.stdout:1/225: dread d3/f21 [0,4194304] 0 2024-02-15T22:51:14.312 INFO:tasks.workunit.client.1.smithi170.stdout:1/226: creat d3/d24/d2c/f49 x:0 0 0 2024-02-15T22:51:14.320 INFO:tasks.workunit.client.1.smithi170.stdout:1/227: mkdir d3/d24/d34/d4a 0 2024-02-15T22:51:14.323 INFO:tasks.workunit.client.1.smithi170.stdout:5/310: dwrite de/d10/d27/d2d/f65 [0,4194304] 0 2024-02-15T22:51:14.336 INFO:tasks.workunit.client.1.smithi170.stdout:5/311: dread de/d36/f41 [0,4194304] 0 2024-02-15T22:51:14.340 INFO:tasks.workunit.client.1.smithi170.stdout:9/224: sync 2024-02-15T22:51:14.341 INFO:tasks.workunit.client.1.smithi170.stdout:1/228: dwrite d3/d24/d2c/f47 [0,4194304] 0 2024-02-15T22:51:14.345 INFO:tasks.workunit.client.1.smithi170.stdout:1/229: mknod d3/c4b 0 2024-02-15T22:51:14.345 INFO:tasks.workunit.client.1.smithi170.stdout:1/230: creat d3/f4c x:0 0 0 2024-02-15T22:51:14.346 INFO:tasks.workunit.client.1.smithi170.stdout:1/231: readlink d3/lc 0 2024-02-15T22:51:14.349 INFO:tasks.workunit.client.1.smithi170.stdout:1/232: creat d3/d24/d34/d4a/f4d x:0 0 0 2024-02-15T22:51:14.357 INFO:tasks.workunit.client.1.smithi170.stdout:5/312: dwrite de/d29/f61 [0,4194304] 0 2024-02-15T22:51:14.358 INFO:tasks.workunit.client.1.smithi170.stdout:5/313: write de/d10/f18 [384572,122325] 0 2024-02-15T22:51:14.361 INFO:tasks.workunit.client.1.smithi170.stdout:5/314: symlink de/d10/d27/d2d/d51/l6a 0 2024-02-15T22:51:14.362 INFO:tasks.workunit.client.1.smithi170.stdout:5/315: write de/f21 [2961576,42025] 0 2024-02-15T22:51:14.362 INFO:tasks.workunit.client.1.smithi170.stdout:5/316: write de/d10/d27/f3d [1119340,97970] 0 2024-02-15T22:51:14.362 INFO:tasks.workunit.client.1.smithi170.stdout:5/317: creat de/d10/f6b x:0 0 0 2024-02-15T22:51:14.368 INFO:tasks.workunit.client.1.smithi170.stdout:9/225: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f32 [0,4194304] 0 2024-02-15T22:51:14.368 INFO:tasks.workunit.client.1.smithi170.stdout:9/226: read de/d1b/d1c/d1f/d20/d27/f29 [2008194,37866] 0 2024-02-15T22:51:14.372 INFO:tasks.workunit.client.1.smithi170.stdout:9/227: dread de/f1a [0,4194304] 0 2024-02-15T22:51:14.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/228: mkdir de/d1b/d1c/d47 0 2024-02-15T22:51:14.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/229: chown de/l11 4 1 2024-02-15T22:51:14.374 INFO:tasks.workunit.client.1.smithi170.stdout:1/233: dwrite d3/f10 [0,4194304] 0 2024-02-15T22:51:14.377 INFO:tasks.workunit.client.1.smithi170.stdout:9/230: link de/f1a de/d1b/d1c/d47/f48 0 2024-02-15T22:51:14.379 INFO:tasks.workunit.client.1.smithi170.stdout:5/318: getdents de/d10/d27/d2d/d51 0 2024-02-15T22:51:14.379 INFO:tasks.workunit.client.1.smithi170.stdout:5/319: write de/d10/d27/d2d/f35 [146198,118554] 0 2024-02-15T22:51:14.381 INFO:tasks.workunit.client.1.smithi170.stdout:9/231: dread de/f14 [0,4194304] 0 2024-02-15T22:51:14.381 INFO:tasks.workunit.client.1.smithi170.stdout:1/234: link d3/f20 d3/d24/d34/d4a/f4e 0 2024-02-15T22:51:14.385 INFO:tasks.workunit.client.1.smithi170.stdout:5/320: unlink fa 0 2024-02-15T22:51:14.385 INFO:tasks.workunit.client.1.smithi170.stdout:5/321: chown de/d10/d27/d4c 7517 1 2024-02-15T22:51:14.388 INFO:tasks.workunit.client.1.smithi170.stdout:9/232: unlink de/c38 0 2024-02-15T22:51:14.390 INFO:tasks.workunit.client.1.smithi170.stdout:5/322: fsync de/f21 0 2024-02-15T22:51:14.390 INFO:tasks.workunit.client.1.smithi170.stdout:1/235: rename d3/c3e to d3/d24/d34/d4a/c4f 0 2024-02-15T22:51:14.390 INFO:tasks.workunit.client.1.smithi170.stdout:1/236: creat d3/d24/d34/f50 x:0 0 0 2024-02-15T22:51:14.390 INFO:tasks.workunit.client.1.smithi170.stdout:1/237: creat d3/d24/f51 x:0 0 0 2024-02-15T22:51:14.390 INFO:tasks.workunit.client.1.smithi170.stdout:9/233: mknod de/d1b/d1c/d1f/d20/c49 0 2024-02-15T22:51:14.393 INFO:tasks.workunit.client.1.smithi170.stdout:5/323: creat de/d10/d27/d4c/f6c x:0 0 0 2024-02-15T22:51:14.393 INFO:tasks.workunit.client.1.smithi170.stdout:5/324: chown de/f4b 63205 1 2024-02-15T22:51:14.396 INFO:tasks.workunit.client.1.smithi170.stdout:1/238: link d3/d24/d2c/f2f d3/d24/d2c/d35/f52 0 2024-02-15T22:51:14.396 INFO:tasks.workunit.client.1.smithi170.stdout:1/239: truncate d3/d24/d34/f39 350769 0 2024-02-15T22:51:14.396 INFO:tasks.workunit.client.1.smithi170.stdout:5/325: symlink de/d10/l6d 0 2024-02-15T22:51:14.398 INFO:tasks.workunit.client.1.smithi170.stdout:1/240: truncate d3/f15 3532554 0 2024-02-15T22:51:14.398 INFO:tasks.workunit.client.1.smithi170.stdout:1/241: write d3/fb [974778,130023] 0 2024-02-15T22:51:14.398 INFO:tasks.workunit.client.1.smithi170.stdout:1/242: fdatasync d3/d24/f36 0 2024-02-15T22:51:14.400 INFO:tasks.workunit.client.1.smithi170.stdout:5/326: link de/d10/d27/d2d/f65 de/d10/d27/d4c/f6e 0 2024-02-15T22:51:14.402 INFO:tasks.workunit.client.1.smithi170.stdout:9/234: read fc [4097402,64716] 0 2024-02-15T22:51:14.410 INFO:tasks.workunit.client.1.smithi170.stdout:5/327: dread de/d10/d27/d2d/f47 [0,4194304] 0 2024-02-15T22:51:14.410 INFO:tasks.workunit.client.1.smithi170.stdout:5/328: dread - de/d10/f5b zero size 2024-02-15T22:51:14.414 INFO:tasks.workunit.client.1.smithi170.stdout:5/329: creat de/d10/d27/d4c/d53/d55/f6f x:0 0 0 2024-02-15T22:51:14.414 INFO:tasks.workunit.client.1.smithi170.stdout:5/330: truncate de/f3f 4577527 0 2024-02-15T22:51:14.415 INFO:tasks.workunit.client.1.smithi170.stdout:5/331: mknod de/d10/c70 0 2024-02-15T22:51:14.417 INFO:tasks.workunit.client.1.smithi170.stdout:1/243: dwrite d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:14.417 INFO:tasks.workunit.client.1.smithi170.stdout:1/244: write d3/f1f [137487,3292] 0 2024-02-15T22:51:14.420 INFO:tasks.workunit.client.1.smithi170.stdout:1/245: dread d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:14.422 INFO:tasks.workunit.client.1.smithi170.stdout:1/246: symlink d3/d24/d34/d4a/l53 0 2024-02-15T22:51:14.424 INFO:tasks.workunit.client.1.smithi170.stdout:1/247: rename d3/d24/d34/d4a/l53 to d3/d24/l54 0 2024-02-15T22:51:14.433 INFO:tasks.workunit.client.1.smithi170.stdout:5/332: dwrite de/f4b [4194304,4194304] 0 2024-02-15T22:51:14.433 INFO:tasks.workunit.client.1.smithi170.stdout:5/333: stat de/d29/f5a 0 2024-02-15T22:51:14.442 INFO:tasks.workunit.client.1.smithi170.stdout:1/248: dwrite d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:14.444 INFO:tasks.workunit.client.1.smithi170.stdout:1/249: rename d3/l31 to d3/l55 0 2024-02-15T22:51:14.445 INFO:tasks.workunit.client.1.smithi170.stdout:1/250: symlink d3/d24/d2c/d35/l56 0 2024-02-15T22:51:14.445 INFO:tasks.workunit.client.1.smithi170.stdout:1/251: creat d3/d24/d34/f57 x:0 0 0 2024-02-15T22:51:14.448 INFO:tasks.workunit.client.1.smithi170.stdout:1/252: mknod d3/d24/d34/c58 0 2024-02-15T22:51:14.449 INFO:tasks.workunit.client.1.smithi170.stdout:1/253: write d3/d24/d2c/f30 [613796,90360] 0 2024-02-15T22:51:14.449 INFO:tasks.workunit.client.1.smithi170.stdout:1/254: stat d3/d24/d2c/d35/c42 0 2024-02-15T22:51:14.452 INFO:tasks.workunit.client.1.smithi170.stdout:1/255: link d3/d24/d34/f3b d3/d24/d2c/f59 0 2024-02-15T22:51:14.452 INFO:tasks.workunit.client.1.smithi170.stdout:1/256: write d3/d24/d34/f46 [810390,116063] 0 2024-02-15T22:51:14.452 INFO:tasks.workunit.client.1.smithi170.stdout:1/257: chown d3/d24/l33 856942577 1 2024-02-15T22:51:14.452 INFO:tasks.workunit.client.1.smithi170.stdout:1/258: write d3/d24/d34/f46 [1824713,24385] 0 2024-02-15T22:51:14.453 INFO:tasks.workunit.client.1.smithi170.stdout:1/259: symlink d3/d24/d34/l5a 0 2024-02-15T22:51:14.454 INFO:tasks.workunit.client.1.smithi170.stdout:1/260: mknod d3/c5b 0 2024-02-15T22:51:14.454 INFO:tasks.workunit.client.1.smithi170.stdout:1/261: chown d3/d24/f27 29 1 2024-02-15T22:51:14.465 INFO:tasks.workunit.client.1.smithi170.stdout:5/334: dwrite de/d10/d33/f42 [0,4194304] 0 2024-02-15T22:51:14.480 INFO:tasks.workunit.client.1.smithi170.stdout:5/335: write de/f1a [3869357,116939] 0 2024-02-15T22:51:14.481 INFO:tasks.workunit.client.1.smithi170.stdout:5/336: symlink de/d36/l71 0 2024-02-15T22:51:14.501 INFO:tasks.workunit.client.1.smithi170.stdout:5/337: dwrite de/d10/d27/f2a [0,4194304] 0 2024-02-15T22:51:14.510 INFO:tasks.workunit.client.1.smithi170.stdout:5/338: read de/d10/f13 [691660,31394] 0 2024-02-15T22:51:14.511 INFO:tasks.workunit.client.1.smithi170.stdout:5/339: mknod de/d10/d52/c72 0 2024-02-15T22:51:14.511 INFO:tasks.workunit.client.1.smithi170.stdout:5/340: truncate de/d10/d27/d4c/d53/f60 783559 0 2024-02-15T22:51:14.511 INFO:tasks.workunit.client.1.smithi170.stdout:5/341: creat de/d10/d52/f73 x:0 0 0 2024-02-15T22:51:14.511 INFO:tasks.workunit.client.1.smithi170.stdout:5/342: dread - de/d10/d52/f73 zero size 2024-02-15T22:51:14.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/343: creat de/d36/f74 x:0 0 0 2024-02-15T22:51:14.512 INFO:tasks.workunit.client.1.smithi170.stdout:5/344: stat de/d10/d27/d4c/d53/d55/c64 0 2024-02-15T22:51:14.513 INFO:tasks.workunit.client.1.smithi170.stdout:5/345: mknod de/d10/d27/d2d/c75 0 2024-02-15T22:51:14.517 INFO:tasks.workunit.client.1.smithi170.stdout:5/346: write de/d10/f32 [2848994,49644] 0 2024-02-15T22:51:14.526 INFO:tasks.workunit.client.1.smithi170.stdout:5/347: write de/d36/f43 [1097514,31434] 0 2024-02-15T22:51:14.528 INFO:tasks.workunit.client.1.smithi170.stdout:5/348: link de/c38 de/d10/d27/d4c/c76 0 2024-02-15T22:51:14.528 INFO:tasks.workunit.client.1.smithi170.stdout:5/349: chown de/d10/d33/f45 6267536 1 2024-02-15T22:51:14.528 INFO:tasks.workunit.client.1.smithi170.stdout:5/350: read - de/d10/d27/d4c/d53/f63 zero size 2024-02-15T22:51:14.528 INFO:tasks.workunit.client.1.smithi170.stdout:5/351: chown f0 625111 1 2024-02-15T22:51:14.662 INFO:tasks.workunit.client.1.smithi170.stdout:2/280: sync 2024-02-15T22:51:14.662 INFO:tasks.workunit.client.1.smithi170.stdout:7/266: sync 2024-02-15T22:51:14.662 INFO:tasks.workunit.client.1.smithi170.stdout:8/169: sync 2024-02-15T22:51:14.662 INFO:tasks.workunit.client.1.smithi170.stdout:3/291: sync 2024-02-15T22:51:14.663 INFO:tasks.workunit.client.1.smithi170.stdout:2/281: chown d0/d13/l45 1013125 1 2024-02-15T22:51:14.663 INFO:tasks.workunit.client.1.smithi170.stdout:7/267: mknod da/d1a/d21/d19/c60 0 2024-02-15T22:51:14.663 INFO:tasks.workunit.client.1.smithi170.stdout:7/268: chown da/d1a/d21/d1b/c1f 1719001897 1 2024-02-15T22:51:14.664 INFO:tasks.workunit.client.1.smithi170.stdout:3/292: symlink d3/dc/d1c/d3d/l5e 0 2024-02-15T22:51:14.664 INFO:tasks.workunit.client.1.smithi170.stdout:2/282: mknod d0/d1/d53/c6b 0 2024-02-15T22:51:14.665 INFO:tasks.workunit.client.1.smithi170.stdout:8/170: symlink d9/l2f 0 2024-02-15T22:51:14.666 INFO:tasks.workunit.client.1.smithi170.stdout:3/293: mknod d3/dc/d1c/c5f 0 2024-02-15T22:51:14.666 INFO:tasks.workunit.client.1.smithi170.stdout:3/294: fdatasync d3/dc/d13/f43 0 2024-02-15T22:51:14.666 INFO:tasks.workunit.client.1.smithi170.stdout:3/295: creat d3/dc/f60 x:0 0 0 2024-02-15T22:51:14.667 INFO:tasks.workunit.client.1.smithi170.stdout:2/283: rename d0/d13/c41 to d0/d28/d2f/c6c 0 2024-02-15T22:51:14.667 INFO:tasks.workunit.client.1.smithi170.stdout:2/284: chown d0/d1d/f22 976925 1 2024-02-15T22:51:14.669 INFO:tasks.workunit.client.1.smithi170.stdout:7/269: getdents da/d1a/d28 0 2024-02-15T22:51:14.669 INFO:tasks.workunit.client.1.smithi170.stdout:7/270: stat da/d1a/d21/d2c 0 2024-02-15T22:51:14.669 INFO:tasks.workunit.client.1.smithi170.stdout:7/271: write da/d1a/d21/f46 [1396576,98559] 0 2024-02-15T22:51:14.671 INFO:tasks.workunit.client.1.smithi170.stdout:8/171: mknod d9/c30 0 2024-02-15T22:51:14.672 INFO:tasks.workunit.client.1.smithi170.stdout:8/172: readlink l3 0 2024-02-15T22:51:14.672 INFO:tasks.workunit.client.1.smithi170.stdout:8/173: write d9/f10 [1912053,124341] 0 2024-02-15T22:51:14.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/174: symlink d9/d18/l31 0 2024-02-15T22:51:14.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/175: read d9/d18/f19 [4021400,123511] 0 2024-02-15T22:51:14.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/176: readlink l3 0 2024-02-15T22:51:14.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/177: fsync d9/d18/f23 0 2024-02-15T22:51:14.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/178: read d9/f1d [2327651,6832] 0 2024-02-15T22:51:14.676 INFO:tasks.workunit.client.1.smithi170.stdout:2/285: dread d0/d1/fe [0,4194304] 0 2024-02-15T22:51:14.677 INFO:tasks.workunit.client.1.smithi170.stdout:2/286: rename d0/d1/f8 to d0/d28/d2f/d37/d58/f6d 0 2024-02-15T22:51:14.678 INFO:tasks.workunit.client.1.smithi170.stdout:2/287: fdatasync d0/d28/f5d 0 2024-02-15T22:51:14.691 INFO:tasks.workunit.client.1.smithi170.stdout:7/272: dwrite da/d1a/d21/d2c/d2e/f35 [0,4194304] 0 2024-02-15T22:51:14.691 INFO:tasks.workunit.client.1.smithi170.stdout:7/273: write da/f3b [365878,86737] 0 2024-02-15T22:51:14.693 INFO:tasks.workunit.client.1.smithi170.stdout:7/274: mkdir da/d1a/d21/d4d/d59/d61 0 2024-02-15T22:51:14.694 INFO:tasks.workunit.client.1.smithi170.stdout:7/275: unlink da/f3f 0 2024-02-15T22:51:14.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/276: unlink da/d1a/d21/d19/f20 0 2024-02-15T22:51:14.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/277: dread - da/d1a/d21/d4d/d59/f5e zero size 2024-02-15T22:51:14.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/278: readlink da/d1a/d21/l31 0 2024-02-15T22:51:14.701 INFO:tasks.workunit.client.1.smithi170.stdout:8/179: dwrite d9/d18/f1e [4194304,4194304] 0 2024-02-15T22:51:14.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/288: dwrite d0/d1/f9 [0,4194304] 0 2024-02-15T22:51:14.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/289: fdatasync d0/d1/d31/f34 0 2024-02-15T22:51:14.705 INFO:tasks.workunit.client.1.smithi170.stdout:2/290: write d0/d1d/d3d/f4c [606631,5712] 0 2024-02-15T22:51:14.706 INFO:tasks.workunit.client.1.smithi170.stdout:2/291: chown d0/d28/d3e/f43 13 1 2024-02-15T22:51:14.707 INFO:tasks.workunit.client.1.smithi170.stdout:2/292: mkdir d0/d1/d11/d26/d6e 0 2024-02-15T22:51:14.707 INFO:tasks.workunit.client.1.smithi170.stdout:2/293: creat d0/d1/f6f x:0 0 0 2024-02-15T22:51:14.709 INFO:tasks.workunit.client.1.smithi170.stdout:2/294: symlink d0/d28/l70 0 2024-02-15T22:51:14.709 INFO:tasks.workunit.client.1.smithi170.stdout:8/180: dread d9/d18/f1e [4194304,4194304] 0 2024-02-15T22:51:14.710 INFO:tasks.workunit.client.1.smithi170.stdout:8/181: readlink d9/l22 0 2024-02-15T22:51:14.710 INFO:tasks.workunit.client.1.smithi170.stdout:8/182: write d9/f17 [736283,112351] 0 2024-02-15T22:51:14.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/295: rename d0/c16 to d0/d1/c71 0 2024-02-15T22:51:14.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/296: chown d0/d28/c47 187038883 1 2024-02-15T22:51:14.711 INFO:tasks.workunit.client.1.smithi170.stdout:7/279: dwrite da/fe [4194304,4194304] 0 2024-02-15T22:51:14.713 INFO:tasks.workunit.client.1.smithi170.stdout:2/297: unlink d0/d1/d11/f2d 0 2024-02-15T22:51:14.713 INFO:tasks.workunit.client.1.smithi170.stdout:2/298: read - d0/d1/f4d zero size 2024-02-15T22:51:14.714 INFO:tasks.workunit.client.1.smithi170.stdout:8/183: mkdir d9/d18/d32 0 2024-02-15T22:51:14.714 INFO:tasks.workunit.client.1.smithi170.stdout:8/184: readlink d9/lb 0 2024-02-15T22:51:14.714 INFO:tasks.workunit.client.1.smithi170.stdout:8/185: write d9/f1d [4302655,129603] 0 2024-02-15T22:51:14.715 INFO:tasks.workunit.client.1.smithi170.stdout:2/299: truncate d0/d1/fc 260453 0 2024-02-15T22:51:14.718 INFO:tasks.workunit.client.1.smithi170.stdout:2/300: symlink d0/d28/d2f/l72 0 2024-02-15T22:51:14.719 INFO:tasks.workunit.client.1.smithi170.stdout:7/280: read da/d1a/d21/d2c/d2e/f35 [440880,205] 0 2024-02-15T22:51:14.719 INFO:tasks.workunit.client.1.smithi170.stdout:8/186: rename d9/c2e to d9/d18/c33 0 2024-02-15T22:51:14.723 INFO:tasks.workunit.client.1.smithi170.stdout:2/301: link d0/d28/d3e/f60 d0/d1d/f73 0 2024-02-15T22:51:14.724 INFO:tasks.workunit.client.1.smithi170.stdout:8/187: rename d9/d18/l20 to d9/d18/d32/l34 0 2024-02-15T22:51:14.724 INFO:tasks.workunit.client.1.smithi170.stdout:2/302: dread d0/d1/d31/f49 [0,4194304] 0 2024-02-15T22:51:14.726 INFO:tasks.workunit.client.1.smithi170.stdout:2/303: mkdir d0/d1/d5f/d74 0 2024-02-15T22:51:14.726 INFO:tasks.workunit.client.1.smithi170.stdout:2/304: fsync d0/d28/f5d 0 2024-02-15T22:51:14.728 INFO:tasks.workunit.client.1.smithi170.stdout:8/188: write d9/fd [6993576,121251] 0 2024-02-15T22:51:14.728 INFO:tasks.workunit.client.1.smithi170.stdout:8/189: dread - d9/d18/f23 zero size 2024-02-15T22:51:14.732 INFO:tasks.workunit.client.1.smithi170.stdout:7/281: write da/d1a/f27 [7213727,19756] 0 2024-02-15T22:51:14.735 INFO:tasks.workunit.client.1.smithi170.stdout:7/282: dread da/f25 [0,4194304] 0 2024-02-15T22:51:14.736 INFO:tasks.workunit.client.1.smithi170.stdout:8/190: getdents d9 0 2024-02-15T22:51:14.737 INFO:tasks.workunit.client.1.smithi170.stdout:8/191: mknod d9/d18/d26/c35 0 2024-02-15T22:51:14.740 INFO:tasks.workunit.client.1.smithi170.stdout:8/192: link d9/l22 d9/l36 0 2024-02-15T22:51:14.741 INFO:tasks.workunit.client.1.smithi170.stdout:8/193: truncate f7 2481263 0 2024-02-15T22:51:14.746 INFO:tasks.workunit.client.1.smithi170.stdout:2/305: dwrite d0/d1/d31/f49 [0,4194304] 0 2024-02-15T22:51:14.746 INFO:tasks.workunit.client.1.smithi170.stdout:7/283: dread da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:14.748 INFO:tasks.workunit.client.1.smithi170.stdout:7/284: rename da/d1a/d28/c29 to da/d1a/d28/c62 0 2024-02-15T22:51:14.749 INFO:tasks.workunit.client.1.smithi170.stdout:2/306: mknod d0/d28/d2f/c75 0 2024-02-15T22:51:14.749 INFO:tasks.workunit.client.1.smithi170.stdout:2/307: dread - d0/d1/d31/f5a zero size 2024-02-15T22:51:14.750 INFO:tasks.workunit.client.1.smithi170.stdout:7/285: mkdir da/d63 0 2024-02-15T22:51:14.750 INFO:tasks.workunit.client.1.smithi170.stdout:7/286: write da/f13 [4651108,36172] 0 2024-02-15T22:51:14.751 INFO:tasks.workunit.client.1.smithi170.stdout:2/308: mkdir d0/d1d/d3d/d76 0 2024-02-15T22:51:14.752 INFO:tasks.workunit.client.1.smithi170.stdout:7/287: creat da/f64 x:0 0 0 2024-02-15T22:51:14.754 INFO:tasks.workunit.client.1.smithi170.stdout:2/309: creat d0/d2a/f77 x:0 0 0 2024-02-15T22:51:14.754 INFO:tasks.workunit.client.1.smithi170.stdout:2/310: stat d0/cd 0 2024-02-15T22:51:14.754 INFO:tasks.workunit.client.1.smithi170.stdout:2/311: fdatasync d0/d1/d11/f29 0 2024-02-15T22:51:14.754 INFO:tasks.workunit.client.1.smithi170.stdout:2/312: stat d0/d28/d2f/f62 0 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/288: mknod da/d1a/d28/c65 0 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/289: readlink da/l41 0 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/290: creat da/d1a/d21/d4d/d59/f66 x:0 0 0 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/291: chown da/d1a/d28/l34 0 1 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/292: truncate da/f25 1344040 0 2024-02-15T22:51:14.755 INFO:tasks.workunit.client.1.smithi170.stdout:7/293: dread - da/d1a/d21/d4d/d59/f66 zero size 2024-02-15T22:51:14.756 INFO:tasks.workunit.client.1.smithi170.stdout:2/313: rename d0/d28/d3e/d4a to d0/d28/d2f/d37/d58/d78 0 2024-02-15T22:51:14.756 INFO:tasks.workunit.client.1.smithi170.stdout:2/314: read d0/d1/fc [22389,2755] 0 2024-02-15T22:51:14.759 INFO:tasks.workunit.client.1.smithi170.stdout:2/315: rename d0/d2a/l2e to d0/d1/d53/l79 0 2024-02-15T22:51:14.760 INFO:tasks.workunit.client.1.smithi170.stdout:2/316: dread d0/d2a/f2b [0,4194304] 0 2024-02-15T22:51:14.762 INFO:tasks.workunit.client.1.smithi170.stdout:8/194: dwrite d9/f2d [0,4194304] 0 2024-02-15T22:51:14.762 INFO:tasks.workunit.client.1.smithi170.stdout:2/317: rename d0/d1/f4 to d0/d28/f7a 0 2024-02-15T22:51:14.763 INFO:tasks.workunit.client.1.smithi170.stdout:2/318: write d0/d1/d31/f5a [47949,126201] 0 2024-02-15T22:51:14.767 INFO:tasks.workunit.client.1.smithi170.stdout:2/319: unlink d0/d13/f52 0 2024-02-15T22:51:14.769 INFO:tasks.workunit.client.1.smithi170.stdout:7/294: dwrite da/f12 [8388608,4194304] 0 2024-02-15T22:51:14.770 INFO:tasks.workunit.client.1.smithi170.stdout:7/295: symlink da/d1a/d21/d4d/d59/l67 0 2024-02-15T22:51:14.771 INFO:tasks.workunit.client.1.smithi170.stdout:7/296: symlink da/d1a/d28/l68 0 2024-02-15T22:51:14.773 INFO:tasks.workunit.client.1.smithi170.stdout:7/297: mkdir da/d1a/d21/d1b/d69 0 2024-02-15T22:51:14.793 INFO:tasks.workunit.client.1.smithi170.stdout:8/195: dwrite d9/d18/f19 [0,4194304] 0 2024-02-15T22:51:14.794 INFO:tasks.workunit.client.1.smithi170.stdout:8/196: rmdir d9/d18/d26 39 2024-02-15T22:51:14.794 INFO:tasks.workunit.client.1.smithi170.stdout:2/320: dwrite d0/d28/f56 [0,4194304] 0 2024-02-15T22:51:14.798 INFO:tasks.workunit.client.1.smithi170.stdout:2/321: symlink d0/d13/l7b 0 2024-02-15T22:51:14.799 INFO:tasks.workunit.client.1.smithi170.stdout:2/322: creat d0/d28/d2f/d37/f7c x:0 0 0 2024-02-15T22:51:14.799 INFO:tasks.workunit.client.1.smithi170.stdout:2/323: stat d0/d1 0 2024-02-15T22:51:14.801 INFO:tasks.workunit.client.1.smithi170.stdout:2/324: rename d0/d1/d11/d26/c68 to d0/d1/d31/c7d 0 2024-02-15T22:51:14.806 INFO:tasks.workunit.client.1.smithi170.stdout:8/197: dread d9/f2d [0,4194304] 0 2024-02-15T22:51:14.808 INFO:tasks.workunit.client.1.smithi170.stdout:0/230: sync 2024-02-15T22:51:14.809 INFO:tasks.workunit.client.1.smithi170.stdout:0/231: creat d8/df/d13/d22/d39/f4f x:0 0 0 2024-02-15T22:51:14.809 INFO:tasks.workunit.client.1.smithi170.stdout:8/198: dread d9/f16 [4194304,4194304] 0 2024-02-15T22:51:14.810 INFO:tasks.workunit.client.1.smithi170.stdout:0/232: mknod d8/d14/d1c/d3f/c50 0 2024-02-15T22:51:14.813 INFO:tasks.workunit.client.1.smithi170.stdout:0/233: mkdir d8/d14/d1c/d3f/d51 0 2024-02-15T22:51:14.813 INFO:tasks.workunit.client.1.smithi170.stdout:2/325: rmdir d0/d28 39 2024-02-15T22:51:14.813 INFO:tasks.workunit.client.1.smithi170.stdout:2/326: write d0/d28/f5d [345320,120809] 0 2024-02-15T22:51:14.815 INFO:tasks.workunit.client.1.smithi170.stdout:8/199: rename d9/d18/c2a to d9/d18/c37 0 2024-02-15T22:51:14.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/200: creat d9/f38 x:0 0 0 2024-02-15T22:51:14.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/201: fsync d9/f17 0 2024-02-15T22:51:14.819 INFO:tasks.workunit.client.1.smithi170.stdout:8/202: creat d9/f39 x:0 0 0 2024-02-15T22:51:14.819 INFO:tasks.workunit.client.1.smithi170.stdout:8/203: truncate d9/d18/f23 451346 0 2024-02-15T22:51:14.820 INFO:tasks.workunit.client.1.smithi170.stdout:8/204: creat d9/d18/d32/f3a x:0 0 0 2024-02-15T22:51:14.821 INFO:tasks.workunit.client.1.smithi170.stdout:0/234: rmdir d8/d14/d1c 39 2024-02-15T22:51:14.821 INFO:tasks.workunit.client.1.smithi170.stdout:0/235: stat d8/f1b 0 2024-02-15T22:51:14.822 INFO:tasks.workunit.client.1.smithi170.stdout:0/236: rename c7 to d8/d14/d44/c52 0 2024-02-15T22:51:14.824 INFO:tasks.workunit.client.1.smithi170.stdout:0/237: truncate d8/df/d13/d22/f4b 1511076 0 2024-02-15T22:51:14.826 INFO:tasks.workunit.client.1.smithi170.stdout:8/205: dread f7 [0,4194304] 0 2024-02-15T22:51:14.826 INFO:tasks.workunit.client.1.smithi170.stdout:8/206: write d9/fd [4761224,23147] 0 2024-02-15T22:51:14.828 INFO:tasks.workunit.client.1.smithi170.stdout:8/207: unlink d9/f11 0 2024-02-15T22:51:14.832 INFO:tasks.workunit.client.1.smithi170.stdout:2/327: dwrite d0/d1/d11/f38 [0,4194304] 0 2024-02-15T22:51:14.837 INFO:tasks.workunit.client.1.smithi170.stdout:2/328: dread d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:14.905 INFO:tasks.workunit.client.1.smithi170.stdout:4/272: sync 2024-02-15T22:51:14.906 INFO:tasks.workunit.client.1.smithi170.stdout:4/273: mknod d0/d22/da/d11/c4e 0 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:6/326: sync 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:1/262: sync 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:5/352: sync 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:3/296: sync 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:3/297: dread - d3/dc/f60 zero size 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:9/235: sync 2024-02-15T22:51:15.018 INFO:tasks.workunit.client.1.smithi170.stdout:9/236: fdatasync de/d1b/d1c/d1f/d20/d27/d2c/f44 0 2024-02-15T22:51:15.019 INFO:tasks.workunit.client.1.smithi170.stdout:1/263: rename d3/ce to d3/d24/d34/c5c 0 2024-02-15T22:51:15.019 INFO:tasks.workunit.client.1.smithi170.stdout:9/237: rename de/d1b to de/d1b/d1c/d1f/d20/d4a 22 2024-02-15T22:51:15.020 INFO:tasks.workunit.client.1.smithi170.stdout:1/264: truncate d3/d24/d2c/d35/f48 791470 0 2024-02-15T22:51:15.020 INFO:tasks.workunit.client.1.smithi170.stdout:1/265: fdatasync d3/d24/d2c/f2f 0 2024-02-15T22:51:15.020 INFO:tasks.workunit.client.1.smithi170.stdout:1/266: fsync d3/f10 0 2024-02-15T22:51:15.020 INFO:tasks.workunit.client.1.smithi170.stdout:3/298: mkdir d3/db/d1f/d61 0 2024-02-15T22:51:15.020 INFO:tasks.workunit.client.1.smithi170.stdout:5/353: dread f7 [0,4194304] 0 2024-02-15T22:51:15.021 INFO:tasks.workunit.client.1.smithi170.stdout:9/238: link de/l45 de/d1b/l4b 0 2024-02-15T22:51:15.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/267: mknod d3/c5d 0 2024-02-15T22:51:15.022 INFO:tasks.workunit.client.1.smithi170.stdout:3/299: truncate d3/f9 4057171 0 2024-02-15T22:51:15.023 INFO:tasks.workunit.client.1.smithi170.stdout:5/354: rename de/d29/l57 to de/d29/l77 0 2024-02-15T22:51:15.024 INFO:tasks.workunit.client.1.smithi170.stdout:9/239: mkdir de/d1b/d1c/d1f/d4c 0 2024-02-15T22:51:15.024 INFO:tasks.workunit.client.1.smithi170.stdout:9/240: chown de/l16 683 1 2024-02-15T22:51:15.027 INFO:tasks.workunit.client.1.smithi170.stdout:3/300: rename d3/dc/d1c/l34 to d3/l62 0 2024-02-15T22:51:15.027 INFO:tasks.workunit.client.1.smithi170.stdout:3/301: creat d3/dc/d1c/d3d/f63 x:0 0 0 2024-02-15T22:51:15.029 INFO:tasks.workunit.client.1.smithi170.stdout:6/327: dread d3/f4 [0,4194304] 0 2024-02-15T22:51:15.030 INFO:tasks.workunit.client.1.smithi170.stdout:6/328: write d3/d24/d31/f34 [361911,385] 0 2024-02-15T22:51:15.030 INFO:tasks.workunit.client.1.smithi170.stdout:9/241: creat de/d1b/d1c/d47/f4d x:0 0 0 2024-02-15T22:51:15.033 INFO:tasks.workunit.client.1.smithi170.stdout:9/242: creat de/f4e x:0 0 0 2024-02-15T22:51:15.033 INFO:tasks.workunit.client.1.smithi170.stdout:5/355: dread de/f3f [0,4194304] 0 2024-02-15T22:51:15.036 INFO:tasks.workunit.client.1.smithi170.stdout:5/356: creat de/d10/d27/d2d/d51/f78 x:0 0 0 2024-02-15T22:51:15.036 INFO:tasks.workunit.client.1.smithi170.stdout:5/357: readlink de/d10/l5c 0 2024-02-15T22:51:15.036 INFO:tasks.workunit.client.1.smithi170.stdout:5/358: creat de/d10/d27/d4c/d53/d55/f79 x:0 0 0 2024-02-15T22:51:15.037 INFO:tasks.workunit.client.1.smithi170.stdout:5/359: mknod de/d10/d27/d4c/d53/d55/c7a 0 2024-02-15T22:51:15.038 INFO:tasks.workunit.client.1.smithi170.stdout:5/360: symlink de/d10/d27/d4c/d53/l7b 0 2024-02-15T22:51:15.039 INFO:tasks.workunit.client.1.smithi170.stdout:1/268: dwrite d3/f15 [0,4194304] 0 2024-02-15T22:51:15.041 INFO:tasks.workunit.client.1.smithi170.stdout:3/302: dread d3/f14 [0,4194304] 0 2024-02-15T22:51:15.042 INFO:tasks.workunit.client.1.smithi170.stdout:3/303: truncate d3/dc/d1c/f1e 3900363 0 2024-02-15T22:51:15.063 INFO:tasks.workunit.client.1.smithi170.stdout:6/329: dwrite d3/d1d/d27/f5b [0,4194304] 0 2024-02-15T22:51:15.064 INFO:tasks.workunit.client.1.smithi170.stdout:5/361: dwrite de/f21 [0,4194304] 0 2024-02-15T22:51:15.068 INFO:tasks.workunit.client.1.smithi170.stdout:6/330: getdents d3/d1d/d53/d5f 0 2024-02-15T22:51:15.068 INFO:tasks.workunit.client.1.smithi170.stdout:6/331: chown d3/f4 1735395 1 2024-02-15T22:51:15.069 INFO:tasks.workunit.client.1.smithi170.stdout:5/362: mkdir de/d10/d27/d2d/d51/d7c 0 2024-02-15T22:51:15.070 INFO:tasks.workunit.client.1.smithi170.stdout:5/363: write de/f16 [2167990,17894] 0 2024-02-15T22:51:15.070 INFO:tasks.workunit.client.1.smithi170.stdout:5/364: write de/d10/f5b [444215,113445] 0 2024-02-15T22:51:15.071 INFO:tasks.workunit.client.1.smithi170.stdout:6/332: truncate d3/d1d/d36/f22 3777042 0 2024-02-15T22:51:15.071 INFO:tasks.workunit.client.1.smithi170.stdout:6/333: fdatasync d3/d1d/d36/f11 0 2024-02-15T22:51:15.071 INFO:tasks.workunit.client.1.smithi170.stdout:6/334: truncate d3/d1d/d27/f43 967554 0 2024-02-15T22:51:15.071 INFO:tasks.workunit.client.1.smithi170.stdout:6/335: truncate d3/d1d/d28/f75 849688 0 2024-02-15T22:51:15.110 INFO:tasks.workunit.client.1.smithi170.stdout:9/243: dwrite de/d1b/d1c/f2d [0,4194304] 0 2024-02-15T22:51:15.111 INFO:tasks.workunit.client.1.smithi170.stdout:9/244: readlink de/l41 0 2024-02-15T22:51:15.111 INFO:tasks.workunit.client.1.smithi170.stdout:9/245: creat de/d1b/f4f x:0 0 0 2024-02-15T22:51:15.112 INFO:tasks.workunit.client.1.smithi170.stdout:8/208: sync 2024-02-15T22:51:15.112 INFO:tasks.workunit.client.1.smithi170.stdout:0/238: sync 2024-02-15T22:51:15.112 INFO:tasks.workunit.client.1.smithi170.stdout:7/298: sync 2024-02-15T22:51:15.112 INFO:tasks.workunit.client.1.smithi170.stdout:8/209: fdatasync d9/f16 0 2024-02-15T22:51:15.119 INFO:tasks.workunit.client.1.smithi170.stdout:6/336: dwrite d3/d1a/f33 [0,4194304] 0 2024-02-15T22:51:15.119 INFO:tasks.workunit.client.1.smithi170.stdout:9/246: getdents de/d1b/d1c/d1f/d20 0 2024-02-15T22:51:15.124 INFO:tasks.workunit.client.1.smithi170.stdout:9/247: dread de/f14 [0,4194304] 0 2024-02-15T22:51:15.125 INFO:tasks.workunit.client.1.smithi170.stdout:6/337: link d3/d1a/f33 d3/d1d/f7b 0 2024-02-15T22:51:15.126 INFO:tasks.workunit.client.1.smithi170.stdout:9/248: getdents de/d1b/d1c 0 2024-02-15T22:51:15.203 INFO:tasks.workunit.client.1.smithi170.stdout:6/338: dread d3/d1d/d28/f47 [0,4194304] 0 2024-02-15T22:51:15.218 INFO:tasks.workunit.client.1.smithi170.stdout:6/339: dread d3/d24/d31/f49 [0,4194304] 0 2024-02-15T22:51:15.218 INFO:tasks.workunit.client.1.smithi170.stdout:6/340: chown d3/d24/l65 1774195287 1 2024-02-15T22:51:15.218 INFO:tasks.workunit.client.1.smithi170.stdout:6/341: dread - d3/d1d/d36/d51/f63 zero size 2024-02-15T22:51:15.219 INFO:tasks.workunit.client.1.smithi170.stdout:6/342: symlink d3/l7c 0 2024-02-15T22:51:15.219 INFO:tasks.workunit.client.1.smithi170.stdout:6/343: read d3/d1a/f40 [2824009,41430] 0 2024-02-15T22:51:15.219 INFO:tasks.workunit.client.1.smithi170.stdout:6/344: read d3/d1d/d36/f11 [43789,67693] 0 2024-02-15T22:51:15.219 INFO:tasks.workunit.client.1.smithi170.stdout:6/345: stat d3/d24 0 2024-02-15T22:51:15.220 INFO:tasks.workunit.client.1.smithi170.stdout:6/346: unlink d3/d1d/d28/d3b/d2f/l46 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/249: dwrite de/d1b/d1c/d1f/d20/d27/f29 [4194304,4194304] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/250: read fb [3473431,98429] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/251: dread - de/d1b/d1c/d1f/f36 zero size 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:8/210: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:8/211: write d9/f39 [576186,78513] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:7/299: dwrite da/f38 [0,4194304] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:0/239: dwrite d8/f1b [0,4194304] 0 2024-02-15T22:51:15.229 INFO:tasks.workunit.client.1.smithi170.stdout:0/240: stat d8/df/d13/d36 0 2024-02-15T22:51:15.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/241: read d8/df/d13/f1f [951487,52682] 0 2024-02-15T22:51:15.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/242: fdatasync d8/df/d13/f1f 0 2024-02-15T22:51:15.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/243: readlink d8/d14/d1c/l43 0 2024-02-15T22:51:15.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/244: write d8/df/f12 [495185,81532] 0 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:9/252: symlink de/d1b/d37/l50 0 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:2/329: sync 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/274: sync 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/275: fsync d0/d22/da/f16 0 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/212: rmdir d9/d18/d26 39 2024-02-15T22:51:15.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/213: fsync f7 0 2024-02-15T22:51:15.235 INFO:tasks.workunit.client.1.smithi170.stdout:7/300: creat da/d1a/d21/d2c/f6a x:0 0 0 2024-02-15T22:51:15.235 INFO:tasks.workunit.client.1.smithi170.stdout:7/301: chown da/d1a/d21/d4d/d59/f66 92387736 1 2024-02-15T22:51:15.239 INFO:tasks.workunit.client.1.smithi170.stdout:0/245: truncate f5 2575077 0 2024-02-15T22:51:15.239 INFO:tasks.workunit.client.1.smithi170.stdout:0/246: read - d8/df/d13/f42 zero size 2024-02-15T22:51:15.240 INFO:tasks.workunit.client.1.smithi170.stdout:9/253: mknod de/d1b/d37/c51 0 2024-02-15T22:51:15.241 INFO:tasks.workunit.client.1.smithi170.stdout:2/330: link d0/d28/f7a d0/d1/d53/f7e 0 2024-02-15T22:51:15.242 INFO:tasks.workunit.client.1.smithi170.stdout:8/214: unlink d9/d18/c2b 0 2024-02-15T22:51:15.244 INFO:tasks.workunit.client.1.smithi170.stdout:7/302: symlink da/d1a/d21/d1b/l6b 0 2024-02-15T22:51:15.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/254: mknod de/d1b/d1c/d1f/d20/d27/c52 0 2024-02-15T22:51:15.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/255: chown de/l40 112 1 2024-02-15T22:51:15.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/256: creat de/d1b/f53 x:0 0 0 2024-02-15T22:51:15.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/257: write de/f4e [274793,64763] 0 2024-02-15T22:51:15.246 INFO:tasks.workunit.client.1.smithi170.stdout:8/215: mkdir d9/d18/d32/d3b 0 2024-02-15T22:51:15.250 INFO:tasks.workunit.client.1.smithi170.stdout:7/303: rename da/d1a/f48 to da/d1a/d21/d4d/d59/f6c 0 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:5/365: sync 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:3/304: sync 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:3/305: chown d3/l62 9683338 1 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:3/306: fsync d3/dc/ff 0 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:3/307: creat d3/dc/d1c/f64 x:0 0 0 2024-02-15T22:51:15.252 INFO:tasks.workunit.client.1.smithi170.stdout:1/269: sync 2024-02-15T22:51:15.253 INFO:tasks.workunit.client.1.smithi170.stdout:6/347: dwrite d3/d1a/f5e [0,4194304] 0 2024-02-15T22:51:15.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/276: dwrite d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:15.254 INFO:tasks.workunit.client.1.smithi170.stdout:0/247: write d8/f29 [3952768,92248] 0 2024-02-15T22:51:15.255 INFO:tasks.workunit.client.1.smithi170.stdout:3/308: write d3/dc/f31 [948065,57879] 0 2024-02-15T22:51:15.255 INFO:tasks.workunit.client.1.smithi170.stdout:3/309: chown d3/c15 5318 1 2024-02-15T22:51:15.256 INFO:tasks.workunit.client.1.smithi170.stdout:5/366: mkdir de/d10/d7d 0 2024-02-15T22:51:15.257 INFO:tasks.workunit.client.1.smithi170.stdout:1/270: mkdir d3/d24/d2c/d5e 0 2024-02-15T22:51:15.257 INFO:tasks.workunit.client.1.smithi170.stdout:1/271: dread - d3/d24/d34/d4a/f4d zero size 2024-02-15T22:51:15.258 INFO:tasks.workunit.client.1.smithi170.stdout:8/216: dread d9/f1a [0,4194304] 0 2024-02-15T22:51:15.264 INFO:tasks.workunit.client.1.smithi170.stdout:0/248: rename d8/d14/d32 to d8/d14/d1c/d3f/d53 0 2024-02-15T22:51:15.264 INFO:tasks.workunit.client.1.smithi170.stdout:1/272: creat d3/d24/d2c/d5e/f5f x:0 0 0 2024-02-15T22:51:15.265 INFO:tasks.workunit.client.1.smithi170.stdout:8/217: rmdir d9/d18 39 2024-02-15T22:51:15.267 INFO:tasks.workunit.client.1.smithi170.stdout:4/277: dread d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:15.268 INFO:tasks.workunit.client.1.smithi170.stdout:4/278: creat d0/d22/da/d32/f4f x:0 0 0 2024-02-15T22:51:15.268 INFO:tasks.workunit.client.1.smithi170.stdout:4/279: chown d0/d22/da/d32/d47/d2b 7562 1 2024-02-15T22:51:15.268 INFO:tasks.workunit.client.1.smithi170.stdout:5/367: rename de/d10/d27/d2d/c59 to de/d10/d27/d2d/d51/c7e 0 2024-02-15T22:51:15.271 INFO:tasks.workunit.client.1.smithi170.stdout:0/249: mknod d8/df/d13/c54 0 2024-02-15T22:51:15.271 INFO:tasks.workunit.client.1.smithi170.stdout:0/250: write d8/d14/d44/f4c [436475,52808] 0 2024-02-15T22:51:15.272 INFO:tasks.workunit.client.1.smithi170.stdout:6/348: dread d3/fa [0,4194304] 0 2024-02-15T22:51:15.278 INFO:tasks.workunit.client.1.smithi170.stdout:4/280: unlink d0/d22/da/d32/d47/c2c 0 2024-02-15T22:51:15.280 INFO:tasks.workunit.client.1.smithi170.stdout:5/368: link de/l2f de/d10/d27/d4c/l7f 0 2024-02-15T22:51:15.280 INFO:tasks.workunit.client.1.smithi170.stdout:5/369: chown de/f26 458151313 1 2024-02-15T22:51:15.281 INFO:tasks.workunit.client.1.smithi170.stdout:6/349: rename d3/d1d/d28/f75 to d3/d1d/d28/f7d 0 2024-02-15T22:51:15.283 INFO:tasks.workunit.client.1.smithi170.stdout:9/258: dwrite de/f1e [0,4194304] 0 2024-02-15T22:51:15.284 INFO:tasks.workunit.client.1.smithi170.stdout:8/218: rmdir d9 39 2024-02-15T22:51:15.287 INFO:tasks.workunit.client.1.smithi170.stdout:4/281: rename d0/d22/da/f16 to d0/d22/f50 0 2024-02-15T22:51:15.288 INFO:tasks.workunit.client.1.smithi170.stdout:5/370: mkdir de/d36/d80 0 2024-02-15T22:51:15.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/371: read de/d10/d27/d2d/f35 [221413,52087] 0 2024-02-15T22:51:15.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/372: write de/d10/d27/d2d/f35 [274708,32155] 0 2024-02-15T22:51:15.289 INFO:tasks.workunit.client.1.smithi170.stdout:5/373: chown de/d10/d27/d4c/l7f 8 1 2024-02-15T22:51:15.292 INFO:tasks.workunit.client.1.smithi170.stdout:9/259: write de/d1b/d1c/d1f/d20/d27/d28/f33 [300629,35645] 0 2024-02-15T22:51:15.294 INFO:tasks.workunit.client.1.smithi170.stdout:8/219: creat d9/d18/d26/f3c x:0 0 0 2024-02-15T22:51:15.296 INFO:tasks.workunit.client.1.smithi170.stdout:4/282: mkdir d0/d51 0 2024-02-15T22:51:15.299 INFO:tasks.workunit.client.1.smithi170.stdout:9/260: creat de/d1b/d37/f54 x:0 0 0 2024-02-15T22:51:15.300 INFO:tasks.workunit.client.1.smithi170.stdout:4/283: dread d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:15.301 INFO:tasks.workunit.client.1.smithi170.stdout:8/220: mknod d9/d18/d32/c3d 0 2024-02-15T22:51:15.302 INFO:tasks.workunit.client.1.smithi170.stdout:7/304: dwrite da/f3b [0,4194304] 0 2024-02-15T22:51:15.302 INFO:tasks.workunit.client.1.smithi170.stdout:7/305: truncate da/d1a/d21/d4d/d59/f6c 91825 0 2024-02-15T22:51:15.302 INFO:tasks.workunit.client.1.smithi170.stdout:7/306: write da/d1a/d21/d4d/d59/f66 [541389,110904] 0 2024-02-15T22:51:15.302 INFO:tasks.workunit.client.1.smithi170.stdout:3/310: dwrite d3/dc/d1c/f48 [0,4194304] 0 2024-02-15T22:51:15.302 INFO:tasks.workunit.client.1.smithi170.stdout:5/374: getdents de/d10/d27/d4c/d53/d55 0 2024-02-15T22:51:15.307 INFO:tasks.workunit.client.1.smithi170.stdout:4/284: rmdir d0/d51 0 2024-02-15T22:51:15.307 INFO:tasks.workunit.client.1.smithi170.stdout:4/285: truncate d0/d22/da/d11/d20/f23 458182 0 2024-02-15T22:51:15.308 INFO:tasks.workunit.client.1.smithi170.stdout:8/221: link d9/d18/f1e d9/d18/d32/f3e 0 2024-02-15T22:51:15.311 INFO:tasks.workunit.client.1.smithi170.stdout:3/311: truncate d3/dc/f1d 3226967 0 2024-02-15T22:51:15.313 INFO:tasks.workunit.client.1.smithi170.stdout:5/375: rename de/d10/c1c to de/d10/d27/c81 0 2024-02-15T22:51:15.320 INFO:tasks.workunit.client.1.smithi170.stdout:9/261: rmdir de 39 2024-02-15T22:51:15.321 INFO:tasks.workunit.client.1.smithi170.stdout:4/286: link d0/d22/da/d11/f46 d0/d22/da/d32/d47/d2b/f52 0 2024-02-15T22:51:15.321 INFO:tasks.workunit.client.1.smithi170.stdout:9/262: write de/f4e [124881,113401] 0 2024-02-15T22:51:15.322 INFO:tasks.workunit.client.1.smithi170.stdout:8/222: rename d9/f39 to d9/d18/d26/f3f 0 2024-02-15T22:51:15.324 INFO:tasks.workunit.client.1.smithi170.stdout:4/287: link d0/d22/da/f27 d0/d22/da/d11/d20/d49/f53 0 2024-02-15T22:51:15.325 INFO:tasks.workunit.client.1.smithi170.stdout:9/263: symlink de/d1b/l55 0 2024-02-15T22:51:15.327 INFO:tasks.workunit.client.1.smithi170.stdout:3/312: rename d3/dc/d13/l2a to d3/l65 0 2024-02-15T22:51:15.328 INFO:tasks.workunit.client.1.smithi170.stdout:8/223: creat d9/d18/d32/d3b/f40 x:0 0 0 2024-02-15T22:51:15.328 INFO:tasks.workunit.client.1.smithi170.stdout:8/224: readlink d9/l21 0 2024-02-15T22:51:15.328 INFO:tasks.workunit.client.1.smithi170.stdout:8/225: stat d9/ff 0 2024-02-15T22:51:15.329 INFO:tasks.workunit.client.1.smithi170.stdout:4/288: symlink d0/d22/da/d32/l54 0 2024-02-15T22:51:15.330 INFO:tasks.workunit.client.1.smithi170.stdout:3/313: creat d3/dc/d1a/f66 x:0 0 0 2024-02-15T22:51:15.331 INFO:tasks.workunit.client.1.smithi170.stdout:8/226: unlink d9/d18/f19 0 2024-02-15T22:51:15.332 INFO:tasks.workunit.client.1.smithi170.stdout:4/289: mknod d0/d22/da/c55 0 2024-02-15T22:51:15.334 INFO:tasks.workunit.client.1.smithi170.stdout:4/290: mknod d0/d22/da/d11/d20/d49/c56 0 2024-02-15T22:51:15.334 INFO:tasks.workunit.client.1.smithi170.stdout:4/291: truncate d0/d22/da/d11/d20/f3d 720015 0 2024-02-15T22:51:15.334 INFO:tasks.workunit.client.1.smithi170.stdout:4/292: chown d0/d22/cb 4724963 1 2024-02-15T22:51:15.334 INFO:tasks.workunit.client.1.smithi170.stdout:4/293: symlink d0/d22/da/d11/d20/d49/l57 0 2024-02-15T22:51:15.334 INFO:tasks.workunit.client.1.smithi170.stdout:4/294: fsync d0/d22/da/d11/f45 0 2024-02-15T22:51:15.336 INFO:tasks.workunit.client.1.smithi170.stdout:4/295: mkdir d0/d22/da/d58 0 2024-02-15T22:51:15.336 INFO:tasks.workunit.client.1.smithi170.stdout:4/296: write d0/d22/da/d11/d20/d49/f4a [1411690,3220] 0 2024-02-15T22:51:15.337 INFO:tasks.workunit.client.1.smithi170.stdout:4/297: unlink d0/d22/da/d11/f3b 0 2024-02-15T22:51:15.338 INFO:tasks.workunit.client.1.smithi170.stdout:4/298: dread - d0/d22/da/f43 zero size 2024-02-15T22:51:15.338 INFO:tasks.workunit.client.1.smithi170.stdout:4/299: fsync d0/f10 0 2024-02-15T22:51:15.338 INFO:tasks.workunit.client.1.smithi170.stdout:4/300: write d0/d22/da/f2d [686547,61946] 0 2024-02-15T22:51:15.338 INFO:tasks.workunit.client.1.smithi170.stdout:4/301: stat d0/d22/da/l3e 0 2024-02-15T22:51:15.339 INFO:tasks.workunit.client.1.smithi170.stdout:4/302: mknod d0/d22/da/d11/d20/d49/c59 0 2024-02-15T22:51:15.339 INFO:tasks.workunit.client.1.smithi170.stdout:4/303: write d0/d22/da/d11/d20/f4d [781541,128960] 0 2024-02-15T22:51:15.339 INFO:tasks.workunit.client.1.smithi170.stdout:3/314: read d3/f5 [2197644,120496] 0 2024-02-15T22:51:15.340 INFO:tasks.workunit.client.1.smithi170.stdout:3/315: mknod d3/db/d1f/c67 0 2024-02-15T22:51:15.342 INFO:tasks.workunit.client.1.smithi170.stdout:3/316: dread d3/dc/f17 [0,4194304] 0 2024-02-15T22:51:15.342 INFO:tasks.workunit.client.1.smithi170.stdout:3/317: read - d3/dc/d13/f43 zero size 2024-02-15T22:51:15.343 INFO:tasks.workunit.client.1.smithi170.stdout:4/304: getdents d0/d22/da/d32/d47/d2b 0 2024-02-15T22:51:15.344 INFO:tasks.workunit.client.1.smithi170.stdout:4/305: fdatasync d0/d22/da/d32/f48 0 2024-02-15T22:51:15.344 INFO:tasks.workunit.client.1.smithi170.stdout:4/306: dread - d0/d22/da/d11/f30 zero size 2024-02-15T22:51:15.352 INFO:tasks.workunit.client.1.smithi170.stdout:6/350: dwrite d3/d1d/d27/f52 [0,4194304] 0 2024-02-15T22:51:15.352 INFO:tasks.workunit.client.1.smithi170.stdout:6/351: dread - d3/d1d/d36/f58 zero size 2024-02-15T22:51:15.354 INFO:tasks.workunit.client.1.smithi170.stdout:6/352: mknod d3/d1d/d53/d5f/c7e 0 2024-02-15T22:51:15.356 INFO:tasks.workunit.client.1.smithi170.stdout:6/353: mknod d3/d1d/d36/d56/c7f 0 2024-02-15T22:51:15.356 INFO:tasks.workunit.client.1.smithi170.stdout:1/273: dwrite d3/f22 [0,4194304] 0 2024-02-15T22:51:15.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/318: dread d3/db/f12 [0,4194304] 0 2024-02-15T22:51:15.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/319: stat d3/d1b/d2c/f50 0 2024-02-15T22:51:15.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/320: readlink d3/dc/d1a/l20 0 2024-02-15T22:51:15.358 INFO:tasks.workunit.client.1.smithi170.stdout:6/354: creat d3/d1d/d1b/f80 x:0 0 0 2024-02-15T22:51:15.358 INFO:tasks.workunit.client.1.smithi170.stdout:6/355: creat d3/d1d/d1b/d3c/f81 x:0 0 0 2024-02-15T22:51:15.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/321: mknod d3/d1b/c68 0 2024-02-15T22:51:15.360 INFO:tasks.workunit.client.1.smithi170.stdout:3/322: chown d3/db/f35 0 1 2024-02-15T22:51:15.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/356: mkdir d3/d1d/d27/d70/d82 0 2024-02-15T22:51:15.362 INFO:tasks.workunit.client.1.smithi170.stdout:6/357: mknod d3/d1d/d53/d5f/c83 0 2024-02-15T22:51:15.365 INFO:tasks.workunit.client.1.smithi170.stdout:0/251: dwrite d8/df/d13/f42 [0,4194304] 0 2024-02-15T22:51:15.365 INFO:tasks.workunit.client.1.smithi170.stdout:7/307: dwrite da/d1a/d21/d4d/d59/f6c [0,4194304] 0 2024-02-15T22:51:15.365 INFO:tasks.workunit.client.1.smithi170.stdout:7/308: readlink da/d1a/l52 0 2024-02-15T22:51:15.365 INFO:tasks.workunit.client.1.smithi170.stdout:5/376: dwrite fd [0,4194304] 0 2024-02-15T22:51:15.365 INFO:tasks.workunit.client.1.smithi170.stdout:8/227: dwrite d9/f2d [0,4194304] 0 2024-02-15T22:51:15.373 INFO:tasks.workunit.client.1.smithi170.stdout:5/377: dread de/f26 [0,4194304] 0 2024-02-15T22:51:15.373 INFO:tasks.workunit.client.1.smithi170.stdout:5/378: fdatasync de/d36/f5e 0 2024-02-15T22:51:15.374 INFO:tasks.workunit.client.1.smithi170.stdout:5/379: chown de/l2f 2257564 1 2024-02-15T22:51:15.374 INFO:tasks.workunit.client.1.smithi170.stdout:5/380: write de/d10/f18 [1452721,38413] 0 2024-02-15T22:51:15.378 INFO:tasks.workunit.client.1.smithi170.stdout:6/358: write d3/d1d/d36/f14 [11413803,74314] 0 2024-02-15T22:51:15.387 INFO:tasks.workunit.client.1.smithi170.stdout:3/323: dwrite d3/dc/d1c/d3d/f58 [0,4194304] 0 2024-02-15T22:51:15.387 INFO:tasks.workunit.client.1.smithi170.stdout:4/307: dwrite d0/d22/da/f2d [0,4194304] 0 2024-02-15T22:51:15.388 INFO:tasks.workunit.client.1.smithi170.stdout:4/308: truncate d0/d22/da/d32/f48 1029496 0 2024-02-15T22:51:15.410 INFO:tasks.workunit.client.1.smithi170.stdout:4/309: dwrite d0/d22/da/d11/d20/d49/f53 [0,4194304] 0 2024-02-15T22:51:15.441 INFO:tasks.workunit.client.1.smithi170.stdout:5/381: rename de/d10/d27/d2d/d51/l62 to de/d10/d27/d2d/d51/d7c/l82 0 2024-02-15T22:51:15.444 INFO:tasks.workunit.client.1.smithi170.stdout:6/359: symlink d3/d1d/d53/l84 0 2024-02-15T22:51:15.449 INFO:tasks.workunit.client.1.smithi170.stdout:3/324: creat d3/dc/d1c/d26/d55/f69 x:0 0 0 2024-02-15T22:51:15.450 INFO:tasks.workunit.client.1.smithi170.stdout:4/310: mknod d0/d22/da/d11/d20/c5a 0 2024-02-15T22:51:15.453 INFO:tasks.workunit.client.1.smithi170.stdout:0/252: rmdir d8/df 39 2024-02-15T22:51:15.457 INFO:tasks.workunit.client.1.smithi170.stdout:3/325: dread d3/dc/d1c/d3d/f58 [0,4194304] 0 2024-02-15T22:51:15.464 INFO:tasks.workunit.client.1.smithi170.stdout:5/382: symlink de/d29/l83 0 2024-02-15T22:51:15.466 INFO:tasks.workunit.client.1.smithi170.stdout:6/360: rename d3/d1a/d6d/c72 to d3/d1a/c85 0 2024-02-15T22:51:15.468 INFO:tasks.workunit.client.1.smithi170.stdout:0/253: mkdir d8/df/d13/d22/d39/d55 0 2024-02-15T22:51:15.470 INFO:tasks.workunit.client.1.smithi170.stdout:3/326: mknod d3/dc/d1c/c6a 0 2024-02-15T22:51:15.472 INFO:tasks.workunit.client.1.smithi170.stdout:6/361: symlink d3/d1d/d27/d70/l86 0 2024-02-15T22:51:15.472 INFO:tasks.workunit.client.1.smithi170.stdout:6/362: dread - d3/d1d/d1b/d3c/f6f zero size 2024-02-15T22:51:15.472 INFO:tasks.workunit.client.1.smithi170.stdout:6/363: truncate d3/d1d/d28/d3b/f2b 427943 0 2024-02-15T22:51:15.473 INFO:tasks.workunit.client.1.smithi170.stdout:8/228: dwrite d9/f16 [0,4194304] 0 2024-02-15T22:51:15.474 INFO:tasks.workunit.client.1.smithi170.stdout:8/229: creat d9/d18/d32/d3b/f41 x:0 0 0 2024-02-15T22:51:15.476 INFO:tasks.workunit.client.1.smithi170.stdout:8/230: mkdir d9/d18/d32/d3b/d42 0 2024-02-15T22:51:15.482 INFO:tasks.workunit.client.1.smithi170.stdout:4/311: truncate d0/d22/da/d11/d20/f3d 613257 0 2024-02-15T22:51:15.482 INFO:tasks.workunit.client.1.smithi170.stdout:4/312: creat d0/d22/da/f5b x:0 0 0 2024-02-15T22:51:15.482 INFO:tasks.workunit.client.1.smithi170.stdout:4/313: write d0/d22/da/d11/f33 [190537,59752] 0 2024-02-15T22:51:15.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/364: dread d3/f16 [0,4194304] 0 2024-02-15T22:51:15.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/365: write d3/d1d/d1b/d3c/f6f [197643,91429] 0 2024-02-15T22:51:15.495 INFO:tasks.workunit.client.1.smithi170.stdout:5/383: dwrite de/d10/f23 [0,4194304] 0 2024-02-15T22:51:15.497 INFO:tasks.workunit.client.1.smithi170.stdout:8/231: rmdir d9/d18 39 2024-02-15T22:51:15.499 INFO:tasks.workunit.client.1.smithi170.stdout:5/384: mknod de/d10/c84 0 2024-02-15T22:51:15.499 INFO:tasks.workunit.client.1.smithi170.stdout:8/232: chown d9/lc 27810 1 2024-02-15T22:51:15.501 INFO:tasks.workunit.client.1.smithi170.stdout:5/385: rename de/d10/f18 to de/d10/d27/d4c/d53/d55/f85 0 2024-02-15T22:51:15.501 INFO:tasks.workunit.client.1.smithi170.stdout:5/386: write de/d10/d27/d4c/f6c [539279,57200] 0 2024-02-15T22:51:15.502 INFO:tasks.workunit.client.1.smithi170.stdout:8/233: mknod d9/d18/d32/c43 0 2024-02-15T22:51:15.504 INFO:tasks.workunit.client.1.smithi170.stdout:8/234: mkdir d9/d18/d32/d44 0 2024-02-15T22:51:15.505 INFO:tasks.workunit.client.1.smithi170.stdout:8/235: rename f7 to d9/d18/d26/f45 0 2024-02-15T22:51:15.506 INFO:tasks.workunit.client.1.smithi170.stdout:8/236: creat d9/f46 x:0 0 0 2024-02-15T22:51:15.507 INFO:tasks.workunit.client.1.smithi170.stdout:8/237: link d9/d18/c29 d9/d18/d26/c47 0 2024-02-15T22:51:15.512 INFO:tasks.workunit.client.1.smithi170.stdout:8/238: getdents d9 0 2024-02-15T22:51:15.513 INFO:tasks.workunit.client.1.smithi170.stdout:8/239: readlink d9/d18/d32/l34 0 2024-02-15T22:51:15.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/240: write d9/f2d [5220827,84384] 0 2024-02-15T22:51:15.514 INFO:tasks.workunit.client.1.smithi170.stdout:8/241: write d9/d18/d32/f3a [340524,56523] 0 2024-02-15T22:51:15.515 INFO:tasks.workunit.client.1.smithi170.stdout:8/242: mkdir d9/d18/d48 0 2024-02-15T22:51:15.516 INFO:tasks.workunit.client.1.smithi170.stdout:8/243: rename d9/d18/d32/c3d to d9/d18/c49 0 2024-02-15T22:51:15.525 INFO:tasks.workunit.client.1.smithi170.stdout:0/254: dwrite d8/f38 [0,4194304] 0 2024-02-15T22:51:15.531 INFO:tasks.workunit.client.1.smithi170.stdout:0/255: dread f6 [0,4194304] 0 2024-02-15T22:51:15.532 INFO:tasks.workunit.client.1.smithi170.stdout:8/244: write d9/f1d [1682268,100228] 0 2024-02-15T22:51:15.532 INFO:tasks.workunit.client.1.smithi170.stdout:8/245: write d9/f38 [402433,105414] 0 2024-02-15T22:51:15.532 INFO:tasks.workunit.client.1.smithi170.stdout:0/256: rmdir d8/d14/d1c/d3f 39 2024-02-15T22:51:15.533 INFO:tasks.workunit.client.1.smithi170.stdout:8/246: unlink d9/f38 0 2024-02-15T22:51:15.533 INFO:tasks.workunit.client.1.smithi170.stdout:0/257: mknod d8/d14/d44/c56 0 2024-02-15T22:51:15.534 INFO:tasks.workunit.client.1.smithi170.stdout:0/258: write d8/f29 [768154,34380] 0 2024-02-15T22:51:15.534 INFO:tasks.workunit.client.1.smithi170.stdout:8/247: creat d9/d18/d32/f4a x:0 0 0 2024-02-15T22:51:15.535 INFO:tasks.workunit.client.1.smithi170.stdout:0/259: mknod d8/df/d13/d22/d39/d55/c57 0 2024-02-15T22:51:15.536 INFO:tasks.workunit.client.1.smithi170.stdout:0/260: rename d8/d14/d1c/d3f/f4e to d8/d14/d1c/d3f/f58 0 2024-02-15T22:51:15.536 INFO:tasks.workunit.client.1.smithi170.stdout:0/261: creat d8/d14/d44/f59 x:0 0 0 2024-02-15T22:51:15.536 INFO:tasks.workunit.client.1.smithi170.stdout:0/262: fsync d8/f34 0 2024-02-15T22:51:15.536 INFO:tasks.workunit.client.1.smithi170.stdout:0/263: fdatasync d8/df/d13/d22/f33 0 2024-02-15T22:51:15.549 INFO:tasks.workunit.client.1.smithi170.stdout:8/248: read d9/fd [1142195,70274] 0 2024-02-15T22:51:15.549 INFO:tasks.workunit.client.1.smithi170.stdout:8/249: dread - d9/d18/d26/f3c zero size 2024-02-15T22:51:15.549 INFO:tasks.workunit.client.1.smithi170.stdout:8/250: write d9/d18/d32/f3e [6961449,124788] 0 2024-02-15T22:51:15.551 INFO:tasks.workunit.client.1.smithi170.stdout:8/251: mkdir d9/d18/d32/d3b/d4b 0 2024-02-15T22:51:15.551 INFO:tasks.workunit.client.1.smithi170.stdout:8/252: creat d9/d18/d32/f4c x:0 0 0 2024-02-15T22:51:15.552 INFO:tasks.workunit.client.1.smithi170.stdout:8/253: symlink d9/d18/l4d 0 2024-02-15T22:51:15.553 INFO:tasks.workunit.client.1.smithi170.stdout:8/254: unlink d9/d18/d26/c35 0 2024-02-15T22:51:15.554 INFO:tasks.workunit.client.1.smithi170.stdout:8/255: rmdir d9/d18/d32/d44 0 2024-02-15T22:51:15.557 INFO:tasks.workunit.client.1.smithi170.stdout:3/327: dwrite d3/dc/d1a/f66 [0,4194304] 0 2024-02-15T22:51:15.558 INFO:tasks.workunit.client.1.smithi170.stdout:4/314: dwrite d0/d22/da/d11/f1e [4194304,4194304] 0 2024-02-15T22:51:15.558 INFO:tasks.workunit.client.1.smithi170.stdout:4/315: stat d0/d22/da/d32/d47/d2b/f52 0 2024-02-15T22:51:15.558 INFO:tasks.workunit.client.1.smithi170.stdout:6/366: dwrite d3/d1d/d27/f43 [0,4194304] 0 2024-02-15T22:51:15.558 INFO:tasks.workunit.client.1.smithi170.stdout:6/367: write d3/f16 [742614,104702] 0 2024-02-15T22:51:15.562 INFO:tasks.workunit.client.1.smithi170.stdout:3/328: mkdir d3/d1b/d51/d6b 0 2024-02-15T22:51:15.566 INFO:tasks.workunit.client.1.smithi170.stdout:6/368: truncate d3/d24/d31/f49 128503 0 2024-02-15T22:51:15.566 INFO:tasks.workunit.client.1.smithi170.stdout:6/369: chown d3/d24/f3d 200 1 2024-02-15T22:51:15.567 INFO:tasks.workunit.client.1.smithi170.stdout:3/329: mknod d3/db/d1f/c6c 0 2024-02-15T22:51:15.570 INFO:tasks.workunit.client.1.smithi170.stdout:8/256: getdents d9/d18/d26 0 2024-02-15T22:51:15.570 INFO:tasks.workunit.client.1.smithi170.stdout:5/387: dwrite de/d36/f41 [0,4194304] 0 2024-02-15T22:51:15.574 INFO:tasks.workunit.client.1.smithi170.stdout:6/370: write d3/d1a/f33 [2759617,125200] 0 2024-02-15T22:51:15.583 INFO:tasks.workunit.client.1.smithi170.stdout:3/330: write d3/db/d1f/f4e [3111095,31040] 0 2024-02-15T22:51:15.583 INFO:tasks.workunit.client.1.smithi170.stdout:5/388: mknod de/d36/d80/c86 0 2024-02-15T22:51:15.585 INFO:tasks.workunit.client.1.smithi170.stdout:8/257: link d9/d18/l31 d9/l4e 0 2024-02-15T22:51:15.585 INFO:tasks.workunit.client.1.smithi170.stdout:0/264: dwrite d8/d14/d44/f4c [0,4194304] 0 2024-02-15T22:51:15.585 INFO:tasks.workunit.client.1.smithi170.stdout:0/265: write d8/d14/d1c/f21 [697380,6773] 0 2024-02-15T22:51:15.586 INFO:tasks.workunit.client.1.smithi170.stdout:4/316: dwrite d0/d22/da/f27 [0,4194304] 0 2024-02-15T22:51:15.589 INFO:tasks.workunit.client.1.smithi170.stdout:6/371: link d3/d1d/d28/d3b/d2f/c6b d3/d1d/d53/c87 0 2024-02-15T22:51:15.589 INFO:tasks.workunit.client.1.smithi170.stdout:6/372: fdatasync d3/d1a/f40 0 2024-02-15T22:51:15.589 INFO:tasks.workunit.client.1.smithi170.stdout:6/373: write d3/d1d/d36/d56/f59 [595440,105331] 0 2024-02-15T22:51:15.591 INFO:tasks.workunit.client.1.smithi170.stdout:3/331: symlink d3/d1b/d2c/l6d 0 2024-02-15T22:51:15.593 INFO:tasks.workunit.client.1.smithi170.stdout:4/317: dread d0/d22/da/f13 [4194304,4194304] 0 2024-02-15T22:51:15.593 INFO:tasks.workunit.client.1.smithi170.stdout:6/374: fsync d3/d1d/f7b 0 2024-02-15T22:51:15.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/389: mkdir de/d10/d27/d2d/d51/d7c/d87 0 2024-02-15T22:51:15.600 INFO:tasks.workunit.client.1.smithi170.stdout:8/258: stat d9/d18/d26/c28 0 2024-02-15T22:51:15.602 INFO:tasks.workunit.client.1.smithi170.stdout:2/331: sync 2024-02-15T22:51:15.602 INFO:tasks.workunit.client.1.smithi170.stdout:2/332: write d0/d28/d2f/f65 [362258,77874] 0 2024-02-15T22:51:15.609 INFO:tasks.workunit.client.1.smithi170.stdout:3/332: truncate d3/dc/d13/f28 2290325 0 2024-02-15T22:51:15.612 INFO:tasks.workunit.client.1.smithi170.stdout:4/318: symlink d0/d22/da/l5c 0 2024-02-15T22:51:15.613 INFO:tasks.workunit.client.1.smithi170.stdout:6/375: creat d3/d1d/d1b/d3e/f88 x:0 0 0 2024-02-15T22:51:15.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/390: symlink de/d10/d7d/l88 0 2024-02-15T22:51:15.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/391: dread - de/d10/d27/d4c/d53/f5f zero size 2024-02-15T22:51:15.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/392: dread - de/d10/d33/f5d zero size 2024-02-15T22:51:15.614 INFO:tasks.workunit.client.1.smithi170.stdout:5/393: stat de/d10/d27/d4c/d53 0 2024-02-15T22:51:15.615 INFO:tasks.workunit.client.1.smithi170.stdout:5/394: write de/d36/f41 [4786704,34075] 0 2024-02-15T22:51:15.615 INFO:tasks.workunit.client.1.smithi170.stdout:9/264: sync 2024-02-15T22:51:15.615 INFO:tasks.workunit.client.1.smithi170.stdout:9/265: truncate de/d1b/f53 624730 0 2024-02-15T22:51:15.617 INFO:tasks.workunit.client.1.smithi170.stdout:8/259: mkdir d9/d18/d26/d4f 0 2024-02-15T22:51:15.620 INFO:tasks.workunit.client.1.smithi170.stdout:2/333: creat d0/d28/d2f/d37/d58/f7f x:0 0 0 2024-02-15T22:51:15.620 INFO:tasks.workunit.client.1.smithi170.stdout:2/334: fsync d0/d1d/f4e 0 2024-02-15T22:51:15.623 INFO:tasks.workunit.client.1.smithi170.stdout:8/260: dread d9/d18/d26/f45 [0,4194304] 0 2024-02-15T22:51:15.623 INFO:tasks.workunit.client.1.smithi170.stdout:8/261: fdatasync d9/f10 0 2024-02-15T22:51:15.623 INFO:tasks.workunit.client.1.smithi170.stdout:3/333: rename d3/f14 to d3/f6e 0 2024-02-15T22:51:15.624 INFO:tasks.workunit.client.1.smithi170.stdout:3/334: readlink d3/l65 0 2024-02-15T22:51:15.626 INFO:tasks.workunit.client.1.smithi170.stdout:6/376: unlink d3/d1d/d36/fc 0 2024-02-15T22:51:15.626 INFO:tasks.workunit.client.1.smithi170.stdout:1/274: sync 2024-02-15T22:51:15.626 INFO:tasks.workunit.client.1.smithi170.stdout:1/275: write d3/d24/d34/f46 [2522218,1005] 0 2024-02-15T22:51:15.630 INFO:tasks.workunit.client.1.smithi170.stdout:4/319: dwrite d0/d22/da/f29 [0,4194304] 0 2024-02-15T22:51:15.630 INFO:tasks.workunit.client.1.smithi170.stdout:4/320: fsync d0/d22/da/d11/d20/f35 0 2024-02-15T22:51:15.632 INFO:tasks.workunit.client.1.smithi170.stdout:5/395: rename de/f1e to de/d10/d27/d2d/d51/d7c/f89 0 2024-02-15T22:51:15.634 INFO:tasks.workunit.client.1.smithi170.stdout:8/262: mknod d9/d18/d32/c50 0 2024-02-15T22:51:15.634 INFO:tasks.workunit.client.1.smithi170.stdout:4/321: dread d0/f21 [0,4194304] 0 2024-02-15T22:51:15.634 INFO:tasks.workunit.client.1.smithi170.stdout:4/322: truncate d0/d22/da/d32/f4f 529976 0 2024-02-15T22:51:15.634 INFO:tasks.workunit.client.1.smithi170.stdout:6/377: symlink d3/d1d/d36/d56/l89 0 2024-02-15T22:51:15.634 INFO:tasks.workunit.client.1.smithi170.stdout:6/378: fsync d3/d1d/d28/d66/f68 0 2024-02-15T22:51:15.638 INFO:tasks.workunit.client.1.smithi170.stdout:3/335: rename d3/ca to d3/d1b/d51/d6b/c6f 0 2024-02-15T22:51:15.638 INFO:tasks.workunit.client.1.smithi170.stdout:8/263: truncate d9/d18/f1e 2546898 0 2024-02-15T22:51:15.639 INFO:tasks.workunit.client.1.smithi170.stdout:8/264: write d9/d18/d32/f4c [270940,63537] 0 2024-02-15T22:51:15.639 INFO:tasks.workunit.client.1.smithi170.stdout:8/265: fdatasync d9/f46 0 2024-02-15T22:51:15.639 INFO:tasks.workunit.client.1.smithi170.stdout:8/266: getdents d9/d18/d48 0 2024-02-15T22:51:15.639 INFO:tasks.workunit.client.1.smithi170.stdout:8/267: fsync d9/f17 0 2024-02-15T22:51:15.640 INFO:tasks.workunit.client.1.smithi170.stdout:6/379: symlink d3/l8a 0 2024-02-15T22:51:15.640 INFO:tasks.workunit.client.1.smithi170.stdout:2/335: dwrite d0/d1d/f22 [0,4194304] 0 2024-02-15T22:51:15.642 INFO:tasks.workunit.client.1.smithi170.stdout:4/323: rename d0/d22/da/d11/c4e to d0/d22/da/d32/d47/d2b/c5d 0 2024-02-15T22:51:15.643 INFO:tasks.workunit.client.1.smithi170.stdout:5/396: dread f1 [0,4194304] 0 2024-02-15T22:51:15.643 INFO:tasks.workunit.client.1.smithi170.stdout:5/397: chown de/c28 63 1 2024-02-15T22:51:15.646 INFO:tasks.workunit.client.1.smithi170.stdout:5/398: creat de/d10/d27/d2d/d51/d7c/d87/f8a x:0 0 0 2024-02-15T22:51:15.648 INFO:tasks.workunit.client.1.smithi170.stdout:4/324: getdents d0/d22/da 0 2024-02-15T22:51:15.648 INFO:tasks.workunit.client.1.smithi170.stdout:4/325: chown d0 10890 1 2024-02-15T22:51:15.651 INFO:tasks.workunit.client.1.smithi170.stdout:3/336: write d3/f3f [8165291,54205] 0 2024-02-15T22:51:15.656 INFO:tasks.workunit.client.1.smithi170.stdout:1/276: dwrite d3/d24/d2c/f59 [0,4194304] 0 2024-02-15T22:51:15.658 INFO:tasks.workunit.client.1.smithi170.stdout:6/380: dread d3/d1d/d27/f52 [0,4194304] 0 2024-02-15T22:51:15.658 INFO:tasks.workunit.client.1.smithi170.stdout:6/381: dread - d3/d1d/d1b/d3c/f81 zero size 2024-02-15T22:51:15.665 INFO:tasks.workunit.client.1.smithi170.stdout:6/382: symlink d3/d1d/d36/l8b 0 2024-02-15T22:51:15.665 INFO:tasks.workunit.client.1.smithi170.stdout:6/383: write d3/d1a/f40 [4900929,36620] 0 2024-02-15T22:51:15.667 INFO:tasks.workunit.client.1.smithi170.stdout:6/384: creat d3/d1d/d53/d5f/f8c x:0 0 0 2024-02-15T22:51:15.667 INFO:tasks.workunit.client.1.smithi170.stdout:6/385: readlink d3/d1d/d1b/l2a 0 2024-02-15T22:51:15.673 INFO:tasks.workunit.client.1.smithi170.stdout:4/326: truncate d0/d22/da/f27 714641 0 2024-02-15T22:51:15.673 INFO:tasks.workunit.client.1.smithi170.stdout:4/327: fdatasync d0/d22/da/f27 0 2024-02-15T22:51:15.676 INFO:tasks.workunit.client.1.smithi170.stdout:4/328: unlink d0/d22/da/d11/f33 0 2024-02-15T22:51:15.677 INFO:tasks.workunit.client.1.smithi170.stdout:5/399: dwrite de/d10/d27/d4c/d53/f63 [0,4194304] 0 2024-02-15T22:51:15.677 INFO:tasks.workunit.client.1.smithi170.stdout:5/400: creat de/d10/d52/f8b x:0 0 0 2024-02-15T22:51:15.677 INFO:tasks.workunit.client.1.smithi170.stdout:5/401: fdatasync de/d10/d27/d2d/f31 0 2024-02-15T22:51:15.677 INFO:tasks.workunit.client.1.smithi170.stdout:4/329: mkdir d0/d22/da/d32/d47/d5e 0 2024-02-15T22:51:15.677 INFO:tasks.workunit.client.1.smithi170.stdout:4/330: dread - d0/d22/da/d32/d47/d2b/f4c zero size 2024-02-15T22:51:15.678 INFO:tasks.workunit.client.1.smithi170.stdout:1/277: dwrite d3/f15 [0,4194304] 0 2024-02-15T22:51:15.680 INFO:tasks.workunit.client.1.smithi170.stdout:3/337: dwrite d3/dc/d1c/d3d/f58 [4194304,4194304] 0 2024-02-15T22:51:15.680 INFO:tasks.workunit.client.1.smithi170.stdout:3/338: fsync d3/dc/d1c/f64 0 2024-02-15T22:51:15.681 INFO:tasks.workunit.client.1.smithi170.stdout:5/402: symlink de/d10/d27/l8c 0 2024-02-15T22:51:15.681 INFO:tasks.workunit.client.1.smithi170.stdout:5/403: fsync de/d10/d33/f5d 0 2024-02-15T22:51:15.684 INFO:tasks.workunit.client.1.smithi170.stdout:4/331: write d0/d22/da/f27 [1404450,11330] 0 2024-02-15T22:51:15.689 INFO:tasks.workunit.client.1.smithi170.stdout:3/339: symlink d3/db/d1f/d61/l70 0 2024-02-15T22:51:15.691 INFO:tasks.workunit.client.1.smithi170.stdout:5/404: rename de/d10/f3b to de/d10/d33/d67/f8d 0 2024-02-15T22:51:15.691 INFO:tasks.workunit.client.1.smithi170.stdout:5/405: chown de/d29/f5a 358014931 1 2024-02-15T22:51:15.691 INFO:tasks.workunit.client.1.smithi170.stdout:5/406: fsync de/d10/d27/d2d/f47 0 2024-02-15T22:51:15.696 INFO:tasks.workunit.client.1.smithi170.stdout:8/268: truncate d9/d18/d32/f3e 236389 0 2024-02-15T22:51:15.699 INFO:tasks.workunit.client.1.smithi170.stdout:8/269: symlink d9/d18/d48/l51 0 2024-02-15T22:51:15.700 INFO:tasks.workunit.client.1.smithi170.stdout:8/270: write d9/d18/d26/f45 [3463808,130184] 0 2024-02-15T22:51:15.704 INFO:tasks.workunit.client.1.smithi170.stdout:4/332: dwrite d0/d22/da/d11/f45 [4194304,4194304] 0 2024-02-15T22:51:15.705 INFO:tasks.workunit.client.1.smithi170.stdout:1/278: dwrite d3/f1e [0,4194304] 0 2024-02-15T22:51:15.705 INFO:tasks.workunit.client.1.smithi170.stdout:1/279: write d3/d24/d2c/f30 [1220687,77465] 0 2024-02-15T22:51:15.707 INFO:tasks.workunit.client.1.smithi170.stdout:1/280: mknod d3/d24/d34/c60 0 2024-02-15T22:51:15.708 INFO:tasks.workunit.client.1.smithi170.stdout:7/309: sync 2024-02-15T22:51:15.708 INFO:tasks.workunit.client.1.smithi170.stdout:7/310: readlink da/d1a/d21/d1b/l45 0 2024-02-15T22:51:15.709 INFO:tasks.workunit.client.1.smithi170.stdout:7/311: mknod da/d1a/d21/d4d/d59/d61/c6d 0 2024-02-15T22:51:15.710 INFO:tasks.workunit.client.1.smithi170.stdout:7/312: write da/d1a/d21/d4d/d59/f66 [239539,23201] 0 2024-02-15T22:51:15.714 INFO:tasks.workunit.client.1.smithi170.stdout:1/281: read d3/f17 [3035948,93767] 0 2024-02-15T22:51:15.717 INFO:tasks.workunit.client.1.smithi170.stdout:1/282: unlink d3/d24/f25 0 2024-02-15T22:51:15.717 INFO:tasks.workunit.client.1.smithi170.stdout:1/283: chown d3/d24/f36 17 1 2024-02-15T22:51:15.717 INFO:tasks.workunit.client.1.smithi170.stdout:1/284: chown d3/l12 196389403 1 2024-02-15T22:51:15.717 INFO:tasks.workunit.client.1.smithi170.stdout:1/285: chown d3/d24/d34/d4a 778264 1 2024-02-15T22:51:15.717 INFO:tasks.workunit.client.1.smithi170.stdout:1/286: dread - d3/d24/d34/f57 zero size 2024-02-15T22:51:15.718 INFO:tasks.workunit.client.1.smithi170.stdout:7/313: dread da/f38 [0,4194304] 0 2024-02-15T22:51:15.718 INFO:tasks.workunit.client.1.smithi170.stdout:7/314: chown da/c40 1116 1 2024-02-15T22:51:15.718 INFO:tasks.workunit.client.1.smithi170.stdout:1/287: getdents d3/d24/d34/d4a 0 2024-02-15T22:51:15.722 INFO:tasks.workunit.client.1.smithi170.stdout:1/288: rename d3/d24/d34/f46 to d3/d24/f61 0 2024-02-15T22:51:15.723 INFO:tasks.workunit.client.1.smithi170.stdout:7/315: rmdir da/d1a/d21/d2c/d2e 39 2024-02-15T22:51:15.724 INFO:tasks.workunit.client.1.smithi170.stdout:3/340: dwrite d3/dc/ff [0,4194304] 0 2024-02-15T22:51:15.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/289: mkdir d3/d24/d34/d4a/d62 0 2024-02-15T22:51:15.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/290: creat d3/d24/f63 x:0 0 0 2024-02-15T22:51:15.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/291: fsync d3/f17 0 2024-02-15T22:51:15.728 INFO:tasks.workunit.client.1.smithi170.stdout:1/292: unlink d3/d24/d34/c60 0 2024-02-15T22:51:15.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/316: write da/fe [9332369,69009] 0 2024-02-15T22:51:15.733 INFO:tasks.workunit.client.1.smithi170.stdout:7/317: mkdir da/d1a/d21/d4d/d6e 0 2024-02-15T22:51:15.733 INFO:tasks.workunit.client.1.smithi170.stdout:7/318: creat da/f6f x:0 0 0 2024-02-15T22:51:15.733 INFO:tasks.workunit.client.1.smithi170.stdout:7/319: creat da/d1a/d21/f70 x:0 0 0 2024-02-15T22:51:15.733 INFO:tasks.workunit.client.1.smithi170.stdout:7/320: readlink da/d1a/d28/l68 0 2024-02-15T22:51:15.735 INFO:tasks.workunit.client.1.smithi170.stdout:5/407: dwrite de/d10/d33/f42 [0,4194304] 0 2024-02-15T22:51:15.735 INFO:tasks.workunit.client.1.smithi170.stdout:4/333: dwrite d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:15.735 INFO:tasks.workunit.client.1.smithi170.stdout:4/334: fsync d0/d22/da/d32/d47/f4b 0 2024-02-15T22:51:15.735 INFO:tasks.workunit.client.1.smithi170.stdout:8/271: dwrite d9/f46 [0,4194304] 0 2024-02-15T22:51:15.736 INFO:tasks.workunit.client.1.smithi170.stdout:1/293: mknod d3/d24/c64 0 2024-02-15T22:51:15.738 INFO:tasks.workunit.client.1.smithi170.stdout:7/321: mkdir da/d1a/d21/d2c/d71 0 2024-02-15T22:51:15.742 INFO:tasks.workunit.client.1.smithi170.stdout:5/408: creat de/d10/d27/d4c/d53/d55/f8e x:0 0 0 2024-02-15T22:51:15.742 INFO:tasks.workunit.client.1.smithi170.stdout:5/409: truncate de/d10/d33/f5d 629339 0 2024-02-15T22:51:15.742 INFO:tasks.workunit.client.1.smithi170.stdout:5/410: creat de/d29/f8f x:0 0 0 2024-02-15T22:51:15.743 INFO:tasks.workunit.client.1.smithi170.stdout:4/335: write d0/f10 [1284042,16471] 0 2024-02-15T22:51:15.746 INFO:tasks.workunit.client.1.smithi170.stdout:8/272: symlink d9/d18/d32/l52 0 2024-02-15T22:51:15.746 INFO:tasks.workunit.client.1.smithi170.stdout:8/273: fsync d9/f1d 0 2024-02-15T22:51:15.757 INFO:tasks.workunit.client.1.smithi170.stdout:7/322: mkdir da/d1a/d28/d72 0 2024-02-15T22:51:15.757 INFO:tasks.workunit.client.1.smithi170.stdout:5/411: dwrite de/d10/f23 [4194304,4194304] 0 2024-02-15T22:51:15.760 INFO:tasks.workunit.client.1.smithi170.stdout:1/294: mkdir d3/d24/d34/d65 0 2024-02-15T22:51:15.761 INFO:tasks.workunit.client.1.smithi170.stdout:7/323: dread da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:15.763 INFO:tasks.workunit.client.1.smithi170.stdout:7/324: mkdir da/d1a/d28/d72/d73 0 2024-02-15T22:51:15.765 INFO:tasks.workunit.client.1.smithi170.stdout:1/295: rename d3/f15 to d3/d24/f66 0 2024-02-15T22:51:15.766 INFO:tasks.workunit.client.1.smithi170.stdout:7/325: mkdir da/d1a/d21/d2c/d74 0 2024-02-15T22:51:15.768 INFO:tasks.workunit.client.1.smithi170.stdout:1/296: dread d3/fb [0,4194304] 0 2024-02-15T22:51:15.768 INFO:tasks.workunit.client.1.smithi170.stdout:7/326: creat da/d1a/d21/d2c/d71/f75 x:0 0 0 2024-02-15T22:51:15.768 INFO:tasks.workunit.client.1.smithi170.stdout:1/297: chown d3/d24/d34/c5c 22 1 2024-02-15T22:51:15.770 INFO:tasks.workunit.client.1.smithi170.stdout:1/298: rmdir d3/d24/d2c/d35 39 2024-02-15T22:51:15.772 INFO:tasks.workunit.client.1.smithi170.stdout:1/299: write d3/fb [574198,18866] 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/300: write d3/d24/d2c/d35/f48 [118095,64999] 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/301: stat d3 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/302: dread - d3/d24/d34/f50 zero size 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/303: write d3/f4c [727452,115774] 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/304: truncate d3/f4c 1794189 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/305: chown d3/d24/d2c/d35/f52 2906 1 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/306: fsync d3/f20 0 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/307: dread - d3/d24/d2c/d5e/f5f zero size 2024-02-15T22:51:15.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/308: stat d3/d24/d2c/d35/f52 0 2024-02-15T22:51:15.774 INFO:tasks.workunit.client.1.smithi170.stdout:1/309: rmdir d3/d24/d34/d4a/d62 0 2024-02-15T22:51:15.776 INFO:tasks.workunit.client.1.smithi170.stdout:5/412: dwrite de/d10/d27/d4c/f6e [4194304,4194304] 0 2024-02-15T22:51:15.776 INFO:tasks.workunit.client.1.smithi170.stdout:5/413: creat de/d10/f90 x:0 0 0 2024-02-15T22:51:15.776 INFO:tasks.workunit.client.1.smithi170.stdout:5/414: creat de/d10/d27/d2d/f91 x:0 0 0 2024-02-15T22:51:15.777 INFO:tasks.workunit.client.1.smithi170.stdout:1/310: dread d3/f17 [0,4194304] 0 2024-02-15T22:51:15.782 INFO:tasks.workunit.client.1.smithi170.stdout:7/327: write da/f3b [2427097,60492] 0 2024-02-15T22:51:15.783 INFO:tasks.workunit.client.1.smithi170.stdout:7/328: creat da/d1a/d21/d1b/d69/f76 x:0 0 0 2024-02-15T22:51:15.783 INFO:tasks.workunit.client.1.smithi170.stdout:7/329: chown da/d1a/d21/l36 3005760 1 2024-02-15T22:51:15.792 INFO:tasks.workunit.client.1.smithi170.stdout:1/311: read d3/d24/f2b [3489236,22340] 0 2024-02-15T22:51:15.793 INFO:tasks.workunit.client.1.smithi170.stdout:1/312: creat d3/d24/f67 x:0 0 0 2024-02-15T22:51:15.795 INFO:tasks.workunit.client.1.smithi170.stdout:1/313: mknod d3/d24/c68 0 2024-02-15T22:51:15.795 INFO:tasks.workunit.client.1.smithi170.stdout:1/314: creat d3/d24/d34/d65/f69 x:0 0 0 2024-02-15T22:51:15.796 INFO:tasks.workunit.client.1.smithi170.stdout:1/315: symlink d3/d24/d34/l6a 0 2024-02-15T22:51:15.797 INFO:tasks.workunit.client.1.smithi170.stdout:1/316: symlink d3/d24/d34/d4a/l6b 0 2024-02-15T22:51:15.798 INFO:tasks.workunit.client.1.smithi170.stdout:5/415: dwrite de/d10/f5b [0,4194304] 0 2024-02-15T22:51:15.799 INFO:tasks.workunit.client.1.smithi170.stdout:5/416: write de/d10/d27/d2d/f39 [436783,97023] 0 2024-02-15T22:51:15.799 INFO:tasks.workunit.client.1.smithi170.stdout:5/417: creat de/d10/d27/d2d/d51/f92 x:0 0 0 2024-02-15T22:51:15.799 INFO:tasks.workunit.client.1.smithi170.stdout:5/418: creat de/d10/d52/f93 x:0 0 0 2024-02-15T22:51:15.802 INFO:tasks.workunit.client.1.smithi170.stdout:7/330: dwrite da/fe [8388608,4194304] 0 2024-02-15T22:51:15.802 INFO:tasks.workunit.client.1.smithi170.stdout:5/419: mknod de/d10/d27/d2d/c94 0 2024-02-15T22:51:15.803 INFO:tasks.workunit.client.1.smithi170.stdout:7/331: creat da/d1a/d21/d1b/f77 x:0 0 0 2024-02-15T22:51:15.805 INFO:tasks.workunit.client.1.smithi170.stdout:7/332: rename da/d1a/d21/d1b/c1f to da/d63/c78 0 2024-02-15T22:51:15.805 INFO:tasks.workunit.client.1.smithi170.stdout:7/333: creat da/d1a/d21/d1b/f79 x:0 0 0 2024-02-15T22:51:15.808 INFO:tasks.workunit.client.1.smithi170.stdout:7/334: mkdir da/d1a/d21/d2c/d2e/d7a 0 2024-02-15T22:51:15.818 INFO:tasks.workunit.client.1.smithi170.stdout:1/317: dwrite d3/d24/d34/f3b [0,4194304] 0 2024-02-15T22:51:15.821 INFO:tasks.workunit.client.1.smithi170.stdout:1/318: link d3/c3c d3/d24/c6c 0 2024-02-15T22:51:15.827 INFO:tasks.workunit.client.1.smithi170.stdout:7/335: dwrite da/d1a/d21/d1b/f79 [0,4194304] 0 2024-02-15T22:51:15.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/420: dwrite de/d10/d27/f3d [0,4194304] 0 2024-02-15T22:51:15.829 INFO:tasks.workunit.client.1.smithi170.stdout:7/336: dread da/f25 [0,4194304] 0 2024-02-15T22:51:15.831 INFO:tasks.workunit.client.1.smithi170.stdout:7/337: creat da/d57/f7b x:0 0 0 2024-02-15T22:51:15.831 INFO:tasks.workunit.client.1.smithi170.stdout:7/338: write da/d1a/d21/f70 [951323,69532] 0 2024-02-15T22:51:15.837 INFO:tasks.workunit.client.1.smithi170.stdout:1/319: dwrite d3/d24/d2c/d5e/f5f [0,4194304] 0 2024-02-15T22:51:15.837 INFO:tasks.workunit.client.1.smithi170.stdout:1/320: write d3/d24/d2c/d35/f52 [50966,96771] 0 2024-02-15T22:51:15.838 INFO:tasks.workunit.client.1.smithi170.stdout:1/321: creat d3/d24/d2c/f6d x:0 0 0 2024-02-15T22:51:15.844 INFO:tasks.workunit.client.1.smithi170.stdout:7/339: dwrite da/d1a/d21/f46 [0,4194304] 0 2024-02-15T22:51:15.848 INFO:tasks.workunit.client.1.smithi170.stdout:1/322: dread d3/d24/f66 [0,4194304] 0 2024-02-15T22:51:15.848 INFO:tasks.workunit.client.1.smithi170.stdout:7/340: rename da/d1a/d21/d4d/d59/d61 to da/d1a/d21/d4d/d59/d7c 0 2024-02-15T22:51:15.848 INFO:tasks.workunit.client.1.smithi170.stdout:7/341: write da/d1a/d21/f51 [2441875,73341] 0 2024-02-15T22:51:15.868 INFO:tasks.workunit.client.1.smithi170.stdout:1/323: dwrite d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:15.868 INFO:tasks.workunit.client.1.smithi170.stdout:7/342: dwrite da/d1a/d21/d2c/d2e/f35 [4194304,4194304] 0 2024-02-15T22:51:15.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/324: dread d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:15.895 INFO:tasks.workunit.client.1.smithi170.stdout:7/343: dwrite da/f38 [0,4194304] 0 2024-02-15T22:51:15.895 INFO:tasks.workunit.client.1.smithi170.stdout:1/325: dwrite d3/d24/d34/f3b [0,4194304] 0 2024-02-15T22:51:15.895 INFO:tasks.workunit.client.1.smithi170.stdout:1/326: stat d3/d24/d34/f3b 0 2024-02-15T22:51:15.908 INFO:tasks.workunit.client.1.smithi170.stdout:1/327: write d3/d24/d2c/f59 [3094829,23096] 0 2024-02-15T22:51:15.909 INFO:tasks.workunit.client.1.smithi170.stdout:1/328: symlink d3/d24/d34/d65/l6e 0 2024-02-15T22:51:15.910 INFO:tasks.workunit.client.1.smithi170.stdout:1/329: symlink d3/d24/d34/l6f 0 2024-02-15T22:51:15.911 INFO:tasks.workunit.client.1.smithi170.stdout:1/330: mknod d3/d24/d34/d4a/c70 0 2024-02-15T22:51:15.911 INFO:tasks.workunit.client.1.smithi170.stdout:1/331: fsync d3/d24/d34/d4a/f4e 0 2024-02-15T22:51:15.911 INFO:tasks.workunit.client.1.smithi170.stdout:1/332: chown d3/d24/f36 168420 1 2024-02-15T22:51:15.911 INFO:tasks.workunit.client.1.smithi170.stdout:1/333: chown d3/f10 31121573 1 2024-02-15T22:51:15.911 INFO:tasks.workunit.client.1.smithi170.stdout:1/334: readlink d3/lc 0 2024-02-15T22:51:15.912 INFO:tasks.workunit.client.1.smithi170.stdout:1/335: link d3/l55 d3/l71 0 2024-02-15T22:51:15.912 INFO:tasks.workunit.client.1.smithi170.stdout:1/336: chown d3/d24/d34/l6f 3330901 1 2024-02-15T22:51:15.913 INFO:tasks.workunit.client.1.smithi170.stdout:1/337: mkdir d3/d24/d2c/d35/d72 0 2024-02-15T22:51:15.913 INFO:tasks.workunit.client.1.smithi170.stdout:1/338: stat d3/d24 0 2024-02-15T22:51:15.914 INFO:tasks.workunit.client.1.smithi170.stdout:1/339: link d3/c32 d3/d24/d2c/d35/d72/c73 0 2024-02-15T22:51:15.914 INFO:tasks.workunit.client.1.smithi170.stdout:1/340: dread - d3/d24/d34/d4a/f4d zero size 2024-02-15T22:51:15.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/341: mknod d3/d24/d2c/d5e/c74 0 2024-02-15T22:51:15.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/342: write d3/d24/d34/f39 [941442,118558] 0 2024-02-15T22:51:15.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/343: stat d3/d24/d2c/d35/f48 0 2024-02-15T22:51:15.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/344: fsync d3/f10 0 2024-02-15T22:51:15.923 INFO:tasks.workunit.client.1.smithi170.stdout:1/345: dread d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:15.930 INFO:tasks.workunit.client.1.smithi170.stdout:1/346: write d3/d24/d34/d4a/f4e [81137,77682] 0 2024-02-15T22:51:15.935 INFO:tasks.workunit.client.1.smithi170.stdout:1/347: creat d3/d24/d2c/d35/f75 x:0 0 0 2024-02-15T22:51:15.941 INFO:tasks.workunit.client.1.smithi170.stdout:1/348: rmdir d3/d24/d2c/d35 39 2024-02-15T22:51:15.943 INFO:tasks.workunit.client.1.smithi170.stdout:1/349: mknod d3/d24/c76 0 2024-02-15T22:51:15.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/350: mkdir d3/d24/d2c/d77 0 2024-02-15T22:51:15.945 INFO:tasks.workunit.client.1.smithi170.stdout:1/351: creat d3/d24/d2c/d35/d72/f78 x:0 0 0 2024-02-15T22:51:15.947 INFO:tasks.workunit.client.1.smithi170.stdout:1/352: rename d3/d24/d34/d4a/c4f to d3/d24/d2c/d77/c79 0 2024-02-15T22:51:15.959 INFO:tasks.workunit.client.1.smithi170.stdout:1/353: dwrite d3/d24/d2c/d35/f75 [0,4194304] 0 2024-02-15T22:51:15.962 INFO:tasks.workunit.client.1.smithi170.stdout:1/354: symlink d3/d24/d2c/l7a 0 2024-02-15T22:51:15.962 INFO:tasks.workunit.client.1.smithi170.stdout:1/355: stat d3/d24/d34/d4a/c70 0 2024-02-15T22:51:15.963 INFO:tasks.workunit.client.1.smithi170.stdout:1/356: dread d3/d24/d2c/f2f [0,4194304] 0 2024-02-15T22:51:15.964 INFO:tasks.workunit.client.1.smithi170.stdout:1/357: symlink d3/d24/d34/d4a/l7b 0 2024-02-15T22:51:15.966 INFO:tasks.workunit.client.1.smithi170.stdout:1/358: truncate d3/d24/d34/f3b 3133550 0 2024-02-15T22:51:15.968 INFO:tasks.workunit.client.1.smithi170.stdout:1/359: write d3/d24/d2c/f59 [3448193,99357] 0 2024-02-15T22:51:15.969 INFO:tasks.workunit.client.1.smithi170.stdout:1/360: symlink d3/l7c 0 2024-02-15T22:51:15.970 INFO:tasks.workunit.client.1.smithi170.stdout:1/361: readlink d3/l7c 0 2024-02-15T22:51:15.970 INFO:tasks.workunit.client.1.smithi170.stdout:1/362: chown d3/c5d 1 1 2024-02-15T22:51:15.977 INFO:tasks.workunit.client.1.smithi170.stdout:1/363: dread d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:15.978 INFO:tasks.workunit.client.1.smithi170.stdout:1/364: mknod d3/d24/d2c/d35/c7d 0 2024-02-15T22:51:15.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/365: mkdir d3/d24/d2c/d35/d72/d7e 0 2024-02-15T22:51:15.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/366: rmdir d3/d24/d2c/d35 39 2024-02-15T22:51:15.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/367: write d3/f1f [1134470,34039] 0 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:9/266: sync 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:9/267: chown de/d1b/f53 236 1 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:6/386: sync 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:2/336: sync 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:3/341: sync 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:0/266: sync 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:3/342: chown d3/dc/d1c/d3d/l45 4711415 1 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:0/267: truncate d8/d14/d1c/f40 932810 0 2024-02-15T22:51:15.986 INFO:tasks.workunit.client.1.smithi170.stdout:4/336: sync 2024-02-15T22:51:15.988 INFO:tasks.workunit.client.1.smithi170.stdout:9/268: symlink de/d1b/d1c/d47/l56 0 2024-02-15T22:51:15.988 INFO:tasks.workunit.client.1.smithi170.stdout:1/368: dread d3/f1e [0,4194304] 0 2024-02-15T22:51:15.988 INFO:tasks.workunit.client.1.smithi170.stdout:6/387: mknod d3/d1d/d27/d70/c8d 0 2024-02-15T22:51:15.989 INFO:tasks.workunit.client.1.smithi170.stdout:2/337: mknod d0/d1d/d3d/c80 0 2024-02-15T22:51:15.990 INFO:tasks.workunit.client.1.smithi170.stdout:4/337: mknod d0/d22/da/c5f 0 2024-02-15T22:51:15.990 INFO:tasks.workunit.client.1.smithi170.stdout:4/338: stat d0/f10 0 2024-02-15T22:51:15.990 INFO:tasks.workunit.client.1.smithi170.stdout:3/343: symlink d3/dc/l71 0 2024-02-15T22:51:15.991 INFO:tasks.workunit.client.1.smithi170.stdout:1/369: mkdir d3/d24/d2c/d35/d7f 0 2024-02-15T22:51:15.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/338: symlink d0/l81 0 2024-02-15T22:51:15.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/339: dread - d0/d28/d2f/d37/f4f zero size 2024-02-15T22:51:15.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/340: truncate d0/d28/d2f/d37/f7c 362539 0 2024-02-15T22:51:15.995 INFO:tasks.workunit.client.1.smithi170.stdout:4/339: mknod d0/d22/da/d11/c60 0 2024-02-15T22:51:15.996 INFO:tasks.workunit.client.1.smithi170.stdout:1/370: creat d3/d24/d2c/d35/d72/d7e/f80 x:0 0 0 2024-02-15T22:51:15.996 INFO:tasks.workunit.client.1.smithi170.stdout:6/388: getdents d3/d1d/d36/d51 0 2024-02-15T22:51:15.998 INFO:tasks.workunit.client.1.smithi170.stdout:0/268: write d8/df/d13/f42 [3014631,112962] 0 2024-02-15T22:51:15.999 INFO:tasks.workunit.client.1.smithi170.stdout:2/341: mkdir d0/d13/d59/d82 0 2024-02-15T22:51:16.002 INFO:tasks.workunit.client.1.smithi170.stdout:4/340: rename d0/d22/da/d11/f46 to d0/d22/da/f61 0 2024-02-15T22:51:16.003 INFO:tasks.workunit.client.1.smithi170.stdout:9/269: write de/d1b/d1c/d1f/d20/d27/d2c/f32 [1872097,87771] 0 2024-02-15T22:51:16.004 INFO:tasks.workunit.client.1.smithi170.stdout:3/344: dwrite d3/dc/d1c/d3d/f53 [0,4194304] 0 2024-02-15T22:51:16.007 INFO:tasks.workunit.client.1.smithi170.stdout:2/342: truncate d0/d2a/f2b 82149 0 2024-02-15T22:51:16.008 INFO:tasks.workunit.client.1.smithi170.stdout:1/371: dread d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:16.008 INFO:tasks.workunit.client.1.smithi170.stdout:1/372: fdatasync d3/d24/d2c/f6d 0 2024-02-15T22:51:16.008 INFO:tasks.workunit.client.1.smithi170.stdout:1/373: read d3/d24/d2c/d35/f48 [598241,119350] 0 2024-02-15T22:51:16.008 INFO:tasks.workunit.client.1.smithi170.stdout:6/389: rename d3/d1d/d27/c79 to d3/d1d/d1b/d3c/c8e 0 2024-02-15T22:51:16.010 INFO:tasks.workunit.client.1.smithi170.stdout:9/270: creat de/d1b/f57 x:0 0 0 2024-02-15T22:51:16.010 INFO:tasks.workunit.client.1.smithi170.stdout:9/271: creat de/d1b/f58 x:0 0 0 2024-02-15T22:51:16.013 INFO:tasks.workunit.client.1.smithi170.stdout:0/269: rmdir d8 39 2024-02-15T22:51:16.014 INFO:tasks.workunit.client.1.smithi170.stdout:2/343: mkdir d0/d28/d83 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/374: creat d3/d24/d2c/d35/f81 x:0 0 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/375: creat d3/d24/d2c/d35/f82 x:0 0 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/376: fsync d3/d24/d2c/d35/f75 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/377: write d3/d24/d34/f57 [2553,66018] 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/378: stat d3/d24/d2c/d35/l56 0 2024-02-15T22:51:16.016 INFO:tasks.workunit.client.1.smithi170.stdout:1/379: chown d3/d24/c64 30777 1 2024-02-15T22:51:16.017 INFO:tasks.workunit.client.1.smithi170.stdout:4/341: rename d0/d22/da/l3e to d0/d22/da/d58/l62 0 2024-02-15T22:51:16.019 INFO:tasks.workunit.client.1.smithi170.stdout:6/390: creat d3/d1d/d53/f8f x:0 0 0 2024-02-15T22:51:16.019 INFO:tasks.workunit.client.1.smithi170.stdout:6/391: read - d3/d1d/d36/d51/f63 zero size 2024-02-15T22:51:16.019 INFO:tasks.workunit.client.1.smithi170.stdout:6/392: creat d3/d1d/d1b/d3c/f90 x:0 0 0 2024-02-15T22:51:16.022 INFO:tasks.workunit.client.1.smithi170.stdout:0/270: link d8/f38 d8/d14/d1c/d3f/d51/f5a 0 2024-02-15T22:51:16.023 INFO:tasks.workunit.client.1.smithi170.stdout:2/344: unlink d0/d1d/f73 0 2024-02-15T22:51:16.026 INFO:tasks.workunit.client.1.smithi170.stdout:1/380: mkdir d3/d24/d2c/d35/d83 0 2024-02-15T22:51:16.026 INFO:tasks.workunit.client.1.smithi170.stdout:1/381: truncate d3/d24/d2c/d35/f82 366421 0 2024-02-15T22:51:16.029 INFO:tasks.workunit.client.1.smithi170.stdout:4/342: rename d0/d22/da/d11/d20/c2a to d0/d22/da/d32/d47/d2b/c63 0 2024-02-15T22:51:16.029 INFO:tasks.workunit.client.1.smithi170.stdout:4/343: readlink d0/d22/l28 0 2024-02-15T22:51:16.031 INFO:tasks.workunit.client.1.smithi170.stdout:6/393: mkdir d3/d24/d31/d91 0 2024-02-15T22:51:16.031 INFO:tasks.workunit.client.1.smithi170.stdout:6/394: write d3/d1d/d28/d66/f68 [661124,279] 0 2024-02-15T22:51:16.032 INFO:tasks.workunit.client.1.smithi170.stdout:6/395: chown d3/d24/f7a 0 1 2024-02-15T22:51:16.033 INFO:tasks.workunit.client.1.smithi170.stdout:0/271: symlink d8/d14/l5b 0 2024-02-15T22:51:16.033 INFO:tasks.workunit.client.1.smithi170.stdout:5/421: sync 2024-02-15T22:51:16.033 INFO:tasks.workunit.client.1.smithi170.stdout:8/274: sync 2024-02-15T22:51:16.034 INFO:tasks.workunit.client.1.smithi170.stdout:8/275: dread - d9/d18/d32/d3b/f40 zero size 2024-02-15T22:51:16.036 INFO:tasks.workunit.client.1.smithi170.stdout:2/345: creat d0/d28/d2f/d37/d58/d78/f84 x:0 0 0 2024-02-15T22:51:16.036 INFO:tasks.workunit.client.1.smithi170.stdout:1/382: mknod d3/d24/d2c/d35/d7f/c84 0 2024-02-15T22:51:16.039 INFO:tasks.workunit.client.1.smithi170.stdout:3/345: rename d3/dc/d1c/d3d/f58 to d3/f72 0 2024-02-15T22:51:16.040 INFO:tasks.workunit.client.1.smithi170.stdout:4/344: symlink d0/d22/da/d11/l64 0 2024-02-15T22:51:16.043 INFO:tasks.workunit.client.1.smithi170.stdout:8/276: truncate d9/d18/f1e 211809 0 2024-02-15T22:51:16.043 INFO:tasks.workunit.client.1.smithi170.stdout:0/272: dread d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:16.047 INFO:tasks.workunit.client.1.smithi170.stdout:9/272: rename de/d1b/d1c/d1f/d20/c49 to de/d1b/d1c/c59 0 2024-02-15T22:51:16.051 INFO:tasks.workunit.client.1.smithi170.stdout:1/383: read d3/f22 [3983998,65552] 0 2024-02-15T22:51:16.051 INFO:tasks.workunit.client.1.smithi170.stdout:1/384: dread - d3/f2e zero size 2024-02-15T22:51:16.051 INFO:tasks.workunit.client.1.smithi170.stdout:5/422: rmdir de/d10/d27/d4c 39 2024-02-15T22:51:16.054 INFO:tasks.workunit.client.1.smithi170.stdout:8/277: write d9/ff [2271317,28475] 0 2024-02-15T22:51:16.054 INFO:tasks.workunit.client.1.smithi170.stdout:8/278: stat d9/ce 0 2024-02-15T22:51:16.055 INFO:tasks.workunit.client.1.smithi170.stdout:6/396: dwrite d3/d1d/d27/f43 [0,4194304] 0 2024-02-15T22:51:16.055 INFO:tasks.workunit.client.1.smithi170.stdout:6/397: creat d3/d1d/d1b/d3e/f92 x:0 0 0 2024-02-15T22:51:16.056 INFO:tasks.workunit.client.1.smithi170.stdout:0/273: rename d8/f34 to d8/df/d13/f5c 0 2024-02-15T22:51:16.058 INFO:tasks.workunit.client.1.smithi170.stdout:1/385: link d3/d24/d2c/l7a d3/d24/d34/d65/l85 0 2024-02-15T22:51:16.058 INFO:tasks.workunit.client.1.smithi170.stdout:9/273: write de/d1b/d1c/d1f/d20/d27/f29 [4836403,121124] 0 2024-02-15T22:51:16.060 INFO:tasks.workunit.client.1.smithi170.stdout:8/279: rmdir d9/d18/d32/d3b 39 2024-02-15T22:51:16.060 INFO:tasks.workunit.client.1.smithi170.stdout:8/280: getdents d9/d18/d32/d3b/d42 0 2024-02-15T22:51:16.063 INFO:tasks.workunit.client.1.smithi170.stdout:3/346: dwrite d3/db/d1f/f41 [0,4194304] 0 2024-02-15T22:51:16.063 INFO:tasks.workunit.client.1.smithi170.stdout:3/347: creat d3/dc/d1c/f73 x:0 0 0 2024-02-15T22:51:16.063 INFO:tasks.workunit.client.1.smithi170.stdout:3/348: fdatasync d3/db/f12 0 2024-02-15T22:51:16.065 INFO:tasks.workunit.client.1.smithi170.stdout:6/398: rmdir d3/d24/d31/d91 0 2024-02-15T22:51:16.065 INFO:tasks.workunit.client.1.smithi170.stdout:5/423: dread f7 [0,4194304] 0 2024-02-15T22:51:16.065 INFO:tasks.workunit.client.1.smithi170.stdout:6/399: creat d3/d1d/d53/f93 x:0 0 0 2024-02-15T22:51:16.067 INFO:tasks.workunit.client.1.smithi170.stdout:0/274: unlink d8/f46 0 2024-02-15T22:51:16.067 INFO:tasks.workunit.client.1.smithi170.stdout:0/275: chown d8/d14/f1a 63 1 2024-02-15T22:51:16.067 INFO:tasks.workunit.client.1.smithi170.stdout:1/386: write d3/d24/d2c/d35/f75 [3210546,88495] 0 2024-02-15T22:51:16.068 INFO:tasks.workunit.client.1.smithi170.stdout:4/345: dwrite d0/d22/da/d11/d20/f35 [0,4194304] 0 2024-02-15T22:51:16.072 INFO:tasks.workunit.client.1.smithi170.stdout:9/274: link de/d1b/f4f de/d1b/d1c/d1f/d20/d27/d2c/f5a 0 2024-02-15T22:51:16.075 INFO:tasks.workunit.client.1.smithi170.stdout:8/281: rename d9/d18/c1b to d9/d18/d32/d3b/d42/c53 0 2024-02-15T22:51:16.079 INFO:tasks.workunit.client.1.smithi170.stdout:7/344: sync 2024-02-15T22:51:16.080 INFO:tasks.workunit.client.1.smithi170.stdout:6/400: dwrite d3/d1d/d36/d51/f63 [0,4194304] 0 2024-02-15T22:51:16.080 INFO:tasks.workunit.client.1.smithi170.stdout:6/401: write d3/d1d/d53/d5f/f8c [619219,91438] 0 2024-02-15T22:51:16.080 INFO:tasks.workunit.client.1.smithi170.stdout:3/349: truncate d3/dc/d1c/f1e 135891 0 2024-02-15T22:51:16.084 INFO:tasks.workunit.client.1.smithi170.stdout:5/424: getdents de/d10/d7d 0 2024-02-15T22:51:16.085 INFO:tasks.workunit.client.1.smithi170.stdout:5/425: readlink de/l2f 0 2024-02-15T22:51:16.085 INFO:tasks.workunit.client.1.smithi170.stdout:5/426: fdatasync fd 0 2024-02-15T22:51:16.085 INFO:tasks.workunit.client.1.smithi170.stdout:3/350: dread d3/f3f [0,4194304] 0 2024-02-15T22:51:16.085 INFO:tasks.workunit.client.1.smithi170.stdout:1/387: truncate d3/d24/d34/d4a/f4e 2423018 0 2024-02-15T22:51:16.087 INFO:tasks.workunit.client.1.smithi170.stdout:9/275: truncate de/f14 2761898 0 2024-02-15T22:51:16.089 INFO:tasks.workunit.client.1.smithi170.stdout:8/282: creat d9/d18/d26/f54 x:0 0 0 2024-02-15T22:51:16.089 INFO:tasks.workunit.client.1.smithi170.stdout:8/283: write d9/d18/d32/d3b/f41 [1026436,120462] 0 2024-02-15T22:51:16.091 INFO:tasks.workunit.client.1.smithi170.stdout:7/345: rename da/d1a/d28 to da/d1a/d21/d4d/d59/d7c/d7d 0 2024-02-15T22:51:16.096 INFO:tasks.workunit.client.1.smithi170.stdout:6/402: mkdir d3/d24/d31/d94 0 2024-02-15T22:51:16.098 INFO:tasks.workunit.client.1.smithi170.stdout:1/388: creat d3/d24/d2c/d35/d83/f86 x:0 0 0 2024-02-15T22:51:16.099 INFO:tasks.workunit.client.1.smithi170.stdout:9/276: creat de/d1b/d1c/f5b x:0 0 0 2024-02-15T22:51:16.101 INFO:tasks.workunit.client.1.smithi170.stdout:3/351: rename d3/f16 to d3/d1b/f74 0 2024-02-15T22:51:16.101 INFO:tasks.workunit.client.1.smithi170.stdout:3/352: fsync d3/dc/d13/f43 0 2024-02-15T22:51:16.102 INFO:tasks.workunit.client.1.smithi170.stdout:6/403: mknod d3/d1d/d36/c95 0 2024-02-15T22:51:16.105 INFO:tasks.workunit.client.1.smithi170.stdout:5/427: getdents de/d10/d27/d2d 0 2024-02-15T22:51:16.105 INFO:tasks.workunit.client.1.smithi170.stdout:5/428: write de/d36/f5e [992198,115692] 0 2024-02-15T22:51:16.105 INFO:tasks.workunit.client.1.smithi170.stdout:1/389: chown d3/d24/l43 718 1 2024-02-15T22:51:16.106 INFO:tasks.workunit.client.1.smithi170.stdout:1/390: dread d3/d24/d2c/d35/f52 [0,4194304] 0 2024-02-15T22:51:16.108 INFO:tasks.workunit.client.1.smithi170.stdout:1/391: read d3/f1c [451704,107766] 0 2024-02-15T22:51:16.108 INFO:tasks.workunit.client.1.smithi170.stdout:1/392: truncate d3/f17 4734237 0 2024-02-15T22:51:16.108 INFO:tasks.workunit.client.1.smithi170.stdout:3/353: creat d3/d1b/d51/d6b/f75 x:0 0 0 2024-02-15T22:51:16.108 INFO:tasks.workunit.client.1.smithi170.stdout:3/354: creat d3/dc/d1c/f76 x:0 0 0 2024-02-15T22:51:16.113 INFO:tasks.workunit.client.1.smithi170.stdout:5/429: dread de/d10/f32 [0,4194304] 0 2024-02-15T22:51:16.113 INFO:tasks.workunit.client.1.smithi170.stdout:1/393: getdents d3/d24 0 2024-02-15T22:51:16.117 INFO:tasks.workunit.client.1.smithi170.stdout:1/394: rename d3/d24/d2c/d35/d72/d7e/f80 to d3/d24/d34/d65/f87 0 2024-02-15T22:51:16.118 INFO:tasks.workunit.client.1.smithi170.stdout:5/430: getdents de/d10/d52 0 2024-02-15T22:51:16.120 INFO:tasks.workunit.client.1.smithi170.stdout:1/395: mknod d3/d24/d2c/d35/d72/c88 0 2024-02-15T22:51:16.120 INFO:tasks.workunit.client.1.smithi170.stdout:1/396: fdatasync d3/d24/d2c/d5e/f5f 0 2024-02-15T22:51:16.122 INFO:tasks.workunit.client.1.smithi170.stdout:1/397: link d3/d24/l33 d3/d24/d34/d4a/l89 0 2024-02-15T22:51:16.123 INFO:tasks.workunit.client.1.smithi170.stdout:5/431: getdents de/d10/d27/d2d/d51/d7c/d87 0 2024-02-15T22:51:16.127 INFO:tasks.workunit.client.1.smithi170.stdout:1/398: getdents d3/d24/d2c 0 2024-02-15T22:51:16.127 INFO:tasks.workunit.client.1.smithi170.stdout:1/399: write d3/d24/d2c/f49 [975564,116049] 0 2024-02-15T22:51:16.127 INFO:tasks.workunit.client.1.smithi170.stdout:1/400: creat d3/d24/d2c/d5e/f8a x:0 0 0 2024-02-15T22:51:16.128 INFO:tasks.workunit.client.1.smithi170.stdout:1/401: dread d3/d24/d2c/d35/f82 [0,4194304] 0 2024-02-15T22:51:16.128 INFO:tasks.workunit.client.1.smithi170.stdout:1/402: creat d3/d24/d2c/d35/d72/f8b x:0 0 0 2024-02-15T22:51:16.133 INFO:tasks.workunit.client.1.smithi170.stdout:1/403: rename d3/d24/d2c/d35/c42 to d3/d24/d2c/d35/d83/c8c 0 2024-02-15T22:51:16.135 INFO:tasks.workunit.client.1.smithi170.stdout:0/276: write d8/d14/d1c/d3f/d51/f5a [1463975,821] 0 2024-02-15T22:51:16.135 INFO:tasks.workunit.client.1.smithi170.stdout:1/404: creat d3/d24/f8d x:0 0 0 2024-02-15T22:51:16.137 INFO:tasks.workunit.client.1.smithi170.stdout:0/277: mknod d8/d14/d1c/d3f/d51/c5d 0 2024-02-15T22:51:16.137 INFO:tasks.workunit.client.1.smithi170.stdout:0/278: fdatasync d8/d14/f16 0 2024-02-15T22:51:16.138 INFO:tasks.workunit.client.1.smithi170.stdout:0/279: truncate d8/f2a 182332 0 2024-02-15T22:51:16.142 INFO:tasks.workunit.client.1.smithi170.stdout:7/346: dwrite da/f12 [8388608,4194304] 0 2024-02-15T22:51:16.143 INFO:tasks.workunit.client.1.smithi170.stdout:4/346: dwrite d0/d22/da/d11/f45 [4194304,4194304] 0 2024-02-15T22:51:16.145 INFO:tasks.workunit.client.1.smithi170.stdout:7/347: mkdir da/d1a/d21/d4d/d6e/d7e 0 2024-02-15T22:51:16.150 INFO:tasks.workunit.client.1.smithi170.stdout:9/277: dread de/f2f [0,4194304] 0 2024-02-15T22:51:16.150 INFO:tasks.workunit.client.1.smithi170.stdout:9/278: truncate de/d1b/f57 858901 0 2024-02-15T22:51:16.152 INFO:tasks.workunit.client.1.smithi170.stdout:9/279: dread de/d1b/f57 [0,4194304] 0 2024-02-15T22:51:16.152 INFO:tasks.workunit.client.1.smithi170.stdout:8/284: read d9/f2d [4098239,100825] 0 2024-02-15T22:51:16.154 INFO:tasks.workunit.client.1.smithi170.stdout:9/280: symlink de/d1b/d1c/d1f/d20/l5c 0 2024-02-15T22:51:16.156 INFO:tasks.workunit.client.1.smithi170.stdout:8/285: rename d9/f10 to d9/d18/d26/f55 0 2024-02-15T22:51:16.156 INFO:tasks.workunit.client.1.smithi170.stdout:8/286: write d9/f1d [3318224,120431] 0 2024-02-15T22:51:16.157 INFO:tasks.workunit.client.1.smithi170.stdout:0/280: write d8/d14/d44/f4c [1180552,78730] 0 2024-02-15T22:51:16.157 INFO:tasks.workunit.client.1.smithi170.stdout:0/281: chown d8/d14/d1c/f35 330665917 1 2024-02-15T22:51:16.158 INFO:tasks.workunit.client.1.smithi170.stdout:9/281: rmdir de/d1b/d1c/d1f/d4c 0 2024-02-15T22:51:16.161 INFO:tasks.workunit.client.1.smithi170.stdout:9/282: dread de/f18 [0,4194304] 0 2024-02-15T22:51:16.161 INFO:tasks.workunit.client.1.smithi170.stdout:6/404: dwrite d3/d1d/f7b [0,4194304] 0 2024-02-15T22:51:16.161 INFO:tasks.workunit.client.1.smithi170.stdout:7/348: dread da/d1a/d21/d4d/d59/f6c [0,4194304] 0 2024-02-15T22:51:16.161 INFO:tasks.workunit.client.1.smithi170.stdout:7/349: creat da/d1a/f7f x:0 0 0 2024-02-15T22:51:16.161 INFO:tasks.workunit.client.1.smithi170.stdout:7/350: fdatasync da/f12 0 2024-02-15T22:51:16.163 INFO:tasks.workunit.client.1.smithi170.stdout:8/287: rename d9/lc to d9/d18/d32/d3b/d4b/l56 0 2024-02-15T22:51:16.164 INFO:tasks.workunit.client.1.smithi170.stdout:7/351: dread da/f13 [4194304,4194304] 0 2024-02-15T22:51:16.164 INFO:tasks.workunit.client.1.smithi170.stdout:7/352: fdatasync da/d1a/d21/d4d/d59/f5e 0 2024-02-15T22:51:16.164 INFO:tasks.workunit.client.1.smithi170.stdout:7/353: write da/d1a/d21/d1b/d69/f76 [899810,93814] 0 2024-02-15T22:51:16.165 INFO:tasks.workunit.client.1.smithi170.stdout:7/354: chown da/d1a/d21/d2c/c5f 3920 1 2024-02-15T22:51:16.165 INFO:tasks.workunit.client.1.smithi170.stdout:1/405: dwrite d3/d24/f51 [0,4194304] 0 2024-02-15T22:51:16.165 INFO:tasks.workunit.client.1.smithi170.stdout:5/432: dwrite de/d10/f6b [0,4194304] 0 2024-02-15T22:51:16.165 INFO:tasks.workunit.client.1.smithi170.stdout:4/347: dwrite d0/d22/da/d11/d20/f23 [0,4194304] 0 2024-02-15T22:51:16.165 INFO:tasks.workunit.client.1.smithi170.stdout:4/348: fdatasync d0/d22/da/d32/d47/d2b/f4c 0 2024-02-15T22:51:16.166 INFO:tasks.workunit.client.1.smithi170.stdout:3/355: dwrite d3/d1b/f74 [0,4194304] 0 2024-02-15T22:51:16.166 INFO:tasks.workunit.client.1.smithi170.stdout:3/356: creat d3/d1b/d2c/f77 x:0 0 0 2024-02-15T22:51:16.168 INFO:tasks.workunit.client.1.smithi170.stdout:9/283: link de/d1b/d1c/d1f/d20/d27/d28/c34 de/d1b/d1c/d1f/d20/d27/c5d 0 2024-02-15T22:51:16.168 INFO:tasks.workunit.client.1.smithi170.stdout:9/284: chown de/d1b/d1c/d1f/c26 1852360 1 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/405: unlink d3/d1d/d27/d70/l86 0 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/406: truncate d3/d24/f35 255897 0 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/407: fsync f2 0 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/408: fsync d3/d1d/d36/d56/f59 0 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/409: chown d3/d1d/d36/d51/d54 2161 1 2024-02-15T22:51:16.169 INFO:tasks.workunit.client.1.smithi170.stdout:6/410: chown d3/d1d/d28/c39 246145381 1 2024-02-15T22:51:16.170 INFO:tasks.workunit.client.1.smithi170.stdout:6/411: dread d3/d1d/d36/f11 [0,4194304] 0 2024-02-15T22:51:16.171 INFO:tasks.workunit.client.1.smithi170.stdout:8/288: unlink d9/d18/l4d 0 2024-02-15T22:51:16.176 INFO:tasks.workunit.client.1.smithi170.stdout:1/406: rename d3/d24/d2c/l7a to d3/d24/d2c/d35/d72/l8e 0 2024-02-15T22:51:16.177 INFO:tasks.workunit.client.1.smithi170.stdout:1/407: chown d3/d24/d34/f57 14531 1 2024-02-15T22:51:16.177 INFO:tasks.workunit.client.1.smithi170.stdout:1/408: chown d3/d24/f51 1768 1 2024-02-15T22:51:16.178 INFO:tasks.workunit.client.1.smithi170.stdout:0/282: dwrite d8/f3b [0,4194304] 0 2024-02-15T22:51:16.181 INFO:tasks.workunit.client.1.smithi170.stdout:3/357: unlink d3/dc/l71 0 2024-02-15T22:51:16.182 INFO:tasks.workunit.client.1.smithi170.stdout:9/285: mknod de/d1b/d1c/d1f/d20/d27/c5e 0 2024-02-15T22:51:16.184 INFO:tasks.workunit.client.1.smithi170.stdout:6/412: mkdir d3/d1d/d53/d5f/d62/d96 0 2024-02-15T22:51:16.184 INFO:tasks.workunit.client.1.smithi170.stdout:6/413: chown d3/d1d/d53/c5a 2637078 1 2024-02-15T22:51:16.185 INFO:tasks.workunit.client.1.smithi170.stdout:1/409: rmdir d3/d24/d34/d4a 39 2024-02-15T22:51:16.185 INFO:tasks.workunit.client.1.smithi170.stdout:5/433: dwrite de/d10/d52/f8b [0,4194304] 0 2024-02-15T22:51:16.185 INFO:tasks.workunit.client.1.smithi170.stdout:5/434: chown de/d10/d52 48 1 2024-02-15T22:51:16.193 INFO:tasks.workunit.client.1.smithi170.stdout:5/435: dread de/f26 [0,4194304] 0 2024-02-15T22:51:16.193 INFO:tasks.workunit.client.1.smithi170.stdout:5/436: fdatasync de/d10/f13 0 2024-02-15T22:51:16.200 INFO:tasks.workunit.client.1.smithi170.stdout:0/283: mknod d8/df/d13/c5e 0 2024-02-15T22:51:16.201 INFO:tasks.workunit.client.1.smithi170.stdout:3/358: mkdir d3/d78 0 2024-02-15T22:51:16.202 INFO:tasks.workunit.client.1.smithi170.stdout:4/349: dwrite d0/d22/f34 [4194304,4194304] 0 2024-02-15T22:51:16.202 INFO:tasks.workunit.client.1.smithi170.stdout:4/350: dread - d0/d22/da/f43 zero size 2024-02-15T22:51:16.202 INFO:tasks.workunit.client.1.smithi170.stdout:8/289: dwrite d9/d18/d32/f3e [0,4194304] 0 2024-02-15T22:51:16.203 INFO:tasks.workunit.client.1.smithi170.stdout:7/355: dwrite da/d1a/d21/d1b/d69/f76 [0,4194304] 0 2024-02-15T22:51:16.204 INFO:tasks.workunit.client.1.smithi170.stdout:9/286: creat de/d1b/d1c/d1f/d20/d27/d2c/f5f x:0 0 0 2024-02-15T22:51:16.204 INFO:tasks.workunit.client.1.smithi170.stdout:6/414: symlink d3/d1d/l97 0 2024-02-15T22:51:16.204 INFO:tasks.workunit.client.1.smithi170.stdout:6/415: fdatasync d3/d1d/d28/f7d 0 2024-02-15T22:51:16.207 INFO:tasks.workunit.client.1.smithi170.stdout:1/410: mkdir d3/d24/d2c/d77/d8f 0 2024-02-15T22:51:16.210 INFO:tasks.workunit.client.1.smithi170.stdout:5/437: mkdir de/d10/d27/d4c/d53/d55/d95 0 2024-02-15T22:51:16.211 INFO:tasks.workunit.client.1.smithi170.stdout:5/438: write f1 [1328287,12557] 0 2024-02-15T22:51:16.211 INFO:tasks.workunit.client.1.smithi170.stdout:5/439: fdatasync de/d10/d27/d2d/d51/f78 0 2024-02-15T22:51:16.212 INFO:tasks.workunit.client.1.smithi170.stdout:0/284: rename d8/d14/d44/c52 to d8/df/c5f 0 2024-02-15T22:51:16.217 INFO:tasks.workunit.client.1.smithi170.stdout:7/356: unlink da/d1a/f7f 0 2024-02-15T22:51:16.217 INFO:tasks.workunit.client.1.smithi170.stdout:7/357: stat da/d1a/d21 0 2024-02-15T22:51:16.218 INFO:tasks.workunit.client.1.smithi170.stdout:9/287: mknod de/d1b/d1c/c60 0 2024-02-15T22:51:16.218 INFO:tasks.workunit.client.1.smithi170.stdout:3/359: write d3/f72 [7249675,32052] 0 2024-02-15T22:51:16.218 INFO:tasks.workunit.client.1.smithi170.stdout:3/360: write d3/db/d1f/f4e [2448860,49136] 0 2024-02-15T22:51:16.218 INFO:tasks.workunit.client.1.smithi170.stdout:5/440: mknod de/d10/d27/c96 0 2024-02-15T22:51:16.219 INFO:tasks.workunit.client.1.smithi170.stdout:4/351: dwrite d0/d22/da/d32/f4f [0,4194304] 0 2024-02-15T22:51:16.221 INFO:tasks.workunit.client.1.smithi170.stdout:8/290: symlink d9/l57 0 2024-02-15T22:51:16.225 INFO:tasks.workunit.client.1.smithi170.stdout:7/358: rmdir da/d1a/d21/d4d/d59/d7c/d7d/d72/d73 0 2024-02-15T22:51:16.225 INFO:tasks.workunit.client.1.smithi170.stdout:7/359: write da/d1a/d21/d4d/d59/f5e [912992,97866] 0 2024-02-15T22:51:16.225 INFO:tasks.workunit.client.1.smithi170.stdout:7/360: readlink da/d1a/d21/d1b/l6b 0 2024-02-15T22:51:16.229 INFO:tasks.workunit.client.1.smithi170.stdout:3/361: mknod d3/db/c79 0 2024-02-15T22:51:16.230 INFO:tasks.workunit.client.1.smithi170.stdout:6/416: dwrite d3/d1a/f40 [4194304,4194304] 0 2024-02-15T22:51:16.230 INFO:tasks.workunit.client.1.smithi170.stdout:6/417: fsync d3/d1d/d28/d66/f68 0 2024-02-15T22:51:16.230 INFO:tasks.workunit.client.1.smithi170.stdout:6/418: fsync d3/d1d/d36/f58 0 2024-02-15T22:51:16.232 INFO:tasks.workunit.client.1.smithi170.stdout:1/411: dwrite d3/f17 [0,4194304] 0 2024-02-15T22:51:16.233 INFO:tasks.workunit.client.1.smithi170.stdout:4/352: symlink d0/d22/da/d11/d20/d49/l65 0 2024-02-15T22:51:16.233 INFO:tasks.workunit.client.1.smithi170.stdout:4/353: read - d0/d22/da/f43 zero size 2024-02-15T22:51:16.233 INFO:tasks.workunit.client.1.smithi170.stdout:4/354: creat d0/d22/da/d11/d20/f66 x:0 0 0 2024-02-15T22:51:16.233 INFO:tasks.workunit.client.1.smithi170.stdout:8/291: getdents d9/d18/d48 0 2024-02-15T22:51:16.239 INFO:tasks.workunit.client.1.smithi170.stdout:7/361: unlink da/f6f 0 2024-02-15T22:51:16.239 INFO:tasks.workunit.client.1.smithi170.stdout:2/346: sync 2024-02-15T22:51:16.240 INFO:tasks.workunit.client.1.smithi170.stdout:9/288: dwrite fb [0,4194304] 0 2024-02-15T22:51:16.242 INFO:tasks.workunit.client.1.smithi170.stdout:1/412: mknod d3/c90 0 2024-02-15T22:51:16.242 INFO:tasks.workunit.client.1.smithi170.stdout:5/441: dwrite de/d10/d27/f54 [0,4194304] 0 2024-02-15T22:51:16.243 INFO:tasks.workunit.client.1.smithi170.stdout:5/442: chown de/d10/d52/f8b 81160 1 2024-02-15T22:51:16.247 INFO:tasks.workunit.client.1.smithi170.stdout:4/355: mkdir d0/d22/da/d32/d47/d67 0 2024-02-15T22:51:16.250 INFO:tasks.workunit.client.1.smithi170.stdout:2/347: rename d0/d1/f4d to d0/d28/f85 0 2024-02-15T22:51:16.251 INFO:tasks.workunit.client.1.smithi170.stdout:2/348: creat d0/d1/d11/f86 x:0 0 0 2024-02-15T22:51:16.251 INFO:tasks.workunit.client.1.smithi170.stdout:2/349: chown d0/d1d/d3d/c80 1073515594 1 2024-02-15T22:51:16.251 INFO:tasks.workunit.client.1.smithi170.stdout:2/350: write d0/d28/d2f/f65 [1116718,5590] 0 2024-02-15T22:51:16.253 INFO:tasks.workunit.client.1.smithi170.stdout:6/419: dwrite d3/d1a/f33 [0,4194304] 0 2024-02-15T22:51:16.255 INFO:tasks.workunit.client.1.smithi170.stdout:9/289: truncate de/d1b/f25 834194 0 2024-02-15T22:51:16.256 INFO:tasks.workunit.client.1.smithi170.stdout:3/362: dwrite d3/db/d1f/f2f [0,4194304] 0 2024-02-15T22:51:16.259 INFO:tasks.workunit.client.1.smithi170.stdout:5/443: symlink de/d36/d80/l97 0 2024-02-15T22:51:16.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/292: mknod d9/d18/c58 0 2024-02-15T22:51:16.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/293: chown d9/l2f 1264757 1 2024-02-15T22:51:16.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/294: creat d9/d18/d32/f59 x:0 0 0 2024-02-15T22:51:16.263 INFO:tasks.workunit.client.1.smithi170.stdout:2/351: mknod d0/d1/d5f/c87 0 2024-02-15T22:51:16.263 INFO:tasks.workunit.client.1.smithi170.stdout:2/352: fdatasync d0/d28/d3e/f44 0 2024-02-15T22:51:16.263 INFO:tasks.workunit.client.1.smithi170.stdout:2/353: chown d0/d13/c21 123212 1 2024-02-15T22:51:16.266 INFO:tasks.workunit.client.1.smithi170.stdout:6/420: mknod d3/d1d/d36/d51/d54/c98 0 2024-02-15T22:51:16.266 INFO:tasks.workunit.client.1.smithi170.stdout:6/421: fdatasync d3/d24/d31/f44 0 2024-02-15T22:51:16.268 INFO:tasks.workunit.client.1.smithi170.stdout:9/290: creat de/d1b/d1c/d1f/f61 x:0 0 0 2024-02-15T22:51:16.268 INFO:tasks.workunit.client.1.smithi170.stdout:9/291: chown de/d1b/d1c/d1f/d20/d27/d2c/c31 117918 1 2024-02-15T22:51:16.268 INFO:tasks.workunit.client.1.smithi170.stdout:9/292: fsync de/d1b/f58 0 2024-02-15T22:51:16.268 INFO:tasks.workunit.client.1.smithi170.stdout:5/444: read de/f4b [5551780,79735] 0 2024-02-15T22:51:16.269 INFO:tasks.workunit.client.1.smithi170.stdout:3/363: unlink d3/c21 0 2024-02-15T22:51:16.269 INFO:tasks.workunit.client.1.smithi170.stdout:3/364: fsync d3/d1b/d2c/f4b 0 2024-02-15T22:51:16.269 INFO:tasks.workunit.client.1.smithi170.stdout:3/365: chown d3/db/d1f 99218448 1 2024-02-15T22:51:16.270 INFO:tasks.workunit.client.1.smithi170.stdout:7/362: dwrite da/d1a/d21/d1b/f79 [0,4194304] 0 2024-02-15T22:51:16.270 INFO:tasks.workunit.client.1.smithi170.stdout:7/363: readlink da/d1a/d21/d4d/d59/d7c/d7d/l34 0 2024-02-15T22:51:16.271 INFO:tasks.workunit.client.1.smithi170.stdout:4/356: dwrite d0/d22/da/d11/d20/f4d [0,4194304] 0 2024-02-15T22:51:16.271 INFO:tasks.workunit.client.1.smithi170.stdout:4/357: write d0/d22/da/d32/d47/f25 [117477,129513] 0 2024-02-15T22:51:16.271 INFO:tasks.workunit.client.1.smithi170.stdout:9/293: truncate de/f1a 27603 0 2024-02-15T22:51:16.273 INFO:tasks.workunit.client.1.smithi170.stdout:5/445: creat de/d10/d27/d2d/f98 x:0 0 0 2024-02-15T22:51:16.274 INFO:tasks.workunit.client.1.smithi170.stdout:5/446: fdatasync de/f21 0 2024-02-15T22:51:16.274 INFO:tasks.workunit.client.1.smithi170.stdout:5/447: truncate de/d36/f74 364761 0 2024-02-15T22:51:16.275 INFO:tasks.workunit.client.1.smithi170.stdout:3/366: mkdir d3/d78/d7a 0 2024-02-15T22:51:16.275 INFO:tasks.workunit.client.1.smithi170.stdout:1/413: dwrite d3/d24/d34/f3b [0,4194304] 0 2024-02-15T22:51:16.278 INFO:tasks.workunit.client.1.smithi170.stdout:7/364: rename l2 to da/d1a/d21/d4d/d59/l80 0 2024-02-15T22:51:16.278 INFO:tasks.workunit.client.1.smithi170.stdout:7/365: chown da/d1a/d21/d1b/c58 2811521 1 2024-02-15T22:51:16.280 INFO:tasks.workunit.client.1.smithi170.stdout:5/448: write de/d10/d33/f42 [1550675,29888] 0 2024-02-15T22:51:16.285 INFO:tasks.workunit.client.1.smithi170.stdout:3/367: mknod d3/dc/d1c/d3d/d5d/c7b 0 2024-02-15T22:51:16.290 INFO:tasks.workunit.client.1.smithi170.stdout:8/295: dwrite d9/fd [0,4194304] 0 2024-02-15T22:51:16.291 INFO:tasks.workunit.client.1.smithi170.stdout:6/422: dwrite d3/d1d/d27/f52 [0,4194304] 0 2024-02-15T22:51:16.291 INFO:tasks.workunit.client.1.smithi170.stdout:6/423: stat d3/d1d/d27/f5b 0 2024-02-15T22:51:16.291 INFO:tasks.workunit.client.1.smithi170.stdout:1/414: write d3/d24/d34/f3b [1731769,73007] 0 2024-02-15T22:51:16.291 INFO:tasks.workunit.client.1.smithi170.stdout:6/424: write d3/d1d/d53/f93 [67863,14782] 0 2024-02-15T22:51:16.293 INFO:tasks.workunit.client.1.smithi170.stdout:3/368: write d3/f9 [2770781,46080] 0 2024-02-15T22:51:16.293 INFO:tasks.workunit.client.1.smithi170.stdout:3/369: read - d3/d2b/f4f zero size 2024-02-15T22:51:16.298 INFO:tasks.workunit.client.1.smithi170.stdout:4/358: rename d0/d22/da/f27 to d0/d22/da/d32/d47/d2b/f68 0 2024-02-15T22:51:16.300 INFO:tasks.workunit.client.1.smithi170.stdout:7/366: symlink da/d1a/d21/d2c/d71/l81 0 2024-02-15T22:51:16.304 INFO:tasks.workunit.client.1.smithi170.stdout:5/449: mkdir de/d10/d27/d2d/d51/d7c/d99 0 2024-02-15T22:51:16.306 INFO:tasks.workunit.client.1.smithi170.stdout:5/450: write de/f16 [1607374,62995] 0 2024-02-15T22:51:16.307 INFO:tasks.workunit.client.1.smithi170.stdout:5/451: chown de/d10/d27/d2d/d51/f69 0 1 2024-02-15T22:51:16.307 INFO:tasks.workunit.client.1.smithi170.stdout:5/452: chown de/d10/d52/f8b 0 1 2024-02-15T22:51:16.309 INFO:tasks.workunit.client.1.smithi170.stdout:8/296: unlink d9/d18/d26/f3f 0 2024-02-15T22:51:16.312 INFO:tasks.workunit.client.1.smithi170.stdout:6/425: creat d3/f99 x:0 0 0 2024-02-15T22:51:16.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/370: symlink d3/dc/l7c 0 2024-02-15T22:51:16.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/371: readlink d3/dc/d13/l23 0 2024-02-15T22:51:16.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/372: chown d3/dc/d1c/f73 54357950 1 2024-02-15T22:51:16.322 INFO:tasks.workunit.client.1.smithi170.stdout:9/294: rename de/d1b/d1c/d1f/d20/d27/d2c/f5f to de/d1b/d1c/f62 0 2024-02-15T22:51:16.322 INFO:tasks.workunit.client.1.smithi170.stdout:9/295: truncate f7 8980251 0 2024-02-15T22:51:16.322 INFO:tasks.workunit.client.1.smithi170.stdout:9/296: stat de/d1b/d1c/d47 0 2024-02-15T22:51:16.323 INFO:tasks.workunit.client.1.smithi170.stdout:7/367: dwrite da/fe [4194304,4194304] 0 2024-02-15T22:51:16.324 INFO:tasks.workunit.client.1.smithi170.stdout:5/453: creat de/d36/d80/f9a x:0 0 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:4/359: dwrite d0/d22/da/f43 [0,4194304] 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/415: mkdir d3/d24/d91 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/416: readlink d3/l18 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:4/360: stat d0/d22/da/d32/c3f 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/417: write d3/fb [1664752,90571] 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/418: truncate d3/d24/d2c/f49 2090952 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/419: write d3/d24/d34/f57 [540022,95798] 0 2024-02-15T22:51:16.326 INFO:tasks.workunit.client.1.smithi170.stdout:1/420: write d3/d24/d34/d65/f69 [40294,43546] 0 2024-02-15T22:51:16.327 INFO:tasks.workunit.client.1.smithi170.stdout:8/297: read d9/f16 [2631437,38563] 0 2024-02-15T22:51:16.328 INFO:tasks.workunit.client.1.smithi170.stdout:7/368: creat da/d1a/d21/d2c/d74/f82 x:0 0 0 2024-02-15T22:51:16.328 INFO:tasks.workunit.client.1.smithi170.stdout:7/369: stat c4 0 2024-02-15T22:51:16.329 INFO:tasks.workunit.client.1.smithi170.stdout:5/454: rmdir de/d10/d52 39 2024-02-15T22:51:16.329 INFO:tasks.workunit.client.1.smithi170.stdout:5/455: creat de/d29/f9b x:0 0 0 2024-02-15T22:51:16.332 INFO:tasks.workunit.client.1.smithi170.stdout:9/297: dread de/d1b/d1c/d1f/d20/f21 [4194304,4194304] 0 2024-02-15T22:51:16.332 INFO:tasks.workunit.client.1.smithi170.stdout:9/298: chown de/d1b/d1c/d1f/d20/d27/c5d 6041 1 2024-02-15T22:51:16.336 INFO:tasks.workunit.client.1.smithi170.stdout:8/298: rename d9/d18/d26/c28 to d9/d18/d32/c5a 0 2024-02-15T22:51:16.336 INFO:tasks.workunit.client.1.smithi170.stdout:4/361: dread d0/d22/da/d32/d47/f4b [0,4194304] 0 2024-02-15T22:51:16.340 INFO:tasks.workunit.client.1.smithi170.stdout:5/456: mknod de/c9c 0 2024-02-15T22:51:16.342 INFO:tasks.workunit.client.1.smithi170.stdout:7/370: read da/d1a/d21/d1b/d69/f76 [4174827,50094] 0 2024-02-15T22:51:16.342 INFO:tasks.workunit.client.1.smithi170.stdout:9/299: unlink de/l16 0 2024-02-15T22:51:16.342 INFO:tasks.workunit.client.1.smithi170.stdout:6/426: dwrite d3/d1d/d36/f22 [0,4194304] 0 2024-02-15T22:51:16.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/373: dwrite d3/dc/d1c/d3d/f53 [0,4194304] 0 2024-02-15T22:51:16.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/374: truncate d3/dc/d1c/d3d/f63 157800 0 2024-02-15T22:51:16.344 INFO:tasks.workunit.client.1.smithi170.stdout:1/421: dwrite d3/d24/d2c/d35/f75 [0,4194304] 0 2024-02-15T22:51:16.345 INFO:tasks.workunit.client.1.smithi170.stdout:4/362: creat d0/d22/da/d32/d47/d5e/f69 x:0 0 0 2024-02-15T22:51:16.348 INFO:tasks.workunit.client.1.smithi170.stdout:5/457: truncate de/d36/f41 3729339 0 2024-02-15T22:51:16.349 INFO:tasks.workunit.client.1.smithi170.stdout:7/371: getdents da/d1a/d21/d4d/d6e 0 2024-02-15T22:51:16.351 INFO:tasks.workunit.client.1.smithi170.stdout:9/300: creat de/d1b/d37/f63 x:0 0 0 2024-02-15T22:51:16.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/375: mkdir d3/dc/d1c/d26/d55/d7d 0 2024-02-15T22:51:16.359 INFO:tasks.workunit.client.1.smithi170.stdout:1/422: truncate d3/f1e 2726406 0 2024-02-15T22:51:16.359 INFO:tasks.workunit.client.1.smithi170.stdout:1/423: write d3/d24/d34/d65/f69 [616220,114673] 0 2024-02-15T22:51:16.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/363: creat d0/d22/da/f6a x:0 0 0 2024-02-15T22:51:16.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/364: chown d0/d22/da/d11/d20/d49/c59 226803 1 2024-02-15T22:51:16.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/365: stat d0/d22/da/d32/d47/d67 0 2024-02-15T22:51:16.363 INFO:tasks.workunit.client.1.smithi170.stdout:5/458: mknod de/d10/d27/d2d/c9d 0 2024-02-15T22:51:16.363 INFO:tasks.workunit.client.1.smithi170.stdout:6/427: dwrite d3/f5 [0,4194304] 0 2024-02-15T22:51:16.365 INFO:tasks.workunit.client.1.smithi170.stdout:7/372: unlink da/d1a/d21/d4d/d59/l80 0 2024-02-15T22:51:16.368 INFO:tasks.workunit.client.1.smithi170.stdout:9/301: rename de/d1b/f58 to de/d1b/d1c/d1f/d20/d27/d28/f64 0 2024-02-15T22:51:16.372 INFO:tasks.workunit.client.1.smithi170.stdout:4/366: unlink d0/d22/da/f2d 0 2024-02-15T22:51:16.372 INFO:tasks.workunit.client.1.smithi170.stdout:4/367: fdatasync d0/d22/da/d11/d20/f66 0 2024-02-15T22:51:16.375 INFO:tasks.workunit.client.1.smithi170.stdout:5/459: unlink de/d10/l2c 0 2024-02-15T22:51:16.377 INFO:tasks.workunit.client.1.smithi170.stdout:6/428: unlink d3/d1d/d1b/f80 0 2024-02-15T22:51:16.379 INFO:tasks.workunit.client.1.smithi170.stdout:7/373: symlink da/d1a/d21/d4d/d59/l83 0 2024-02-15T22:51:16.381 INFO:tasks.workunit.client.1.smithi170.stdout:9/302: creat de/d1b/d1c/d1f/d20/f65 x:0 0 0 2024-02-15T22:51:16.382 INFO:tasks.workunit.client.1.smithi170.stdout:3/376: rmdir d3/dc/d1a 39 2024-02-15T22:51:16.385 INFO:tasks.workunit.client.1.smithi170.stdout:4/368: mkdir d0/d22/da/d58/d6b 0 2024-02-15T22:51:16.385 INFO:tasks.workunit.client.1.smithi170.stdout:4/369: truncate d0/d22/da/d11/d20/f66 578536 0 2024-02-15T22:51:16.385 INFO:tasks.workunit.client.1.smithi170.stdout:4/370: read d0/f21 [48276,88114] 0 2024-02-15T22:51:16.388 INFO:tasks.workunit.client.1.smithi170.stdout:5/460: mknod de/d10/d27/d2d/d51/d7c/c9e 0 2024-02-15T22:51:16.388 INFO:tasks.workunit.client.1.smithi170.stdout:5/461: chown de/d10/f23 423790 1 2024-02-15T22:51:16.389 INFO:tasks.workunit.client.1.smithi170.stdout:5/462: chown de/d36/c3c 66245869 1 2024-02-15T22:51:16.398 INFO:tasks.workunit.client.1.smithi170.stdout:3/377: mknod d3/dc/d1c/d3d/d5d/c7e 0 2024-02-15T22:51:16.398 INFO:tasks.workunit.client.1.smithi170.stdout:9/303: dwrite de/d1b/d1c/d1f/d20/d27/f29 [8388608,4194304] 0 2024-02-15T22:51:16.400 INFO:tasks.workunit.client.1.smithi170.stdout:4/371: symlink d0/d22/da/d32/d47/d5e/l6c 0 2024-02-15T22:51:16.401 INFO:tasks.workunit.client.1.smithi170.stdout:5/463: write de/d10/f23 [3872669,78230] 0 2024-02-15T22:51:16.405 INFO:tasks.workunit.client.1.smithi170.stdout:6/429: rmdir d3/d1d/d27/d70 39 2024-02-15T22:51:16.409 INFO:tasks.workunit.client.1.smithi170.stdout:7/374: getdents da/d57 0 2024-02-15T22:51:16.409 INFO:tasks.workunit.client.1.smithi170.stdout:7/375: write da/f13 [2087881,48481] 0 2024-02-15T22:51:16.410 INFO:tasks.workunit.client.1.smithi170.stdout:4/372: dread d0/d22/da/d11/d20/f4d [0,4194304] 0 2024-02-15T22:51:16.410 INFO:tasks.workunit.client.1.smithi170.stdout:4/373: chown d0/d22/da/d32/f4f 7872187 1 2024-02-15T22:51:16.410 INFO:tasks.workunit.client.1.smithi170.stdout:4/374: chown d0/d22/da/d11/d20/d49/f53 425855 1 2024-02-15T22:51:16.414 INFO:tasks.workunit.client.1.smithi170.stdout:3/378: truncate d3/d2b/f57 464997 0 2024-02-15T22:51:16.417 INFO:tasks.workunit.client.1.smithi170.stdout:5/464: truncate de/d29/f5a 652440 0 2024-02-15T22:51:16.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/430: unlink d3/d1d/d36/d56/f64 0 2024-02-15T22:51:16.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/431: creat d3/d1d/d53/d5f/f9a x:0 0 0 2024-02-15T22:51:16.424 INFO:tasks.workunit.client.1.smithi170.stdout:3/379: write d3/db/d1f/f41 [1581284,41194] 0 2024-02-15T22:51:16.424 INFO:tasks.workunit.client.1.smithi170.stdout:3/380: read d3/f9 [2978566,18276] 0 2024-02-15T22:51:16.426 INFO:tasks.workunit.client.1.smithi170.stdout:7/376: getdents da/d1a/d21/d4d/d59/d7c/d7d/d72 0 2024-02-15T22:51:16.426 INFO:tasks.workunit.client.1.smithi170.stdout:7/377: write da/d1a/d21/d2c/f6a [833009,57768] 0 2024-02-15T22:51:16.428 INFO:tasks.workunit.client.1.smithi170.stdout:4/375: mkdir d0/d22/da/d6d 0 2024-02-15T22:51:16.431 INFO:tasks.workunit.client.1.smithi170.stdout:9/304: creat de/d1b/d1c/d1f/d20/d27/f66 x:0 0 0 2024-02-15T22:51:16.434 INFO:tasks.workunit.client.1.smithi170.stdout:6/432: mkdir d3/d1d/d1b/d9b 0 2024-02-15T22:51:16.438 INFO:tasks.workunit.client.1.smithi170.stdout:7/378: write da/d1a/d21/d4d/d59/f6c [372464,127647] 0 2024-02-15T22:51:16.438 INFO:tasks.workunit.client.1.smithi170.stdout:7/379: write da/d1a/d21/f51 [4830321,36475] 0 2024-02-15T22:51:16.438 INFO:tasks.workunit.client.1.smithi170.stdout:7/380: chown da/l4f 47 1 2024-02-15T22:51:16.439 INFO:tasks.workunit.client.1.smithi170.stdout:9/305: mknod de/d1b/d37/c67 0 2024-02-15T22:51:16.441 INFO:tasks.workunit.client.1.smithi170.stdout:6/433: mkdir d3/d1d/d1b/d3e/d9c 0 2024-02-15T22:51:16.441 INFO:tasks.workunit.client.1.smithi170.stdout:6/434: chown d3/d1d/d1b/d3e/d9c 24563 1 2024-02-15T22:51:16.443 INFO:tasks.workunit.client.1.smithi170.stdout:7/381: truncate da/d1a/d21/d1b/f77 515042 0 2024-02-15T22:51:16.443 INFO:tasks.workunit.client.1.smithi170.stdout:7/382: stat da/d1a/d21/f51 0 2024-02-15T22:51:16.443 INFO:tasks.workunit.client.1.smithi170.stdout:5/465: dwrite de/d10/d27/d2d/d51/d7c/f89 [0,4194304] 0 2024-02-15T22:51:16.450 INFO:tasks.workunit.client.1.smithi170.stdout:9/306: mknod de/d1b/d1c/c68 0 2024-02-15T22:51:16.451 INFO:tasks.workunit.client.1.smithi170.stdout:4/376: dwrite d0/d22/da/f43 [0,4194304] 0 2024-02-15T22:51:16.451 INFO:tasks.workunit.client.1.smithi170.stdout:3/381: dwrite d3/dc/d13/f4a [0,4194304] 0 2024-02-15T22:51:16.454 INFO:tasks.workunit.client.1.smithi170.stdout:7/383: dread da/fe [4194304,4194304] 0 2024-02-15T22:51:16.455 INFO:tasks.workunit.client.1.smithi170.stdout:4/377: mkdir d0/d22/d6e 0 2024-02-15T22:51:16.462 INFO:tasks.workunit.client.1.smithi170.stdout:6/435: rmdir d3/d1d/d27 39 2024-02-15T22:51:16.462 INFO:tasks.workunit.client.1.smithi170.stdout:6/436: truncate d3/d24/f77 354293 0 2024-02-15T22:51:16.463 INFO:tasks.workunit.client.1.smithi170.stdout:9/307: read de/d1b/d1c/f2d [3396867,123530] 0 2024-02-15T22:51:16.477 INFO:tasks.workunit.client.1.smithi170.stdout:3/382: mknod d3/dc/c7f 0 2024-02-15T22:51:16.479 INFO:tasks.workunit.client.1.smithi170.stdout:4/378: link d0/d22/da/f13 d0/d22/da/d11/f6f 0 2024-02-15T22:51:16.479 INFO:tasks.workunit.client.1.smithi170.stdout:4/379: write d0/d22/da/d32/d47/d2b/f4c [505073,109504] 0 2024-02-15T22:51:16.481 INFO:tasks.workunit.client.1.smithi170.stdout:6/437: mknod d3/d1d/d1b/d9b/c9d 0 2024-02-15T22:51:16.483 INFO:tasks.workunit.client.1.smithi170.stdout:9/308: unlink de/d1b/d37/f63 0 2024-02-15T22:51:16.485 INFO:tasks.workunit.client.1.smithi170.stdout:5/466: rename de/d10/d27/d2d/d51 to de/d10/d33/d9f 0 2024-02-15T22:51:16.487 INFO:tasks.workunit.client.1.smithi170.stdout:4/380: mknod d0/c70 0 2024-02-15T22:51:16.490 INFO:tasks.workunit.client.1.smithi170.stdout:7/384: rename da/d1a/d21/d4d/d59/f5e to da/d1a/d21/d2c/f84 0 2024-02-15T22:51:16.491 INFO:tasks.workunit.client.1.smithi170.stdout:4/381: creat d0/d22/da/d6d/f71 x:0 0 0 2024-02-15T22:51:16.493 INFO:tasks.workunit.client.1.smithi170.stdout:3/383: write d3/dc/d13/f24 [1664570,99172] 0 2024-02-15T22:51:16.494 INFO:tasks.workunit.client.1.smithi170.stdout:7/385: mknod da/d1a/d21/d4d/d59/c85 0 2024-02-15T22:51:16.494 INFO:tasks.workunit.client.1.smithi170.stdout:7/386: fsync da/fe 0 2024-02-15T22:51:16.495 INFO:tasks.workunit.client.1.smithi170.stdout:4/382: symlink d0/d22/da/d32/d47/d5e/l72 0 2024-02-15T22:51:16.501 INFO:tasks.workunit.client.1.smithi170.stdout:5/467: dread de/d10/f5b [0,4194304] 0 2024-02-15T22:51:16.503 INFO:tasks.workunit.client.1.smithi170.stdout:5/468: creat de/d10/d33/d67/fa0 x:0 0 0 2024-02-15T22:51:16.505 INFO:tasks.workunit.client.1.smithi170.stdout:9/309: dwrite de/d1b/d1c/d1f/d20/f42 [0,4194304] 0 2024-02-15T22:51:16.507 INFO:tasks.workunit.client.1.smithi170.stdout:9/310: mkdir de/d1b/d1c/d1f/d20/d27/d28/d69 0 2024-02-15T22:51:16.507 INFO:tasks.workunit.client.1.smithi170.stdout:9/311: fdatasync de/d1b/f53 0 2024-02-15T22:51:16.507 INFO:tasks.workunit.client.1.smithi170.stdout:9/312: read de/d1b/d1c/d1f/d20/d27/d28/f33 [1706,62753] 0 2024-02-15T22:51:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:16 smithi170 ceph-mon[35248]: pgmap v21: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 115 MiB/s rd, 150 MiB/s wr, 678 op/s 2024-02-15T22:51:16.533 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:16 smithi138 ceph-mon[29229]: pgmap v21: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 115 MiB/s rd, 150 MiB/s wr, 678 op/s 2024-02-15T22:51:16.554 INFO:tasks.workunit.client.1.smithi170.stdout:4/383: dread d0/d22/da/d11/d20/d49/f4a [0,4194304] 0 2024-02-15T22:51:16.555 INFO:tasks.workunit.client.1.smithi170.stdout:4/384: mkdir d0/d22/da/d32/d47/d5e/d73 0 2024-02-15T22:51:16.557 INFO:tasks.workunit.client.1.smithi170.stdout:7/387: dread da/d1a/d21/d1b/f79 [0,4194304] 0 2024-02-15T22:51:16.557 INFO:tasks.workunit.client.1.smithi170.stdout:4/385: truncate d0/f10 4088557 0 2024-02-15T22:51:16.557 INFO:tasks.workunit.client.1.smithi170.stdout:0/285: sync 2024-02-15T22:51:16.557 INFO:tasks.workunit.client.1.smithi170.stdout:3/384: dwrite d3/dc/d1c/d26/f52 [0,4194304] 0 2024-02-15T22:51:16.558 INFO:tasks.workunit.client.1.smithi170.stdout:9/313: dwrite de/d1b/d37/f3b [0,4194304] 0 2024-02-15T22:51:16.559 INFO:tasks.workunit.client.1.smithi170.stdout:5/469: dread f0 [0,4194304] 0 2024-02-15T22:51:16.559 INFO:tasks.workunit.client.1.smithi170.stdout:5/470: dread - de/d10/d27/d4c/d53/d55/f6f zero size 2024-02-15T22:51:16.561 INFO:tasks.workunit.client.1.smithi170.stdout:4/386: truncate d0/d22/da/d11/d20/d49/f4a 3056968 0 2024-02-15T22:51:16.563 INFO:tasks.workunit.client.1.smithi170.stdout:7/388: write da/d1a/d21/d1b/f79 [1845263,129508] 0 2024-02-15T22:51:16.568 INFO:tasks.workunit.client.1.smithi170.stdout:9/314: chown de/f14 6 1 2024-02-15T22:51:16.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/471: dread de/d36/f41 [0,4194304] 0 2024-02-15T22:51:16.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/472: write de/d10/d27/d4c/d53/d55/f79 [685401,118817] 0 2024-02-15T22:51:16.570 INFO:tasks.workunit.client.1.smithi170.stdout:4/387: unlink d0/d22/da/d11/d20/f66 0 2024-02-15T22:51:16.570 INFO:tasks.workunit.client.1.smithi170.stdout:4/388: write d0/d22/f34 [958604,7241] 0 2024-02-15T22:51:16.572 INFO:tasks.workunit.client.1.smithi170.stdout:0/286: mkdir d8/df/d13/d36/d60 0 2024-02-15T22:51:16.573 INFO:tasks.workunit.client.1.smithi170.stdout:9/315: read de/f18 [101925,70165] 0 2024-02-15T22:51:16.575 INFO:tasks.workunit.client.1.smithi170.stdout:5/473: link de/d10/d27/d4c/d53/l7b de/d10/la1 0 2024-02-15T22:51:16.577 INFO:tasks.workunit.client.1.smithi170.stdout:4/389: link d0/c70 d0/d22/da/d32/c74 0 2024-02-15T22:51:16.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/385: dwrite d3/f9 [0,4194304] 0 2024-02-15T22:51:16.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/386: creat d3/dc/d1c/d3d/f80 x:0 0 0 2024-02-15T22:51:16.578 INFO:tasks.workunit.client.1.smithi170.stdout:3/387: chown d3/db/f22 2 1 2024-02-15T22:51:16.579 INFO:tasks.workunit.client.1.smithi170.stdout:7/389: rmdir da/d1a/d21/d2c 39 2024-02-15T22:51:16.580 INFO:tasks.workunit.client.1.smithi170.stdout:0/287: dread d8/d14/d1c/f24 [0,4194304] 0 2024-02-15T22:51:16.581 INFO:tasks.workunit.client.1.smithi170.stdout:0/288: chown d8/df/d13/d36/l4d 245231680 1 2024-02-15T22:51:16.581 INFO:tasks.workunit.client.1.smithi170.stdout:0/289: write d8/d14/d1c/d3f/f58 [531198,31148] 0 2024-02-15T22:51:16.581 INFO:tasks.workunit.client.1.smithi170.stdout:0/290: fdatasync d8/f1b 0 2024-02-15T22:51:16.587 INFO:tasks.workunit.client.1.smithi170.stdout:3/388: mkdir d3/d1b/d81 0 2024-02-15T22:51:16.589 INFO:tasks.workunit.client.1.smithi170.stdout:9/316: link de/f17 de/d1b/f6a 0 2024-02-15T22:51:16.592 INFO:tasks.workunit.client.1.smithi170.stdout:0/291: dread d8/f29 [0,4194304] 0 2024-02-15T22:51:16.592 INFO:tasks.workunit.client.1.smithi170.stdout:0/292: fsync d8/d14/d1c/f40 0 2024-02-15T22:51:16.592 INFO:tasks.workunit.client.1.smithi170.stdout:0/293: fdatasync d8/df/d13/f30 0 2024-02-15T22:51:16.592 INFO:tasks.workunit.client.1.smithi170.stdout:0/294: readlink l2 0 2024-02-15T22:51:16.592 INFO:tasks.workunit.client.1.smithi170.stdout:0/295: readlink d8/d14/l26 0 2024-02-15T22:51:16.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/474: rmdir de/d10/d33/d67 39 2024-02-15T22:51:16.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/475: creat de/d10/d27/d2d/fa2 x:0 0 0 2024-02-15T22:51:16.594 INFO:tasks.workunit.client.1.smithi170.stdout:4/390: unlink d0/d22/da/d11/d20/d49/f4a 0 2024-02-15T22:51:16.596 INFO:tasks.workunit.client.1.smithi170.stdout:0/296: rmdir d8/d14/d1c 39 2024-02-15T22:51:16.598 INFO:tasks.workunit.client.1.smithi170.stdout:5/476: creat de/d10/d33/d67/fa3 x:0 0 0 2024-02-15T22:51:16.598 INFO:tasks.workunit.client.1.smithi170.stdout:0/297: dread d8/df/f12 [0,4194304] 0 2024-02-15T22:51:16.598 INFO:tasks.workunit.client.1.smithi170.stdout:0/298: write d8/df/f49 [567167,45198] 0 2024-02-15T22:51:16.600 INFO:tasks.workunit.client.1.smithi170.stdout:4/391: link d0/d22/da/l5c d0/d22/da/d58/l75 0 2024-02-15T22:51:16.601 INFO:tasks.workunit.client.1.smithi170.stdout:4/392: fdatasync d0/d22/da/d11/d20/f3d 0 2024-02-15T22:51:16.601 INFO:tasks.workunit.client.1.smithi170.stdout:4/393: creat d0/d22/da/d11/d20/f76 x:0 0 0 2024-02-15T22:51:16.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/389: getdents d3/d1b/d2c 0 2024-02-15T22:51:16.608 INFO:tasks.workunit.client.1.smithi170.stdout:3/390: symlink d3/dc/d1c/l82 0 2024-02-15T22:51:16.608 INFO:tasks.workunit.client.1.smithi170.stdout:3/391: read d3/dc/f31 [770404,94314] 0 2024-02-15T22:51:16.609 INFO:tasks.workunit.client.1.smithi170.stdout:0/299: write d8/f3b [66182,1170] 0 2024-02-15T22:51:16.610 INFO:tasks.workunit.client.1.smithi170.stdout:3/392: rename d3/dc/d1c/d3d/f54 to d3/dc/d1c/f83 0 2024-02-15T22:51:16.612 INFO:tasks.workunit.client.1.smithi170.stdout:0/300: creat d8/df/d13/f61 x:0 0 0 2024-02-15T22:51:16.612 INFO:tasks.workunit.client.1.smithi170.stdout:0/301: write d8/df/d13/f1f [1783077,22280] 0 2024-02-15T22:51:16.613 INFO:tasks.workunit.client.1.smithi170.stdout:3/393: rename d3/dc/d1c/d3d/d5d/c7e to d3/d78/d7a/c84 0 2024-02-15T22:51:16.614 INFO:tasks.workunit.client.1.smithi170.stdout:0/302: symlink d8/d14/d1c/l62 0 2024-02-15T22:51:16.615 INFO:tasks.workunit.client.1.smithi170.stdout:0/303: creat d8/d14/f63 x:0 0 0 2024-02-15T22:51:16.616 INFO:tasks.workunit.client.1.smithi170.stdout:0/304: mknod d8/d14/d1c/d3f/d51/c64 0 2024-02-15T22:51:16.616 INFO:tasks.workunit.client.1.smithi170.stdout:0/305: write d8/d14/d1c/f3d [86381,628] 0 2024-02-15T22:51:16.617 INFO:tasks.workunit.client.1.smithi170.stdout:5/477: dwrite de/f21 [4194304,4194304] 0 2024-02-15T22:51:16.617 INFO:tasks.workunit.client.1.smithi170.stdout:5/478: fdatasync de/d10/d27/d4c/d53/f60 0 2024-02-15T22:51:16.619 INFO:tasks.workunit.client.1.smithi170.stdout:4/394: dwrite d0/d22/da/d11/d20/f4d [0,4194304] 0 2024-02-15T22:51:16.619 INFO:tasks.workunit.client.1.smithi170.stdout:4/395: write d0/d22/da/d11/f30 [813969,37409] 0 2024-02-15T22:51:16.619 INFO:tasks.workunit.client.1.smithi170.stdout:4/396: dread - d0/d22/da/f61 zero size 2024-02-15T22:51:16.619 INFO:tasks.workunit.client.1.smithi170.stdout:5/479: mknod de/d10/d27/d2d/ca4 0 2024-02-15T22:51:16.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/480: fsync de/d10/d27/d2d/f35 0 2024-02-15T22:51:16.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/481: stat de/c9c 0 2024-02-15T22:51:16.622 INFO:tasks.workunit.client.1.smithi170.stdout:4/397: getdents d0/d22/da/d11 0 2024-02-15T22:51:16.622 INFO:tasks.workunit.client.1.smithi170.stdout:4/398: chown d0/d22/da/f13 90812030 1 2024-02-15T22:51:16.622 INFO:tasks.workunit.client.1.smithi170.stdout:3/394: dread d3/dc/d13/f24 [0,4194304] 0 2024-02-15T22:51:16.622 INFO:tasks.workunit.client.1.smithi170.stdout:3/395: stat d3/dc/f31 0 2024-02-15T22:51:16.632 INFO:tasks.workunit.client.1.smithi170.stdout:4/399: write d0/d22/da/d32/d47/f3a [2961678,104395] 0 2024-02-15T22:51:16.633 INFO:tasks.workunit.client.1.smithi170.stdout:4/400: chown d0/d22/da/d11/d20/d49 34 1 2024-02-15T22:51:16.634 INFO:tasks.workunit.client.1.smithi170.stdout:4/401: mkdir d0/d22/da/d32/d47/d67/d77 0 2024-02-15T22:51:16.634 INFO:tasks.workunit.client.1.smithi170.stdout:4/402: readlink d0/d22/da/d11/d20/d49/l65 0 2024-02-15T22:51:16.639 INFO:tasks.workunit.client.1.smithi170.stdout:0/306: dwrite d8/f29 [4194304,4194304] 0 2024-02-15T22:51:16.641 INFO:tasks.workunit.client.1.smithi170.stdout:5/482: dwrite de/d10/f90 [0,4194304] 0 2024-02-15T22:51:16.642 INFO:tasks.workunit.client.1.smithi170.stdout:3/396: dwrite d3/dc/d1c/d26/d55/f69 [0,4194304] 0 2024-02-15T22:51:16.642 INFO:tasks.workunit.client.1.smithi170.stdout:3/397: dread - d3/d1b/d51/d6b/f75 zero size 2024-02-15T22:51:16.642 INFO:tasks.workunit.client.1.smithi170.stdout:0/307: rename d8/d14/d1c/f21 to d8/d14/d1c/d3f/d51/f65 0 2024-02-15T22:51:16.643 INFO:tasks.workunit.client.1.smithi170.stdout:0/308: stat d8/df/d13/d22/c23 0 2024-02-15T22:51:16.643 INFO:tasks.workunit.client.1.smithi170.stdout:0/309: fsync d8/df/d13/f5c 0 2024-02-15T22:51:16.643 INFO:tasks.workunit.client.1.smithi170.stdout:0/310: chown d8/df/d13/l1d 7477 1 2024-02-15T22:51:16.646 INFO:tasks.workunit.client.1.smithi170.stdout:0/311: link d8/f2a d8/d14/d44/f66 0 2024-02-15T22:51:16.647 INFO:tasks.workunit.client.1.smithi170.stdout:4/403: dread d0/d22/da/d11/f45 [0,4194304] 0 2024-02-15T22:51:16.648 INFO:tasks.workunit.client.1.smithi170.stdout:4/404: mknod d0/d22/da/d32/d47/d2b/c78 0 2024-02-15T22:51:16.653 INFO:tasks.workunit.client.1.smithi170.stdout:4/405: rename d0/d22/da/d6d to d0/d22/da/d32/d47/d5e/d79 0 2024-02-15T22:51:16.653 INFO:tasks.workunit.client.1.smithi170.stdout:4/406: readlink d0/d22/l31 0 2024-02-15T22:51:16.653 INFO:tasks.workunit.client.1.smithi170.stdout:4/407: write d0/d22/f34 [2295748,119278] 0 2024-02-15T22:51:16.656 INFO:tasks.workunit.client.1.smithi170.stdout:4/408: getdents d0/d22/da/d32/d47/d2b 0 2024-02-15T22:51:16.656 INFO:tasks.workunit.client.1.smithi170.stdout:4/409: fdatasync d0/d22/f50 0 2024-02-15T22:51:16.656 INFO:tasks.workunit.client.1.smithi170.stdout:0/312: write d8/d14/d1c/f1e [3589600,9658] 0 2024-02-15T22:51:16.658 INFO:tasks.workunit.client.1.smithi170.stdout:0/313: mknod d8/df/c67 0 2024-02-15T22:51:16.658 INFO:tasks.workunit.client.1.smithi170.stdout:4/410: write d0/d22/f50 [451635,97589] 0 2024-02-15T22:51:16.658 INFO:tasks.workunit.client.1.smithi170.stdout:3/398: dread d3/f42 [0,4194304] 0 2024-02-15T22:51:16.660 INFO:tasks.workunit.client.1.smithi170.stdout:0/314: symlink d8/d14/d1c/d3f/d53/l68 0 2024-02-15T22:51:16.661 INFO:tasks.workunit.client.1.smithi170.stdout:4/411: rmdir d0/d22/da/d58 39 2024-02-15T22:51:16.662 INFO:tasks.workunit.client.1.smithi170.stdout:0/315: getdents d8/d14/d1c 0 2024-02-15T22:51:16.662 INFO:tasks.workunit.client.1.smithi170.stdout:0/316: write d8/f2a [778994,24890] 0 2024-02-15T22:51:16.664 INFO:tasks.workunit.client.1.smithi170.stdout:4/412: creat d0/d22/da/d32/d47/d67/f7a x:0 0 0 2024-02-15T22:51:16.664 INFO:tasks.workunit.client.1.smithi170.stdout:4/413: chown d0/d22/da/d32/c74 217 1 2024-02-15T22:51:16.664 INFO:tasks.workunit.client.1.smithi170.stdout:4/414: fsync d0/d22/da/d11/d20/f35 0 2024-02-15T22:51:16.666 INFO:tasks.workunit.client.1.smithi170.stdout:3/399: read d3/dc/d1c/d3d/f53 [3352975,108897] 0 2024-02-15T22:51:16.666 INFO:tasks.workunit.client.1.smithi170.stdout:0/317: symlink d8/df/l69 0 2024-02-15T22:51:16.672 INFO:tasks.workunit.client.1.smithi170.stdout:5/483: dwrite de/d10/d27/f3d [0,4194304] 0 2024-02-15T22:51:16.674 INFO:tasks.workunit.client.1.smithi170.stdout:3/400: read d3/db/d1f/f36 [2983175,66157] 0 2024-02-15T22:51:16.679 INFO:tasks.workunit.client.1.smithi170.stdout:0/318: dread d8/df/d13/f1f [0,4194304] 0 2024-02-15T22:51:16.681 INFO:tasks.workunit.client.1.smithi170.stdout:5/484: mknod de/d10/d27/d4c/d53/d55/ca5 0 2024-02-15T22:51:16.682 INFO:tasks.workunit.client.1.smithi170.stdout:0/319: dread d8/df/d13/f5c [0,4194304] 0 2024-02-15T22:51:16.682 INFO:tasks.workunit.client.1.smithi170.stdout:3/401: symlink d3/d1b/d51/d6b/l85 0 2024-02-15T22:51:16.682 INFO:tasks.workunit.client.1.smithi170.stdout:4/415: dread d0/d22/da/d32/d47/f3a [0,4194304] 0 2024-02-15T22:51:16.683 INFO:tasks.workunit.client.1.smithi170.stdout:0/320: mkdir d8/df/d13/d22/d6a 0 2024-02-15T22:51:16.683 INFO:tasks.workunit.client.1.smithi170.stdout:0/321: chown d8/df 480 1 2024-02-15T22:51:16.684 INFO:tasks.workunit.client.1.smithi170.stdout:3/402: mkdir d3/d1b/d51/d6b/d86 0 2024-02-15T22:51:16.684 INFO:tasks.workunit.client.1.smithi170.stdout:3/403: write d3/dc/d1c/d26/f52 [4326196,87981] 0 2024-02-15T22:51:16.686 INFO:tasks.workunit.client.1.smithi170.stdout:4/416: creat d0/d22/da/d58/f7b x:0 0 0 2024-02-15T22:51:16.687 INFO:tasks.workunit.client.1.smithi170.stdout:0/322: chown d8/df/d13/d36/c3e 6687 1 2024-02-15T22:51:16.688 INFO:tasks.workunit.client.1.smithi170.stdout:3/404: rmdir d3/d1b 39 2024-02-15T22:51:16.688 INFO:tasks.workunit.client.1.smithi170.stdout:3/405: chown d3/d1b/d51/d6b/f75 1 1 2024-02-15T22:51:16.690 INFO:tasks.workunit.client.1.smithi170.stdout:0/323: unlink d8/d14/d44/f66 0 2024-02-15T22:51:16.690 INFO:tasks.workunit.client.1.smithi170.stdout:0/324: truncate d8/df/d13/f61 386992 0 2024-02-15T22:51:16.692 INFO:tasks.workunit.client.1.smithi170.stdout:0/325: rename d8/f38 to d8/df/d13/d22/f6b 0 2024-02-15T22:51:16.695 INFO:tasks.workunit.client.1.smithi170.stdout:5/485: dwrite de/d10/d33/d9f/f92 [0,4194304] 0 2024-02-15T22:51:16.697 INFO:tasks.workunit.client.1.smithi170.stdout:4/417: dread d0/d22/da/d11/d20/f4d [0,4194304] 0 2024-02-15T22:51:16.707 INFO:tasks.workunit.client.1.smithi170.stdout:0/326: rmdir d8/d14 39 2024-02-15T22:51:16.707 INFO:tasks.workunit.client.1.smithi170.stdout:0/327: truncate f5 3177660 0 2024-02-15T22:51:16.709 INFO:tasks.workunit.client.1.smithi170.stdout:0/328: creat d8/d14/d1c/d3f/d51/f6c x:0 0 0 2024-02-15T22:51:16.716 INFO:tasks.workunit.client.1.smithi170.stdout:4/418: dwrite d0/d22/da/d32/f4f [0,4194304] 0 2024-02-15T22:51:16.718 INFO:tasks.workunit.client.1.smithi170.stdout:5/486: dwrite de/d10/d27/d2d/f35 [0,4194304] 0 2024-02-15T22:51:16.718 INFO:tasks.workunit.client.1.smithi170.stdout:4/419: mknod d0/d22/c7c 0 2024-02-15T22:51:16.719 INFO:tasks.workunit.client.1.smithi170.stdout:4/420: write d0/d22/da/f29 [4199579,61432] 0 2024-02-15T22:51:16.720 INFO:tasks.workunit.client.1.smithi170.stdout:2/354: sync 2024-02-15T22:51:16.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/299: sync 2024-02-15T22:51:16.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/300: readlink d9/l36 0 2024-02-15T22:51:16.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/301: fsync d9/d18/d32/f4c 0 2024-02-15T22:51:16.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/302: stat d9/d18/d32/f3a 0 2024-02-15T22:51:16.721 INFO:tasks.workunit.client.1.smithi170.stdout:2/355: dread d0/d1d/d3d/f4c [0,4194304] 0 2024-02-15T22:51:16.722 INFO:tasks.workunit.client.1.smithi170.stdout:5/487: symlink de/d36/la6 0 2024-02-15T22:51:16.724 INFO:tasks.workunit.client.1.smithi170.stdout:4/421: unlink d0/d22/da/d32/d47/f25 0 2024-02-15T22:51:16.725 INFO:tasks.workunit.client.1.smithi170.stdout:2/356: unlink d0/d1/d11/f38 0 2024-02-15T22:51:16.725 INFO:tasks.workunit.client.1.smithi170.stdout:2/357: creat d0/d28/d2f/d37/d58/d78/f88 x:0 0 0 2024-02-15T22:51:16.727 INFO:tasks.workunit.client.1.smithi170.stdout:5/488: creat de/d10/d27/d4c/fa7 x:0 0 0 2024-02-15T22:51:16.727 INFO:tasks.workunit.client.1.smithi170.stdout:5/489: write de/d10/d27/d4c/f6c [1028498,28716] 0 2024-02-15T22:51:16.727 INFO:tasks.workunit.client.1.smithi170.stdout:0/329: dwrite d8/df/f49 [0,4194304] 0 2024-02-15T22:51:16.728 INFO:tasks.workunit.client.1.smithi170.stdout:4/422: mkdir d0/d22/da/d32/d47/d5e/d7d 0 2024-02-15T22:51:16.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/358: mkdir d0/d1/d89 0 2024-02-15T22:51:16.730 INFO:tasks.workunit.client.1.smithi170.stdout:5/490: unlink de/d10/c84 0 2024-02-15T22:51:16.732 INFO:tasks.workunit.client.1.smithi170.stdout:2/359: dread d0/f25 [0,4194304] 0 2024-02-15T22:51:16.732 INFO:tasks.workunit.client.1.smithi170.stdout:2/360: fdatasync d0/d28/d3e/f43 0 2024-02-15T22:51:16.732 INFO:tasks.workunit.client.1.smithi170.stdout:0/330: mkdir d8/d6d 0 2024-02-15T22:51:16.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/361: mkdir d0/d1/d11/d26/d6e/d8a 0 2024-02-15T22:51:16.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/362: fsync d0/d1/d31/f49 0 2024-02-15T22:51:16.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/363: dread - d0/d1/d11/f86 zero size 2024-02-15T22:51:16.734 INFO:tasks.workunit.client.1.smithi170.stdout:0/331: mknod d8/d14/d1c/d3f/d53/c6e 0 2024-02-15T22:51:16.734 INFO:tasks.workunit.client.1.smithi170.stdout:0/332: fsync d8/f29 0 2024-02-15T22:51:16.735 INFO:tasks.workunit.client.1.smithi170.stdout:5/491: write de/d36/f41 [3641734,50112] 0 2024-02-15T22:51:16.735 INFO:tasks.workunit.client.1.smithi170.stdout:4/423: write d0/d22/da/d11/d20/f23 [389119,117789] 0 2024-02-15T22:51:16.736 INFO:tasks.workunit.client.1.smithi170.stdout:2/364: mkdir d0/d1/d89/d8b 0 2024-02-15T22:51:16.739 INFO:tasks.workunit.client.1.smithi170.stdout:5/492: truncate de/d10/d27/d2d/f65 480901 0 2024-02-15T22:51:16.739 INFO:tasks.workunit.client.1.smithi170.stdout:5/493: chown de/d10/d27/d4c/d53/f60 8 1 2024-02-15T22:51:16.739 INFO:tasks.workunit.client.1.smithi170.stdout:5/494: dread - de/d10/d33/d67/fa0 zero size 2024-02-15T22:51:16.742 INFO:tasks.workunit.client.1.smithi170.stdout:2/365: creat d0/d1/d5f/f8c x:0 0 0 2024-02-15T22:51:16.742 INFO:tasks.workunit.client.1.smithi170.stdout:2/366: write d0/d28/d2f/d37/d58/d78/f88 [983218,80978] 0 2024-02-15T22:51:16.743 INFO:tasks.workunit.client.1.smithi170.stdout:5/495: mkdir de/d10/da8 0 2024-02-15T22:51:16.744 INFO:tasks.workunit.client.1.smithi170.stdout:4/424: rmdir d0/d22/da/d32/d47/d5e 39 2024-02-15T22:51:16.746 INFO:tasks.workunit.client.1.smithi170.stdout:8/303: dwrite d9/d18/d32/f3e [0,4194304] 0 2024-02-15T22:51:16.748 INFO:tasks.workunit.client.1.smithi170.stdout:5/496: truncate de/d10/d33/f42 1604851 0 2024-02-15T22:51:16.748 INFO:tasks.workunit.client.1.smithi170.stdout:5/497: chown de/d10/d27/d4c/d53/d55/d95 9 1 2024-02-15T22:51:16.748 INFO:tasks.workunit.client.1.smithi170.stdout:5/498: readlink de/d10/d33/l3e 0 2024-02-15T22:51:16.749 INFO:tasks.workunit.client.1.smithi170.stdout:8/304: rename d9/d18/d26/f54 to d9/d18/d48/f5b 0 2024-02-15T22:51:16.750 INFO:tasks.workunit.client.1.smithi170.stdout:8/305: symlink d9/d18/d32/d3b/l5c 0 2024-02-15T22:51:16.751 INFO:tasks.workunit.client.1.smithi170.stdout:8/306: symlink d9/d18/d32/d3b/d42/l5d 0 2024-02-15T22:51:16.751 INFO:tasks.workunit.client.1.smithi170.stdout:8/307: dread - d9/d18/d48/f5b zero size 2024-02-15T22:51:16.753 INFO:tasks.workunit.client.1.smithi170.stdout:8/308: write d9/f17 [248232,111916] 0 2024-02-15T22:51:16.758 INFO:tasks.workunit.client.1.smithi170.stdout:2/367: dwrite d0/d2a/f2b [0,4194304] 0 2024-02-15T22:51:16.758 INFO:tasks.workunit.client.1.smithi170.stdout:0/333: dwrite d8/d14/f63 [0,4194304] 0 2024-02-15T22:51:16.758 INFO:tasks.workunit.client.1.smithi170.stdout:0/334: fsync f6 0 2024-02-15T22:51:16.762 INFO:tasks.workunit.client.1.smithi170.stdout:5/499: write de/d10/d27/d2d/f35 [1446159,80957] 0 2024-02-15T22:51:16.764 INFO:tasks.workunit.client.1.smithi170.stdout:4/425: dread d0/d22/da/f29 [0,4194304] 0 2024-02-15T22:51:16.764 INFO:tasks.workunit.client.1.smithi170.stdout:4/426: write d0/d22/da/f43 [4219454,26262] 0 2024-02-15T22:51:16.764 INFO:tasks.workunit.client.1.smithi170.stdout:4/427: readlink d0/d22/da/d11/l64 0 2024-02-15T22:51:16.764 INFO:tasks.workunit.client.1.smithi170.stdout:4/428: readlink d0/d22/da/d32/d47/d5e/l72 0 2024-02-15T22:51:16.767 INFO:tasks.workunit.client.1.smithi170.stdout:5/500: link fd de/d10/d33/fa9 0 2024-02-15T22:51:16.771 INFO:tasks.workunit.client.1.smithi170.stdout:4/429: creat d0/d22/da/d32/d47/f7e x:0 0 0 2024-02-15T22:51:16.774 INFO:tasks.workunit.client.1.smithi170.stdout:5/501: mknod de/d10/d27/d4c/d53/d55/caa 0 2024-02-15T22:51:16.774 INFO:tasks.workunit.client.1.smithi170.stdout:5/502: creat de/d36/fab x:0 0 0 2024-02-15T22:51:16.774 INFO:tasks.workunit.client.1.smithi170.stdout:5/503: write f0 [3445142,7425] 0 2024-02-15T22:51:16.775 INFO:tasks.workunit.client.1.smithi170.stdout:8/309: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:16.777 INFO:tasks.workunit.client.1.smithi170.stdout:2/368: dwrite d0/d28/d2f/f62 [0,4194304] 0 2024-02-15T22:51:16.778 INFO:tasks.workunit.client.1.smithi170.stdout:5/504: mknod de/d10/d33/d9f/cac 0 2024-02-15T22:51:16.783 INFO:tasks.workunit.client.1.smithi170.stdout:2/369: mknod d0/d13/d59/c8d 0 2024-02-15T22:51:16.783 INFO:tasks.workunit.client.1.smithi170.stdout:2/370: getdents d0/d1/d11/d26/d6e/d8a 0 2024-02-15T22:51:16.784 INFO:tasks.workunit.client.1.smithi170.stdout:0/335: truncate d8/d14/f63 457999 0 2024-02-15T22:51:16.786 INFO:tasks.workunit.client.1.smithi170.stdout:5/505: creat de/d10/d27/d4c/d53/d55/fad x:0 0 0 2024-02-15T22:51:16.787 INFO:tasks.workunit.client.1.smithi170.stdout:8/310: dread d9/d18/f1e [0,4194304] 0 2024-02-15T22:51:16.788 INFO:tasks.workunit.client.1.smithi170.stdout:2/371: mkdir d0/d1/d5f/d74/d8e 0 2024-02-15T22:51:16.788 INFO:tasks.workunit.client.1.smithi170.stdout:4/430: dwrite d0/d22/da/d11/f6f [4194304,4194304] 0 2024-02-15T22:51:16.788 INFO:tasks.workunit.client.1.smithi170.stdout:0/336: stat c3 0 2024-02-15T22:51:16.790 INFO:tasks.workunit.client.1.smithi170.stdout:8/311: creat d9/d18/d32/d3b/d4b/f5e x:0 0 0 2024-02-15T22:51:16.790 INFO:tasks.workunit.client.1.smithi170.stdout:8/312: fsync d9/d18/f1e 0 2024-02-15T22:51:16.790 INFO:tasks.workunit.client.1.smithi170.stdout:8/313: write d9/d18/d32/d3b/f40 [781462,127789] 0 2024-02-15T22:51:16.791 INFO:tasks.workunit.client.1.smithi170.stdout:2/372: symlink d0/d28/d2f/l8f 0 2024-02-15T22:51:16.792 INFO:tasks.workunit.client.1.smithi170.stdout:4/431: symlink d0/d22/d6e/l7f 0 2024-02-15T22:51:16.802 INFO:tasks.workunit.client.1.smithi170.stdout:5/506: dread de/f4b [0,4194304] 0 2024-02-15T22:51:16.804 INFO:tasks.workunit.client.1.smithi170.stdout:5/507: read de/d29/f5a [524860,127173] 0 2024-02-15T22:51:16.809 INFO:tasks.workunit.client.1.smithi170.stdout:0/337: dwrite d8/df/d13/d22/f4b [0,4194304] 0 2024-02-15T22:51:16.809 INFO:tasks.workunit.client.1.smithi170.stdout:0/338: write d8/d14/d1c/d3f/d51/f6c [634899,51613] 0 2024-02-15T22:51:16.813 INFO:tasks.workunit.client.1.smithi170.stdout:8/314: link d9/d18/d32/d3b/d4b/f5e d9/d18/d32/d3b/d4b/f5f 0 2024-02-15T22:51:16.813 INFO:tasks.workunit.client.1.smithi170.stdout:2/373: mknod d0/d1d/d3d/c90 0 2024-02-15T22:51:16.816 INFO:tasks.workunit.client.1.smithi170.stdout:5/508: rename de/d10/f19 to de/d10/d27/d4c/d53/d55/d95/fae 0 2024-02-15T22:51:16.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/315: write d9/fd [3728083,78770] 0 2024-02-15T22:51:16.818 INFO:tasks.workunit.client.1.smithi170.stdout:0/339: mkdir d8/d14/d6f 0 2024-02-15T22:51:16.819 INFO:tasks.workunit.client.1.smithi170.stdout:2/374: creat d0/d1d/f91 x:0 0 0 2024-02-15T22:51:16.820 INFO:tasks.workunit.client.1.smithi170.stdout:4/432: rmdir d0/d22/da/d58 39 2024-02-15T22:51:16.822 INFO:tasks.workunit.client.1.smithi170.stdout:5/509: link de/d36/f74 de/d10/d52/faf 0 2024-02-15T22:51:16.822 INFO:tasks.workunit.client.1.smithi170.stdout:5/510: readlink de/d29/l68 0 2024-02-15T22:51:16.822 INFO:tasks.workunit.client.1.smithi170.stdout:5/511: creat de/d36/fb0 x:0 0 0 2024-02-15T22:51:16.823 INFO:tasks.workunit.client.1.smithi170.stdout:0/340: mkdir d8/d14/d70 0 2024-02-15T22:51:16.824 INFO:tasks.workunit.client.1.smithi170.stdout:4/433: mkdir d0/d22/da/d32/d80 0 2024-02-15T22:51:16.825 INFO:tasks.workunit.client.1.smithi170.stdout:1/424: sync 2024-02-15T22:51:16.825 INFO:tasks.workunit.client.1.smithi170.stdout:1/425: read d3/d24/d34/f3b [1791102,93721] 0 2024-02-15T22:51:16.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/512: creat de/d10/d7d/fb1 x:0 0 0 2024-02-15T22:51:16.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/513: chown de/d10/d27/d4c/d53/d55 37 1 2024-02-15T22:51:16.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/426: mkdir d3/d24/d2c/d35/d72/d92 0 2024-02-15T22:51:16.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/427: write d3/f20 [545431,68570] 0 2024-02-15T22:51:16.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/428: creat d3/d24/d34/d65/f93 x:0 0 0 2024-02-15T22:51:16.832 INFO:tasks.workunit.client.1.smithi170.stdout:5/514: mkdir de/d10/d33/db2 0 2024-02-15T22:51:16.832 INFO:tasks.workunit.client.1.smithi170.stdout:8/316: write d9/ff [1292225,50179] 0 2024-02-15T22:51:16.834 INFO:tasks.workunit.client.1.smithi170.stdout:2/375: write d0/d28/f56 [2034823,87861] 0 2024-02-15T22:51:16.840 INFO:tasks.workunit.client.1.smithi170.stdout:5/515: symlink de/d10/d27/lb3 0 2024-02-15T22:51:16.842 INFO:tasks.workunit.client.1.smithi170.stdout:8/317: rmdir d9/d18/d32 39 2024-02-15T22:51:16.843 INFO:tasks.workunit.client.1.smithi170.stdout:5/516: symlink de/d10/lb4 0 2024-02-15T22:51:16.843 INFO:tasks.workunit.client.1.smithi170.stdout:5/517: truncate de/f26 4388758 0 2024-02-15T22:51:16.847 INFO:tasks.workunit.client.1.smithi170.stdout:5/518: dread de/f4b [4194304,4194304] 0 2024-02-15T22:51:16.848 INFO:tasks.workunit.client.1.smithi170.stdout:5/519: link de/d10/d27/d2d/f35 de/d29/fb5 0 2024-02-15T22:51:16.848 INFO:tasks.workunit.client.1.smithi170.stdout:5/520: chown de/l14 188 1 2024-02-15T22:51:16.850 INFO:tasks.workunit.client.1.smithi170.stdout:5/521: mkdir de/d10/da8/db6 0 2024-02-15T22:51:16.850 INFO:tasks.workunit.client.1.smithi170.stdout:5/522: readlink de/d10/la1 0 2024-02-15T22:51:16.852 INFO:tasks.workunit.client.1.smithi170.stdout:5/523: unlink de/d10/d33/d9f/f78 0 2024-02-15T22:51:16.852 INFO:tasks.workunit.client.1.smithi170.stdout:8/318: dread d9/d18/f1e [0,4194304] 0 2024-02-15T22:51:16.852 INFO:tasks.workunit.client.1.smithi170.stdout:8/319: write d9/fd [4259448,114668] 0 2024-02-15T22:51:16.856 INFO:tasks.workunit.client.1.smithi170.stdout:4/434: dwrite d0/d22/da/d11/f1c [0,4194304] 0 2024-02-15T22:51:16.857 INFO:tasks.workunit.client.1.smithi170.stdout:1/429: dwrite d3/d24/d2c/d35/d83/f86 [0,4194304] 0 2024-02-15T22:51:16.857 INFO:tasks.workunit.client.1.smithi170.stdout:0/341: dwrite d8/d14/d1c/f1e [0,4194304] 0 2024-02-15T22:51:16.857 INFO:tasks.workunit.client.1.smithi170.stdout:1/430: dread - d3/d24/d2c/f6d zero size 2024-02-15T22:51:16.857 INFO:tasks.workunit.client.1.smithi170.stdout:1/431: fdatasync d3/f2e 0 2024-02-15T22:51:16.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/432: mkdir d3/d24/d2c/d94 0 2024-02-15T22:51:16.864 INFO:tasks.workunit.client.1.smithi170.stdout:0/342: mkdir d8/df/d13/d22/d71 0 2024-02-15T22:51:16.866 INFO:tasks.workunit.client.1.smithi170.stdout:0/343: link d8/df/d13/d36/l47 d8/d14/d1c/l72 0 2024-02-15T22:51:16.866 INFO:tasks.workunit.client.1.smithi170.stdout:0/344: write d8/df/d13/d22/f6b [3546856,127169] 0 2024-02-15T22:51:16.866 INFO:tasks.workunit.client.1.smithi170.stdout:0/345: creat d8/df/d13/f73 x:0 0 0 2024-02-15T22:51:16.869 INFO:tasks.workunit.client.1.smithi170.stdout:0/346: creat d8/df/d13/d22/d39/f74 x:0 0 0 2024-02-15T22:51:16.869 INFO:tasks.workunit.client.1.smithi170.stdout:0/347: fdatasync d8/df/f12 0 2024-02-15T22:51:16.870 INFO:tasks.workunit.client.1.smithi170.stdout:5/524: dwrite de/d36/f5e [0,4194304] 0 2024-02-15T22:51:16.870 INFO:tasks.workunit.client.1.smithi170.stdout:0/348: creat d8/d14/d1c/f75 x:0 0 0 2024-02-15T22:51:16.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/433: dread d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:16.875 INFO:tasks.workunit.client.1.smithi170.stdout:5/525: link de/c38 de/d10/d27/d2d/cb7 0 2024-02-15T22:51:16.875 INFO:tasks.workunit.client.1.smithi170.stdout:5/526: fsync de/d29/f8f 0 2024-02-15T22:51:16.877 INFO:tasks.workunit.client.1.smithi170.stdout:0/349: creat d8/d14/f76 x:0 0 0 2024-02-15T22:51:16.877 INFO:tasks.workunit.client.1.smithi170.stdout:0/350: read d8/d14/d1c/d3f/d51/f5a [2286563,68337] 0 2024-02-15T22:51:16.878 INFO:tasks.workunit.client.1.smithi170.stdout:1/434: creat d3/d24/d91/f95 x:0 0 0 2024-02-15T22:51:16.880 INFO:tasks.workunit.client.1.smithi170.stdout:4/435: dwrite d0/d22/f50 [0,4194304] 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/320: dwrite d9/d18/d32/f4a [0,4194304] 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/321: truncate d9/d18/d32/f59 933919 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:0/351: link d8/df/l2c d8/d14/d1c/d3f/d51/l77 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:0/352: write d8/d14/f76 [796671,37333] 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:0/353: truncate d8/df/d13/d22/f33 1023804 0 2024-02-15T22:51:16.881 INFO:tasks.workunit.client.1.smithi170.stdout:0/354: fsync d8/d14/d1c/f3d 0 2024-02-15T22:51:16.884 INFO:tasks.workunit.client.1.smithi170.stdout:5/527: read de/d29/f61 [2750755,127459] 0 2024-02-15T22:51:16.884 INFO:tasks.workunit.client.1.smithi170.stdout:5/528: read - de/d10/d27/d2d/f98 zero size 2024-02-15T22:51:16.887 INFO:tasks.workunit.client.1.smithi170.stdout:5/529: mkdir de/d10/d7d/db8 0 2024-02-15T22:51:16.891 INFO:tasks.workunit.client.1.smithi170.stdout:5/530: dread de/f4b [4194304,4194304] 0 2024-02-15T22:51:16.891 INFO:tasks.workunit.client.1.smithi170.stdout:4/436: rmdir d0/d22/da/d32 39 2024-02-15T22:51:16.894 INFO:tasks.workunit.client.1.smithi170.stdout:5/531: symlink de/d10/d27/d2d/lb9 0 2024-02-15T22:51:16.894 INFO:tasks.workunit.client.1.smithi170.stdout:5/532: creat de/d10/d27/d2d/fba x:0 0 0 2024-02-15T22:51:16.897 INFO:tasks.workunit.client.1.smithi170.stdout:5/533: rename de/d10/d27/d2d/ca4 to de/d10/da8/db6/cbb 0 2024-02-15T22:51:16.898 INFO:tasks.workunit.client.1.smithi170.stdout:1/435: dwrite d3/d24/d2c/d5e/f5f [0,4194304] 0 2024-02-15T22:51:16.898 INFO:tasks.workunit.client.1.smithi170.stdout:5/534: mkdir de/d10/d7d/db8/dbc 0 2024-02-15T22:51:16.899 INFO:tasks.workunit.client.1.smithi170.stdout:4/437: write d0/d22/da/d11/f1e [5347652,33506] 0 2024-02-15T22:51:16.900 INFO:tasks.workunit.client.1.smithi170.stdout:1/436: symlink d3/d24/d2c/d5e/l96 0 2024-02-15T22:51:16.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/535: getdents de/d10/d27/d4c/d53 0 2024-02-15T22:51:16.902 INFO:tasks.workunit.client.1.smithi170.stdout:0/355: getdents d8/d14 0 2024-02-15T22:51:16.904 INFO:tasks.workunit.client.1.smithi170.stdout:4/438: unlink d0/d22/da/d58/f7b 0 2024-02-15T22:51:16.905 INFO:tasks.workunit.client.1.smithi170.stdout:4/439: write d0/d22/f5 [9800247,12076] 0 2024-02-15T22:51:16.906 INFO:tasks.workunit.client.1.smithi170.stdout:1/437: rename d3/c23 to d3/d24/d2c/d35/d72/c97 0 2024-02-15T22:51:16.907 INFO:tasks.workunit.client.1.smithi170.stdout:5/536: mkdir de/d10/d27/dbd 0 2024-02-15T22:51:16.908 INFO:tasks.workunit.client.1.smithi170.stdout:0/356: creat d8/d14/d6f/f78 x:0 0 0 2024-02-15T22:51:16.909 INFO:tasks.workunit.client.1.smithi170.stdout:4/440: mknod d0/d22/da/d32/d80/c81 0 2024-02-15T22:51:16.909 INFO:tasks.workunit.client.1.smithi170.stdout:4/441: creat d0/d22/da/d11/d20/f82 x:0 0 0 2024-02-15T22:51:16.911 INFO:tasks.workunit.client.1.smithi170.stdout:0/357: creat d8/d14/d44/f79 x:0 0 0 2024-02-15T22:51:16.911 INFO:tasks.workunit.client.1.smithi170.stdout:5/537: write de/f26 [368884,120737] 0 2024-02-15T22:51:16.912 INFO:tasks.workunit.client.1.smithi170.stdout:4/442: symlink d0/d22/d6e/l83 0 2024-02-15T22:51:16.912 INFO:tasks.workunit.client.1.smithi170.stdout:1/438: symlink d3/d24/l98 0 2024-02-15T22:51:16.912 INFO:tasks.workunit.client.1.smithi170.stdout:1/439: write d3/d24/d2c/d35/f40 [606360,116360] 0 2024-02-15T22:51:16.913 INFO:tasks.workunit.client.1.smithi170.stdout:0/358: creat d8/d14/d70/f7a x:0 0 0 2024-02-15T22:51:16.914 INFO:tasks.workunit.client.1.smithi170.stdout:5/538: symlink de/d36/lbe 0 2024-02-15T22:51:16.916 INFO:tasks.workunit.client.1.smithi170.stdout:4/443: creat d0/f84 x:0 0 0 2024-02-15T22:51:16.918 INFO:tasks.workunit.client.1.smithi170.stdout:0/359: creat d8/df/d13/d22/d71/f7b x:0 0 0 2024-02-15T22:51:16.919 INFO:tasks.workunit.client.1.smithi170.stdout:4/444: symlink d0/d22/d6e/l85 0 2024-02-15T22:51:16.920 INFO:tasks.workunit.client.1.smithi170.stdout:0/360: creat d8/df/d13/d22/f7c x:0 0 0 2024-02-15T22:51:16.921 INFO:tasks.workunit.client.1.smithi170.stdout:4/445: creat d0/d22/da/d32/d47/d5e/d79/f86 x:0 0 0 2024-02-15T22:51:16.922 INFO:tasks.workunit.client.1.smithi170.stdout:0/361: symlink d8/d14/d1c/d3f/l7d 0 2024-02-15T22:51:16.922 INFO:tasks.workunit.client.1.smithi170.stdout:0/362: chown d8/d14/d1c/f3d 537272 1 2024-02-15T22:51:16.922 INFO:tasks.workunit.client.1.smithi170.stdout:0/363: readlink d8/d14/d1c/d3f/l7d 0 2024-02-15T22:51:16.923 INFO:tasks.workunit.client.1.smithi170.stdout:4/446: symlink d0/d22/da/d32/d47/d5e/l87 0 2024-02-15T22:51:16.923 INFO:tasks.workunit.client.1.smithi170.stdout:4/447: dread - d0/d22/da/f5b zero size 2024-02-15T22:51:16.927 INFO:tasks.workunit.client.1.smithi170.stdout:1/440: dwrite d3/d24/d2c/f2f [0,4194304] 0 2024-02-15T22:51:16.934 INFO:tasks.workunit.client.1.smithi170.stdout:1/441: symlink d3/d24/d2c/d35/d7f/l99 0 2024-02-15T22:51:16.934 INFO:tasks.workunit.client.1.smithi170.stdout:1/442: creat d3/d24/d34/d65/f9a x:0 0 0 2024-02-15T22:51:16.935 INFO:tasks.workunit.client.1.smithi170.stdout:5/539: dwrite de/f3f [0,4194304] 0 2024-02-15T22:51:16.935 INFO:tasks.workunit.client.1.smithi170.stdout:5/540: readlink de/d10/d27/d2d/lb9 0 2024-02-15T22:51:16.938 INFO:tasks.workunit.client.1.smithi170.stdout:5/541: mknod de/d10/d33/db2/cbf 0 2024-02-15T22:51:16.938 INFO:tasks.workunit.client.1.smithi170.stdout:5/542: stat de/d29/f8f 0 2024-02-15T22:51:16.938 INFO:tasks.workunit.client.1.smithi170.stdout:5/543: write de/d10/d33/d9f/f69 [504779,1429] 0 2024-02-15T22:51:16.938 INFO:tasks.workunit.client.1.smithi170.stdout:1/443: symlink d3/d24/l9b 0 2024-02-15T22:51:16.942 INFO:tasks.workunit.client.1.smithi170.stdout:1/444: truncate d3/f17 1427524 0 2024-02-15T22:51:16.946 INFO:tasks.workunit.client.1.smithi170.stdout:1/445: creat d3/d24/d2c/d35/d7f/f9c x:0 0 0 2024-02-15T22:51:16.959 INFO:tasks.workunit.client.1.smithi170.stdout:4/448: dwrite d0/d22/da/d32/d47/d5e/d79/f86 [0,4194304] 0 2024-02-15T22:51:16.960 INFO:tasks.workunit.client.1.smithi170.stdout:0/364: dwrite d8/f2a [0,4194304] 0 2024-02-15T22:51:16.960 INFO:tasks.workunit.client.1.smithi170.stdout:0/365: write d8/d14/d1c/f40 [1163765,15847] 0 2024-02-15T22:51:16.960 INFO:tasks.workunit.client.1.smithi170.stdout:0/366: fsync d8/d14/f28 0 2024-02-15T22:51:16.960 INFO:tasks.workunit.client.1.smithi170.stdout:5/544: dwrite de/d10/d33/fa9 [0,4194304] 0 2024-02-15T22:51:16.965 INFO:tasks.workunit.client.1.smithi170.stdout:4/449: getdents d0/d22/da/d32/d80 0 2024-02-15T22:51:16.971 INFO:tasks.workunit.client.1.smithi170.stdout:0/367: truncate d8/d14/d1c/f2b 2773352 0 2024-02-15T22:51:16.974 INFO:tasks.workunit.client.1.smithi170.stdout:0/368: dread d8/d14/d1c/f3d [0,4194304] 0 2024-02-15T22:51:16.982 INFO:tasks.workunit.client.1.smithi170.stdout:0/369: write d8/d14/d1c/d3f/f48 [3407484,16470] 0 2024-02-15T22:51:16.982 INFO:tasks.workunit.client.1.smithi170.stdout:0/370: readlink d8/df/d13/l1d 0 2024-02-15T22:51:16.984 INFO:tasks.workunit.client.1.smithi170.stdout:5/545: mknod de/d10/d27/dbd/cc0 0 2024-02-15T22:51:16.986 INFO:tasks.workunit.client.1.smithi170.stdout:1/446: truncate d3/d24/f61 2107690 0 2024-02-15T22:51:16.987 INFO:tasks.workunit.client.1.smithi170.stdout:4/450: creat d0/d22/da/d32/f88 x:0 0 0 2024-02-15T22:51:16.989 INFO:tasks.workunit.client.1.smithi170.stdout:0/371: mkdir d8/df/d13/d22/d6a/d7e 0 2024-02-15T22:51:16.989 INFO:tasks.workunit.client.1.smithi170.stdout:0/372: chown d8/df/c67 130124 1 2024-02-15T22:51:16.990 INFO:tasks.workunit.client.1.smithi170.stdout:5/546: symlink de/d36/lc1 0 2024-02-15T22:51:16.991 INFO:tasks.workunit.client.1.smithi170.stdout:1/447: mknod d3/d24/d2c/c9d 0 2024-02-15T22:51:16.992 INFO:tasks.workunit.client.1.smithi170.stdout:4/451: truncate d0/d22/da/d32/d47/d2b/f68 903391 0 2024-02-15T22:51:16.996 INFO:tasks.workunit.client.1.smithi170.stdout:4/452: mkdir d0/d22/da/d11/d89 0 2024-02-15T22:51:17.009 INFO:tasks.workunit.client.1.smithi170.stdout:0/373: dwrite d8/f1b [0,4194304] 0 2024-02-15T22:51:17.016 INFO:tasks.workunit.client.1.smithi170.stdout:0/374: write d8/f1b [77030,8361] 0 2024-02-15T22:51:17.016 INFO:tasks.workunit.client.1.smithi170.stdout:0/375: write d8/d14/d1c/d3f/f58 [1009516,4079] 0 2024-02-15T22:51:17.017 INFO:tasks.workunit.client.1.smithi170.stdout:0/376: creat d8/d14/f7f x:0 0 0 2024-02-15T22:51:17.018 INFO:tasks.workunit.client.1.smithi170.stdout:0/377: unlink l2 0 2024-02-15T22:51:17.018 INFO:tasks.workunit.client.1.smithi170.stdout:0/378: readlink d8/df/l4a 0 2024-02-15T22:51:17.019 INFO:tasks.workunit.client.1.smithi170.stdout:7/390: sync 2024-02-15T22:51:17.019 INFO:tasks.workunit.client.1.smithi170.stdout:6/438: sync 2024-02-15T22:51:17.019 INFO:tasks.workunit.client.1.smithi170.stdout:7/391: chown da/d1a/d21/d4d/d59/d7c 1485 1 2024-02-15T22:51:17.019 INFO:tasks.workunit.client.1.smithi170.stdout:7/392: fsync da/f38 0 2024-02-15T22:51:17.020 INFO:tasks.workunit.client.1.smithi170.stdout:0/379: rename d8/d14/d1c/f75 to d8/d6d/f80 0 2024-02-15T22:51:17.020 INFO:tasks.workunit.client.1.smithi170.stdout:4/453: dwrite d0/d22/da/d11/f30 [0,4194304] 0 2024-02-15T22:51:17.020 INFO:tasks.workunit.client.1.smithi170.stdout:5/547: dwrite f1 [0,4194304] 0 2024-02-15T22:51:17.020 INFO:tasks.workunit.client.1.smithi170.stdout:6/439: symlink d3/d1d/d1b/d3c/l9e 0 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:4/454: mknod d0/d22/da/c8a 0 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:4/455: dread - d0/d22/da/d32/d47/d5e/d79/f71 zero size 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:4/456: fsync d0/d22/f14 0 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:4/457: stat d0/d22/da/d32/d47/d5e/f69 0 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:7/393: dread da/f25 [0,4194304] 0 2024-02-15T22:51:17.024 INFO:tasks.workunit.client.1.smithi170.stdout:0/380: getdents d8/d14/d6f 0 2024-02-15T22:51:17.026 INFO:tasks.workunit.client.1.smithi170.stdout:7/394: creat da/d1a/d21/d2c/d74/f86 x:0 0 0 2024-02-15T22:51:17.027 INFO:tasks.workunit.client.1.smithi170.stdout:7/395: mkdir da/d1a/d21/d2c/d74/d87 0 2024-02-15T22:51:17.028 INFO:tasks.workunit.client.1.smithi170.stdout:0/381: mknod d8/df/d13/d36/c81 0 2024-02-15T22:51:17.030 INFO:tasks.workunit.client.1.smithi170.stdout:7/396: creat da/d1a/d21/d1b/f88 x:0 0 0 2024-02-15T22:51:17.030 INFO:tasks.workunit.client.1.smithi170.stdout:7/397: creat da/d1a/d21/d4d/d59/f89 x:0 0 0 2024-02-15T22:51:17.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/382: mkdir d8/d14/d1c/d82 0 2024-02-15T22:51:17.032 INFO:tasks.workunit.client.1.smithi170.stdout:0/383: readlink d8/df/d13/l18 0 2024-02-15T22:51:17.038 INFO:tasks.workunit.client.1.smithi170.stdout:4/458: write d0/d22/da/d11/f1c [509948,129994] 0 2024-02-15T22:51:17.041 INFO:tasks.workunit.client.1.smithi170.stdout:5/548: dwrite de/d10/d33/d9f/d7c/d87/f8a [0,4194304] 0 2024-02-15T22:51:17.041 INFO:tasks.workunit.client.1.smithi170.stdout:6/440: dwrite d3/d1d/d36/f58 [0,4194304] 0 2024-02-15T22:51:17.042 INFO:tasks.workunit.client.1.smithi170.stdout:4/459: rename d0/d22/da/d32 to d0/d22/da/d8b 0 2024-02-15T22:51:17.042 INFO:tasks.workunit.client.1.smithi170.stdout:4/460: truncate d0/d22/da/d11/d20/f35 4276745 0 2024-02-15T22:51:17.042 INFO:tasks.workunit.client.1.smithi170.stdout:4/461: write d0/d22/da/d11/d20/f3d [33863,112657] 0 2024-02-15T22:51:17.047 INFO:tasks.workunit.client.1.smithi170.stdout:6/441: truncate d3/d1d/d36/f14 118735 0 2024-02-15T22:51:17.048 INFO:tasks.workunit.client.1.smithi170.stdout:4/462: creat d0/d22/da/d8b/d47/d5e/d73/f8c x:0 0 0 2024-02-15T22:51:17.049 INFO:tasks.workunit.client.1.smithi170.stdout:6/442: creat d3/d1d/f9f x:0 0 0 2024-02-15T22:51:17.049 INFO:tasks.workunit.client.1.smithi170.stdout:6/443: stat d3/d1d/d36/d56/c7f 0 2024-02-15T22:51:17.050 INFO:tasks.workunit.client.1.smithi170.stdout:4/463: mkdir d0/d22/da/d8b/d47/d67/d77/d8d 0 2024-02-15T22:51:17.051 INFO:tasks.workunit.client.1.smithi170.stdout:6/444: mknod d3/d1d/d36/d56/d6c/ca0 0 2024-02-15T22:51:17.053 INFO:tasks.workunit.client.1.smithi170.stdout:4/464: creat d0/d22/da/d8b/d47/f8e x:0 0 0 2024-02-15T22:51:17.055 INFO:tasks.workunit.client.1.smithi170.stdout:6/445: creat d3/d1d/d27/fa1 x:0 0 0 2024-02-15T22:51:17.057 INFO:tasks.workunit.client.1.smithi170.stdout:6/446: rename d3/d1d/d1b/d3c/f90 to d3/d1d/d27/fa2 0 2024-02-15T22:51:17.059 INFO:tasks.workunit.client.1.smithi170.stdout:6/447: mkdir d3/d1d/d28/d3b/da3 0 2024-02-15T22:51:17.063 INFO:tasks.workunit.client.1.smithi170.stdout:6/448: write d3/d24/d31/f49 [54331,106628] 0 2024-02-15T22:51:17.063 INFO:tasks.workunit.client.1.smithi170.stdout:6/449: fsync d3/d1d/d36/f58 0 2024-02-15T22:51:17.064 INFO:tasks.workunit.client.1.smithi170.stdout:7/398: dwrite da/f25 [0,4194304] 0 2024-02-15T22:51:17.066 INFO:tasks.workunit.client.1.smithi170.stdout:6/450: symlink d3/d1d/d1b/d3e/la4 0 2024-02-15T22:51:17.067 INFO:tasks.workunit.client.1.smithi170.stdout:6/451: chown d3/d1d/d36/d56/l89 2207 1 2024-02-15T22:51:17.067 INFO:tasks.workunit.client.1.smithi170.stdout:6/452: mkdir d3/d1d/d27/d70/da5 0 2024-02-15T22:51:17.068 INFO:tasks.workunit.client.1.smithi170.stdout:6/453: symlink d3/d1d/d1b/d9b/la6 0 2024-02-15T22:51:17.072 INFO:tasks.workunit.client.1.smithi170.stdout:4/465: dwrite d0/d22/da/d8b/d47/d2b/f52 [0,4194304] 0 2024-02-15T22:51:17.072 INFO:tasks.workunit.client.1.smithi170.stdout:0/384: dwrite d8/d14/d44/f4c [0,4194304] 0 2024-02-15T22:51:17.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/466: creat d0/d22/da/d8b/d47/d2b/f8f x:0 0 0 2024-02-15T22:51:17.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/467: dread - d0/d22/da/f6a zero size 2024-02-15T22:51:17.076 INFO:tasks.workunit.client.1.smithi170.stdout:4/468: write d0/d22/da/d11/f26 [1132197,14607] 0 2024-02-15T22:51:17.076 INFO:tasks.workunit.client.1.smithi170.stdout:0/385: mknod d8/df/d13/d22/d39/d55/c83 0 2024-02-15T22:51:17.077 INFO:tasks.workunit.client.1.smithi170.stdout:5/549: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:17.077 INFO:tasks.workunit.client.1.smithi170.stdout:5/550: chown de/d10/d27/dbd 1057 1 2024-02-15T22:51:17.083 INFO:tasks.workunit.client.1.smithi170.stdout:4/469: unlink d0/d22/cb 0 2024-02-15T22:51:17.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/386: unlink d8/d14/f7f 0 2024-02-15T22:51:17.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/387: write d8/df/d13/d22/f7c [228432,81816] 0 2024-02-15T22:51:17.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/388: chown d8/df/d13/d22/f33 170576 1 2024-02-15T22:51:17.086 INFO:tasks.workunit.client.1.smithi170.stdout:0/389: write d8/df/d13/d22/f4b [4812894,6789] 0 2024-02-15T22:51:17.087 INFO:tasks.workunit.client.1.smithi170.stdout:5/551: mkdir de/d36/d80/dc2 0 2024-02-15T22:51:17.087 INFO:tasks.workunit.client.1.smithi170.stdout:5/552: creat de/d36/d80/fc3 x:0 0 0 2024-02-15T22:51:17.087 INFO:tasks.workunit.client.1.smithi170.stdout:5/553: stat de/d36/d80/fc3 0 2024-02-15T22:51:17.088 INFO:tasks.workunit.client.1.smithi170.stdout:5/554: truncate de/d10/d52/f93 688189 0 2024-02-15T22:51:17.088 INFO:tasks.workunit.client.1.smithi170.stdout:4/470: mknod d0/d22/da/d8b/d47/d5e/d79/c90 0 2024-02-15T22:51:17.090 INFO:tasks.workunit.client.1.smithi170.stdout:0/390: rename d8/d14/d1c/l43 to d8/df/l84 0 2024-02-15T22:51:17.090 INFO:tasks.workunit.client.1.smithi170.stdout:7/399: dwrite da/f3b [0,4194304] 0 2024-02-15T22:51:17.091 INFO:tasks.workunit.client.1.smithi170.stdout:6/454: dwrite d3/f99 [0,4194304] 0 2024-02-15T22:51:17.091 INFO:tasks.workunit.client.1.smithi170.stdout:6/455: chown d3/d1d/l97 30306423 1 2024-02-15T22:51:17.091 INFO:tasks.workunit.client.1.smithi170.stdout:6/456: readlink d3/d1d/d28/d3b/l1f 0 2024-02-15T22:51:17.092 INFO:tasks.workunit.client.1.smithi170.stdout:6/457: dread d3/d24/f35 [0,4194304] 0 2024-02-15T22:51:17.092 INFO:tasks.workunit.client.1.smithi170.stdout:6/458: write d3/d1d/d36/f22 [4485090,122244] 0 2024-02-15T22:51:17.093 INFO:tasks.workunit.client.1.smithi170.stdout:4/471: rename d0/d22/da/d11/d20/f76 to d0/d22/da/d58/d6b/f91 0 2024-02-15T22:51:17.095 INFO:tasks.workunit.client.1.smithi170.stdout:0/391: unlink d8/d14/d1c/f40 0 2024-02-15T22:51:17.095 INFO:tasks.workunit.client.1.smithi170.stdout:0/392: stat d8/df/d13/f1f 0 2024-02-15T22:51:17.096 INFO:tasks.workunit.client.1.smithi170.stdout:0/393: dread - d8/d14/d70/f7a zero size 2024-02-15T22:51:17.096 INFO:tasks.workunit.client.1.smithi170.stdout:0/394: fdatasync d8/df/d13/d22/f33 0 2024-02-15T22:51:17.099 INFO:tasks.workunit.client.1.smithi170.stdout:5/555: dread de/d10/d33/fa9 [0,4194304] 0 2024-02-15T22:51:17.101 INFO:tasks.workunit.client.1.smithi170.stdout:4/472: write d0/d22/f34 [5260873,96884] 0 2024-02-15T22:51:17.104 INFO:tasks.workunit.client.1.smithi170.stdout:6/459: creat d3/d1a/fa7 x:0 0 0 2024-02-15T22:51:17.104 INFO:tasks.workunit.client.1.smithi170.stdout:6/460: dread - d3/d24/f7a zero size 2024-02-15T22:51:17.106 INFO:tasks.workunit.client.1.smithi170.stdout:4/473: dread d0/d22/da/d8b/d47/d2b/f68 [0,4194304] 0 2024-02-15T22:51:17.109 INFO:tasks.workunit.client.1.smithi170.stdout:7/400: rmdir da/d1a 39 2024-02-15T22:51:17.111 INFO:tasks.workunit.client.1.smithi170.stdout:5/556: mkdir de/d10/d33/d67/dc4 0 2024-02-15T22:51:17.111 INFO:tasks.workunit.client.1.smithi170.stdout:5/557: write de/d10/d27/d4c/d53/d55/f8e [603020,44246] 0 2024-02-15T22:51:17.113 INFO:tasks.workunit.client.1.smithi170.stdout:7/401: dread da/d1a/d21/d1b/f79 [0,4194304] 0 2024-02-15T22:51:17.116 INFO:tasks.workunit.client.1.smithi170.stdout:6/461: creat d3/d1d/d28/d3b/da3/fa8 x:0 0 0 2024-02-15T22:51:17.116 INFO:tasks.workunit.client.1.smithi170.stdout:4/474: mknod d0/d22/da/d8b/d47/c92 0 2024-02-15T22:51:17.117 INFO:tasks.workunit.client.1.smithi170.stdout:4/475: rename d0/d22/da/d8b to d0/d22/da/d8b/d47/d67/d77/d8d/d93 22 2024-02-15T22:51:17.119 INFO:tasks.workunit.client.1.smithi170.stdout:4/476: link d0/d22/da/d11/d20/d49/l57 d0/d22/da/d8b/d47/d5e/d7d/l94 0 2024-02-15T22:51:17.119 INFO:tasks.workunit.client.1.smithi170.stdout:4/477: write d0/f84 [803782,34967] 0 2024-02-15T22:51:17.122 INFO:tasks.workunit.client.1.smithi170.stdout:4/478: symlink d0/d22/l95 0 2024-02-15T22:51:17.143 INFO:tasks.workunit.client.1.smithi170.stdout:5/558: dwrite de/d36/f41 [0,4194304] 0 2024-02-15T22:51:17.143 INFO:tasks.workunit.client.1.smithi170.stdout:5/559: stat de/c2b 0 2024-02-15T22:51:17.144 INFO:tasks.workunit.client.1.smithi170.stdout:6/462: dwrite d3/d24/f77 [0,4194304] 0 2024-02-15T22:51:17.144 INFO:tasks.workunit.client.1.smithi170.stdout:6/463: fdatasync d3/fa 0 2024-02-15T22:51:17.145 INFO:tasks.workunit.client.1.smithi170.stdout:7/402: dwrite da/d1a/d21/d2c/d74/f86 [0,4194304] 0 2024-02-15T22:51:17.145 INFO:tasks.workunit.client.1.smithi170.stdout:4/479: dwrite d0/d22/f5 [8388608,4194304] 0 2024-02-15T22:51:17.145 INFO:tasks.workunit.client.1.smithi170.stdout:4/480: chown d0/d22/da/d8b/d47/f7e 72695 1 2024-02-15T22:51:17.145 INFO:tasks.workunit.client.1.smithi170.stdout:4/481: readlink d0/d22/da/d8b/d47/d5e/l6c 0 2024-02-15T22:51:17.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/464: mknod d3/d1d/d1b/d3e/d9c/ca9 0 2024-02-15T22:51:17.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/465: write d3/d24/d31/f44 [1464762,91710] 0 2024-02-15T22:51:17.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/466: creat d3/d1d/d1b/d3c/faa x:0 0 0 2024-02-15T22:51:17.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/467: truncate d3/f16 3425389 0 2024-02-15T22:51:17.149 INFO:tasks.workunit.client.1.smithi170.stdout:7/403: dread da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:17.151 INFO:tasks.workunit.client.1.smithi170.stdout:5/560: dread de/d10/d27/f2a [0,4194304] 0 2024-02-15T22:51:17.153 INFO:tasks.workunit.client.1.smithi170.stdout:4/482: dread d0/d22/da/d11/f36 [0,4194304] 0 2024-02-15T22:51:17.153 INFO:tasks.workunit.client.1.smithi170.stdout:7/404: mknod da/d1a/d21/d2c/d2e/c8a 0 2024-02-15T22:51:17.156 INFO:tasks.workunit.client.1.smithi170.stdout:6/468: read d3/f5 [1773508,58454] 0 2024-02-15T22:51:17.156 INFO:tasks.workunit.client.1.smithi170.stdout:6/469: chown d3/d1d/d36/d56/l89 39 1 2024-02-15T22:51:17.156 INFO:tasks.workunit.client.1.smithi170.stdout:6/470: chown d3/f5 92314026 1 2024-02-15T22:51:17.156 INFO:tasks.workunit.client.1.smithi170.stdout:6/471: chown d3/d24/l76 4 1 2024-02-15T22:51:17.160 INFO:tasks.workunit.client.1.smithi170.stdout:5/561: rename de/d10/d27/d4c/d53/d55/f85 to de/d10/d7d/fc5 0 2024-02-15T22:51:17.169 INFO:tasks.workunit.client.1.smithi170.stdout:7/405: dread da/d1a/d21/d1b/d69/f76 [0,4194304] 0 2024-02-15T22:51:17.169 INFO:tasks.workunit.client.1.smithi170.stdout:4/483: truncate d0/d22/f5 9742805 0 2024-02-15T22:51:17.171 INFO:tasks.workunit.client.1.smithi170.stdout:5/562: dread de/d36/f41 [0,4194304] 0 2024-02-15T22:51:17.171 INFO:tasks.workunit.client.1.smithi170.stdout:7/406: symlink da/d1a/d21/d2c/d2e/l8b 0 2024-02-15T22:51:17.172 INFO:tasks.workunit.client.1.smithi170.stdout:4/484: truncate d0/d22/da/d8b/d47/f4b 3585393 0 2024-02-15T22:51:17.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/407: creat da/d1a/d21/d1b/f8c x:0 0 0 2024-02-15T22:51:17.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/408: truncate da/f13 5574576 0 2024-02-15T22:51:17.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/409: write da/d1a/d21/d4d/d59/f89 [8966,77762] 0 2024-02-15T22:51:17.175 INFO:tasks.workunit.client.1.smithi170.stdout:4/485: creat d0/d22/da/d8b/d80/f96 x:0 0 0 2024-02-15T22:51:17.177 INFO:tasks.workunit.client.1.smithi170.stdout:7/410: unlink da/d1a/d21/d19/c60 0 2024-02-15T22:51:17.177 INFO:tasks.workunit.client.1.smithi170.stdout:7/411: fsync da/d1a/d21/d4d/d59/d7c/d7d/f32 0 2024-02-15T22:51:17.177 INFO:tasks.workunit.client.1.smithi170.stdout:7/412: write da/d1a/f27 [7529418,102563] 0 2024-02-15T22:51:17.178 INFO:tasks.workunit.client.1.smithi170.stdout:4/486: symlink d0/d22/da/d8b/l97 0 2024-02-15T22:51:17.179 INFO:tasks.workunit.client.1.smithi170.stdout:5/563: dread de/d10/d33/d9f/d7c/d87/f8a [0,4194304] 0 2024-02-15T22:51:17.181 INFO:tasks.workunit.client.1.smithi170.stdout:4/487: rename d0/d22/c7c to d0/d22/da/d8b/d47/c98 0 2024-02-15T22:51:17.183 INFO:tasks.workunit.client.1.smithi170.stdout:5/564: symlink de/d10/d52/lc6 0 2024-02-15T22:51:17.184 INFO:tasks.workunit.client.1.smithi170.stdout:5/565: symlink de/d36/d80/lc7 0 2024-02-15T22:51:17.185 INFO:tasks.workunit.client.1.smithi170.stdout:9/317: sync 2024-02-15T22:51:17.185 INFO:tasks.workunit.client.1.smithi170.stdout:9/318: fdatasync de/d1b/d1c/d1f/f36 0 2024-02-15T22:51:17.185 INFO:tasks.workunit.client.1.smithi170.stdout:3/406: sync 2024-02-15T22:51:17.185 INFO:tasks.workunit.client.1.smithi170.stdout:5/566: symlink de/d10/d27/dbd/lc8 0 2024-02-15T22:51:17.186 INFO:tasks.workunit.client.1.smithi170.stdout:9/319: mknod de/d1b/d1c/d1f/d20/d27/d28/d69/c6b 0 2024-02-15T22:51:17.190 INFO:tasks.workunit.client.1.smithi170.stdout:4/488: dread d0/d22/da/d8b/f4f [0,4194304] 0 2024-02-15T22:51:17.190 INFO:tasks.workunit.client.1.smithi170.stdout:3/407: rmdir d3/dc/d13 39 2024-02-15T22:51:17.193 INFO:tasks.workunit.client.1.smithi170.stdout:4/489: rename d0/d22/da/d8b/d80/c81 to d0/d22/da/d11/d20/d49/c99 0 2024-02-15T22:51:17.193 INFO:tasks.workunit.client.1.smithi170.stdout:4/490: write d0/d22/da/d8b/d47/d2b/f68 [919193,103592] 0 2024-02-15T22:51:17.194 INFO:tasks.workunit.client.1.smithi170.stdout:4/491: creat d0/f9a x:0 0 0 2024-02-15T22:51:17.194 INFO:tasks.workunit.client.1.smithi170.stdout:4/492: chown d0/d22/da/d8b/d47/d5e/l72 94 1 2024-02-15T22:51:17.194 INFO:tasks.workunit.client.1.smithi170.stdout:5/567: write f1 [2332225,70408] 0 2024-02-15T22:51:17.194 INFO:tasks.workunit.client.1.smithi170.stdout:5/568: creat de/d10/d27/fc9 x:0 0 0 2024-02-15T22:51:17.196 INFO:tasks.workunit.client.1.smithi170.stdout:4/493: creat d0/d22/da/d58/d6b/f9b x:0 0 0 2024-02-15T22:51:17.200 INFO:tasks.workunit.client.1.smithi170.stdout:7/413: truncate da/d1a/f27 1356479 0 2024-02-15T22:51:17.201 INFO:tasks.workunit.client.1.smithi170.stdout:5/569: unlink de/d36/f43 0 2024-02-15T22:51:17.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/408: dread d3/f3f [4194304,4194304] 0 2024-02-15T22:51:17.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/409: dread - d3/d2b/f4f zero size 2024-02-15T22:51:17.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/410: write d3/d1b/d2c/f50 [837387,57706] 0 2024-02-15T22:51:17.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/411: truncate d3/f3c 1495942 0 2024-02-15T22:51:17.203 INFO:tasks.workunit.client.1.smithi170.stdout:4/494: fdatasync d0/d22/da/d11/d20/d49/f53 0 2024-02-15T22:51:17.203 INFO:tasks.workunit.client.1.smithi170.stdout:4/495: fdatasync d0/d22/da/d11/f1e 0 2024-02-15T22:51:17.203 INFO:tasks.workunit.client.1.smithi170.stdout:9/320: dwrite de/d1b/d1c/d1f/d20/f65 [0,4194304] 0 2024-02-15T22:51:17.204 INFO:tasks.workunit.client.1.smithi170.stdout:7/414: mkdir da/d63/d8d 0 2024-02-15T22:51:17.204 INFO:tasks.workunit.client.1.smithi170.stdout:7/415: getdents da/d1a/d21/d4d/d6e/d7e 0 2024-02-15T22:51:17.205 INFO:tasks.workunit.client.1.smithi170.stdout:5/570: mknod de/d10/d33/d9f/cca 0 2024-02-15T22:51:17.205 INFO:tasks.workunit.client.1.smithi170.stdout:5/571: read - de/d10/d33/d67/f8d zero size 2024-02-15T22:51:17.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/412: link d3/db/d1f/f2f d3/dc/d1c/d3d/f87 0 2024-02-15T22:51:17.207 INFO:tasks.workunit.client.1.smithi170.stdout:3/413: creat d3/d1b/d51/d6b/f88 x:0 0 0 2024-02-15T22:51:17.211 INFO:tasks.workunit.client.1.smithi170.stdout:4/496: creat d0/d22/da/d8b/d47/d5e/d7d/f9c x:0 0 0 2024-02-15T22:51:17.213 INFO:tasks.workunit.client.1.smithi170.stdout:7/416: rmdir da/d1a/d21/d2c/d74 39 2024-02-15T22:51:17.216 INFO:tasks.workunit.client.1.smithi170.stdout:4/497: creat d0/d22/da/d8b/d47/d67/d77/d8d/f9d x:0 0 0 2024-02-15T22:51:17.217 INFO:tasks.workunit.client.1.smithi170.stdout:3/414: write d3/d1b/d2c/f4b [938415,67036] 0 2024-02-15T22:51:17.218 INFO:tasks.workunit.client.1.smithi170.stdout:9/321: link de/l43 de/d1b/d1c/d1f/d20/l6c 0 2024-02-15T22:51:17.219 INFO:tasks.workunit.client.1.smithi170.stdout:7/417: mkdir da/d63/d8e 0 2024-02-15T22:51:17.221 INFO:tasks.workunit.client.1.smithi170.stdout:4/498: link d0/d22/da/d11/d20/f23 d0/d22/da/d8b/d47/d67/f9e 0 2024-02-15T22:51:17.222 INFO:tasks.workunit.client.1.smithi170.stdout:3/415: truncate d3/dc/d1c/d26/d55/f69 1533473 0 2024-02-15T22:51:17.224 INFO:tasks.workunit.client.1.smithi170.stdout:9/322: mknod de/d1b/d1c/d1f/d20/d27/d2c/c6d 0 2024-02-15T22:51:17.225 INFO:tasks.workunit.client.1.smithi170.stdout:7/418: readlink da/d1a/d21/d1b/l45 0 2024-02-15T22:51:17.225 INFO:tasks.workunit.client.1.smithi170.stdout:9/323: readlink de/l11 0 2024-02-15T22:51:17.227 INFO:tasks.workunit.client.1.smithi170.stdout:7/419: creat da/d1a/d21/d2c/f8f x:0 0 0 2024-02-15T22:51:17.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/324: creat de/f6e x:0 0 0 2024-02-15T22:51:17.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/325: chown de/d1b/d37/f3b 0 1 2024-02-15T22:51:17.231 INFO:tasks.workunit.client.1.smithi170.stdout:5/572: dwrite de/f16 [0,4194304] 0 2024-02-15T22:51:17.232 INFO:tasks.workunit.client.1.smithi170.stdout:3/416: dread d3/f6e [0,4194304] 0 2024-02-15T22:51:17.232 INFO:tasks.workunit.client.1.smithi170.stdout:3/417: write d3/dc/d1c/d26/f52 [395538,71095] 0 2024-02-15T22:51:17.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/499: write d0/d22/da/d8b/d47/d2b/f52 [759943,15920] 0 2024-02-15T22:51:17.232 INFO:tasks.workunit.client.1.smithi170.stdout:5/573: mkdir de/d10/d33/d9f/d7c/d99/dcb 0 2024-02-15T22:51:17.234 INFO:tasks.workunit.client.1.smithi170.stdout:3/418: rename d3/d1b/d51/d6b/f88 to d3/dc/d1c/d26/d55/f89 0 2024-02-15T22:51:17.236 INFO:tasks.workunit.client.1.smithi170.stdout:7/420: write da/f38 [2969411,47189] 0 2024-02-15T22:51:17.238 INFO:tasks.workunit.client.1.smithi170.stdout:4/500: truncate d0/d22/da/d11/d20/d49/f53 151669 0 2024-02-15T22:51:17.239 INFO:tasks.workunit.client.1.smithi170.stdout:9/326: dread de/d1b/d1c/d1f/d20/f42 [0,4194304] 0 2024-02-15T22:51:17.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/574: mknod de/d10/d27/d2d/ccc 0 2024-02-15T22:51:17.242 INFO:tasks.workunit.client.1.smithi170.stdout:3/419: mkdir d3/d1b/d8a 0 2024-02-15T22:51:17.244 INFO:tasks.workunit.client.1.smithi170.stdout:7/421: rmdir da/d1a/d21 39 2024-02-15T22:51:17.244 INFO:tasks.workunit.client.1.smithi170.stdout:3/420: write d3/d1b/d2c/f50 [807343,36833] 0 2024-02-15T22:51:17.245 INFO:tasks.workunit.client.1.smithi170.stdout:4/501: mkdir d0/d9f 0 2024-02-15T22:51:17.246 INFO:tasks.workunit.client.1.smithi170.stdout:9/327: mknod de/d1b/d1c/d1f/c6f 0 2024-02-15T22:51:17.250 INFO:tasks.workunit.client.1.smithi170.stdout:7/422: link da/d1a/d21/d1b/d69/f76 da/d1a/f90 0 2024-02-15T22:51:17.251 INFO:tasks.workunit.client.1.smithi170.stdout:3/421: creat d3/d1b/d81/f8b x:0 0 0 2024-02-15T22:51:17.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/328: creat de/d1b/d1c/d1f/d20/d27/d28/d69/f70 x:0 0 0 2024-02-15T22:51:17.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/329: chown de/d1b/d1c/f2d 3718545 1 2024-02-15T22:51:17.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/330: creat de/d1b/d1c/d1f/d20/d27/d28/d69/f71 x:0 0 0 2024-02-15T22:51:17.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/331: creat de/d1b/d1c/d1f/d20/d27/d28/d69/f72 x:0 0 0 2024-02-15T22:51:17.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/332: write de/f14 [3406892,88781] 0 2024-02-15T22:51:17.254 INFO:tasks.workunit.client.1.smithi170.stdout:7/423: creat da/d1a/d21/d19/f91 x:0 0 0 2024-02-15T22:51:17.256 INFO:tasks.workunit.client.1.smithi170.stdout:9/333: mknod de/d1b/d1c/d1f/d20/d27/d28/c73 0 2024-02-15T22:51:17.262 INFO:tasks.workunit.client.1.smithi170.stdout:4/502: dwrite d0/d22/da/d8b/f4f [0,4194304] 0 2024-02-15T22:51:17.263 INFO:tasks.workunit.client.1.smithi170.stdout:3/422: dread d3/d1b/d2c/f50 [0,4194304] 0 2024-02-15T22:51:17.269 INFO:tasks.workunit.client.1.smithi170.stdout:3/423: truncate d3/f9 959788 0 2024-02-15T22:51:17.269 INFO:tasks.workunit.client.1.smithi170.stdout:3/424: rename d3 to d3/dc/d1c/d3d/d8c 22 2024-02-15T22:51:17.270 INFO:tasks.workunit.client.1.smithi170.stdout:3/425: mknod d3/d1b/d81/c8d 0 2024-02-15T22:51:17.270 INFO:tasks.workunit.client.1.smithi170.stdout:3/426: stat d3/dc/d1a/c29 0 2024-02-15T22:51:17.270 INFO:tasks.workunit.client.1.smithi170.stdout:3/427: stat d3/dc/d1c/f64 0 2024-02-15T22:51:17.270 INFO:tasks.workunit.client.1.smithi170.stdout:3/428: chown d3/dc/d1c/f83 45388 1 2024-02-15T22:51:17.270 INFO:tasks.workunit.client.1.smithi170.stdout:9/334: dread de/d1b/d1c/d1f/d20/d27/f29 [0,4194304] 0 2024-02-15T22:51:17.272 INFO:tasks.workunit.client.1.smithi170.stdout:9/335: getdents de/d1b/d1c/d1f/d20 0 2024-02-15T22:51:17.272 INFO:tasks.workunit.client.1.smithi170.stdout:7/424: dwrite da/d1a/d21/d19/f50 [4194304,4194304] 0 2024-02-15T22:51:17.277 INFO:tasks.workunit.client.1.smithi170.stdout:4/503: dwrite d0/d22/da/d8b/f48 [0,4194304] 0 2024-02-15T22:51:17.277 INFO:tasks.workunit.client.1.smithi170.stdout:4/504: creat d0/d22/da/d11/d20/fa0 x:0 0 0 2024-02-15T22:51:17.279 INFO:tasks.workunit.client.1.smithi170.stdout:3/429: read d3/dc/d1c/d3d/f87 [505696,10207] 0 2024-02-15T22:51:17.279 INFO:tasks.workunit.client.1.smithi170.stdout:7/425: truncate da/f3b 2319653 0 2024-02-15T22:51:17.279 INFO:tasks.workunit.client.1.smithi170.stdout:7/426: fdatasync da/d1a/d21/d4d/d59/d7c/d7d/f32 0 2024-02-15T22:51:17.279 INFO:tasks.workunit.client.1.smithi170.stdout:9/336: rename de/l45 to de/d1b/d1c/d1f/d20/d27/d28/d69/l74 0 2024-02-15T22:51:17.280 INFO:tasks.workunit.client.1.smithi170.stdout:2/376: sync 2024-02-15T22:51:17.280 INFO:tasks.workunit.client.1.smithi170.stdout:1/448: sync 2024-02-15T22:51:17.280 INFO:tasks.workunit.client.1.smithi170.stdout:8/322: sync 2024-02-15T22:51:17.280 INFO:tasks.workunit.client.1.smithi170.stdout:2/377: creat d0/d1/d5f/f92 x:0 0 0 2024-02-15T22:51:17.280 INFO:tasks.workunit.client.1.smithi170.stdout:2/378: truncate d0/d28/d2f/d37/d58/d78/f88 1669224 0 2024-02-15T22:51:17.290 INFO:tasks.workunit.client.1.smithi170.stdout:7/427: dread da/d1a/d21/d2c/d2e/f35 [4194304,4194304] 0 2024-02-15T22:51:17.290 INFO:tasks.workunit.client.1.smithi170.stdout:3/430: write d3/dc/d13/f4a [2659127,35532] 0 2024-02-15T22:51:17.294 INFO:tasks.workunit.client.1.smithi170.stdout:8/323: link d9/d18/d32/d3b/d4b/f5f d9/f60 0 2024-02-15T22:51:17.298 INFO:tasks.workunit.client.1.smithi170.stdout:3/431: mknod d3/c8e 0 2024-02-15T22:51:17.300 INFO:tasks.workunit.client.1.smithi170.stdout:9/337: rename de/f2f to de/f75 0 2024-02-15T22:51:17.301 INFO:tasks.workunit.client.1.smithi170.stdout:8/324: creat d9/d18/d32/d3b/d42/f61 x:0 0 0 2024-02-15T22:51:17.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/432: dread d3/dc/ff [0,4194304] 0 2024-02-15T22:51:17.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/433: chown d3/d78/d7a/c84 2071174 1 2024-02-15T22:51:17.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/434: write d3/dc/d1c/f1e [323395,118] 0 2024-02-15T22:51:17.315 INFO:tasks.workunit.client.1.smithi170.stdout:9/338: dread fb [0,4194304] 0 2024-02-15T22:51:17.315 INFO:tasks.workunit.client.1.smithi170.stdout:3/435: truncate d3/dc/f17 1974691 0 2024-02-15T22:51:17.321 INFO:tasks.workunit.client.1.smithi170.stdout:1/449: dwrite d3/d24/d34/d4a/f4d [0,4194304] 0 2024-02-15T22:51:17.322 INFO:tasks.workunit.client.1.smithi170.stdout:4/505: dwrite d0/d22/da/d11/d20/f23 [0,4194304] 0 2024-02-15T22:51:17.323 INFO:tasks.workunit.client.1.smithi170.stdout:1/450: dread d3/d24/d34/f39 [0,4194304] 0 2024-02-15T22:51:17.324 INFO:tasks.workunit.client.1.smithi170.stdout:1/451: chown d3/f1f 38 1 2024-02-15T22:51:17.324 INFO:tasks.workunit.client.1.smithi170.stdout:1/452: fsync d3/d24/f61 0 2024-02-15T22:51:17.324 INFO:tasks.workunit.client.1.smithi170.stdout:2/379: dwrite d0/d1/d11/f29 [0,4194304] 0 2024-02-15T22:51:17.324 INFO:tasks.workunit.client.1.smithi170.stdout:8/325: dread d9/f46 [0,4194304] 0 2024-02-15T22:51:17.324 INFO:tasks.workunit.client.1.smithi170.stdout:2/380: read - d0/d28/d2f/d37/d58/f7f zero size 2024-02-15T22:51:17.325 INFO:tasks.workunit.client.1.smithi170.stdout:8/326: write d9/d18/d32/f3e [3468113,19050] 0 2024-02-15T22:51:17.325 INFO:tasks.workunit.client.1.smithi170.stdout:7/428: dwrite da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:17.327 INFO:tasks.workunit.client.1.smithi170.stdout:1/453: symlink d3/d24/d2c/d35/d72/d92/l9e 0 2024-02-15T22:51:17.329 INFO:tasks.workunit.client.1.smithi170.stdout:3/436: dread d3/dc/d1c/f1e [0,4194304] 0 2024-02-15T22:51:17.329 INFO:tasks.workunit.client.1.smithi170.stdout:3/437: chown d3/db/d1f/d61 16050844 1 2024-02-15T22:51:17.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/506: dread d0/d22/f5 [0,4194304] 0 2024-02-15T22:51:17.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/507: truncate d0/d22/f14 983879 0 2024-02-15T22:51:17.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/508: dread - d0/d22/da/d11/d20/f82 zero size 2024-02-15T22:51:17.334 INFO:tasks.workunit.client.1.smithi170.stdout:7/429: unlink da/d1a/d21/d2c/f8f 0 2024-02-15T22:51:17.335 INFO:tasks.workunit.client.1.smithi170.stdout:3/438: creat d3/d1b/f8f x:0 0 0 2024-02-15T22:51:17.337 INFO:tasks.workunit.client.1.smithi170.stdout:2/381: rename d0/d28/d2f/d37/d58/d78/f88 to d0/d1d/f93 0 2024-02-15T22:51:17.339 INFO:tasks.workunit.client.1.smithi170.stdout:7/430: mknod da/d1a/d21/d4d/c92 0 2024-02-15T22:51:17.340 INFO:tasks.workunit.client.1.smithi170.stdout:9/339: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f32 [0,4194304] 0 2024-02-15T22:51:17.342 INFO:tasks.workunit.client.1.smithi170.stdout:3/439: symlink d3/d78/l90 0 2024-02-15T22:51:17.345 INFO:tasks.workunit.client.1.smithi170.stdout:1/454: rename d3/d24/l9b to d3/d24/d2c/l9f 0 2024-02-15T22:51:17.345 INFO:tasks.workunit.client.1.smithi170.stdout:1/455: creat d3/d24/d2c/d35/fa0 x:0 0 0 2024-02-15T22:51:17.348 INFO:tasks.workunit.client.1.smithi170.stdout:2/382: creat d0/d1/d5f/d74/f94 x:0 0 0 2024-02-15T22:51:17.348 INFO:tasks.workunit.client.1.smithi170.stdout:7/431: creat da/d1a/d21/f93 x:0 0 0 2024-02-15T22:51:17.348 INFO:tasks.workunit.client.1.smithi170.stdout:7/432: creat da/d1a/d21/d19/f94 x:0 0 0 2024-02-15T22:51:17.352 INFO:tasks.workunit.client.1.smithi170.stdout:1/456: creat d3/d24/d2c/d77/fa1 x:0 0 0 2024-02-15T22:51:17.352 INFO:tasks.workunit.client.1.smithi170.stdout:1/457: write d3/d24/d2c/f6d [651847,111210] 0 2024-02-15T22:51:17.353 INFO:tasks.workunit.client.1.smithi170.stdout:8/327: dwrite d9/d18/d32/f59 [0,4194304] 0 2024-02-15T22:51:17.355 INFO:tasks.workunit.client.1.smithi170.stdout:7/433: unlink da/d1a/d21/d2c/d74/f82 0 2024-02-15T22:51:17.355 INFO:tasks.workunit.client.1.smithi170.stdout:7/434: chown da/d1a/d21/d4d/d59/f89 34515 1 2024-02-15T22:51:17.361 INFO:tasks.workunit.client.1.smithi170.stdout:1/458: dread d3/d24/d2c/d35/f75 [0,4194304] 0 2024-02-15T22:51:17.365 INFO:tasks.workunit.client.1.smithi170.stdout:8/328: unlink d9/d18/d32/f3e 0 2024-02-15T22:51:17.365 INFO:tasks.workunit.client.1.smithi170.stdout:7/435: link da/c40 da/d1a/d21/d1b/d69/c95 0 2024-02-15T22:51:17.367 INFO:tasks.workunit.client.1.smithi170.stdout:1/459: unlink d3/d24/d2c/d35/d72/l8e 0 2024-02-15T22:51:17.368 INFO:tasks.workunit.client.1.smithi170.stdout:8/329: mknod d9/d18/d48/c62 0 2024-02-15T22:51:17.369 INFO:tasks.workunit.client.1.smithi170.stdout:7/436: rmdir da/d63/d8e 0 2024-02-15T22:51:17.371 INFO:tasks.workunit.client.1.smithi170.stdout:2/383: dwrite d0/d28/d2f/d37/f4f [0,4194304] 0 2024-02-15T22:51:17.373 INFO:tasks.workunit.client.1.smithi170.stdout:8/330: mknod d9/d18/d32/d3b/c63 0 2024-02-15T22:51:17.373 INFO:tasks.workunit.client.1.smithi170.stdout:8/331: write d9/d18/d26/f55 [2512757,94008] 0 2024-02-15T22:51:17.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/340: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f44 [0,4194304] 0 2024-02-15T22:51:17.385 INFO:tasks.workunit.client.1.smithi170.stdout:8/332: creat d9/d18/d32/d3b/f64 x:0 0 0 2024-02-15T22:51:17.385 INFO:tasks.workunit.client.1.smithi170.stdout:8/333: dread - d9/f60 zero size 2024-02-15T22:51:17.386 INFO:tasks.workunit.client.1.smithi170.stdout:7/437: dwrite da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:17.386 INFO:tasks.workunit.client.1.smithi170.stdout:7/438: creat da/d1a/d21/d19/f96 x:0 0 0 2024-02-15T22:51:17.389 INFO:tasks.workunit.client.1.smithi170.stdout:9/341: mknod de/d1b/d1c/d1f/c76 0 2024-02-15T22:51:17.389 INFO:tasks.workunit.client.1.smithi170.stdout:1/460: rename d3/d24/d34 to d3/da2 0 2024-02-15T22:51:17.390 INFO:tasks.workunit.client.1.smithi170.stdout:2/384: getdents d0/d1/d5f 0 2024-02-15T22:51:17.390 INFO:tasks.workunit.client.1.smithi170.stdout:2/385: stat d0/d1d/f93 0 2024-02-15T22:51:17.393 INFO:tasks.workunit.client.1.smithi170.stdout:8/334: mknod d9/d18/d26/c65 0 2024-02-15T22:51:17.396 INFO:tasks.workunit.client.1.smithi170.stdout:9/342: mknod de/d1b/d1c/d1f/d20/d27/d28/c77 0 2024-02-15T22:51:17.397 INFO:tasks.workunit.client.1.smithi170.stdout:1/461: rmdir d3/d24/d2c/d35/d72/d92 39 2024-02-15T22:51:17.398 INFO:tasks.workunit.client.1.smithi170.stdout:0/395: sync 2024-02-15T22:51:17.398 INFO:tasks.workunit.client.1.smithi170.stdout:6/472: sync 2024-02-15T22:51:17.400 INFO:tasks.workunit.client.1.smithi170.stdout:7/439: rename da/d1a/d21/f93 to da/d1a/d21/d1b/d69/f97 0 2024-02-15T22:51:17.400 INFO:tasks.workunit.client.1.smithi170.stdout:7/440: read - da/d1a/d21/d1b/f8c zero size 2024-02-15T22:51:17.403 INFO:tasks.workunit.client.1.smithi170.stdout:2/386: link d0/d28/l70 d0/d1/d11/d26/d6e/d8a/l95 0 2024-02-15T22:51:17.403 INFO:tasks.workunit.client.1.smithi170.stdout:2/387: creat d0/d28/d2f/d37/d58/f96 x:0 0 0 2024-02-15T22:51:17.403 INFO:tasks.workunit.client.1.smithi170.stdout:2/388: creat d0/d1/d31/f97 x:0 0 0 2024-02-15T22:51:17.405 INFO:tasks.workunit.client.1.smithi170.stdout:8/335: link d9/l22 d9/d18/d32/d3b/d42/l66 0 2024-02-15T22:51:17.407 INFO:tasks.workunit.client.1.smithi170.stdout:9/343: chown de/l40 13838787 1 2024-02-15T22:51:17.409 INFO:tasks.workunit.client.1.smithi170.stdout:1/462: mknod d3/d24/d2c/d35/d83/ca3 0 2024-02-15T22:51:17.409 INFO:tasks.workunit.client.1.smithi170.stdout:1/463: write d3/d24/d2c/d35/d72/f78 [298971,82260] 0 2024-02-15T22:51:17.411 INFO:tasks.workunit.client.1.smithi170.stdout:7/441: mknod da/d1a/d21/d2c/d74/d87/c98 0 2024-02-15T22:51:17.411 INFO:tasks.workunit.client.1.smithi170.stdout:7/442: read - da/d1a/d21/d19/f91 zero size 2024-02-15T22:51:17.417 INFO:tasks.workunit.client.1.smithi170.stdout:6/473: dwrite d3/d1d/d36/f14 [0,4194304] 0 2024-02-15T22:51:17.417 INFO:tasks.workunit.client.1.smithi170.stdout:6/474: write d3/d1d/d1b/d3c/f6f [1245628,97159] 0 2024-02-15T22:51:17.417 INFO:tasks.workunit.client.1.smithi170.stdout:6/475: creat d3/d1d/d27/fab x:0 0 0 2024-02-15T22:51:17.418 INFO:tasks.workunit.client.1.smithi170.stdout:2/389: mknod d0/d1/d31/c98 0 2024-02-15T22:51:17.420 INFO:tasks.workunit.client.1.smithi170.stdout:9/344: mkdir de/d1b/d1c/d1f/d20/d78 0 2024-02-15T22:51:17.422 INFO:tasks.workunit.client.1.smithi170.stdout:1/464: link d3/d24/d2c/f47 d3/d24/d2c/d77/fa4 0 2024-02-15T22:51:17.423 INFO:tasks.workunit.client.1.smithi170.stdout:7/443: truncate da/d1a/d21/f51 3632496 0 2024-02-15T22:51:17.428 INFO:tasks.workunit.client.1.smithi170.stdout:2/390: creat d0/d1/d11/d26/f99 x:0 0 0 2024-02-15T22:51:17.428 INFO:tasks.workunit.client.1.smithi170.stdout:2/391: creat d0/d1/d11/d26/f9a x:0 0 0 2024-02-15T22:51:17.440 INFO:tasks.workunit.client.1.smithi170.stdout:2/392: mkdir d0/d28/d2f/d9b 0 2024-02-15T22:51:17.442 INFO:tasks.workunit.client.1.smithi170.stdout:1/465: dwrite d3/d24/d2c/d77/fa4 [4194304,4194304] 0 2024-02-15T22:51:17.445 INFO:tasks.workunit.client.1.smithi170.stdout:7/444: dread da/f12 [8388608,4194304] 0 2024-02-15T22:51:17.445 INFO:tasks.workunit.client.1.smithi170.stdout:7/445: read da/d1a/d21/d4d/d59/f66 [9478,40839] 0 2024-02-15T22:51:17.445 INFO:tasks.workunit.client.1.smithi170.stdout:7/446: truncate da/d1a/d21/d1b/d69/f97 430761 0 2024-02-15T22:51:17.446 INFO:tasks.workunit.client.1.smithi170.stdout:9/345: dwrite de/d1b/d1c/f46 [0,4194304] 0 2024-02-15T22:51:17.446 INFO:tasks.workunit.client.1.smithi170.stdout:9/346: write de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [778022,84327] 0 2024-02-15T22:51:17.446 INFO:tasks.workunit.client.1.smithi170.stdout:9/347: readlink de/d1b/d37/l50 0 2024-02-15T22:51:17.450 INFO:tasks.workunit.client.1.smithi170.stdout:2/393: symlink d0/l9c 0 2024-02-15T22:51:17.450 INFO:tasks.workunit.client.1.smithi170.stdout:2/394: chown d0/d28/d2f/f65 1991335 1 2024-02-15T22:51:17.460 INFO:tasks.workunit.client.1.smithi170.stdout:1/466: truncate d3/f22 657958 0 2024-02-15T22:51:17.462 INFO:tasks.workunit.client.1.smithi170.stdout:7/447: symlink da/d1a/d21/d2c/d74/l99 0 2024-02-15T22:51:17.462 INFO:tasks.workunit.client.1.smithi170.stdout:7/448: chown da/d1a 1615124 1 2024-02-15T22:51:17.463 INFO:tasks.workunit.client.1.smithi170.stdout:7/449: fsync da/d1a/d21/d4d/d59/f6c 0 2024-02-15T22:51:17.465 INFO:tasks.workunit.client.1.smithi170.stdout:8/336: rmdir d9 39 2024-02-15T22:51:17.465 INFO:tasks.workunit.client.1.smithi170.stdout:8/337: chown d9/f46 440548 1 2024-02-15T22:51:17.465 INFO:tasks.workunit.client.1.smithi170.stdout:8/338: write d9/d18/d32/d3b/d42/f61 [192210,50536] 0 2024-02-15T22:51:17.466 INFO:tasks.workunit.client.1.smithi170.stdout:8/339: stat d9/d18/d32/d3b/d42 0 2024-02-15T22:51:17.467 INFO:tasks.workunit.client.1.smithi170.stdout:1/467: write d3/f17 [1311946,93753] 0 2024-02-15T22:51:17.472 INFO:tasks.workunit.client.1.smithi170.stdout:9/348: readlink de/l13 0 2024-02-15T22:51:17.473 INFO:tasks.workunit.client.1.smithi170.stdout:2/395: mknod d0/d1/d31/c9d 0 2024-02-15T22:51:17.475 INFO:tasks.workunit.client.1.smithi170.stdout:8/340: creat d9/d18/d26/f67 x:0 0 0 2024-02-15T22:51:17.475 INFO:tasks.workunit.client.1.smithi170.stdout:8/341: write d9/f1a [164894,65190] 0 2024-02-15T22:51:17.475 INFO:tasks.workunit.client.1.smithi170.stdout:8/342: truncate d9/f1d 4458780 0 2024-02-15T22:51:17.476 INFO:tasks.workunit.client.1.smithi170.stdout:1/468: write d3/da2/d65/f9a [429131,58718] 0 2024-02-15T22:51:17.476 INFO:tasks.workunit.client.1.smithi170.stdout:1/469: dread - d3/d24/f8d zero size 2024-02-15T22:51:17.478 INFO:tasks.workunit.client.1.smithi170.stdout:9/349: unlink de/d1b/d1c/d1f/d20/f21 0 2024-02-15T22:51:17.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/396: mknod d0/d1/d5f/c9e 0 2024-02-15T22:51:17.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/397: write d0/d1/d5f/f92 [740935,43408] 0 2024-02-15T22:51:17.482 INFO:tasks.workunit.client.1.smithi170.stdout:7/450: dwrite da/fe [4194304,4194304] 0 2024-02-15T22:51:17.485 INFO:tasks.workunit.client.1.smithi170.stdout:8/343: mkdir d9/d18/d32/d3b/d68 0 2024-02-15T22:51:17.487 INFO:tasks.workunit.client.1.smithi170.stdout:1/470: link d3/f20 d3/d24/d2c/d94/fa5 0 2024-02-15T22:51:17.489 INFO:tasks.workunit.client.1.smithi170.stdout:5/575: sync 2024-02-15T22:51:17.489 INFO:tasks.workunit.client.1.smithi170.stdout:5/576: read de/d10/d33/f45 [221836,41580] 0 2024-02-15T22:51:17.489 INFO:tasks.workunit.client.1.smithi170.stdout:5/577: dread - de/d10/d27/d2d/f91 zero size 2024-02-15T22:51:17.489 INFO:tasks.workunit.client.1.smithi170.stdout:5/578: write de/d10/d27/d2d/f47 [5056943,52685] 0 2024-02-15T22:51:17.490 INFO:tasks.workunit.client.1.smithi170.stdout:5/579: fdatasync de/f1a 0 2024-02-15T22:51:17.495 INFO:tasks.workunit.client.1.smithi170.stdout:7/451: write da/f12 [986000,13735] 0 2024-02-15T22:51:17.499 INFO:tasks.workunit.client.1.smithi170.stdout:9/350: link de/f18 de/d1b/d1c/d1f/f79 0 2024-02-15T22:51:17.499 INFO:tasks.workunit.client.1.smithi170.stdout:2/398: dwrite d0/d1d/d3d/f5c [0,4194304] 0 2024-02-15T22:51:17.505 INFO:tasks.workunit.client.1.smithi170.stdout:8/344: symlink d9/d18/d48/l69 0 2024-02-15T22:51:17.508 INFO:tasks.workunit.client.1.smithi170.stdout:7/452: mknod da/d1a/d21/d2c/d74/c9a 0 2024-02-15T22:51:17.508 INFO:tasks.workunit.client.1.smithi170.stdout:7/453: fdatasync da/d1a/d21/d19/f94 0 2024-02-15T22:51:17.510 INFO:tasks.workunit.client.1.smithi170.stdout:9/351: mkdir de/d1b/d1c/d1f/d20/d27/d28/d7a 0 2024-02-15T22:51:17.514 INFO:tasks.workunit.client.1.smithi170.stdout:5/580: dwrite de/d10/d27/fc9 [0,4194304] 0 2024-02-15T22:51:17.517 INFO:tasks.workunit.client.1.smithi170.stdout:2/399: link d0/l42 d0/d1/d11/d26/d6e/d8a/l9f 0 2024-02-15T22:51:17.517 INFO:tasks.workunit.client.1.smithi170.stdout:2/400: chown d0/d1/d53 238 1 2024-02-15T22:51:17.518 INFO:tasks.workunit.client.1.smithi170.stdout:7/454: dread da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:17.518 INFO:tasks.workunit.client.1.smithi170.stdout:7/455: readlink da/d1a/d21/d4d/d59/l83 0 2024-02-15T22:51:17.518 INFO:tasks.workunit.client.1.smithi170.stdout:7/456: truncate da/d1a/d21/d2c/d71/f75 797240 0 2024-02-15T22:51:17.518 INFO:tasks.workunit.client.1.smithi170.stdout:7/457: getdents da/d57 0 2024-02-15T22:51:17.518 INFO:tasks.workunit.client.1.smithi170.stdout:7/458: chown da/d1a/d21/d2c/c5a 125793717 1 2024-02-15T22:51:17.519 INFO:tasks.workunit.client.1.smithi170.stdout:5/581: dread de/d10/d52/faf [0,4194304] 0 2024-02-15T22:51:17.520 INFO:tasks.workunit.client.1.smithi170.stdout:8/345: symlink d9/d18/d32/d3b/d4b/l6a 0 2024-02-15T22:51:17.521 INFO:tasks.workunit.client.1.smithi170.stdout:2/401: dread d0/d28/f5d [0,4194304] 0 2024-02-15T22:51:17.522 INFO:tasks.workunit.client.1.smithi170.stdout:1/471: mknod d3/d24/ca6 0 2024-02-15T22:51:17.526 INFO:tasks.workunit.client.1.smithi170.stdout:7/459: unlink da/fe 0 2024-02-15T22:51:17.526 INFO:tasks.workunit.client.1.smithi170.stdout:7/460: stat da/l4f 0 2024-02-15T22:51:17.527 INFO:tasks.workunit.client.1.smithi170.stdout:5/582: mkdir de/d10/d33/d67/dc4/dcd 0 2024-02-15T22:51:17.528 INFO:tasks.workunit.client.1.smithi170.stdout:5/583: write de/d10/d27/d4c/d53/d55/f79 [147761,69755] 0 2024-02-15T22:51:17.529 INFO:tasks.workunit.client.1.smithi170.stdout:5/584: chown de/d10/d27 3 1 2024-02-15T22:51:17.530 INFO:tasks.workunit.client.1.smithi170.stdout:8/346: rename d9/f60 to d9/d18/d32/d3b/d68/f6b 0 2024-02-15T22:51:17.530 INFO:tasks.workunit.client.1.smithi170.stdout:8/347: write d9/d18/d26/f55 [2560833,39970] 0 2024-02-15T22:51:17.532 INFO:tasks.workunit.client.1.smithi170.stdout:2/402: creat d0/d1d/d3d/d76/fa0 x:0 0 0 2024-02-15T22:51:17.534 INFO:tasks.workunit.client.1.smithi170.stdout:9/352: dwrite de/d1b/d1c/f5b [0,4194304] 0 2024-02-15T22:51:17.534 INFO:tasks.workunit.client.1.smithi170.stdout:1/472: mknod d3/d24/d2c/d5e/ca7 0 2024-02-15T22:51:17.536 INFO:tasks.workunit.client.1.smithi170.stdout:7/461: mkdir da/d1a/d21/d2c/d74/d87/d9b 0 2024-02-15T22:51:17.539 INFO:tasks.workunit.client.1.smithi170.stdout:8/348: creat d9/d18/d32/d3b/f6c x:0 0 0 2024-02-15T22:51:17.541 INFO:tasks.workunit.client.1.smithi170.stdout:2/403: dread d0/d1/fe [0,4194304] 0 2024-02-15T22:51:17.541 INFO:tasks.workunit.client.1.smithi170.stdout:2/404: fsync d0/d1d/f91 0 2024-02-15T22:51:17.543 INFO:tasks.workunit.client.1.smithi170.stdout:8/349: fsync d9/d18/d26/f55 0 2024-02-15T22:51:17.546 INFO:tasks.workunit.client.1.smithi170.stdout:1/473: symlink d3/d24/d2c/d35/la8 0 2024-02-15T22:51:17.546 INFO:tasks.workunit.client.1.smithi170.stdout:1/474: creat d3/d24/d2c/d35/d7f/fa9 x:0 0 0 2024-02-15T22:51:17.547 INFO:tasks.workunit.client.1.smithi170.stdout:7/462: symlink da/d63/d8d/l9c 0 2024-02-15T22:51:17.551 INFO:tasks.workunit.client.1.smithi170.stdout:2/405: mknod d0/d28/d2f/ca1 0 2024-02-15T22:51:17.556 INFO:tasks.workunit.client.1.smithi170.stdout:2/406: rename d0/d1/d89 to d0/d1/d89/da2 22 2024-02-15T22:51:17.556 INFO:tasks.workunit.client.1.smithi170.stdout:8/350: rename d9/d18/d32/d3b/f64 to d9/f6d 0 2024-02-15T22:51:17.556 INFO:tasks.workunit.client.1.smithi170.stdout:2/407: chown d0/d1 27 1 2024-02-15T22:51:17.557 INFO:tasks.workunit.client.1.smithi170.stdout:2/408: fdatasync d0/d1/d11/d26/f99 0 2024-02-15T22:51:17.559 INFO:tasks.workunit.client.1.smithi170.stdout:9/353: dwrite de/d1b/f4f [0,4194304] 0 2024-02-15T22:51:17.561 INFO:tasks.workunit.client.1.smithi170.stdout:7/463: dread da/f12 [0,4194304] 0 2024-02-15T22:51:17.561 INFO:tasks.workunit.client.1.smithi170.stdout:8/351: unlink d9/d18/d26/f67 0 2024-02-15T22:51:17.562 INFO:tasks.workunit.client.1.smithi170.stdout:2/409: mkdir d0/d1/d31/da3 0 2024-02-15T22:51:17.569 INFO:tasks.workunit.client.1.smithi170.stdout:1/475: dwrite d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:17.569 INFO:tasks.workunit.client.1.smithi170.stdout:1/476: read - d3/da2/f50 zero size 2024-02-15T22:51:17.570 INFO:tasks.workunit.client.1.smithi170.stdout:7/464: mkdir da/d1a/d21/d19/d9d 0 2024-02-15T22:51:17.570 INFO:tasks.workunit.client.1.smithi170.stdout:7/465: read - da/d1a/d21/d19/f94 zero size 2024-02-15T22:51:17.573 INFO:tasks.workunit.client.1.smithi170.stdout:8/352: symlink d9/d18/d48/l6e 0 2024-02-15T22:51:17.573 INFO:tasks.workunit.client.1.smithi170.stdout:8/353: chown d9/d18/d32/d3b/d4b/f5f 344895 1 2024-02-15T22:51:17.575 INFO:tasks.workunit.client.1.smithi170.stdout:2/410: unlink d0/d1/c71 0 2024-02-15T22:51:17.575 INFO:tasks.workunit.client.1.smithi170.stdout:2/411: truncate d0/d1d/f93 2547410 0 2024-02-15T22:51:17.576 INFO:tasks.workunit.client.1.smithi170.stdout:1/477: write d3/d24/d2c/d35/f38 [1398224,102229] 0 2024-02-15T22:51:17.590 INFO:tasks.workunit.client.1.smithi170.stdout:2/412: dread d0/d2a/f2b [0,4194304] 0 2024-02-15T22:51:17.590 INFO:tasks.workunit.client.1.smithi170.stdout:2/413: write d0/d1/f6f [507509,179] 0 2024-02-15T22:51:17.590 INFO:tasks.workunit.client.1.smithi170.stdout:9/354: rmdir de/d1b 39 2024-02-15T22:51:17.592 INFO:tasks.workunit.client.1.smithi170.stdout:1/478: dwrite d3/da2/f50 [0,4194304] 0 2024-02-15T22:51:17.592 INFO:tasks.workunit.client.1.smithi170.stdout:1/479: fsync d3/f21 0 2024-02-15T22:51:17.592 INFO:tasks.workunit.client.1.smithi170.stdout:1/480: write d3/d24/d2c/f2f [4360871,90190] 0 2024-02-15T22:51:17.602 INFO:tasks.workunit.client.1.smithi170.stdout:7/466: rename da/d1a/d21/d4d/d6e/d7e to da/d1a/d21/d4d/d59/d7c/d9e 0 2024-02-15T22:51:17.603 INFO:tasks.workunit.client.1.smithi170.stdout:8/354: creat d9/d18/d32/d3b/d4b/f6f x:0 0 0 2024-02-15T22:51:17.604 INFO:tasks.workunit.client.1.smithi170.stdout:8/355: dread d9/d18/f23 [0,4194304] 0 2024-02-15T22:51:17.604 INFO:tasks.workunit.client.1.smithi170.stdout:8/356: write d9/d18/d26/f45 [4483908,42499] 0 2024-02-15T22:51:17.604 INFO:tasks.workunit.client.1.smithi170.stdout:2/414: mkdir d0/d28/d2f/d37/d58/d78/da4 0 2024-02-15T22:51:17.604 INFO:tasks.workunit.client.1.smithi170.stdout:2/415: write d0/d28/d2f/d37/d58/d78/f84 [886642,101314] 0 2024-02-15T22:51:17.610 INFO:tasks.workunit.client.1.smithi170.stdout:1/481: link d3/d24/c68 d3/d24/d2c/d35/d72/d92/caa 0 2024-02-15T22:51:17.613 INFO:tasks.workunit.client.1.smithi170.stdout:7/467: mkdir da/d1a/d21/d19/d9f 0 2024-02-15T22:51:17.614 INFO:tasks.workunit.client.1.smithi170.stdout:8/357: symlink d9/d18/d48/l70 0 2024-02-15T22:51:17.615 INFO:tasks.workunit.client.1.smithi170.stdout:2/416: mknod d0/d28/d2f/d9b/ca5 0 2024-02-15T22:51:17.617 INFO:tasks.workunit.client.1.smithi170.stdout:9/355: mknod de/d1b/d1c/c7b 0 2024-02-15T22:51:17.618 INFO:tasks.workunit.client.1.smithi170.stdout:1/482: link d3/d24/d2c/d35/l56 d3/d24/d2c/d77/lab 0 2024-02-15T22:51:17.620 INFO:tasks.workunit.client.1.smithi170.stdout:8/358: unlink d9/d18/c37 0 2024-02-15T22:51:17.621 INFO:tasks.workunit.client.1.smithi170.stdout:7/468: dread da/f3b [0,4194304] 0 2024-02-15T22:51:17.621 INFO:tasks.workunit.client.1.smithi170.stdout:7/469: readlink da/d1a/d21/d19/l5c 0 2024-02-15T22:51:17.621 INFO:tasks.workunit.client.1.smithi170.stdout:9/356: unlink f7 0 2024-02-15T22:51:17.622 INFO:tasks.workunit.client.1.smithi170.stdout:1/483: creat d3/da2/fac x:0 0 0 2024-02-15T22:51:17.624 INFO:tasks.workunit.client.1.smithi170.stdout:2/417: write d0/d28/f7a [2419968,28799] 0 2024-02-15T22:51:17.625 INFO:tasks.workunit.client.1.smithi170.stdout:8/359: rename d9/l22 to d9/d18/d32/d3b/d68/l71 0 2024-02-15T22:51:17.628 INFO:tasks.workunit.client.1.smithi170.stdout:7/470: link da/d1a/d21/d2c/d71/l81 da/d1a/d21/d2c/d2e/la0 0 2024-02-15T22:51:17.628 INFO:tasks.workunit.client.1.smithi170.stdout:9/357: symlink de/d1b/d1c/d1f/d20/d27/d28/d69/l7c 0 2024-02-15T22:51:17.629 INFO:tasks.workunit.client.1.smithi170.stdout:1/484: truncate d3/da2/d4a/f4d 2996866 0 2024-02-15T22:51:17.629 INFO:tasks.workunit.client.1.smithi170.stdout:7/471: write da/d1a/d21/d2c/f84 [405572,111482] 0 2024-02-15T22:51:17.631 INFO:tasks.workunit.client.1.smithi170.stdout:2/418: symlink d0/d28/d2f/la6 0 2024-02-15T22:51:17.631 INFO:tasks.workunit.client.1.smithi170.stdout:8/360: mknod d9/d18/d48/c72 0 2024-02-15T22:51:17.634 INFO:tasks.workunit.client.1.smithi170.stdout:9/358: symlink de/d1b/d1c/d47/l7d 0 2024-02-15T22:51:17.636 INFO:tasks.workunit.client.1.smithi170.stdout:1/485: link d3/d24/d2c/d35/d72/d92/l9e d3/d24/d2c/d35/d83/lad 0 2024-02-15T22:51:17.638 INFO:tasks.workunit.client.1.smithi170.stdout:7/472: rename da/f25 to da/d1a/fa1 0 2024-02-15T22:51:17.640 INFO:tasks.workunit.client.1.smithi170.stdout:9/359: creat de/d1b/f7e x:0 0 0 2024-02-15T22:51:17.643 INFO:tasks.workunit.client.1.smithi170.stdout:1/486: chown d3/d24/f63 193216896 1 2024-02-15T22:51:17.643 INFO:tasks.workunit.client.1.smithi170.stdout:1/487: chown d3/da2/d4a 75874670 1 2024-02-15T22:51:17.645 INFO:tasks.workunit.client.1.smithi170.stdout:9/360: truncate fb 2666628 0 2024-02-15T22:51:17.650 INFO:tasks.workunit.client.1.smithi170.stdout:1/488: truncate d3/d24/f51 2500871 0 2024-02-15T22:51:17.657 INFO:tasks.workunit.client.1.smithi170.stdout:2/419: rename d0/cd to d0/d1d/ca7 0 2024-02-15T22:51:17.660 INFO:tasks.workunit.client.1.smithi170.stdout:7/473: dwrite da/d1a/d21/d1b/f77 [0,4194304] 0 2024-02-15T22:51:17.661 INFO:tasks.workunit.client.1.smithi170.stdout:2/420: dread d0/f2c [0,4194304] 0 2024-02-15T22:51:17.661 INFO:tasks.workunit.client.1.smithi170.stdout:2/421: creat d0/d13/fa8 x:0 0 0 2024-02-15T22:51:17.664 INFO:tasks.workunit.client.1.smithi170.stdout:8/361: rename d9/d18/c58 to d9/c73 0 2024-02-15T22:51:17.668 INFO:tasks.workunit.client.1.smithi170.stdout:7/474: rmdir da/d1a/d21/d2c/d2e 39 2024-02-15T22:51:17.668 INFO:tasks.workunit.client.1.smithi170.stdout:7/475: fsync da/d1a/d21/d1b/f88 0 2024-02-15T22:51:17.671 INFO:tasks.workunit.client.1.smithi170.stdout:8/362: creat d9/d18/d32/d3b/d42/f74 x:0 0 0 2024-02-15T22:51:17.674 INFO:tasks.workunit.client.1.smithi170.stdout:9/361: rename de/f17 to de/d1b/d1c/d1f/d20/d27/d2c/f7f 0 2024-02-15T22:51:17.675 INFO:tasks.workunit.client.1.smithi170.stdout:9/362: stat de/d1b/d1c/d1f 0 2024-02-15T22:51:17.678 INFO:tasks.workunit.client.1.smithi170.stdout:7/476: rename da/d1a/d21/d4d/d59/f6c to da/d63/fa2 0 2024-02-15T22:51:17.678 INFO:tasks.workunit.client.1.smithi170.stdout:7/477: write da/d1a/f27 [4809852,78066] 0 2024-02-15T22:51:17.678 INFO:tasks.workunit.client.1.smithi170.stdout:7/478: write da/d1a/d21/d2c/f84 [1496367,119133] 0 2024-02-15T22:51:17.681 INFO:tasks.workunit.client.1.smithi170.stdout:2/422: dwrite d0/d28/d2f/f62 [0,4194304] 0 2024-02-15T22:51:17.682 INFO:tasks.workunit.client.1.smithi170.stdout:8/363: symlink d9/d18/l75 0 2024-02-15T22:51:17.682 INFO:tasks.workunit.client.1.smithi170.stdout:8/364: chown d9/l21 32652 1 2024-02-15T22:51:17.683 INFO:tasks.workunit.client.1.smithi170.stdout:8/365: dread d9/d18/d32/d3b/d42/f61 [0,4194304] 0 2024-02-15T22:51:17.687 INFO:tasks.workunit.client.1.smithi170.stdout:7/479: creat da/d1a/d21/d2c/d74/fa3 x:0 0 0 2024-02-15T22:51:17.691 INFO:tasks.workunit.client.1.smithi170.stdout:2/423: unlink d0/d13/c1b 0 2024-02-15T22:51:17.692 INFO:tasks.workunit.client.1.smithi170.stdout:2/424: write d0/d28/f5d [918342,11873] 0 2024-02-15T22:51:17.692 INFO:tasks.workunit.client.1.smithi170.stdout:2/425: write d0/d28/d2f/d37/f7c [1357578,19025] 0 2024-02-15T22:51:17.693 INFO:tasks.workunit.client.1.smithi170.stdout:8/366: read d9/fd [3796189,82218] 0 2024-02-15T22:51:17.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/480: rmdir da/d1a/d21/d19/d9d 0 2024-02-15T22:51:17.699 INFO:tasks.workunit.client.1.smithi170.stdout:2/426: unlink d0/d1/d5f/f92 0 2024-02-15T22:51:17.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/427: dread d0/d28/d2f/d37/f4f [0,4194304] 0 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:4/509: sync 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:4/510: creat d0/d22/da/fa1 x:0 0 0 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:4/511: truncate d0/d22/da/d11/f3c 4918863 0 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:4/512: read - d0/f9a zero size 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:4/513: chown d0/d22/da/d58/d6b 12158 1 2024-02-15T22:51:17.713 INFO:tasks.workunit.client.1.smithi170.stdout:8/367: dwrite d9/d18/d26/f55 [0,4194304] 0 2024-02-15T22:51:17.714 INFO:tasks.workunit.client.1.smithi170.stdout:2/428: symlink d0/d13/d59/la9 0 2024-02-15T22:51:17.715 INFO:tasks.workunit.client.1.smithi170.stdout:7/481: dwrite da/d1a/d21/d2c/f6a [0,4194304] 0 2024-02-15T22:51:17.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/489: fsync d3/d24/f51 0 2024-02-15T22:51:17.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/482: dwrite da/d1a/d21/d4d/d59/f66 [0,4194304] 0 2024-02-15T22:51:17.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/429: rmdir d0/d28/d2f/d37/d58/d78 39 2024-02-15T22:51:17.740 INFO:tasks.workunit.client.1.smithi170.stdout:4/514: rename d0/d22/da/d8b/d47/d67/d77/d8d to d0/d22/da/d11/da2 0 2024-02-15T22:51:17.740 INFO:tasks.workunit.client.1.smithi170.stdout:4/515: fsync d0/d22/da/d11/d20/f3d 0 2024-02-15T22:51:17.740 INFO:tasks.workunit.client.1.smithi170.stdout:4/516: chown d0/f21 10 1 2024-02-15T22:51:17.741 INFO:tasks.workunit.client.1.smithi170.stdout:2/430: mkdir d0/d2a/daa 0 2024-02-15T22:51:17.744 INFO:tasks.workunit.client.1.smithi170.stdout:4/517: rename d0/d22/da/d8b/d47/d5e/l72 to d0/d9f/la3 0 2024-02-15T22:51:17.746 INFO:tasks.workunit.client.1.smithi170.stdout:8/368: getdents d9/d18/d32/d3b/d42 0 2024-02-15T22:51:17.746 INFO:tasks.workunit.client.1.smithi170.stdout:8/369: chown d9/d18/d32/d3b/f6c 9611 1 2024-02-15T22:51:17.748 INFO:tasks.workunit.client.1.smithi170.stdout:4/518: creat d0/d22/da/d11/d89/fa4 x:0 0 0 2024-02-15T22:51:17.748 INFO:tasks.workunit.client.1.smithi170.stdout:4/519: truncate d0/d22/da/d11/da2/f9d 1022656 0 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/490: dwrite d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/491: chown d3/d24/d2c/d35/f38 36889785 1 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/492: creat d3/d24/d2c/d35/d7f/fae x:0 0 0 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/493: chown d3/d24/d2c/d35/f82 1272550 1 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/494: chown d3/d24/d2c/l9f 158 1 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/495: creat d3/d24/d2c/d35/d7f/faf x:0 0 0 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:7/483: dwrite da/d1a/d21/d2c/d2e/f35 [4194304,4194304] 0 2024-02-15T22:51:17.750 INFO:tasks.workunit.client.1.smithi170.stdout:1/496: chown d3/d24/c6c 2762 1 2024-02-15T22:51:17.751 INFO:tasks.workunit.client.1.smithi170.stdout:8/370: creat d9/d18/d48/f76 x:0 0 0 2024-02-15T22:51:17.752 INFO:tasks.workunit.client.1.smithi170.stdout:4/520: mknod d0/d22/d6e/ca5 0 2024-02-15T22:51:17.758 INFO:tasks.workunit.client.1.smithi170.stdout:8/371: mkdir d9/d18/d32/d3b/d42/d77 0 2024-02-15T22:51:17.758 INFO:tasks.workunit.client.1.smithi170.stdout:2/431: dwrite d0/d1d/d3d/d76/fa0 [0,4194304] 0 2024-02-15T22:51:17.759 INFO:tasks.workunit.client.1.smithi170.stdout:4/521: mknod d0/d22/da/d58/ca6 0 2024-02-15T22:51:17.759 INFO:tasks.workunit.client.1.smithi170.stdout:4/522: chown d0/d22/f14 92652001 1 2024-02-15T22:51:17.760 INFO:tasks.workunit.client.1.smithi170.stdout:4/523: write d0/d22/f34 [3450143,45975] 0 2024-02-15T22:51:17.762 INFO:tasks.workunit.client.1.smithi170.stdout:7/484: write da/d1a/d21/d19/f50 [6051095,122385] 0 2024-02-15T22:51:17.766 INFO:tasks.workunit.client.1.smithi170.stdout:2/432: truncate d0/d1/d53/f7e 739207 0 2024-02-15T22:51:17.767 INFO:tasks.workunit.client.1.smithi170.stdout:1/497: dwrite d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:4/524: read d0/d22/da/f43 [3542891,64658] 0 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:4/525: write d0/d22/da/d8b/d47/d67/f7a [859986,87683] 0 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:7/485: creat da/d1a/d21/d1b/fa4 x:0 0 0 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:4/526: write d0/d22/da/d8b/d47/d2b/f68 [822118,122447] 0 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:4/527: chown d0/d22/l31 270 1 2024-02-15T22:51:17.768 INFO:tasks.workunit.client.1.smithi170.stdout:7/486: write da/f64 [684644,121217] 0 2024-02-15T22:51:17.769 INFO:tasks.workunit.client.1.smithi170.stdout:7/487: read da/d1a/d21/d4d/d59/f89 [7114,87912] 0 2024-02-15T22:51:17.771 INFO:tasks.workunit.client.1.smithi170.stdout:2/433: link d0/d28/d2f/l8f d0/d1/d11/d26/lab 0 2024-02-15T22:51:17.771 INFO:tasks.workunit.client.1.smithi170.stdout:8/372: dread d9/d18/d32/f59 [0,4194304] 0 2024-02-15T22:51:17.772 INFO:tasks.workunit.client.1.smithi170.stdout:1/498: mkdir d3/d24/d2c/d35/d83/db0 0 2024-02-15T22:51:17.773 INFO:tasks.workunit.client.1.smithi170.stdout:8/373: mkdir d9/d18/d32/d3b/d42/d77/d78 0 2024-02-15T22:51:17.775 INFO:tasks.workunit.client.1.smithi170.stdout:1/499: link d3/f2e d3/fb1 0 2024-02-15T22:51:17.775 INFO:tasks.workunit.client.1.smithi170.stdout:1/500: readlink d3/d24/d2c/l9f 0 2024-02-15T22:51:17.776 INFO:tasks.workunit.client.1.smithi170.stdout:8/374: creat d9/d18/f79 x:0 0 0 2024-02-15T22:51:17.777 INFO:tasks.workunit.client.1.smithi170.stdout:8/375: dread d9/d18/d32/d3b/d42/f61 [0,4194304] 0 2024-02-15T22:51:17.784 INFO:tasks.workunit.client.1.smithi170.stdout:7/488: dread da/d63/fa2 [0,4194304] 0 2024-02-15T22:51:17.805 INFO:tasks.workunit.client.1.smithi170.stdout:1/501: dwrite d3/d24/f8d [0,4194304] 0 2024-02-15T22:51:17.807 INFO:tasks.workunit.client.1.smithi170.stdout:2/434: dwrite d0/d28/d2f/d37/d58/f96 [0,4194304] 0 2024-02-15T22:51:17.808 INFO:tasks.workunit.client.1.smithi170.stdout:7/489: dwrite da/f38 [0,4194304] 0 2024-02-15T22:51:17.808 INFO:tasks.workunit.client.1.smithi170.stdout:4/528: dwrite d0/d22/da/d11/d20/f4d [4194304,4194304] 0 2024-02-15T22:51:17.813 INFO:tasks.workunit.client.1.smithi170.stdout:7/490: unlink da/d1a/l4a 0 2024-02-15T22:51:17.813 INFO:tasks.workunit.client.1.smithi170.stdout:7/491: chown da/d1a/d21/d4d/d59/l83 2 1 2024-02-15T22:51:17.813 INFO:tasks.workunit.client.1.smithi170.stdout:7/492: write da/d1a/d21/d1b/f79 [2416597,24692] 0 2024-02-15T22:51:17.816 INFO:tasks.workunit.client.1.smithi170.stdout:2/435: getdents d0/d1/d11 0 2024-02-15T22:51:17.817 INFO:tasks.workunit.client.1.smithi170.stdout:1/502: getdents d3/d24/d2c/d35/d83 0 2024-02-15T22:51:17.817 INFO:tasks.workunit.client.1.smithi170.stdout:1/503: fdatasync d3/d24/d2c/d35/d72/f8b 0 2024-02-15T22:51:17.823 INFO:tasks.workunit.client.1.smithi170.stdout:7/493: mknod da/d1a/d21/d1b/ca5 0 2024-02-15T22:51:17.825 INFO:tasks.workunit.client.1.smithi170.stdout:1/504: rename d3/da2/d65/f9a to d3/da2/d65/fb2 0 2024-02-15T22:51:17.825 INFO:tasks.workunit.client.1.smithi170.stdout:1/505: fsync d3/f10 0 2024-02-15T22:51:17.826 INFO:tasks.workunit.client.1.smithi170.stdout:4/529: dwrite d0/d22/da/fa1 [0,4194304] 0 2024-02-15T22:51:17.826 INFO:tasks.workunit.client.1.smithi170.stdout:4/530: dread - d0/d22/da/d8b/d47/d5e/d7d/f9c zero size 2024-02-15T22:51:17.827 INFO:tasks.workunit.client.1.smithi170.stdout:7/494: truncate da/d1a/d21/f46 1725187 0 2024-02-15T22:51:17.830 INFO:tasks.workunit.client.1.smithi170.stdout:7/495: creat da/d1a/d21/d2c/d71/fa6 x:0 0 0 2024-02-15T22:51:17.831 INFO:tasks.workunit.client.1.smithi170.stdout:7/496: truncate da/d1a/d21/d2c/f6a 4761187 0 2024-02-15T22:51:17.831 INFO:tasks.workunit.client.1.smithi170.stdout:7/497: chown da/d63/d8d/l9c 810549615 1 2024-02-15T22:51:17.831 INFO:tasks.workunit.client.1.smithi170.stdout:7/498: fsync da/d1a/d21/d4d/d59/d7c/d7d/f32 0 2024-02-15T22:51:17.832 INFO:tasks.workunit.client.1.smithi170.stdout:7/499: symlink da/d63/d8d/la7 0 2024-02-15T22:51:17.833 INFO:tasks.workunit.client.1.smithi170.stdout:7/500: truncate da/d1a/fa1 2161165 0 2024-02-15T22:51:17.833 INFO:tasks.workunit.client.1.smithi170.stdout:7/501: creat da/fa8 x:0 0 0 2024-02-15T22:51:17.833 INFO:tasks.workunit.client.1.smithi170.stdout:7/502: readlink da/l4f 0 2024-02-15T22:51:17.841 INFO:tasks.workunit.client.1.smithi170.stdout:7/503: write da/d1a/d21/d2c/f6a [2538377,126733] 0 2024-02-15T22:51:17.842 INFO:tasks.workunit.client.1.smithi170.stdout:4/531: dread d0/d22/da/d11/d20/f4d [4194304,4194304] 0 2024-02-15T22:51:17.842 INFO:tasks.workunit.client.1.smithi170.stdout:4/532: write d0/d22/da/f13 [1210639,5446] 0 2024-02-15T22:51:17.843 INFO:tasks.workunit.client.1.smithi170.stdout:7/504: creat da/d57/fa9 x:0 0 0 2024-02-15T22:51:17.845 INFO:tasks.workunit.client.1.smithi170.stdout:2/436: dwrite d0/f2c [0,4194304] 0 2024-02-15T22:51:17.846 INFO:tasks.workunit.client.1.smithi170.stdout:7/505: link da/fa8 da/d1a/d21/d4d/d59/d7c/d7d/d72/faa 0 2024-02-15T22:51:17.849 INFO:tasks.workunit.client.1.smithi170.stdout:2/437: creat d0/d1/d5f/fac x:0 0 0 2024-02-15T22:51:17.851 INFO:tasks.workunit.client.1.smithi170.stdout:1/506: dwrite d3/d24/f36 [0,4194304] 0 2024-02-15T22:51:17.854 INFO:tasks.workunit.client.1.smithi170.stdout:1/507: mknod d3/d24/d2c/d5e/cb3 0 2024-02-15T22:51:17.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/508: rename d3/l18 to d3/d24/d2c/d35/lb4 0 2024-02-15T22:51:17.857 INFO:tasks.workunit.client.1.smithi170.stdout:2/438: dread d0/d28/d2f/d37/d58/f96 [0,4194304] 0 2024-02-15T22:51:17.858 INFO:tasks.workunit.client.1.smithi170.stdout:1/509: creat d3/da2/d65/fb5 x:0 0 0 2024-02-15T22:51:17.859 INFO:tasks.workunit.client.1.smithi170.stdout:2/439: mknod d0/d1/d53/cad 0 2024-02-15T22:51:17.859 INFO:tasks.workunit.client.1.smithi170.stdout:4/533: dwrite d0/d22/da/d8b/d47/d2b/f8f [0,4194304] 0 2024-02-15T22:51:17.862 INFO:tasks.workunit.client.1.smithi170.stdout:4/534: mknod d0/d22/da/d58/d6b/ca7 0 2024-02-15T22:51:17.864 INFO:tasks.workunit.client.1.smithi170.stdout:7/506: dwrite da/d1a/d21/d4d/d59/f89 [0,4194304] 0 2024-02-15T22:51:17.865 INFO:tasks.workunit.client.1.smithi170.stdout:1/510: rename d3/d24/d2c/d35/d7f/fae to d3/da2/d65/fb6 0 2024-02-15T22:51:17.865 INFO:tasks.workunit.client.1.smithi170.stdout:1/511: chown d3/d24/l33 3016852 1 2024-02-15T22:51:17.865 INFO:tasks.workunit.client.1.smithi170.stdout:1/512: write d3/d24/d91/f95 [689990,90179] 0 2024-02-15T22:51:17.865 INFO:tasks.workunit.client.1.smithi170.stdout:4/535: mkdir d0/d22/da8 0 2024-02-15T22:51:17.866 INFO:tasks.workunit.client.1.smithi170.stdout:3/440: sync 2024-02-15T22:51:17.871 INFO:tasks.workunit.client.1.smithi170.stdout:1/513: link d3/d24/d2c/d35/d72/c73 d3/d24/d91/cb7 0 2024-02-15T22:51:17.871 INFO:tasks.workunit.client.1.smithi170.stdout:1/514: fdatasync d3/d24/d2c/d35/f81 0 2024-02-15T22:51:17.871 INFO:tasks.workunit.client.1.smithi170.stdout:1/515: write d3/d24/d2c/f47 [8843343,46771] 0 2024-02-15T22:51:17.871 INFO:tasks.workunit.client.1.smithi170.stdout:1/516: fdatasync d3/d24/d2c/d35/f52 0 2024-02-15T22:51:17.871 INFO:tasks.workunit.client.1.smithi170.stdout:2/440: getdents d0/d1/d5f 0 2024-02-15T22:51:17.873 INFO:tasks.workunit.client.1.smithi170.stdout:3/441: truncate d3/db/d1f/f41 3274128 0 2024-02-15T22:51:17.873 INFO:tasks.workunit.client.1.smithi170.stdout:3/442: write d3/db/d1f/f2f [4184381,84229] 0 2024-02-15T22:51:17.875 INFO:tasks.workunit.client.1.smithi170.stdout:1/517: stat d3/d24/d2c/d35/d72/c97 0 2024-02-15T22:51:17.875 INFO:tasks.workunit.client.1.smithi170.stdout:1/518: dread - d3/f2e zero size 2024-02-15T22:51:17.877 INFO:tasks.workunit.client.1.smithi170.stdout:2/441: mknod d0/d28/d2f/d37/d58/d78/cae 0 2024-02-15T22:51:17.879 INFO:tasks.workunit.client.1.smithi170.stdout:1/519: rename d3/f21 to d3/fb8 0 2024-02-15T22:51:17.880 INFO:tasks.workunit.client.1.smithi170.stdout:2/442: truncate d0/d28/d2f/d37/d58/f96 444344 0 2024-02-15T22:51:17.881 INFO:tasks.workunit.client.1.smithi170.stdout:2/443: readlink d0/d1/d53/l79 0 2024-02-15T22:51:17.883 INFO:tasks.workunit.client.1.smithi170.stdout:7/507: dwrite da/f64 [0,4194304] 0 2024-02-15T22:51:17.883 INFO:tasks.workunit.client.1.smithi170.stdout:7/508: truncate da/d1a/d21/d19/f91 621192 0 2024-02-15T22:51:17.890 INFO:tasks.workunit.client.1.smithi170.stdout:7/509: symlink da/d1a/d21/d19/lab 0 2024-02-15T22:51:17.891 INFO:tasks.workunit.client.1.smithi170.stdout:2/444: rmdir d0/d1d/d3d/d76 39 2024-02-15T22:51:17.894 INFO:tasks.workunit.client.1.smithi170.stdout:7/510: rename da/d1a/d21/d4d/d59 to da/d1a/d21/d2c/d74/d87/dac 0 2024-02-15T22:51:17.895 INFO:tasks.workunit.client.1.smithi170.stdout:2/445: mknod d0/caf 0 2024-02-15T22:51:17.896 INFO:tasks.workunit.client.1.smithi170.stdout:1/520: dwrite d3/da2/d65/f87 [0,4194304] 0 2024-02-15T22:51:17.897 INFO:tasks.workunit.client.1.smithi170.stdout:7/511: creat da/d1a/d21/d2c/d2e/fad x:0 0 0 2024-02-15T22:51:17.897 INFO:tasks.workunit.client.1.smithi170.stdout:7/512: readlink da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/l34 0 2024-02-15T22:51:17.903 INFO:tasks.workunit.client.1.smithi170.stdout:1/521: link d3/da2/d4a/f4e d3/fb9 0 2024-02-15T22:51:17.911 INFO:tasks.workunit.client.1.smithi170.stdout:2/446: dwrite d0/d1d/f4e [0,4194304] 0 2024-02-15T22:51:17.911 INFO:tasks.workunit.client.1.smithi170.stdout:2/447: creat d0/d1/d5f/d74/fb0 x:0 0 0 2024-02-15T22:51:17.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/522: write d3/d24/f36 [172592,12342] 0 2024-02-15T22:51:17.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/523: chown d3/f10 23 1 2024-02-15T22:51:17.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/513: dwrite da/fa8 [0,4194304] 0 2024-02-15T22:51:17.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/514: chown da/d1a/d21/d19/l24 1592366 1 2024-02-15T22:51:17.917 INFO:tasks.workunit.client.1.smithi170.stdout:2/448: creat d0/d1/d5f/d74/d8e/fb1 x:0 0 0 2024-02-15T22:51:17.922 INFO:tasks.workunit.client.1.smithi170.stdout:2/449: symlink d0/d1/d31/da3/lb2 0 2024-02-15T22:51:17.923 INFO:tasks.workunit.client.1.smithi170.stdout:1/524: rmdir d3/d24/d2c/d5e 39 2024-02-15T22:51:17.923 INFO:tasks.workunit.client.1.smithi170.stdout:1/525: dread - d3/d24/d2c/d35/d7f/f9c zero size 2024-02-15T22:51:17.923 INFO:tasks.workunit.client.1.smithi170.stdout:1/526: symlink d3/da2/lba 0 2024-02-15T22:51:17.925 INFO:tasks.workunit.client.1.smithi170.stdout:1/527: link d3/d24/d2c/d77/fa4 d3/fbb 0 2024-02-15T22:51:17.925 INFO:tasks.workunit.client.1.smithi170.stdout:1/528: chown d3/d24/f8d 467970377 1 2024-02-15T22:51:17.928 INFO:tasks.workunit.client.1.smithi170.stdout:1/529: dread d3/da2/d4a/f4e [0,4194304] 0 2024-02-15T22:51:17.928 INFO:tasks.workunit.client.1.smithi170.stdout:7/515: dwrite da/d1a/d21/d1b/d69/f97 [0,4194304] 0 2024-02-15T22:51:17.928 INFO:tasks.workunit.client.1.smithi170.stdout:1/530: readlink d3/d24/d2c/d35/d83/lad 0 2024-02-15T22:51:17.932 INFO:tasks.workunit.client.1.smithi170.stdout:7/516: rmdir da/d1a/d21/d19/d9f 0 2024-02-15T22:51:17.932 INFO:tasks.workunit.client.1.smithi170.stdout:7/517: write da/d57/f7b [317300,6508] 0 2024-02-15T22:51:17.932 INFO:tasks.workunit.client.1.smithi170.stdout:7/518: creat da/d1a/d21/fae x:0 0 0 2024-02-15T22:51:17.932 INFO:tasks.workunit.client.1.smithi170.stdout:1/531: creat d3/d24/d2c/d94/fbc x:0 0 0 2024-02-15T22:51:17.933 INFO:tasks.workunit.client.1.smithi170.stdout:2/450: write d0/d1/f9 [3797834,84335] 0 2024-02-15T22:51:17.935 INFO:tasks.workunit.client.1.smithi170.stdout:1/532: dread d3/d24/d2c/f2f [4194304,4194304] 0 2024-02-15T22:51:17.935 INFO:tasks.workunit.client.1.smithi170.stdout:1/533: write d3/f10 [4328896,102611] 0 2024-02-15T22:51:17.935 INFO:tasks.workunit.client.1.smithi170.stdout:2/451: link d0/d28/d2f/d37/c61 d0/d1/d89/d8b/cb3 0 2024-02-15T22:51:17.937 INFO:tasks.workunit.client.1.smithi170.stdout:7/519: dread da/d63/fa2 [0,4194304] 0 2024-02-15T22:51:17.939 INFO:tasks.workunit.client.1.smithi170.stdout:1/534: unlink d3/l55 0 2024-02-15T22:51:17.939 INFO:tasks.workunit.client.1.smithi170.stdout:1/535: fdatasync d3/d24/d2c/d35/d72/f8b 0 2024-02-15T22:51:17.939 INFO:tasks.workunit.client.1.smithi170.stdout:1/536: write d3/da2/f57 [1129376,70511] 0 2024-02-15T22:51:17.939 INFO:tasks.workunit.client.1.smithi170.stdout:1/537: chown d3/d24/d2c/d77 8843 1 2024-02-15T22:51:17.939 INFO:tasks.workunit.client.1.smithi170.stdout:1/538: creat d3/fbd x:0 0 0 2024-02-15T22:51:17.940 INFO:tasks.workunit.client.1.smithi170.stdout:2/452: link d0/caf d0/d1/d31/da3/cb4 0 2024-02-15T22:51:17.940 INFO:tasks.workunit.client.1.smithi170.stdout:1/539: read d3/d24/d2c/f6d [552548,49703] 0 2024-02-15T22:51:17.940 INFO:tasks.workunit.client.1.smithi170.stdout:2/453: creat d0/d2a/fb5 x:0 0 0 2024-02-15T22:51:17.940 INFO:tasks.workunit.client.1.smithi170.stdout:2/454: chown d0/d1/d5f/c9e 1492042 1 2024-02-15T22:51:17.941 INFO:tasks.workunit.client.1.smithi170.stdout:2/455: fsync d0/d1/d11/f86 0 2024-02-15T22:51:17.941 INFO:tasks.workunit.client.1.smithi170.stdout:2/456: chown d0/d1d/f22 3684 1 2024-02-15T22:51:17.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/540: mknod d3/d24/d2c/d94/cbe 0 2024-02-15T22:51:17.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/541: chown d3/c1a 29 1 2024-02-15T22:51:17.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/542: chown d3/fb 924891 1 2024-02-15T22:51:17.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/543: creat d3/d24/d91/fbf x:0 0 0 2024-02-15T22:51:17.944 INFO:tasks.workunit.client.1.smithi170.stdout:1/544: creat d3/d24/d2c/d35/fc0 x:0 0 0 2024-02-15T22:51:17.945 INFO:tasks.workunit.client.1.smithi170.stdout:2/457: symlink d0/d2a/lb6 0 2024-02-15T22:51:17.945 INFO:tasks.workunit.client.1.smithi170.stdout:2/458: readlink d0/d1/d11/l5b 0 2024-02-15T22:51:17.947 INFO:tasks.workunit.client.1.smithi170.stdout:2/459: creat d0/d13/d59/d82/fb7 x:0 0 0 2024-02-15T22:51:17.947 INFO:tasks.workunit.client.1.smithi170.stdout:2/460: dread - d0/d1/d11/d26/f9a zero size 2024-02-15T22:51:17.950 INFO:tasks.workunit.client.1.smithi170.stdout:7/520: dwrite da/d1a/d21/f70 [0,4194304] 0 2024-02-15T22:51:17.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/461: fsync d0/d1/f9 0 2024-02-15T22:51:17.955 INFO:tasks.workunit.client.1.smithi170.stdout:1/545: dread d3/da2/d65/f87 [0,4194304] 0 2024-02-15T22:51:17.963 INFO:tasks.workunit.client.1.smithi170.stdout:1/546: dread d3/d24/d2c/d94/fa5 [0,4194304] 0 2024-02-15T22:51:17.965 INFO:tasks.workunit.client.1.smithi170.stdout:1/547: rename l2 to d3/d24/d2c/d77/lc1 0 2024-02-15T22:51:17.970 INFO:tasks.workunit.client.1.smithi170.stdout:2/462: dwrite d0/d13/fa8 [0,4194304] 0 2024-02-15T22:51:17.974 INFO:tasks.workunit.client.1.smithi170.stdout:7/521: dwrite da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:17.975 INFO:tasks.workunit.client.1.smithi170.stdout:7/522: readlink da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/l68 0 2024-02-15T22:51:17.977 INFO:tasks.workunit.client.1.smithi170.stdout:2/463: creat d0/d1/d53/fb8 x:0 0 0 2024-02-15T22:51:17.978 INFO:tasks.workunit.client.1.smithi170.stdout:2/464: truncate d0/d1d/d3d/f5c 5040979 0 2024-02-15T22:51:17.982 INFO:tasks.workunit.client.1.smithi170.stdout:1/548: dwrite d3/da2/d65/fb6 [0,4194304] 0 2024-02-15T22:51:17.990 INFO:tasks.workunit.client.1.smithi170.stdout:7/523: truncate da/d1a/d21/d1b/f79 3206298 0 2024-02-15T22:51:17.991 INFO:tasks.workunit.client.1.smithi170.stdout:2/465: creat d0/d1d/fb9 x:0 0 0 2024-02-15T22:51:17.994 INFO:tasks.workunit.client.1.smithi170.stdout:6/476: sync 2024-02-15T22:51:17.994 INFO:tasks.workunit.client.1.smithi170.stdout:5/585: sync 2024-02-15T22:51:17.994 INFO:tasks.workunit.client.1.smithi170.stdout:0/396: sync 2024-02-15T22:51:17.994 INFO:tasks.workunit.client.1.smithi170.stdout:6/477: dread - d3/d24/f7a zero size 2024-02-15T22:51:17.994 INFO:tasks.workunit.client.1.smithi170.stdout:0/397: creat d8/df/d13/f85 x:0 0 0 2024-02-15T22:51:18.000 INFO:tasks.workunit.client.1.smithi170.stdout:0/398: creat d8/df/d13/d36/d60/f86 x:0 0 0 2024-02-15T22:51:18.002 INFO:tasks.workunit.client.1.smithi170.stdout:1/549: rmdir d3/d24/d2c/d35/d83/db0 0 2024-02-15T22:51:18.002 INFO:tasks.workunit.client.1.smithi170.stdout:7/524: dread da/d1a/d21/f70 [0,4194304] 0 2024-02-15T22:51:18.002 INFO:tasks.workunit.client.1.smithi170.stdout:7/525: fsync da/d1a/d21/d1b/f77 0 2024-02-15T22:51:18.002 INFO:tasks.workunit.client.1.smithi170.stdout:7/526: fdatasync da/f38 0 2024-02-15T22:51:18.002 INFO:tasks.workunit.client.1.smithi170.stdout:6/478: dread d3/d1a/f40 [0,4194304] 0 2024-02-15T22:51:18.003 INFO:tasks.workunit.client.1.smithi170.stdout:1/550: write d3/f20 [1646538,62624] 0 2024-02-15T22:51:18.004 INFO:tasks.workunit.client.1.smithi170.stdout:7/527: mkdir da/d1a/d21/d2c/d74/d87/daf 0 2024-02-15T22:51:18.006 INFO:tasks.workunit.client.1.smithi170.stdout:1/551: rmdir d3/d24/d2c 39 2024-02-15T22:51:18.006 INFO:tasks.workunit.client.1.smithi170.stdout:7/528: symlink da/d1a/d21/d2c/d74/d87/dac/lb0 0 2024-02-15T22:51:18.007 INFO:tasks.workunit.client.1.smithi170.stdout:7/529: fsync da/d1a/d21/d2c/d2e/f35 0 2024-02-15T22:51:18.007 INFO:tasks.workunit.client.1.smithi170.stdout:6/479: getdents d3/d1d/d27 0 2024-02-15T22:51:18.009 INFO:tasks.workunit.client.1.smithi170.stdout:2/466: dwrite d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:18.012 INFO:tasks.workunit.client.1.smithi170.stdout:1/552: unlink d3/da2/f57 0 2024-02-15T22:51:18.012 INFO:tasks.workunit.client.1.smithi170.stdout:1/553: creat d3/da2/fc2 x:0 0 0 2024-02-15T22:51:18.012 INFO:tasks.workunit.client.1.smithi170.stdout:2/467: mknod d0/d2a/daa/cba 0 2024-02-15T22:51:18.015 INFO:tasks.workunit.client.1.smithi170.stdout:1/554: mknod d3/da2/cc3 0 2024-02-15T22:51:18.017 INFO:tasks.workunit.client.1.smithi170.stdout:2/468: rename d0/d2a/c3f to d0/d1/d11/cbb 0 2024-02-15T22:51:18.019 INFO:tasks.workunit.client.1.smithi170.stdout:1/555: symlink d3/d24/d2c/d35/d72/d7e/lc4 0 2024-02-15T22:51:18.019 INFO:tasks.workunit.client.1.smithi170.stdout:1/556: write d3/d24/d2c/d35/f82 [699478,53593] 0 2024-02-15T22:51:18.019 INFO:tasks.workunit.client.1.smithi170.stdout:1/557: write d3/d24/f36 [2910283,97592] 0 2024-02-15T22:51:18.020 INFO:tasks.workunit.client.1.smithi170.stdout:0/399: dwrite d8/df/d13/d36/d60/f86 [0,4194304] 0 2024-02-15T22:51:18.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/558: mknod d3/d24/cc5 0 2024-02-15T22:51:18.023 INFO:tasks.workunit.client.1.smithi170.stdout:1/559: symlink d3/d24/d2c/d35/d83/lc6 0 2024-02-15T22:51:18.024 INFO:tasks.workunit.client.1.smithi170.stdout:7/530: dwrite da/d1a/d21/d19/f91 [0,4194304] 0 2024-02-15T22:51:18.026 INFO:tasks.workunit.client.1.smithi170.stdout:1/560: fdatasync d3/fbd 0 2024-02-15T22:51:18.028 INFO:tasks.workunit.client.1.smithi170.stdout:1/561: symlink d3/d24/d2c/d94/lc7 0 2024-02-15T22:51:18.030 INFO:tasks.workunit.client.1.smithi170.stdout:1/562: link d3/d24/d2c/d35/d72/c88 d3/d24/d2c/d35/d72/d92/cc8 0 2024-02-15T22:51:18.031 INFO:tasks.workunit.client.1.smithi170.stdout:1/563: symlink d3/d24/d2c/d5e/lc9 0 2024-02-15T22:51:18.031 INFO:tasks.workunit.client.1.smithi170.stdout:1/564: chown d3/c28 0 1 2024-02-15T22:51:18.034 INFO:tasks.workunit.client.1.smithi170.stdout:7/531: dread da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/faa [0,4194304] 0 2024-02-15T22:51:18.036 INFO:tasks.workunit.client.1.smithi170.stdout:1/565: dread d3/f1f [0,4194304] 0 2024-02-15T22:51:18.039 INFO:tasks.workunit.client.1.smithi170.stdout:0/400: dwrite d8/f3b [4194304,4194304] 0 2024-02-15T22:51:18.040 INFO:tasks.workunit.client.1.smithi170.stdout:2/469: dwrite d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:18.044 INFO:tasks.workunit.client.1.smithi170.stdout:2/470: link d0/d28/d2f/la6 d0/d1d/lbc 0 2024-02-15T22:51:18.045 INFO:tasks.workunit.client.1.smithi170.stdout:2/471: mknod d0/d1/cbd 0 2024-02-15T22:51:18.046 INFO:tasks.workunit.client.1.smithi170.stdout:2/472: mkdir d0/d28/d2f/dbe 0 2024-02-15T22:51:18.071 INFO:tasks.workunit.client.1.smithi170.stdout:7/532: dwrite da/d1a/d21/f46 [0,4194304] 0 2024-02-15T22:51:18.071 INFO:tasks.workunit.client.1.smithi170.stdout:7/533: truncate da/d1a/d21/d19/f94 52804 0 2024-02-15T22:51:18.072 INFO:tasks.workunit.client.1.smithi170.stdout:7/534: symlink da/d1a/d21/d2c/d74/d87/dac/d7c/d9e/lb1 0 2024-02-15T22:51:18.073 INFO:tasks.workunit.client.1.smithi170.stdout:7/535: unlink da/f12 0 2024-02-15T22:51:18.074 INFO:tasks.workunit.client.1.smithi170.stdout:7/536: mkdir da/d1a/d21/db2 0 2024-02-15T22:51:18.075 INFO:tasks.workunit.client.1.smithi170.stdout:1/566: dwrite d3/d24/d2c/d35/f48 [0,4194304] 0 2024-02-15T22:51:18.075 INFO:tasks.workunit.client.1.smithi170.stdout:7/537: rmdir da/d57 39 2024-02-15T22:51:18.075 INFO:tasks.workunit.client.1.smithi170.stdout:7/538: truncate da/d1a/d21/d19/f94 435779 0 2024-02-15T22:51:18.078 INFO:tasks.workunit.client.1.smithi170.stdout:1/567: mknod d3/d24/d91/cca 0 2024-02-15T22:51:18.078 INFO:tasks.workunit.client.1.smithi170.stdout:0/401: dwrite f5 [0,4194304] 0 2024-02-15T22:51:18.079 INFO:tasks.workunit.client.1.smithi170.stdout:1/568: symlink d3/d24/d91/lcb 0 2024-02-15T22:51:18.081 INFO:tasks.workunit.client.1.smithi170.stdout:2/473: dwrite d0/d1d/f93 [0,4194304] 0 2024-02-15T22:51:18.084 INFO:tasks.workunit.client.1.smithi170.stdout:1/569: mknod d3/ccc 0 2024-02-15T22:51:18.086 INFO:tasks.workunit.client.1.smithi170.stdout:1/570: write d3/d24/d91/f95 [94231,29729] 0 2024-02-15T22:51:18.092 INFO:tasks.workunit.client.1.smithi170.stdout:1/571: mkdir d3/d24/d2c/d77/d8f/dcd 0 2024-02-15T22:51:18.093 INFO:tasks.workunit.client.1.smithi170.stdout:1/572: chown d3/c90 819480246 1 2024-02-15T22:51:18.093 INFO:tasks.workunit.client.1.smithi170.stdout:7/539: dwrite da/d1a/d21/f70 [0,4194304] 0 2024-02-15T22:51:18.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/573: mkdir d3/d24/d2c/d77/dce 0 2024-02-15T22:51:18.097 INFO:tasks.workunit.client.1.smithi170.stdout:1/574: link d3/da2/fc2 d3/da2/fcf 0 2024-02-15T22:51:18.098 INFO:tasks.workunit.client.1.smithi170.stdout:2/474: dwrite d0/d1d/f22 [0,4194304] 0 2024-02-15T22:51:18.099 INFO:tasks.workunit.client.1.smithi170.stdout:1/575: creat d3/da2/d4a/fd0 x:0 0 0 2024-02-15T22:51:18.113 INFO:tasks.workunit.client.1.smithi170.stdout:2/475: read d0/d1/fc [2509457,72667] 0 2024-02-15T22:51:18.113 INFO:tasks.workunit.client.1.smithi170.stdout:1/576: dread d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:18.113 INFO:tasks.workunit.client.1.smithi170.stdout:1/577: chown d3/d24/d2c/d35/d83/lad 3512 1 2024-02-15T22:51:18.114 INFO:tasks.workunit.client.1.smithi170.stdout:2/476: creat d0/d1/d89/d8b/fbf x:0 0 0 2024-02-15T22:51:18.114 INFO:tasks.workunit.client.1.smithi170.stdout:2/477: chown d0/d2a/fb5 385882 1 2024-02-15T22:51:18.115 INFO:tasks.workunit.client.1.smithi170.stdout:2/478: write d0/d28/d2f/d37/d58/f7f [459672,67744] 0 2024-02-15T22:51:18.115 INFO:tasks.workunit.client.1.smithi170.stdout:2/479: mknod d0/d1/d89/cc0 0 2024-02-15T22:51:18.115 INFO:tasks.workunit.client.1.smithi170.stdout:2/480: chown d0/d1/d5f/d74/d8e 44850944 1 2024-02-15T22:51:18.116 INFO:tasks.workunit.client.1.smithi170.stdout:7/540: dwrite da/d1a/fa1 [0,4194304] 0 2024-02-15T22:51:18.117 INFO:tasks.workunit.client.1.smithi170.stdout:2/481: creat d0/d1/d11/fc1 x:0 0 0 2024-02-15T22:51:18.117 INFO:tasks.workunit.client.1.smithi170.stdout:2/482: write d0/d1/d5f/fac [6898,130962] 0 2024-02-15T22:51:18.119 INFO:tasks.workunit.client.1.smithi170.stdout:7/541: link da/d1a/d21/d2c/f6a da/d1a/d21/d2c/d74/d87/dac/d7c/fb3 0 2024-02-15T22:51:18.120 INFO:tasks.workunit.client.1.smithi170.stdout:2/483: creat d0/d13/d59/fc2 x:0 0 0 2024-02-15T22:51:18.120 INFO:tasks.workunit.client.1.smithi170.stdout:7/542: rmdir da/d1a/d21/d4d 39 2024-02-15T22:51:18.121 INFO:tasks.workunit.client.1.smithi170.stdout:7/543: write da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/f32 [5099882,8300] 0 2024-02-15T22:51:18.121 INFO:tasks.workunit.client.1.smithi170.stdout:2/484: write d0/d1d/d3d/f4c [246780,110185] 0 2024-02-15T22:51:18.122 INFO:tasks.workunit.client.1.smithi170.stdout:2/485: creat d0/d28/d2f/d37/d58/d78/da4/fc3 x:0 0 0 2024-02-15T22:51:18.123 INFO:tasks.workunit.client.1.smithi170.stdout:2/486: rename d0/d1/c10 to d0/d1/d11/d26/d6e/d8a/cc4 0 2024-02-15T22:51:18.128 INFO:tasks.workunit.client.1.smithi170.stdout:1/578: dwrite d3/da2/f44 [0,4194304] 0 2024-02-15T22:51:18.128 INFO:tasks.workunit.client.1.smithi170.stdout:1/579: creat d3/d24/d2c/d35/fd1 x:0 0 0 2024-02-15T22:51:18.130 INFO:tasks.workunit.client.1.smithi170.stdout:7/544: write da/f64 [2668904,71058] 0 2024-02-15T22:51:18.131 INFO:tasks.workunit.client.1.smithi170.stdout:7/545: dread - da/d1a/d21/fae zero size 2024-02-15T22:51:18.133 INFO:tasks.workunit.client.1.smithi170.stdout:1/580: truncate d3/d24/d2c/d35/f48 2021475 0 2024-02-15T22:51:18.133 INFO:tasks.workunit.client.1.smithi170.stdout:1/581: fsync d3/d24/f51 0 2024-02-15T22:51:18.136 INFO:tasks.workunit.client.1.smithi170.stdout:7/546: creat da/d63/fb4 x:0 0 0 2024-02-15T22:51:18.136 INFO:tasks.workunit.client.1.smithi170.stdout:7/547: stat da/l5d 0 2024-02-15T22:51:18.136 INFO:tasks.workunit.client.1.smithi170.stdout:1/582: dread d3/d24/d2c/d94/fa5 [0,4194304] 0 2024-02-15T22:51:18.136 INFO:tasks.workunit.client.1.smithi170.stdout:1/583: write d3/d24/d2c/d35/fd1 [83414,122574] 0 2024-02-15T22:51:18.138 INFO:tasks.workunit.client.1.smithi170.stdout:1/584: dread d3/da2/d65/fb2 [0,4194304] 0 2024-02-15T22:51:18.138 INFO:tasks.workunit.client.1.smithi170.stdout:1/585: truncate d3/fbd 365068 0 2024-02-15T22:51:18.140 INFO:tasks.workunit.client.1.smithi170.stdout:7/548: creat da/d63/d8d/fb5 x:0 0 0 2024-02-15T22:51:18.142 INFO:tasks.workunit.client.1.smithi170.stdout:1/586: creat d3/d24/fd2 x:0 0 0 2024-02-15T22:51:18.144 INFO:tasks.workunit.client.1.smithi170.stdout:1/587: dread d3/d24/d2c/d35/fd1 [0,4194304] 0 2024-02-15T22:51:18.145 INFO:tasks.workunit.client.1.smithi170.stdout:1/588: mknod d3/d24/d2c/d35/d7f/cd3 0 2024-02-15T22:51:18.146 INFO:tasks.workunit.client.1.smithi170.stdout:1/589: mknod d3/d24/d2c/d35/d72/cd4 0 2024-02-15T22:51:18.146 INFO:tasks.workunit.client.1.smithi170.stdout:1/590: fdatasync d3/f1e 0 2024-02-15T22:51:18.147 INFO:tasks.workunit.client.1.smithi170.stdout:1/591: mknod d3/d24/d2c/d77/dce/cd5 0 2024-02-15T22:51:18.148 INFO:tasks.workunit.client.1.smithi170.stdout:1/592: creat d3/d24/d2c/d5e/fd6 x:0 0 0 2024-02-15T22:51:18.150 INFO:tasks.workunit.client.1.smithi170.stdout:1/593: symlink d3/ld7 0 2024-02-15T22:51:18.151 INFO:tasks.workunit.client.1.smithi170.stdout:1/594: mkdir d3/d24/d2c/d35/d83/dd8 0 2024-02-15T22:51:18.157 INFO:tasks.workunit.client.1.smithi170.stdout:1/595: write d3/da2/f44 [964175,19021] 0 2024-02-15T22:51:18.192 INFO:tasks.workunit.client.1.smithi170.stdout:9/363: sync 2024-02-15T22:51:18.194 INFO:tasks.workunit.client.1.smithi170.stdout:9/364: mkdir de/d1b/d1c/d1f/d20/d27/d28/d80 0 2024-02-15T22:51:18.195 INFO:tasks.workunit.client.1.smithi170.stdout:9/365: truncate de/d1b/d1c/d1f/d20/d27/f29 11666906 0 2024-02-15T22:51:18.196 INFO:tasks.workunit.client.1.smithi170.stdout:9/366: mknod de/d1b/d1c/d1f/d20/d27/d28/d80/c81 0 2024-02-15T22:51:18.198 INFO:tasks.workunit.client.1.smithi170.stdout:9/367: mknod de/d1b/d1c/c82 0 2024-02-15T22:51:18.198 INFO:tasks.workunit.client.1.smithi170.stdout:9/368: readlink l5 0 2024-02-15T22:51:18.199 INFO:tasks.workunit.client.1.smithi170.stdout:9/369: symlink de/d1b/d1c/d1f/d20/l83 0 2024-02-15T22:51:18.199 INFO:tasks.workunit.client.1.smithi170.stdout:9/370: dread - de/d1b/d1c/d1f/f36 zero size 2024-02-15T22:51:18.199 INFO:tasks.workunit.client.1.smithi170.stdout:9/371: chown de/d1b 10835065 1 2024-02-15T22:51:18.199 INFO:tasks.workunit.client.1.smithi170.stdout:9/372: write de/d1b/d1c/d1f/d20/d27/d28/d69/f70 [171494,20012] 0 2024-02-15T22:51:18.199 INFO:tasks.workunit.client.1.smithi170.stdout:9/373: read de/d1b/d1c/d47/f48 [4335,122155] 0 2024-02-15T22:51:18.201 INFO:tasks.workunit.client.1.smithi170.stdout:9/374: mkdir de/d1b/d1c/d1f/d20/d27/d84 0 2024-02-15T22:51:18.201 INFO:tasks.workunit.client.1.smithi170.stdout:9/375: fsync de/d1b/f25 0 2024-02-15T22:51:18.202 INFO:tasks.workunit.client.1.smithi170.stdout:9/376: write de/d1b/d1c/d1f/d20/d27/d2c/f7f [828056,70779] 0 2024-02-15T22:51:18.204 INFO:tasks.workunit.client.1.smithi170.stdout:9/377: unlink de/d1b/d1c/d1f/d20/d27/d2c/f7f 0 2024-02-15T22:51:18.205 INFO:tasks.workunit.client.1.smithi170.stdout:9/378: creat de/d1b/d1c/d1f/d20/d27/d2c/f85 x:0 0 0 2024-02-15T22:51:18.206 INFO:tasks.workunit.client.1.smithi170.stdout:9/379: rmdir de/d1b/d1c/d1f/d20/d27 39 2024-02-15T22:51:18.208 INFO:tasks.workunit.client.1.smithi170.stdout:9/380: mknod de/d1b/d1c/d1f/d20/d27/d2c/c86 0 2024-02-15T22:51:18.208 INFO:tasks.workunit.client.1.smithi170.stdout:9/381: chown de/d1b/d1c/d1f 10659189 1 2024-02-15T22:51:18.209 INFO:tasks.workunit.client.1.smithi170.stdout:9/382: mknod de/d1b/d1c/d1f/d20/d27/d28/c87 0 2024-02-15T22:51:18.209 INFO:tasks.workunit.client.1.smithi170.stdout:9/383: fdatasync f2 0 2024-02-15T22:51:18.209 INFO:tasks.workunit.client.1.smithi170.stdout:9/384: fsync de/d1b/d1c/d1f/d20/f42 0 2024-02-15T22:51:18.209 INFO:tasks.workunit.client.1.smithi170.stdout:9/385: creat de/d1b/f88 x:0 0 0 2024-02-15T22:51:18.209 INFO:tasks.workunit.client.1.smithi170.stdout:9/386: truncate de/d1b/f7e 421361 0 2024-02-15T22:51:18.210 INFO:tasks.workunit.client.1.smithi170.stdout:9/387: truncate de/f12 3313893 0 2024-02-15T22:51:18.227 INFO:tasks.workunit.client.1.smithi170.stdout:9/388: dwrite de/d1b/d1c/f62 [0,4194304] 0 2024-02-15T22:51:18.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/389: truncate fc 1370696 0 2024-02-15T22:51:18.231 INFO:tasks.workunit.client.1.smithi170.stdout:9/390: symlink de/d1b/d1c/d1f/d20/d27/d28/l89 0 2024-02-15T22:51:18.231 INFO:tasks.workunit.client.1.smithi170.stdout:9/391: fdatasync de/d1b/d1c/d1f/d20/f42 0 2024-02-15T22:51:18.233 INFO:tasks.workunit.client.1.smithi170.stdout:9/392: dread de/d1b/f25 [0,4194304] 0 2024-02-15T22:51:18.236 INFO:tasks.workunit.client.1.smithi170.stdout:9/393: fdatasync de/d1b/d1c/d1f/d20/d27/d28/d69/f71 0 2024-02-15T22:51:18.239 INFO:tasks.workunit.client.1.smithi170.stdout:9/394: unlink de/d1b/d1c/d1f/d20/l3d 0 2024-02-15T22:51:18.242 INFO:tasks.workunit.client.1.smithi170.stdout:9/395: unlink de/f6e 0 2024-02-15T22:51:18.248 INFO:tasks.workunit.client.1.smithi170.stdout:9/396: creat de/d1b/d37/f8a x:0 0 0 2024-02-15T22:51:18.249 INFO:tasks.workunit.client.1.smithi170.stdout:9/397: creat de/d1b/d1c/d1f/d20/d78/f8b x:0 0 0 2024-02-15T22:51:18.250 INFO:tasks.workunit.client.1.smithi170.stdout:9/398: mkdir de/d1b/d1c/d1f/d20/d8c 0 2024-02-15T22:51:18.254 INFO:tasks.workunit.client.1.smithi170.stdout:8/376: sync 2024-02-15T22:51:18.255 INFO:tasks.workunit.client.1.smithi170.stdout:4/536: sync 2024-02-15T22:51:18.256 INFO:tasks.workunit.client.1.smithi170.stdout:8/377: rename d9/d18/d32/d3b/d42/d77 to d9/d18/d32/d7a 0 2024-02-15T22:51:18.256 INFO:tasks.workunit.client.1.smithi170.stdout:8/378: fdatasync d9/f1d 0 2024-02-15T22:51:18.256 INFO:tasks.workunit.client.1.smithi170.stdout:8/379: write d9/d18/f1e [4086505,55390] 0 2024-02-15T22:51:18.264 INFO:tasks.workunit.client.1.smithi170.stdout:8/380: dread d9/d18/d32/f4a [0,4194304] 0 2024-02-15T22:51:18.264 INFO:tasks.workunit.client.1.smithi170.stdout:8/381: chown d9/d18/d48/c62 105291 1 2024-02-15T22:51:18.280 INFO:tasks.workunit.client.1.smithi170.stdout:8/382: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:18.280 INFO:tasks.workunit.client.1.smithi170.stdout:8/383: stat d9/f16 0 2024-02-15T22:51:18.302 INFO:tasks.workunit.client.1.smithi170.stdout:8/384: dwrite d9/fd [0,4194304] 0 2024-02-15T22:51:18.302 INFO:tasks.workunit.client.1.smithi170.stdout:8/385: readlink d9/d18/l31 0 2024-02-15T22:51:18.302 INFO:tasks.workunit.client.1.smithi170.stdout:8/386: chown d9/d18/d26/l27 14122 1 2024-02-15T22:51:18.302 INFO:tasks.workunit.client.1.smithi170.stdout:8/387: readlink d9/d18/d26/l27 0 2024-02-15T22:51:18.304 INFO:tasks.workunit.client.1.smithi170.stdout:8/388: unlink d9/d18/d48/c62 0 2024-02-15T22:51:18.387 INFO:tasks.workunit.client.1.smithi170.stdout:3/443: sync 2024-02-15T22:51:18.387 INFO:tasks.workunit.client.1.smithi170.stdout:3/444: creat d3/d1b/d51/d6b/f91 x:0 0 0 2024-02-15T22:51:18.406 INFO:tasks.workunit.client.1.smithi170.stdout:3/445: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:18.406 INFO:tasks.workunit.client.1.smithi170.stdout:3/446: dread - d3/dc/d1c/d26/d55/f89 zero size 2024-02-15T22:51:18.424 INFO:tasks.workunit.client.1.smithi170.stdout:3/447: mkdir d3/d1b/d2c/d92 0 2024-02-15T22:51:18.424 INFO:tasks.workunit.client.1.smithi170.stdout:3/448: fdatasync d3/dc/d1c/f64 0 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 100 MiB/s rd, 128 MiB/s wr, 339 op/s 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: Upgrade: Updating mgr.smithi138.jqscxs 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:18.470 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:18 smithi138 ceph-mon[29229]: Deploying daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:51:18.549 INFO:tasks.workunit.client.1.smithi170.stdout:6/480: sync 2024-02-15T22:51:18.550 INFO:tasks.workunit.client.1.smithi170.stdout:0/402: sync 2024-02-15T22:51:18.550 INFO:tasks.workunit.client.1.smithi170.stdout:0/403: write f1 [4281965,21619] 0 2024-02-15T22:51:18.550 INFO:tasks.workunit.client.1.smithi170.stdout:5/586: sync 2024-02-15T22:51:18.550 INFO:tasks.workunit.client.1.smithi170.stdout:6/481: dread d3/d1d/d36/f11 [0,4194304] 0 2024-02-15T22:51:18.551 INFO:tasks.workunit.client.1.smithi170.stdout:6/482: getdents d3/d1d/d27/d70 0 2024-02-15T22:51:18.551 INFO:tasks.workunit.client.1.smithi170.stdout:6/483: fdatasync d3/d1d/d28/f7d 0 2024-02-15T22:51:18.553 INFO:tasks.workunit.client.1.smithi170.stdout:6/484: symlink d3/d24/d31/lac 0 2024-02-15T22:51:18.555 INFO:tasks.workunit.client.1.smithi170.stdout:6/485: creat d3/d1d/d28/fad x:0 0 0 2024-02-15T22:51:18.556 INFO:tasks.workunit.client.1.smithi170.stdout:0/404: dread d8/f1b [0,4194304] 0 2024-02-15T22:51:18.557 INFO:tasks.workunit.client.1.smithi170.stdout:6/486: symlink d3/d1d/d1b/d3e/lae 0 2024-02-15T22:51:18.559 INFO:tasks.workunit.client.1.smithi170.stdout:0/405: link d8/d14/d1c/f3d d8/d14/d70/f87 0 2024-02-15T22:51:18.559 INFO:tasks.workunit.client.1.smithi170.stdout:0/406: chown d8/df/d13/l18 8235 1 2024-02-15T22:51:18.559 INFO:tasks.workunit.client.1.smithi170.stdout:0/407: dread - d8/df/d13/f73 zero size 2024-02-15T22:51:18.560 INFO:tasks.workunit.client.1.smithi170.stdout:0/408: getdents d8 0 2024-02-15T22:51:18.565 INFO:tasks.workunit.client.1.smithi170.stdout:5/587: dwrite de/d10/d33/d67/fa3 [0,4194304] 0 2024-02-15T22:51:18.565 INFO:tasks.workunit.client.1.smithi170.stdout:5/588: fdatasync de/d10/d33/d9f/d7c/f89 0 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/589: creat de/d36/d80/dc2/fce x:0 0 0 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/590: creat de/d10/d33/d67/fcf x:0 0 0 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/591: chown de/d10/d27/fc9 168146236 1 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/592: chown de/d10/d33/d67/fa3 5 1 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/593: write de/d10/d7d/fb1 [641140,72314] 0 2024-02-15T22:51:18.568 INFO:tasks.workunit.client.1.smithi170.stdout:5/594: chown de/d10/da8/db6/cbb 25319611 1 2024-02-15T22:51:18.572 INFO:tasks.workunit.client.1.smithi170.stdout:5/595: creat de/d10/da8/db6/fd0 x:0 0 0 2024-02-15T22:51:18.572 INFO:tasks.workunit.client.1.smithi170.stdout:5/596: chown de/d10/d27/d2d/fa2 89 1 2024-02-15T22:51:18.573 INFO:tasks.workunit.client.1.smithi170.stdout:5/597: truncate de/f21 2273387 0 2024-02-15T22:51:18.574 INFO:tasks.workunit.client.1.smithi170.stdout:0/409: dread d8/d14/d1c/d3f/d51/f5a [0,4194304] 0 2024-02-15T22:51:18.577 INFO:tasks.workunit.client.1.smithi170.stdout:0/410: rename d8/d14/d6f/f78 to d8/d14/d6f/f88 0 2024-02-15T22:51:18.581 INFO:tasks.workunit.client.1.smithi170.stdout:0/411: creat d8/d6d/f89 x:0 0 0 2024-02-15T22:51:18.596 INFO:tasks.workunit.client.1.smithi170.stdout:0/412: dread d8/df/d13/d36/d60/f86 [0,4194304] 0 2024-02-15T22:51:18.596 INFO:tasks.workunit.client.1.smithi170.stdout:0/413: dread - d8/d14/d6f/f88 zero size 2024-02-15T22:51:18.597 INFO:tasks.workunit.client.1.smithi170.stdout:5/598: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:18.597 INFO:tasks.workunit.client.1.smithi170.stdout:0/414: read d8/df/d13/f61 [218416,69532] 0 2024-02-15T22:51:18.597 INFO:tasks.workunit.client.1.smithi170.stdout:0/415: creat d8/d14/d70/f8a x:0 0 0 2024-02-15T22:51:18.598 INFO:tasks.workunit.client.1.smithi170.stdout:5/599: mknod de/d10/d7d/db8/dbc/cd1 0 2024-02-15T22:51:18.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/416: rmdir d8 39 2024-02-15T22:51:18.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/417: write d8/df/d13/d22/f33 [1909747,63760] 0 2024-02-15T22:51:18.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/418: truncate d8/d14/f63 544707 0 2024-02-15T22:51:18.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/419: chown d8/d14/l5b 96168 1 2024-02-15T22:51:18.604 INFO:tasks.workunit.client.1.smithi170.stdout:5/600: link c5 de/d36/cd2 0 2024-02-15T22:51:18.612 INFO:tasks.workunit.client.1.smithi170.stdout:0/420: read d8/d14/d1c/f1e [904198,62485] 0 2024-02-15T22:51:18.612 INFO:tasks.workunit.client.1.smithi170.stdout:0/421: stat d8/df/l41 0 2024-02-15T22:51:18.612 INFO:tasks.workunit.client.1.smithi170.stdout:0/422: write d8/d6d/f80 [426676,191] 0 2024-02-15T22:51:18.613 INFO:tasks.workunit.client.1.smithi170.stdout:0/423: creat d8/df/f8b x:0 0 0 2024-02-15T22:51:18.637 INFO:tasks.workunit.client.1.smithi170.stdout:0/424: dwrite d8/d14/f76 [0,4194304] 0 2024-02-15T22:51:18.663 INFO:tasks.workunit.client.1.smithi170.stdout:0/425: dwrite d8/df/d13/f1f [0,4194304] 0 2024-02-15T22:51:18.667 INFO:tasks.workunit.client.1.smithi170.stdout:0/426: truncate d8/d14/f63 21530 0 2024-02-15T22:51:18.667 INFO:tasks.workunit.client.1.smithi170.stdout:0/427: creat d8/df/d13/d22/d39/f8c x:0 0 0 2024-02-15T22:51:18.669 INFO:tasks.workunit.client.1.smithi170.stdout:0/428: creat d8/d14/d6f/f8d x:0 0 0 2024-02-15T22:51:18.671 INFO:tasks.workunit.client.1.smithi170.stdout:0/429: unlink d8/d6d/f80 0 2024-02-15T22:51:18.672 INFO:tasks.workunit.client.1.smithi170.stdout:0/430: unlink d8/df/l4a 0 2024-02-15T22:51:18.674 INFO:tasks.workunit.client.1.smithi170.stdout:0/431: link d8/f1b d8/df/d13/d22/d39/d55/f8e 0 2024-02-15T22:51:18.674 INFO:tasks.workunit.client.1.smithi170.stdout:0/432: write d8/d14/d6f/f8d [162347,7297] 0 2024-02-15T22:51:18.675 INFO:tasks.workunit.client.1.smithi170.stdout:0/433: truncate d8/df/f49 2634914 0 2024-02-15T22:51:18.676 INFO:tasks.workunit.client.1.smithi170.stdout:0/434: mkdir d8/df/d13/d22/d6a/d8f 0 2024-02-15T22:51:18.677 INFO:tasks.workunit.client.1.smithi170.stdout:0/435: rmdir d8 39 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:9/399: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:4/537: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:1/596: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:3/449: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:3/450: fsync d3/dc/d13/f43 0 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:7/549: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:8/389: sync 2024-02-15T22:51:18.693 INFO:tasks.workunit.client.1.smithi170.stdout:2/487: sync 2024-02-15T22:51:18.694 INFO:tasks.workunit.client.1.smithi170.stdout:1/597: chown d3/la 0 1 2024-02-15T22:51:18.695 INFO:tasks.workunit.client.1.smithi170.stdout:3/451: symlink d3/d1b/d2c/d92/l93 0 2024-02-15T22:51:18.695 INFO:tasks.workunit.client.1.smithi170.stdout:3/452: read d3/db/d1f/f2f [3673857,114427] 0 2024-02-15T22:51:18.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/550: creat da/d1a/d21/d2c/d2e/d7a/fb6 x:0 0 0 2024-02-15T22:51:18.697 INFO:tasks.workunit.client.1.smithi170.stdout:8/390: creat d9/d18/d32/d7a/f7b x:0 0 0 2024-02-15T22:51:18.697 INFO:tasks.workunit.client.1.smithi170.stdout:1/598: read - d3/f2e zero size 2024-02-15T22:51:18.697 INFO:tasks.workunit.client.1.smithi170.stdout:1/599: stat d3/da2/d65/fb5 0 2024-02-15T22:51:18.699 INFO:tasks.workunit.client.1.smithi170.stdout:3/453: getdents d3/db/d1f/d61 0 2024-02-15T22:51:18.699 INFO:tasks.workunit.client.1.smithi170.stdout:3/454: write d3/dc/d1c/d3d/f80 [94698,32809] 0 2024-02-15T22:51:18.699 INFO:tasks.workunit.client.1.smithi170.stdout:3/455: stat d3/dc/d1c/d3d 0 2024-02-15T22:51:18.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/538: rename d0/d22/da/d58/d6b to d0/d22/da/d8b/d47/da9 0 2024-02-15T22:51:18.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/539: creat d0/d22/da/d8b/d47/d2b/faa x:0 0 0 2024-02-15T22:51:18.705 INFO:tasks.workunit.client.1.smithi170.stdout:4/540: getdents d0/d22 0 2024-02-15T22:51:18.706 INFO:tasks.workunit.client.1.smithi170.stdout:4/541: stat d0/d22/da/d11/d20/d49/l65 0 2024-02-15T22:51:18.706 INFO:tasks.workunit.client.1.smithi170.stdout:4/542: chown d0/d22/da/d11/d20/f4d 207081 1 2024-02-15T22:51:18.708 INFO:tasks.workunit.client.1.smithi170.stdout:7/551: rename da/d1a/d21/d1b/ca5 to da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/cb7 0 2024-02-15T22:51:18.710 INFO:tasks.workunit.client.1.smithi170.stdout:4/543: getdents d0/d22/da/d8b/d47/d67 0 2024-02-15T22:51:18.710 INFO:tasks.workunit.client.1.smithi170.stdout:4/544: truncate d0/d22/da/d8b/d47/da9/f9b 84837 0 2024-02-15T22:51:18.710 INFO:tasks.workunit.client.1.smithi170.stdout:4/545: dread - d0/d22/da/d8b/d47/da9/f91 zero size 2024-02-15T22:51:18.710 INFO:tasks.workunit.client.1.smithi170.stdout:7/552: mkdir da/d1a/d21/d4d/db8 0 2024-02-15T22:51:18.713 INFO:tasks.workunit.client.1.smithi170.stdout:7/553: creat da/d1a/d21/d2c/d74/d87/dac/fb9 x:0 0 0 2024-02-15T22:51:18.713 INFO:tasks.workunit.client.1.smithi170.stdout:7/554: truncate da/d1a/d21/d2c/f84 1886405 0 2024-02-15T22:51:18.717 INFO:tasks.workunit.client.1.smithi170.stdout:2/488: dwrite d0/d28/d2f/f65 [0,4194304] 0 2024-02-15T22:51:18.718 INFO:tasks.workunit.client.1.smithi170.stdout:2/489: chown d0/d1/d31/c7d 18648 1 2024-02-15T22:51:18.720 INFO:tasks.workunit.client.1.smithi170.stdout:7/555: dread da/d1a/d21/d2c/f84 [0,4194304] 0 2024-02-15T22:51:18.721 INFO:tasks.workunit.client.1.smithi170.stdout:7/556: truncate da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/f32 2767877 0 2024-02-15T22:51:18.723 INFO:tasks.workunit.client.1.smithi170.stdout:7/557: creat da/d1a/d21/d2c/d74/d87/dac/d7c/fba x:0 0 0 2024-02-15T22:51:18.723 INFO:tasks.workunit.client.1.smithi170.stdout:7/558: write da/d1a/d21/d2c/d71/f75 [1045834,28923] 0 2024-02-15T22:51:18.723 INFO:tasks.workunit.client.1.smithi170.stdout:7/559: creat da/d1a/d21/d2c/d2e/d7a/fbb x:0 0 0 2024-02-15T22:51:18.727 INFO:tasks.workunit.client.1.smithi170.stdout:2/490: write d0/d28/d3e/f44 [83023,24991] 0 2024-02-15T22:51:18.727 INFO:tasks.workunit.client.1.smithi170.stdout:7/560: dread da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/faa [0,4194304] 0 2024-02-15T22:51:18.728 INFO:tasks.workunit.client.1.smithi170.stdout:2/491: symlink d0/d1/d11/lc5 0 2024-02-15T22:51:18.728 INFO:tasks.workunit.client.1.smithi170.stdout:7/561: truncate da/d1a/d21/d2c/d74/f86 1552615 0 2024-02-15T22:51:18.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/492: mknod d0/d1/d11/d26/d6e/cc6 0 2024-02-15T22:51:18.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/493: chown d0/d28/d2f/d37/d58 32 1 2024-02-15T22:51:18.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/494: stat d0/d1/d89 0 2024-02-15T22:51:18.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/495: truncate d0/d28/d2f/d37/d58/d78/f84 1286883 0 2024-02-15T22:51:18.731 INFO:tasks.workunit.client.1.smithi170.stdout:2/496: unlink d0/d13/d59/la9 0 2024-02-15T22:51:18.731 INFO:tasks.workunit.client.1.smithi170.stdout:8/391: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:18.732 INFO:tasks.workunit.client.1.smithi170.stdout:3/456: dwrite d3/d1b/d2c/f4b [0,4194304] 0 2024-02-15T22:51:18.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/497: rename d0/d1/d11/f86 to d0/d28/d2f/d37/fc7 0 2024-02-15T22:51:18.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/498: truncate d0/d1/d5f/f8c 340103 0 2024-02-15T22:51:18.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/499: dread - d0/d1/f48 zero size 2024-02-15T22:51:18.734 INFO:tasks.workunit.client.1.smithi170.stdout:1/600: dwrite d3/d24/d2c/d35/f38 [0,4194304] 0 2024-02-15T22:51:18.734 INFO:tasks.workunit.client.1.smithi170.stdout:3/457: mkdir d3/d1b/d51/d94 0 2024-02-15T22:51:18.734 INFO:tasks.workunit.client.1.smithi170.stdout:4/546: dwrite d0/d22/da/d8b/d47/d2b/f68 [0,4194304] 0 2024-02-15T22:51:18.735 INFO:tasks.workunit.client.1.smithi170.stdout:1/601: mkdir d3/d24/d2c/d94/dd9 0 2024-02-15T22:51:18.737 INFO:tasks.workunit.client.1.smithi170.stdout:3/458: getdents d3/d1b 0 2024-02-15T22:51:18.738 INFO:tasks.workunit.client.1.smithi170.stdout:4/547: creat d0/d22/da/d8b/d47/fab x:0 0 0 2024-02-15T22:51:18.738 INFO:tasks.workunit.client.1.smithi170.stdout:7/562: write da/d1a/d21/d2c/d74/d87/dac/f89 [1533677,81040] 0 2024-02-15T22:51:18.739 INFO:tasks.workunit.client.1.smithi170.stdout:1/602: mkdir d3/d24/d2c/d77/dda 0 2024-02-15T22:51:18.741 INFO:tasks.workunit.client.1.smithi170.stdout:2/500: dread d0/d1d/f4e [0,4194304] 0 2024-02-15T22:51:18.741 INFO:tasks.workunit.client.1.smithi170.stdout:3/459: symlink d3/d1b/d2c/d92/l95 0 2024-02-15T22:51:18.741 INFO:tasks.workunit.client.1.smithi170.stdout:3/460: creat d3/dc/d1c/d3d/f96 x:0 0 0 2024-02-15T22:51:18.744 INFO:tasks.workunit.client.1.smithi170.stdout:4/548: rmdir d0/d22/da 39 2024-02-15T22:51:18.744 INFO:tasks.workunit.client.1.smithi170.stdout:4/549: write d0/d22/da/f6a [150959,34611] 0 2024-02-15T22:51:18.744 INFO:tasks.workunit.client.1.smithi170.stdout:1/603: dread d3/d24/f66 [0,4194304] 0 2024-02-15T22:51:18.748 INFO:tasks.workunit.client.1.smithi170.stdout:7/563: creat da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/fbc x:0 0 0 2024-02-15T22:51:18.749 INFO:tasks.workunit.client.1.smithi170.stdout:7/564: chown da/d63/d8d/l9c 3549 1 2024-02-15T22:51:18.753 INFO:tasks.workunit.client.1.smithi170.stdout:3/461: rename d3/dc/d13/l23 to d3/dc/d1c/d26/d55/d7d/l97 0 2024-02-15T22:51:18.753 INFO:tasks.workunit.client.1.smithi170.stdout:3/462: write d3/dc/d1c/d26/d55/f89 [115029,127355] 0 2024-02-15T22:51:18.754 INFO:tasks.workunit.client.1.smithi170.stdout:8/392: dwrite d9/d18/d32/d3b/f40 [0,4194304] 0 2024-02-15T22:51:18.760 INFO:tasks.workunit.client.1.smithi170.stdout:7/565: rename da/d1a/d21/d2c/d74/l99 to da/d1a/d21/d2c/d74/d87/lbd 0 2024-02-15T22:51:18.760 INFO:tasks.workunit.client.1.smithi170.stdout:7/566: truncate da/d1a/d21/d2c/d2e/d7a/fb6 332037 0 2024-02-15T22:51:18.760 INFO:tasks.workunit.client.1.smithi170.stdout:7/567: fsync da/d1a/d21/f46 0 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: pgmap v22: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 100 MiB/s rd, 128 MiB/s wr, 339 op/s 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: Upgrade: Updating mgr.smithi138.jqscxs 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:51:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:18.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:18 smithi170 ceph-mon[35248]: Deploying daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:51:18.765 INFO:tasks.workunit.client.1.smithi170.stdout:4/550: dwrite d0/d22/da/d8b/d47/d67/f7a [0,4194304] 0 2024-02-15T22:51:18.765 INFO:tasks.workunit.client.1.smithi170.stdout:4/551: write d0/d22/da/d8b/d47/d2b/faa [100990,114609] 0 2024-02-15T22:51:18.768 INFO:tasks.workunit.client.1.smithi170.stdout:8/393: dread d9/f2d [0,4194304] 0 2024-02-15T22:51:18.770 INFO:tasks.workunit.client.1.smithi170.stdout:7/568: dread da/d1a/d21/d19/f91 [0,4194304] 0 2024-02-15T22:51:18.770 INFO:tasks.workunit.client.1.smithi170.stdout:7/569: write da/d1a/d21/d2c/f6a [3446057,88022] 0 2024-02-15T22:51:18.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/604: dwrite d3/da2/f44 [0,4194304] 0 2024-02-15T22:51:18.777 INFO:tasks.workunit.client.1.smithi170.stdout:1/605: mknod d3/d24/d2c/d77/d8f/dcd/cdb 0 2024-02-15T22:51:18.777 INFO:tasks.workunit.client.1.smithi170.stdout:1/606: read - d3/d24/d91/fbf zero size 2024-02-15T22:51:18.777 INFO:tasks.workunit.client.1.smithi170.stdout:1/607: fdatasync d3/d24/fd2 0 2024-02-15T22:51:18.779 INFO:tasks.workunit.client.1.smithi170.stdout:3/463: dwrite d3/dc/ff [0,4194304] 0 2024-02-15T22:51:18.781 INFO:tasks.workunit.client.1.smithi170.stdout:3/464: symlink d3/dc/d1c/d26/d55/l98 0 2024-02-15T22:51:18.784 INFO:tasks.workunit.client.1.smithi170.stdout:8/394: write d9/d18/d32/d3b/f40 [2459807,96597] 0 2024-02-15T22:51:18.784 INFO:tasks.workunit.client.1.smithi170.stdout:8/395: fdatasync d9/d18/d48/f5b 0 2024-02-15T22:51:18.785 INFO:tasks.workunit.client.1.smithi170.stdout:8/396: mknod d9/d18/d32/c7c 0 2024-02-15T22:51:18.786 INFO:tasks.workunit.client.1.smithi170.stdout:3/465: dread d3/f3c [0,4194304] 0 2024-02-15T22:51:18.786 INFO:tasks.workunit.client.1.smithi170.stdout:8/397: mkdir d9/d18/d26/d7d 0 2024-02-15T22:51:18.787 INFO:tasks.workunit.client.1.smithi170.stdout:1/608: write d3/d24/d2c/d35/d83/f86 [534116,106449] 0 2024-02-15T22:51:18.788 INFO:tasks.workunit.client.1.smithi170.stdout:3/466: link d3/db/f22 d3/d1b/d8a/f99 0 2024-02-15T22:51:18.788 INFO:tasks.workunit.client.1.smithi170.stdout:3/467: readlink d3/dc/d1c/l2e 0 2024-02-15T22:51:18.789 INFO:tasks.workunit.client.1.smithi170.stdout:8/398: creat d9/d18/f7e x:0 0 0 2024-02-15T22:51:18.793 INFO:tasks.workunit.client.1.smithi170.stdout:1/609: getdents d3/d24/d2c/d94 0 2024-02-15T22:51:18.793 INFO:tasks.workunit.client.1.smithi170.stdout:1/610: fdatasync d3/da2/d4a/fd0 0 2024-02-15T22:51:18.797 INFO:tasks.workunit.client.1.smithi170.stdout:1/611: dread d3/f17 [0,4194304] 0 2024-02-15T22:51:18.797 INFO:tasks.workunit.client.1.smithi170.stdout:1/612: chown d3/ld7 237 1 2024-02-15T22:51:18.797 INFO:tasks.workunit.client.1.smithi170.stdout:1/613: getdents d3/d24/d2c/d94/dd9 0 2024-02-15T22:51:18.797 INFO:tasks.workunit.client.1.smithi170.stdout:1/614: write d3/da2/d4a/f4e [162492,72592] 0 2024-02-15T22:51:18.798 INFO:tasks.workunit.client.1.smithi170.stdout:8/399: dread d9/f46 [0,4194304] 0 2024-02-15T22:51:18.799 INFO:tasks.workunit.client.1.smithi170.stdout:1/615: rename d3/la to d3/da2/ldc 0 2024-02-15T22:51:18.800 INFO:tasks.workunit.client.1.smithi170.stdout:1/616: mknod d3/d24/d2c/d35/d72/d7e/cdd 0 2024-02-15T22:51:18.803 INFO:tasks.workunit.client.1.smithi170.stdout:4/552: dwrite d0/d22/da/d11/da2/f9d [0,4194304] 0 2024-02-15T22:51:18.803 INFO:tasks.workunit.client.1.smithi170.stdout:7/570: dwrite da/d63/fb4 [0,4194304] 0 2024-02-15T22:51:18.803 INFO:tasks.workunit.client.1.smithi170.stdout:1/617: write d3/da2/d65/f93 [41562,91588] 0 2024-02-15T22:51:18.809 INFO:tasks.workunit.client.1.smithi170.stdout:1/618: dread d3/d24/f61 [0,4194304] 0 2024-02-15T22:51:18.813 INFO:tasks.workunit.client.1.smithi170.stdout:1/619: creat d3/d24/d2c/d35/d83/fde x:0 0 0 2024-02-15T22:51:18.814 INFO:tasks.workunit.client.1.smithi170.stdout:8/400: dwrite d9/d18/d32/d3b/d4b/f5f [0,4194304] 0 2024-02-15T22:51:18.814 INFO:tasks.workunit.client.1.smithi170.stdout:8/401: fdatasync d9/d18/d32/d3b/f41 0 2024-02-15T22:51:18.817 INFO:tasks.workunit.client.1.smithi170.stdout:3/468: truncate d3/d1b/d2c/f4b 2980718 0 2024-02-15T22:51:18.817 INFO:tasks.workunit.client.1.smithi170.stdout:3/469: chown d3/f3f 188 1 2024-02-15T22:51:18.819 INFO:tasks.workunit.client.1.smithi170.stdout:1/620: unlink d3/d24/d91/f95 0 2024-02-15T22:51:18.822 INFO:tasks.workunit.client.1.smithi170.stdout:8/402: mkdir d9/d18/d32/d7a/d78/d7f 0 2024-02-15T22:51:18.823 INFO:tasks.workunit.client.1.smithi170.stdout:4/553: dwrite d0/d22/da/d11/d20/fa0 [0,4194304] 0 2024-02-15T22:51:18.824 INFO:tasks.workunit.client.1.smithi170.stdout:3/470: unlink d3/dc/d1a/f66 0 2024-02-15T22:51:18.824 INFO:tasks.workunit.client.1.smithi170.stdout:3/471: chown d3/d1b/d2c/f50 182 1 2024-02-15T22:51:18.828 INFO:tasks.workunit.client.1.smithi170.stdout:3/472: mkdir d3/d1b/d2c/d9a 0 2024-02-15T22:51:18.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/621: read d3/d24/d2c/d35/f52 [1147791,55817] 0 2024-02-15T22:51:18.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/622: dread - d3/d24/d2c/d94/fbc zero size 2024-02-15T22:51:18.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/623: truncate d3/d24/f51 2655166 0 2024-02-15T22:51:18.829 INFO:tasks.workunit.client.1.smithi170.stdout:1/624: creat d3/d24/d2c/d77/dce/fdf x:0 0 0 2024-02-15T22:51:18.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/403: dread d9/d18/d32/d3b/d4b/f5e [0,4194304] 0 2024-02-15T22:51:18.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/404: write d9/d18/f7e [235587,110727] 0 2024-02-15T22:51:18.832 INFO:tasks.workunit.client.1.smithi170.stdout:1/625: dread d3/d24/d2c/f6d [0,4194304] 0 2024-02-15T22:51:18.832 INFO:tasks.workunit.client.1.smithi170.stdout:1/626: truncate d3/fbd 504068 0 2024-02-15T22:51:18.833 INFO:tasks.workunit.client.1.smithi170.stdout:8/405: unlink d9/d18/d26/c65 0 2024-02-15T22:51:18.835 INFO:tasks.workunit.client.1.smithi170.stdout:8/406: creat d9/d18/d26/d4f/f80 x:0 0 0 2024-02-15T22:51:18.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/407: link d9/f17 d9/d18/d32/f81 0 2024-02-15T22:51:18.839 INFO:tasks.workunit.client.1.smithi170.stdout:8/408: link d9/f1a d9/f82 0 2024-02-15T22:51:18.848 INFO:tasks.workunit.client.1.smithi170.stdout:1/627: dwrite d3/d24/d2c/d35/f75 [0,4194304] 0 2024-02-15T22:51:18.849 INFO:tasks.workunit.client.1.smithi170.stdout:1/628: creat d3/d24/d2c/d35/d72/d7e/fe0 x:0 0 0 2024-02-15T22:51:18.849 INFO:tasks.workunit.client.1.smithi170.stdout:1/629: chown d3/d24/c6c 500 1 2024-02-15T22:51:18.849 INFO:tasks.workunit.client.1.smithi170.stdout:1/630: write d3/d24/d2c/d5e/fd6 [83834,74059] 0 2024-02-15T22:51:18.852 INFO:tasks.workunit.client.1.smithi170.stdout:1/631: dread d3/d24/f66 [0,4194304] 0 2024-02-15T22:51:18.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/632: getdents d3/d24/d2c 0 2024-02-15T22:51:18.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/633: write d3/fb [2526306,73365] 0 2024-02-15T22:51:18.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/634: creat d3/d24/d2c/d77/dce/fe1 x:0 0 0 2024-02-15T22:51:18.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/635: rename d3/d24/d91 to d3/da2/de2 0 2024-02-15T22:51:18.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/636: read - d3/d24/d2c/d94/fbc zero size 2024-02-15T22:51:18.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/637: creat d3/d24/d2c/d35/fe3 x:0 0 0 2024-02-15T22:51:18.866 INFO:tasks.workunit.client.1.smithi170.stdout:6/487: sync 2024-02-15T22:51:18.868 INFO:tasks.workunit.client.1.smithi170.stdout:6/488: dread d3/d1d/d27/f2d [0,4194304] 0 2024-02-15T22:51:18.869 INFO:tasks.workunit.client.1.smithi170.stdout:6/489: mkdir d3/d1d/d36/d56/daf 0 2024-02-15T22:51:18.870 INFO:tasks.workunit.client.1.smithi170.stdout:6/490: unlink d3/d1a/l4e 0 2024-02-15T22:51:18.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/491: getdents d3/d1d/d27/d70/da5 0 2024-02-15T22:51:18.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/492: fsync d3/d1d/f7b 0 2024-02-15T22:51:18.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/493: truncate d3/d1d/d27/f4a 1315511 0 2024-02-15T22:51:18.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/494: write d3/d1d/d28/f7d [1867232,28966] 0 2024-02-15T22:51:18.872 INFO:tasks.workunit.client.1.smithi170.stdout:6/495: mknod d3/d24/d31/d94/cb0 0 2024-02-15T22:51:18.872 INFO:tasks.workunit.client.1.smithi170.stdout:1/638: dread d3/fbb [0,4194304] 0 2024-02-15T22:51:18.873 INFO:tasks.workunit.client.1.smithi170.stdout:6/496: mknod d3/d1d/d27/d70/da5/cb1 0 2024-02-15T22:51:18.873 INFO:tasks.workunit.client.1.smithi170.stdout:6/497: write d3/d1d/d36/f58 [4308610,99890] 0 2024-02-15T22:51:18.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/639: symlink d3/d24/d2c/d77/dda/le4 0 2024-02-15T22:51:18.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/640: write d3/d24/d2c/d77/fa1 [1023453,77294] 0 2024-02-15T22:51:18.875 INFO:tasks.workunit.client.1.smithi170.stdout:6/498: rename d3/d1d/d27/c71 to d3/d1d/d28/d3b/cb2 0 2024-02-15T22:51:18.875 INFO:tasks.workunit.client.1.smithi170.stdout:6/499: truncate d3/d1d/d53/d5f/f8c 1318429 0 2024-02-15T22:51:18.900 INFO:tasks.workunit.client.1.smithi170.stdout:1/641: dwrite d3/d24/d2c/d35/fe3 [0,4194304] 0 2024-02-15T22:51:18.900 INFO:tasks.workunit.client.1.smithi170.stdout:1/642: readlink d3/d24/d2c/d35/lb4 0 2024-02-15T22:51:18.900 INFO:tasks.workunit.client.1.smithi170.stdout:1/643: creat d3/d24/d2c/d77/fe5 x:0 0 0 2024-02-15T22:51:18.900 INFO:tasks.workunit.client.1.smithi170.stdout:1/644: write d3/d24/d2c/d35/f52 [2213989,130318] 0 2024-02-15T22:51:18.905 INFO:tasks.workunit.client.1.smithi170.stdout:6/500: dwrite d3/d1d/d28/f47 [0,4194304] 0 2024-02-15T22:51:18.905 INFO:tasks.workunit.client.1.smithi170.stdout:6/501: read - d3/d1d/d28/fad zero size 2024-02-15T22:51:18.905 INFO:tasks.workunit.client.1.smithi170.stdout:1/645: symlink d3/da2/le6 0 2024-02-15T22:51:18.905 INFO:tasks.workunit.client.1.smithi170.stdout:1/646: creat d3/d24/d2c/d77/fe7 x:0 0 0 2024-02-15T22:51:18.905 INFO:tasks.workunit.client.1.smithi170.stdout:1/647: truncate d3/d24/d2c/d77/fe5 21020 0 2024-02-15T22:51:18.908 INFO:tasks.workunit.client.1.smithi170.stdout:6/502: rename d3/d24/f3d to d3/d1d/d27/fb3 0 2024-02-15T22:51:18.912 INFO:tasks.workunit.client.1.smithi170.stdout:6/503: mknod d3/d1d/d27/d70/d82/cb4 0 2024-02-15T22:51:18.913 INFO:tasks.workunit.client.1.smithi170.stdout:1/648: rmdir d3/d24/d2c/d35/d72/d7e 39 2024-02-15T22:51:18.915 INFO:tasks.workunit.client.1.smithi170.stdout:1/649: link d3/d24/d2c/d35/f52 d3/d24/d2c/d5e/fe8 0 2024-02-15T22:51:18.925 INFO:tasks.workunit.client.1.smithi170.stdout:6/504: dwrite d3/d1d/d1b/d3c/f81 [0,4194304] 0 2024-02-15T22:51:18.931 INFO:tasks.workunit.client.1.smithi170.stdout:1/650: dwrite d3/d24/d2c/d35/d7f/fa9 [0,4194304] 0 2024-02-15T22:51:18.935 INFO:tasks.workunit.client.1.smithi170.stdout:6/505: dread d3/d24/f77 [0,4194304] 0 2024-02-15T22:51:18.936 INFO:tasks.workunit.client.1.smithi170.stdout:1/651: mkdir d3/d24/d2c/d5e/de9 0 2024-02-15T22:51:18.936 INFO:tasks.workunit.client.1.smithi170.stdout:1/652: chown d3/d24/d2c/d5e/cb3 0 1 2024-02-15T22:51:18.938 INFO:tasks.workunit.client.1.smithi170.stdout:1/653: unlink d3/d24/d2c/d35/f38 0 2024-02-15T22:51:18.938 INFO:tasks.workunit.client.1.smithi170.stdout:1/654: fsync d3/d24/d2c/d35/d83/f86 0 2024-02-15T22:51:18.940 INFO:tasks.workunit.client.1.smithi170.stdout:1/655: dread d3/d24/d2c/d35/f40 [0,4194304] 0 2024-02-15T22:51:18.940 INFO:tasks.workunit.client.1.smithi170.stdout:1/656: write d3/d24/d2c/d94/fbc [36637,118253] 0 2024-02-15T22:51:18.941 INFO:tasks.workunit.client.1.smithi170.stdout:1/657: unlink d3/d24/d2c/d77/lab 0 2024-02-15T22:51:18.944 INFO:tasks.workunit.client.1.smithi170.stdout:6/506: dread d3/d1d/d36/f22 [0,4194304] 0 2024-02-15T22:51:18.945 INFO:tasks.workunit.client.1.smithi170.stdout:6/507: creat d3/d1d/fb5 x:0 0 0 2024-02-15T22:51:18.955 INFO:tasks.workunit.client.1.smithi170.stdout:6/508: dread d3/d1d/d27/f52 [0,4194304] 0 2024-02-15T22:51:18.963 INFO:tasks.workunit.client.1.smithi170.stdout:1/658: dwrite d3/d24/d2c/d77/fa4 [0,4194304] 0 2024-02-15T22:51:18.969 INFO:tasks.workunit.client.1.smithi170.stdout:6/509: dread d3/d1d/d36/f14 [0,4194304] 0 2024-02-15T22:51:18.969 INFO:tasks.workunit.client.1.smithi170.stdout:6/510: write d3/d1d/d28/f47 [4827167,93559] 0 2024-02-15T22:51:18.969 INFO:tasks.workunit.client.1.smithi170.stdout:6/511: chown d3/d1d/d36/d56/c7f 3597 1 2024-02-15T22:51:18.970 INFO:tasks.workunit.client.1.smithi170.stdout:6/512: write d3/d1d/d1b/d3e/f92 [242113,18334] 0 2024-02-15T22:51:18.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/659: dwrite d3/d24/d2c/d35/d7f/fa9 [0,4194304] 0 2024-02-15T22:51:18.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/660: read - d3/d24/f67 zero size 2024-02-15T22:51:18.979 INFO:tasks.workunit.client.1.smithi170.stdout:1/661: stat d3/d24/d2c/d35/fc0 0 2024-02-15T22:51:18.979 INFO:tasks.workunit.client.1.smithi170.stdout:6/513: write d3/d1d/d36/f58 [454206,38809] 0 2024-02-15T22:51:18.982 INFO:tasks.workunit.client.1.smithi170.stdout:6/514: rename d3/d1d/d53/f8f to d3/d1d/d1b/d3c/fb6 0 2024-02-15T22:51:18.982 INFO:tasks.workunit.client.1.smithi170.stdout:6/515: chown d3 1723021426 1 2024-02-15T22:51:18.982 INFO:tasks.workunit.client.1.smithi170.stdout:6/516: chown d3/d1d/d53/c87 0 1 2024-02-15T22:51:18.982 INFO:tasks.workunit.client.1.smithi170.stdout:6/517: write d3/f5 [4239378,123991] 0 2024-02-15T22:51:18.982 INFO:tasks.workunit.client.1.smithi170.stdout:6/518: dread - d3/d1d/d27/fab zero size 2024-02-15T22:51:18.987 INFO:tasks.workunit.client.1.smithi170.stdout:6/519: fsync d3/d1d/d1b/d3c/fb6 0 2024-02-15T22:51:18.987 INFO:tasks.workunit.client.1.smithi170.stdout:6/520: write d3/d1d/d53/f93 [204869,36752] 0 2024-02-15T22:51:18.988 INFO:tasks.workunit.client.1.smithi170.stdout:6/521: rename d3/l41 to d3/d24/lb7 0 2024-02-15T22:51:18.988 INFO:tasks.workunit.client.1.smithi170.stdout:6/522: write d3/f5 [845510,93880] 0 2024-02-15T22:51:18.989 INFO:tasks.workunit.client.1.smithi170.stdout:6/523: rename d3/d1d/d53/d5f/d62 to d3/db8 0 2024-02-15T22:51:18.990 INFO:tasks.workunit.client.1.smithi170.stdout:6/524: write d3/d1d/d53/f93 [101385,80459] 0 2024-02-15T22:51:18.991 INFO:tasks.workunit.client.1.smithi170.stdout:6/525: symlink d3/d1d/d27/d70/da5/lb9 0 2024-02-15T22:51:18.991 INFO:tasks.workunit.client.1.smithi170.stdout:6/526: chown d3/d1d/d28/f47 28007127 1 2024-02-15T22:51:18.991 INFO:tasks.workunit.client.1.smithi170.stdout:6/527: fdatasync d3/d1d/d1b/d3e/f88 0 2024-02-15T22:51:19.007 INFO:tasks.workunit.client.1.smithi170.stdout:6/528: dwrite d3/d1d/d27/fb3 [0,4194304] 0 2024-02-15T22:51:19.008 INFO:tasks.workunit.client.1.smithi170.stdout:6/529: read d3/d1d/d28/d66/f68 [534569,65622] 0 2024-02-15T22:51:19.008 INFO:tasks.workunit.client.1.smithi170.stdout:6/530: creat d3/d1d/d53/fba x:0 0 0 2024-02-15T22:51:19.029 INFO:tasks.workunit.client.1.smithi170.stdout:6/531: dwrite d3/d1d/f9f [0,4194304] 0 2024-02-15T22:51:19.031 INFO:tasks.workunit.client.1.smithi170.stdout:6/532: getdents d3/d1d/d28/d3b/d2f 0 2024-02-15T22:51:19.031 INFO:tasks.workunit.client.1.smithi170.stdout:6/533: fdatasync d3/d1d/d27/f4a 0 2024-02-15T22:51:19.033 INFO:tasks.workunit.client.1.smithi170.stdout:6/534: symlink d3/d1d/d1b/d3c/lbb 0 2024-02-15T22:51:19.033 INFO:tasks.workunit.client.1.smithi170.stdout:6/535: dread - d3/d1d/d1b/d3e/f88 zero size 2024-02-15T22:51:19.048 INFO:tasks.workunit.client.1.smithi170.stdout:6/536: dwrite d3/d1d/d36/d51/f63 [0,4194304] 0 2024-02-15T22:51:19.061 INFO:tasks.workunit.client.1.smithi170.stdout:6/537: dwrite d3/d1d/d27/fab [0,4194304] 0 2024-02-15T22:51:19.062 INFO:tasks.workunit.client.1.smithi170.stdout:6/538: fdatasync d3/d24/d31/f34 0 2024-02-15T22:51:19.062 INFO:tasks.workunit.client.1.smithi170.stdout:6/539: creat d3/d1d/d28/fbc x:0 0 0 2024-02-15T22:51:19.073 INFO:tasks.workunit.client.1.smithi170.stdout:6/540: write d3/d1a/f5e [994122,76896] 0 2024-02-15T22:51:19.088 INFO:tasks.workunit.client.1.smithi170.stdout:6/541: dwrite d3/d1d/d28/d3b/f2b [0,4194304] 0 2024-02-15T22:51:19.090 INFO:tasks.workunit.client.1.smithi170.stdout:6/542: getdents d3/d1d/d28/d3b/da3 0 2024-02-15T22:51:19.110 INFO:tasks.workunit.client.1.smithi170.stdout:6/543: dwrite d3/d1d/d1b/d3c/faa [0,4194304] 0 2024-02-15T22:51:19.112 INFO:tasks.workunit.client.1.smithi170.stdout:6/544: symlink d3/d1d/d27/d70/lbd 0 2024-02-15T22:51:19.117 INFO:tasks.workunit.client.1.smithi170.stdout:6/545: dread d3/d1d/d36/f22 [0,4194304] 0 2024-02-15T22:51:19.117 INFO:tasks.workunit.client.1.smithi170.stdout:6/546: write d3/d1d/d53/d5f/f9a [991053,104918] 0 2024-02-15T22:51:19.118 INFO:tasks.workunit.client.1.smithi170.stdout:6/547: write d3/d1d/d53/d5f/f8c [256328,30126] 0 2024-02-15T22:51:19.131 INFO:tasks.workunit.client.1.smithi170.stdout:6/548: dwrite d3/d24/f77 [0,4194304] 0 2024-02-15T22:51:19.135 INFO:tasks.workunit.client.1.smithi170.stdout:6/549: rename d3/d1d/d28/d3b/d2f to d3/d1d/d27/d70/da5/dbe 0 2024-02-15T22:51:19.136 INFO:tasks.workunit.client.1.smithi170.stdout:6/550: stat d3/d1d/d1b/d3c/c8e 0 2024-02-15T22:51:19.136 INFO:tasks.workunit.client.1.smithi170.stdout:6/551: dread - d3/d1d/fb5 zero size 2024-02-15T22:51:19.136 INFO:tasks.workunit.client.1.smithi170.stdout:6/552: chown d3/d1d/d1b/d3c/f6f 2591 1 2024-02-15T22:51:19.143 INFO:tasks.workunit.client.1.smithi170.stdout:9/400: sync 2024-02-15T22:51:19.143 INFO:tasks.workunit.client.1.smithi170.stdout:5/601: sync 2024-02-15T22:51:19.143 INFO:tasks.workunit.client.1.smithi170.stdout:0/436: sync 2024-02-15T22:51:19.143 INFO:tasks.workunit.client.1.smithi170.stdout:5/602: readlink de/d10/d27/d4c/l7f 0 2024-02-15T22:51:19.145 INFO:tasks.workunit.client.1.smithi170.stdout:0/437: mkdir d8/df/d90 0 2024-02-15T22:51:19.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/401: link de/d1b/f6a de/d1b/d1c/d1f/d20/d8c/f8d 0 2024-02-15T22:51:19.148 INFO:tasks.workunit.client.1.smithi170.stdout:0/438: truncate f6 3216943 0 2024-02-15T22:51:19.148 INFO:tasks.workunit.client.1.smithi170.stdout:0/439: creat d8/df/d13/d36/d60/f91 x:0 0 0 2024-02-15T22:51:19.150 INFO:tasks.workunit.client.1.smithi170.stdout:9/402: mkdir de/d8e 0 2024-02-15T22:51:19.151 INFO:tasks.workunit.client.1.smithi170.stdout:9/403: write de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [302208,53321] 0 2024-02-15T22:51:19.152 INFO:tasks.workunit.client.1.smithi170.stdout:9/404: chown de/d1b/f2b 0 1 2024-02-15T22:51:19.152 INFO:tasks.workunit.client.1.smithi170.stdout:9/405: stat de/f1e 0 2024-02-15T22:51:19.153 INFO:tasks.workunit.client.1.smithi170.stdout:9/406: getdents de/d1b/d1c/d1f/d20/d27/d28 0 2024-02-15T22:51:19.154 INFO:tasks.workunit.client.1.smithi170.stdout:6/553: dwrite d3/d1d/f12 [0,4194304] 0 2024-02-15T22:51:19.154 INFO:tasks.workunit.client.1.smithi170.stdout:6/554: fdatasync d3/d1d/fb5 0 2024-02-15T22:51:19.154 INFO:tasks.workunit.client.1.smithi170.stdout:6/555: getdents d3/d1d/d36/d51 0 2024-02-15T22:51:19.154 INFO:tasks.workunit.client.1.smithi170.stdout:9/407: creat de/f8f x:0 0 0 2024-02-15T22:51:19.156 INFO:tasks.workunit.client.1.smithi170.stdout:6/556: rename d3/d1d/d36/f11 to d3/d1d/d1b/d3e/d5d/fbf 0 2024-02-15T22:51:19.157 INFO:tasks.workunit.client.1.smithi170.stdout:6/557: mkdir d3/d1a/dc0 0 2024-02-15T22:51:19.157 INFO:tasks.workunit.client.1.smithi170.stdout:6/558: creat d3/d1d/d1b/d3c/fc1 x:0 0 0 2024-02-15T22:51:19.157 INFO:tasks.workunit.client.1.smithi170.stdout:6/559: fdatasync d3/d1d/fb5 0 2024-02-15T22:51:19.160 INFO:tasks.workunit.client.1.smithi170.stdout:6/560: truncate d3/d1d/d1b/d3c/f6f 296392 0 2024-02-15T22:51:19.175 INFO:tasks.workunit.client.1.smithi170.stdout:6/561: dread d3/d1d/d27/f5b [0,4194304] 0 2024-02-15T22:51:19.176 INFO:tasks.workunit.client.1.smithi170.stdout:6/562: unlink d3/d1d/d27/f52 0 2024-02-15T22:51:19.177 INFO:tasks.workunit.client.1.smithi170.stdout:6/563: rmdir d3/d1d/d36/d56/d6c 39 2024-02-15T22:51:19.179 INFO:tasks.workunit.client.1.smithi170.stdout:5/603: dwrite de/d36/f41 [0,4194304] 0 2024-02-15T22:51:19.179 INFO:tasks.workunit.client.1.smithi170.stdout:0/440: dwrite d8/df/d13/d22/f33 [0,4194304] 0 2024-02-15T22:51:19.179 INFO:tasks.workunit.client.1.smithi170.stdout:5/604: write de/d29/f5a [327674,88473] 0 2024-02-15T22:51:19.179 INFO:tasks.workunit.client.1.smithi170.stdout:9/408: dwrite de/f18 [0,4194304] 0 2024-02-15T22:51:19.183 INFO:tasks.workunit.client.1.smithi170.stdout:0/441: mknod d8/d14/d1c/c92 0 2024-02-15T22:51:19.188 INFO:tasks.workunit.client.1.smithi170.stdout:9/409: write de/d1b/d1c/d1f/d20/d27/d2c/f44 [3116180,43589] 0 2024-02-15T22:51:19.188 INFO:tasks.workunit.client.1.smithi170.stdout:9/410: chown de 2668 1 2024-02-15T22:51:19.191 INFO:tasks.workunit.client.1.smithi170.stdout:6/564: dread d3/d1d/d1b/d3c/faa [0,4194304] 0 2024-02-15T22:51:19.193 INFO:tasks.workunit.client.1.smithi170.stdout:5/605: link c6 de/d10/d33/d67/dc4/dcd/cd3 0 2024-02-15T22:51:19.195 INFO:tasks.workunit.client.1.smithi170.stdout:9/411: getdents de/d1b/d1c 0 2024-02-15T22:51:19.198 INFO:tasks.workunit.client.1.smithi170.stdout:9/412: mknod de/d1b/d1c/d1f/d20/d27/d28/c90 0 2024-02-15T22:51:19.198 INFO:tasks.workunit.client.1.smithi170.stdout:9/413: fsync de/f1e 0 2024-02-15T22:51:19.199 INFO:tasks.workunit.client.1.smithi170.stdout:0/442: dwrite d8/d14/f76 [4194304,4194304] 0 2024-02-15T22:51:19.200 INFO:tasks.workunit.client.1.smithi170.stdout:9/414: mknod de/d1b/d1c/d1f/d20/d27/c91 0 2024-02-15T22:51:19.200 INFO:tasks.workunit.client.1.smithi170.stdout:0/443: write d8/d14/d1c/d3f/d51/f65 [298027,2340] 0 2024-02-15T22:51:19.202 INFO:tasks.workunit.client.1.smithi170.stdout:1/662: sync 2024-02-15T22:51:19.202 INFO:tasks.workunit.client.1.smithi170.stdout:8/409: sync 2024-02-15T22:51:19.203 INFO:tasks.workunit.client.1.smithi170.stdout:9/415: mknod de/d1b/d1c/d1f/d20/d27/d84/c92 0 2024-02-15T22:51:19.204 INFO:tasks.workunit.client.1.smithi170.stdout:4/554: sync 2024-02-15T22:51:19.204 INFO:tasks.workunit.client.1.smithi170.stdout:2/501: sync 2024-02-15T22:51:19.205 INFO:tasks.workunit.client.1.smithi170.stdout:3/473: sync 2024-02-15T22:51:19.205 INFO:tasks.workunit.client.1.smithi170.stdout:7/571: sync 2024-02-15T22:51:19.206 INFO:tasks.workunit.client.1.smithi170.stdout:0/444: mkdir d8/d14/d70/d93 0 2024-02-15T22:51:19.207 INFO:tasks.workunit.client.1.smithi170.stdout:6/565: dwrite d3/d1d/d27/f43 [0,4194304] 0 2024-02-15T22:51:19.207 INFO:tasks.workunit.client.1.smithi170.stdout:6/566: stat d3/d1a/f33 0 2024-02-15T22:51:19.210 INFO:tasks.workunit.client.1.smithi170.stdout:8/410: unlink d9/d18/d32/f59 0 2024-02-15T22:51:19.212 INFO:tasks.workunit.client.1.smithi170.stdout:3/474: symlink d3/d1b/d51/d6b/d86/l9b 0 2024-02-15T22:51:19.212 INFO:tasks.workunit.client.1.smithi170.stdout:3/475: chown d3/d1b/d2c/f4b 1 1 2024-02-15T22:51:19.212 INFO:tasks.workunit.client.1.smithi170.stdout:3/476: fdatasync d3/dc/ff 0 2024-02-15T22:51:19.212 INFO:tasks.workunit.client.1.smithi170.stdout:7/572: creat da/d1a/d21/d2c/d74/d87/fbe x:0 0 0 2024-02-15T22:51:19.213 INFO:tasks.workunit.client.1.smithi170.stdout:7/573: read da/d1a/d21/d1b/d69/f76 [228266,25899] 0 2024-02-15T22:51:19.214 INFO:tasks.workunit.client.1.smithi170.stdout:6/567: mknod d3/d1d/d1b/d3e/d5d/cc2 0 2024-02-15T22:51:19.214 INFO:tasks.workunit.client.1.smithi170.stdout:1/663: getdents d3/d24/d2c/d35/d83 0 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:8/411: rename d9/d18/d32/d3b/d42/l66 to d9/d18/d32/d3b/d68/l83 0 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:8/412: chown d9/d18/d32/l52 11233387 1 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:7/574: truncate da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/f32 1976984 0 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:7/575: write da/d1a/d21/fae [279049,104698] 0 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:4/555: write d0/d22/f50 [3932892,4359] 0 2024-02-15T22:51:19.219 INFO:tasks.workunit.client.1.smithi170.stdout:0/445: getdents d8/d14/d44 0 2024-02-15T22:51:19.220 INFO:tasks.workunit.client.1.smithi170.stdout:3/477: dread d3/db/f11 [0,4194304] 0 2024-02-15T22:51:19.222 INFO:tasks.workunit.client.1.smithi170.stdout:6/568: symlink d3/d24/d31/d94/lc3 0 2024-02-15T22:51:19.223 INFO:tasks.workunit.client.1.smithi170.stdout:8/413: rmdir d9/d18/d26/d7d 0 2024-02-15T22:51:19.226 INFO:tasks.workunit.client.1.smithi170.stdout:7/576: rename da/d1a/d21/d2c/d74/fa3 to da/d1a/fbf 0 2024-02-15T22:51:19.226 INFO:tasks.workunit.client.1.smithi170.stdout:9/416: dread de/d1b/f4f [0,4194304] 0 2024-02-15T22:51:19.228 INFO:tasks.workunit.client.1.smithi170.stdout:4/556: creat d0/d22/da/d11/fac x:0 0 0 2024-02-15T22:51:19.228 INFO:tasks.workunit.client.1.smithi170.stdout:4/557: fsync d0/d22/da/d11/f30 0 2024-02-15T22:51:19.228 INFO:tasks.workunit.client.1.smithi170.stdout:4/558: getdents d0/d22/da8 0 2024-02-15T22:51:19.228 INFO:tasks.workunit.client.1.smithi170.stdout:4/559: chown d0/d22/da/d11/d20/d49/c99 36203 1 2024-02-15T22:51:19.229 INFO:tasks.workunit.client.1.smithi170.stdout:6/569: mkdir d3/d1d/d36/d56/d6c/dc4 0 2024-02-15T22:51:19.229 INFO:tasks.workunit.client.1.smithi170.stdout:7/577: mknod da/d63/cc0 0 2024-02-15T22:51:19.231 INFO:tasks.workunit.client.1.smithi170.stdout:6/570: mkdir d3/d1d/d27/dc5 0 2024-02-15T22:51:19.231 INFO:tasks.workunit.client.1.smithi170.stdout:6/571: stat d3/d1d/d1b/d3e/d5d/cc2 0 2024-02-15T22:51:19.231 INFO:tasks.workunit.client.1.smithi170.stdout:6/572: chown d3/d1d/d1b/d3e/f88 4 1 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/414: dread d9/f17 [0,4194304] 0 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/578: symlink da/d1a/d21/d2c/d74/d87/d9b/lc1 0 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/579: chown da/d1a/l4e 0 1 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/580: readlink da/d1a/d21/d19/l24 0 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/560: getdents d0/d22/da/d58 0 2024-02-15T22:51:19.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/561: truncate d0/d22/da/d11/d89/fa4 553480 0 2024-02-15T22:51:19.234 INFO:tasks.workunit.client.1.smithi170.stdout:8/415: link d9/c30 d9/d18/d32/d7a/d78/d7f/c84 0 2024-02-15T22:51:19.236 INFO:tasks.workunit.client.1.smithi170.stdout:7/581: symlink da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/lc2 0 2024-02-15T22:51:19.238 INFO:tasks.workunit.client.1.smithi170.stdout:7/582: creat da/d1a/d21/d1b/fc3 x:0 0 0 2024-02-15T22:51:19.244 INFO:tasks.workunit.client.1.smithi170.stdout:6/573: dread d3/d1d/d36/f14 [0,4194304] 0 2024-02-15T22:51:19.244 INFO:tasks.workunit.client.1.smithi170.stdout:0/446: dread d8/df/d13/d22/f4b [0,4194304] 0 2024-02-15T22:51:19.244 INFO:tasks.workunit.client.1.smithi170.stdout:6/574: dread - d3/d1d/d28/d3b/da3/fa8 zero size 2024-02-15T22:51:19.244 INFO:tasks.workunit.client.1.smithi170.stdout:6/575: chown d3/d1d/d1b/l2a 53930662 1 2024-02-15T22:51:19.245 INFO:tasks.workunit.client.1.smithi170.stdout:6/576: stat d3/d1d/d1b/d3e/d9c/ca9 0 2024-02-15T22:51:19.245 INFO:tasks.workunit.client.1.smithi170.stdout:6/577: fsync d3/d1d/d1b/d3e/f92 0 2024-02-15T22:51:19.246 INFO:tasks.workunit.client.1.smithi170.stdout:1/664: dwrite d3/d24/d2c/d35/d7f/fa9 [0,4194304] 0 2024-02-15T22:51:19.246 INFO:tasks.workunit.client.1.smithi170.stdout:1/665: chown d3/d24/d2c/d35/d83 3484 1 2024-02-15T22:51:19.251 INFO:tasks.workunit.client.1.smithi170.stdout:3/478: dwrite d3/d1b/f74 [4194304,4194304] 0 2024-02-15T22:51:19.251 INFO:tasks.workunit.client.1.smithi170.stdout:2/502: dwrite d0/d1/d53/fb8 [0,4194304] 0 2024-02-15T22:51:19.251 INFO:tasks.workunit.client.1.smithi170.stdout:1/666: link d3/d24/f27 d3/d24/d2c/d77/dda/fea 0 2024-02-15T22:51:19.252 INFO:tasks.workunit.client.1.smithi170.stdout:4/562: write d0/d22/da/d8b/d47/d67/f7a [1611186,42229] 0 2024-02-15T22:51:19.252 INFO:tasks.workunit.client.1.smithi170.stdout:5/606: dwrite de/d29/f5a [0,4194304] 0 2024-02-15T22:51:19.264 INFO:tasks.workunit.client.1.smithi170.stdout:9/417: dwrite de/d1b/d1c/d1f/d20/d27/d28/d69/f70 [0,4194304] 0 2024-02-15T22:51:19.266 INFO:tasks.workunit.client.1.smithi170.stdout:4/563: unlink d0/d22/da/d11/d20/d49/l65 0 2024-02-15T22:51:19.266 INFO:tasks.workunit.client.1.smithi170.stdout:4/564: getdents d0/d22/da/d8b/d47/d67 0 2024-02-15T22:51:19.268 INFO:tasks.workunit.client.1.smithi170.stdout:1/667: mkdir d3/deb 0 2024-02-15T22:51:19.269 INFO:tasks.workunit.client.1.smithi170.stdout:1/668: chown d3/d24/d2c/d77/d8f 2866 1 2024-02-15T22:51:19.269 INFO:tasks.workunit.client.1.smithi170.stdout:1/669: read - d3/d24/d2c/d35/f81 zero size 2024-02-15T22:51:19.269 INFO:tasks.workunit.client.1.smithi170.stdout:1/670: readlink d3/d24/l43 0 2024-02-15T22:51:19.269 INFO:tasks.workunit.client.1.smithi170.stdout:0/447: dread d8/df/d13/f2e [0,4194304] 0 2024-02-15T22:51:19.269 INFO:tasks.workunit.client.1.smithi170.stdout:0/448: write d8/d14/d6f/f8d [822973,31310] 0 2024-02-15T22:51:19.270 INFO:tasks.workunit.client.1.smithi170.stdout:9/418: truncate de/d1b/f53 1555863 0 2024-02-15T22:51:19.271 INFO:tasks.workunit.client.1.smithi170.stdout:4/565: symlink d0/d22/da/d8b/d47/d5e/lad 0 2024-02-15T22:51:19.272 INFO:tasks.workunit.client.1.smithi170.stdout:5/607: rmdir de/d10/da8/db6 39 2024-02-15T22:51:19.272 INFO:tasks.workunit.client.1.smithi170.stdout:5/608: write de/d10/da8/db6/fd0 [111578,15493] 0 2024-02-15T22:51:19.273 INFO:tasks.workunit.client.1.smithi170.stdout:9/419: rename ca to de/d1b/d1c/d1f/d20/d27/d28/d7a/c93 0 2024-02-15T22:51:19.274 INFO:tasks.workunit.client.1.smithi170.stdout:9/420: fsync de/f18 0 2024-02-15T22:51:19.274 INFO:tasks.workunit.client.1.smithi170.stdout:5/609: write de/d10/d27/d4c/f6e [348549,99316] 0 2024-02-15T22:51:19.275 INFO:tasks.workunit.client.1.smithi170.stdout:4/566: unlink d0/d22/da/f13 0 2024-02-15T22:51:19.276 INFO:tasks.workunit.client.1.smithi170.stdout:9/421: creat de/d1b/d1c/d1f/d20/d27/d84/f94 x:0 0 0 2024-02-15T22:51:19.277 INFO:tasks.workunit.client.1.smithi170.stdout:5/610: creat de/d10/da8/fd4 x:0 0 0 2024-02-15T22:51:19.285 INFO:tasks.workunit.client.1.smithi170.stdout:5/611: write de/d10/d27/f4f [2684628,41259] 0 2024-02-15T22:51:19.287 INFO:tasks.workunit.client.1.smithi170.stdout:1/671: dread d3/d24/d2c/d77/fa4 [0,4194304] 0 2024-02-15T22:51:19.289 INFO:tasks.workunit.client.1.smithi170.stdout:1/672: rename d3/ld7 to d3/d24/d2c/d77/d8f/dcd/lec 0 2024-02-15T22:51:19.291 INFO:tasks.workunit.client.1.smithi170.stdout:9/422: read de/d1b/d1c/d1f/d20/f65 [822905,130186] 0 2024-02-15T22:51:19.291 INFO:tasks.workunit.client.1.smithi170.stdout:9/423: dread - de/f8f zero size 2024-02-15T22:51:19.291 INFO:tasks.workunit.client.1.smithi170.stdout:1/673: mknod d3/d24/d2c/d35/d7f/ced 0 2024-02-15T22:51:19.292 INFO:tasks.workunit.client.1.smithi170.stdout:9/424: chown de/d1b/c3f 6383738 1 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:7/583: dwrite da/d1a/d21/f46 [4194304,4194304] 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:7/584: fdatasync da/f38 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:8/416: dwrite d9/d18/d32/d3b/d4b/f6f [0,4194304] 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:1/674: creat d3/d24/d2c/d35/d83/fee x:0 0 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:8/417: write d9/d18/d32/f81 [1696896,28792] 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:1/675: write d3/d24/d2c/d35/d72/d7e/fe0 [176289,45943] 0 2024-02-15T22:51:19.295 INFO:tasks.workunit.client.1.smithi170.stdout:1/676: write d3/d24/d2c/d35/f48 [2640928,22994] 0 2024-02-15T22:51:19.296 INFO:tasks.workunit.client.1.smithi170.stdout:1/677: write d3/da2/d65/fb6 [4952889,5002] 0 2024-02-15T22:51:19.296 INFO:tasks.workunit.client.1.smithi170.stdout:0/449: dwrite d8/d14/d1c/d3f/d51/f6c [0,4194304] 0 2024-02-15T22:51:19.296 INFO:tasks.workunit.client.1.smithi170.stdout:3/479: dwrite d3/d1b/f8f [0,4194304] 0 2024-02-15T22:51:19.296 INFO:tasks.workunit.client.1.smithi170.stdout:5/612: dread de/d10/f5b [0,4194304] 0 2024-02-15T22:51:19.297 INFO:tasks.workunit.client.1.smithi170.stdout:5/613: write de/d10/d27/d4c/d53/d55/fad [336188,72645] 0 2024-02-15T22:51:19.297 INFO:tasks.workunit.client.1.smithi170.stdout:2/503: dwrite d0/d28/d2f/d37/fc7 [0,4194304] 0 2024-02-15T22:51:19.297 INFO:tasks.workunit.client.1.smithi170.stdout:2/504: fsync d0/d1/d89/d8b/fbf 0 2024-02-15T22:51:19.299 INFO:tasks.workunit.client.1.smithi170.stdout:7/585: getdents da/d57 0 2024-02-15T22:51:19.299 INFO:tasks.workunit.client.1.smithi170.stdout:4/567: dread d0/d22/f50 [0,4194304] 0 2024-02-15T22:51:19.301 INFO:tasks.workunit.client.1.smithi170.stdout:4/568: dread d0/f84 [0,4194304] 0 2024-02-15T22:51:19.303 INFO:tasks.workunit.client.1.smithi170.stdout:8/418: creat d9/d18/f85 x:0 0 0 2024-02-15T22:51:19.303 INFO:tasks.workunit.client.1.smithi170.stdout:8/419: stat d9/d18/d26/c2c 0 2024-02-15T22:51:19.303 INFO:tasks.workunit.client.1.smithi170.stdout:8/420: chown d9/f46 1270240 1 2024-02-15T22:51:19.307 INFO:tasks.workunit.client.1.smithi170.stdout:8/421: dread d9/d18/d32/d3b/d4b/f5f [0,4194304] 0 2024-02-15T22:51:19.307 INFO:tasks.workunit.client.1.smithi170.stdout:1/678: symlink d3/d24/d2c/lef 0 2024-02-15T22:51:19.307 INFO:tasks.workunit.client.1.smithi170.stdout:8/422: stat d9/f1d 0 2024-02-15T22:51:19.307 INFO:tasks.workunit.client.1.smithi170.stdout:8/423: readlink d9/d18/d32/d3b/l5c 0 2024-02-15T22:51:19.308 INFO:tasks.workunit.client.1.smithi170.stdout:3/480: dread d3/db/f12 [0,4194304] 0 2024-02-15T22:51:19.309 INFO:tasks.workunit.client.1.smithi170.stdout:9/425: symlink de/d1b/l95 0 2024-02-15T22:51:19.313 INFO:tasks.workunit.client.1.smithi170.stdout:0/450: creat d8/f94 x:0 0 0 2024-02-15T22:51:19.313 INFO:tasks.workunit.client.1.smithi170.stdout:8/424: dread d9/f82 [0,4194304] 0 2024-02-15T22:51:19.316 INFO:tasks.workunit.client.1.smithi170.stdout:5/614: creat de/d10/d7d/db8/fd5 x:0 0 0 2024-02-15T22:51:19.320 INFO:tasks.workunit.client.1.smithi170.stdout:2/505: rmdir d0/d28/d3e 39 2024-02-15T22:51:19.321 INFO:tasks.workunit.client.1.smithi170.stdout:7/586: creat da/d1a/d21/d2c/d74/d87/daf/fc4 x:0 0 0 2024-02-15T22:51:19.321 INFO:tasks.workunit.client.1.smithi170.stdout:7/587: dread - da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/fbc zero size 2024-02-15T22:51:19.321 INFO:tasks.workunit.client.1.smithi170.stdout:7/588: stat da/d1a/d21/d2c/d74/d87/d9b 0 2024-02-15T22:51:19.322 INFO:tasks.workunit.client.1.smithi170.stdout:7/589: creat da/d1a/d21/d2c/d74/d87/dac/fc5 x:0 0 0 2024-02-15T22:51:19.327 INFO:tasks.workunit.client.1.smithi170.stdout:5/615: dread de/d36/f41 [0,4194304] 0 2024-02-15T22:51:19.329 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T22:51:19.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-15T22:51:19.331 INFO:tasks.workunit.client.1.smithi170.stdout:1/679: rename d3/da2/de2/lcb to d3/d24/d2c/d77/d8f/dcd/lf0 0 2024-02-15T22:51:19.332 INFO:tasks.workunit.client.1.smithi170.stdout:3/481: creat d3/dc/f9c x:0 0 0 2024-02-15T22:51:19.334 INFO:tasks.workunit.client.1.smithi170.stdout:9/426: creat de/d8e/f96 x:0 0 0 2024-02-15T22:51:19.335 INFO:tasks.workunit.client.1.smithi170.stdout:0/451: creat d8/df/d13/d36/f95 x:0 0 0 2024-02-15T22:51:19.336 INFO:tasks.workunit.client.1.smithi170.stdout:0/452: read d8/df/d13/d22/f6b [97773,4328] 0 2024-02-15T22:51:19.338 INFO:tasks.workunit.client.1.smithi170.stdout:8/425: creat d9/d18/f86 x:0 0 0 2024-02-15T22:51:19.339 INFO:tasks.workunit.client.1.smithi170.stdout:2/506: dwrite d0/d13/d59/d82/fb7 [0,4194304] 0 2024-02-15T22:51:19.345 INFO:tasks.workunit.client.1.smithi170.stdout:5/616: link de/d36/d80/lc7 de/d10/d7d/db8/ld6 0 2024-02-15T22:51:19.347 INFO:tasks.workunit.client.1.smithi170.stdout:1/680: mkdir d3/d24/d2c/d35/d72/df1 0 2024-02-15T22:51:19.351 INFO:tasks.workunit.client.1.smithi170.stdout:0/453: mkdir d8/d6d/d96 0 2024-02-15T22:51:19.354 INFO:tasks.workunit.client.1.smithi170.stdout:3/482: dwrite d3/dc/d1c/f83 [0,4194304] 0 2024-02-15T22:51:19.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/483: write d3/dc/d1c/d26/d55/f89 [665591,34226] 0 2024-02-15T22:51:19.356 INFO:tasks.workunit.client.1.smithi170.stdout:7/590: rmdir da/d1a/d21/d19 39 2024-02-15T22:51:19.357 INFO:tasks.workunit.client.1.smithi170.stdout:5/617: mknod de/d36/cd7 0 2024-02-15T22:51:19.359 INFO:tasks.workunit.client.1.smithi170.stdout:1/681: rename d3/d24/c64 to d3/d24/d2c/d94/dd9/cf2 0 2024-02-15T22:51:19.359 INFO:tasks.workunit.client.1.smithi170.stdout:0/454: write d8/df/d13/f2e [2778690,106785] 0 2024-02-15T22:51:19.361 INFO:tasks.workunit.client.1.smithi170.stdout:5/618: read de/d10/d33/d9f/f69 [140240,26975] 0 2024-02-15T22:51:19.363 INFO:tasks.workunit.client.1.smithi170.stdout:2/507: dwrite d0/d1/d11/d26/f9a [0,4194304] 0 2024-02-15T22:51:19.363 INFO:tasks.workunit.client.1.smithi170.stdout:9/427: mkdir de/d97 0 2024-02-15T22:51:19.363 INFO:tasks.workunit.client.1.smithi170.stdout:7/591: truncate da/d1a/d21/d19/f50 6110309 0 2024-02-15T22:51:19.363 INFO:tasks.workunit.client.1.smithi170.stdout:7/592: fdatasync da/d1a/d21/d19/f94 0 2024-02-15T22:51:19.366 INFO:tasks.workunit.client.1.smithi170.stdout:3/484: write d3/dc/d1c/f83 [822359,12435] 0 2024-02-15T22:51:19.367 INFO:tasks.workunit.client.1.smithi170.stdout:8/426: dwrite d9/d18/d26/f45 [0,4194304] 0 2024-02-15T22:51:19.367 INFO:tasks.workunit.client.1.smithi170.stdout:8/427: write d9/d18/d32/d3b/d4b/f5f [4322515,6573] 0 2024-02-15T22:51:19.369 INFO:tasks.workunit.client.1.smithi170.stdout:9/428: write de/f14 [2067203,130653] 0 2024-02-15T22:51:19.370 INFO:tasks.workunit.client.1.smithi170.stdout:0/455: write f5 [313323,15198] 0 2024-02-15T22:51:19.373 INFO:tasks.workunit.client.1.smithi170.stdout:7/593: dread da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/f32 [0,4194304] 0 2024-02-15T22:51:19.375 INFO:tasks.workunit.client.1.smithi170.stdout:3/485: truncate d3/db/d1f/f41 1146615 0 2024-02-15T22:51:19.375 INFO:tasks.workunit.client.1.smithi170.stdout:3/486: readlink d3/d1b/d2c/l6d 0 2024-02-15T22:51:19.377 INFO:tasks.workunit.client.1.smithi170.stdout:9/429: unlink de/d1b/c3f 0 2024-02-15T22:51:19.378 INFO:tasks.workunit.client.1.smithi170.stdout:0/456: truncate d8/d14/d1c/f35 1888569 0 2024-02-15T22:51:19.378 INFO:tasks.workunit.client.1.smithi170.stdout:0/457: fsync d8/df/d13/f85 0 2024-02-15T22:51:19.380 INFO:tasks.workunit.client.1.smithi170.stdout:7/594: dread da/f13 [4194304,4194304] 0 2024-02-15T22:51:19.402 INFO:tasks.workunit.client.1.smithi170.stdout:8/428: rename d9/d18/d32/d3b/d68/l71 to d9/d18/l87 0 2024-02-15T22:51:19.406 INFO:tasks.workunit.client.1.smithi170.stdout:8/429: dread d9/d18/d32/d3b/d42/f61 [0,4194304] 0 2024-02-15T22:51:19.407 INFO:tasks.workunit.client.1.smithi170.stdout:0/458: symlink d8/d6d/l97 0 2024-02-15T22:51:19.408 INFO:tasks.workunit.client.1.smithi170.stdout:9/430: getdents de/d1b/d1c/d1f/d20/d27/d84 0 2024-02-15T22:51:19.408 INFO:tasks.workunit.client.1.smithi170.stdout:5/619: dwrite de/d36/d80/f9a [0,4194304] 0 2024-02-15T22:51:19.411 INFO:tasks.workunit.client.1.smithi170.stdout:7/595: mkdir da/d1a/d21/d1b/dc6 0 2024-02-15T22:51:19.411 INFO:tasks.workunit.client.1.smithi170.stdout:7/596: chown da/l4f 212 1 2024-02-15T22:51:19.411 INFO:tasks.workunit.client.1.smithi170.stdout:7/597: write da/f64 [187404,111350] 0 2024-02-15T22:51:19.411 INFO:tasks.workunit.client.1.smithi170.stdout:9/431: truncate f4 713937 0 2024-02-15T22:51:19.413 INFO:tasks.workunit.client.1.smithi170.stdout:1/682: dwrite d3/d24/d2c/d35/fa0 [0,4194304] 0 2024-02-15T22:51:19.415 INFO:tasks.workunit.client.1.smithi170.stdout:2/508: dwrite d0/d1/d11/fc1 [0,4194304] 0 2024-02-15T22:51:19.416 INFO:tasks.workunit.client.1.smithi170.stdout:3/487: dwrite d3/db/d1f/f36 [0,4194304] 0 2024-02-15T22:51:19.417 INFO:tasks.workunit.client.1.smithi170.stdout:3/488: chown d3/dc/d1c/d26/d55/d7d 1 1 2024-02-15T22:51:19.418 INFO:tasks.workunit.client.1.smithi170.stdout:5/620: unlink de/d36/cd7 0 2024-02-15T22:51:19.421 INFO:tasks.workunit.client.1.smithi170.stdout:0/459: dread f1 [0,4194304] 0 2024-02-15T22:51:19.423 INFO:tasks.workunit.client.1.smithi170.stdout:7/598: mkdir da/d1a/d21/d2c/d74/d87/dac/d7c/dc7 0 2024-02-15T22:51:19.423 INFO:tasks.workunit.client.1.smithi170.stdout:7/599: read da/d63/fa2 [1052721,16821] 0 2024-02-15T22:51:19.423 INFO:tasks.workunit.client.1.smithi170.stdout:9/432: write de/d1b/f2b [2901706,88784] 0 2024-02-15T22:51:19.433 INFO:tasks.workunit.client.1.smithi170.stdout:2/509: mkdir d0/d28/d2f/d37/d58/d78/da4/dc8 0 2024-02-15T22:51:19.438 INFO:tasks.workunit.client.1.smithi170.stdout:5/621: link de/d10/d33/d67/dc4/dcd/cd3 de/d10/d33/d9f/cd8 0 2024-02-15T22:51:19.441 INFO:tasks.workunit.client.1.smithi170.stdout:7/600: symlink da/d1a/d21/d1b/d69/lc8 0 2024-02-15T22:51:19.442 INFO:tasks.workunit.client.1.smithi170.stdout:0/460: dwrite d8/d14/d70/f7a [0,4194304] 0 2024-02-15T22:51:19.443 INFO:tasks.workunit.client.1.smithi170.stdout:0/461: stat d8/df/d13/f61 0 2024-02-15T22:51:19.443 INFO:tasks.workunit.client.1.smithi170.stdout:0/462: creat d8/d14/d6f/f98 x:0 0 0 2024-02-15T22:51:19.443 INFO:tasks.workunit.client.1.smithi170.stdout:9/433: getdents de/d1b/d1c/d1f/d20/d27/d28 0 2024-02-15T22:51:19.446 INFO:tasks.workunit.client.1.smithi170.stdout:1/683: symlink d3/lf3 0 2024-02-15T22:51:19.449 INFO:tasks.workunit.client.1.smithi170.stdout:2/510: creat d0/d28/d2f/d9b/fc9 x:0 0 0 2024-02-15T22:51:19.452 INFO:tasks.workunit.client.1.smithi170.stdout:7/601: symlink da/d1a/d21/d2c/d2e/lc9 0 2024-02-15T22:51:19.452 INFO:tasks.workunit.client.1.smithi170.stdout:7/602: creat da/d1a/d21/d2c/d2e/d7a/fca x:0 0 0 2024-02-15T22:51:19.453 INFO:tasks.workunit.client.1.smithi170.stdout:7/603: chown da/d1a/d21/d4d/c92 6871349 1 2024-02-15T22:51:19.459 INFO:tasks.workunit.client.1.smithi170.stdout:9/434: creat de/d1b/d1c/d1f/d20/d27/d28/f98 x:0 0 0 2024-02-15T22:51:19.461 INFO:tasks.workunit.client.1.smithi170.stdout:0/463: dwrite d8/df/d13/d36/d60/f86 [0,4194304] 0 2024-02-15T22:51:19.462 INFO:tasks.workunit.client.1.smithi170.stdout:2/511: rename d0/d13/d59/d82/fb7 to d0/d28/d2f/fca 0 2024-02-15T22:51:19.463 INFO:tasks.workunit.client.1.smithi170.stdout:2/512: chown d0/d1/d89 5810 1 2024-02-15T22:51:19.465 INFO:tasks.workunit.client.1.smithi170.stdout:2/513: dread d0/d1/f9 [4194304,4194304] 0 2024-02-15T22:51:19.467 INFO:tasks.workunit.client.1.smithi170.stdout:7/604: link da/d1a/d21/d1b/fc3 da/fcb 0 2024-02-15T22:51:19.467 INFO:tasks.workunit.client.1.smithi170.stdout:0/464: mknod d8/df/d13/d22/d6a/c99 0 2024-02-15T22:51:19.467 INFO:tasks.workunit.client.1.smithi170.stdout:0/465: dread - d8/df/f8b zero size 2024-02-15T22:51:19.468 INFO:tasks.workunit.client.1.smithi170.stdout:0/466: fsync d8/df/d13/d22/f6b 0 2024-02-15T22:51:19.468 INFO:tasks.workunit.client.1.smithi170.stdout:0/467: read d8/d14/d6f/f8d [358311,1085] 0 2024-02-15T22:51:19.469 INFO:tasks.workunit.client.1.smithi170.stdout:9/435: dread de/d1b/d1c/d1f/f79 [0,4194304] 0 2024-02-15T22:51:19.470 INFO:tasks.workunit.client.1.smithi170.stdout:2/514: link d0/d1/d11/f50 d0/d1/d89/fcb 0 2024-02-15T22:51:19.470 INFO:tasks.workunit.client.1.smithi170.stdout:1/684: dread d3/f4c [0,4194304] 0 2024-02-15T22:51:19.471 INFO:tasks.workunit.client.1.smithi170.stdout:7/605: mkdir da/d57/dcc 0 2024-02-15T22:51:19.474 INFO:tasks.workunit.client.1.smithi170.stdout:0/468: rename d8/f3b to d8/d14/d1c/d82/f9a 0 2024-02-15T22:51:19.477 INFO:tasks.workunit.client.1.smithi170.stdout:7/606: symlink da/d1a/d21/d2c/lcd 0 2024-02-15T22:51:19.477 INFO:tasks.workunit.client.1.smithi170.stdout:7/607: chown da/d1a/d21/d1b/dc6 7 1 2024-02-15T22:51:19.479 INFO:tasks.workunit.client.1.smithi170.stdout:0/469: getdents d8/d14/d1c/d3f 0 2024-02-15T22:51:19.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/515: dread d0/d1/fe [0,4194304] 0 2024-02-15T22:51:19.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/516: chown d0/d1d 866 1 2024-02-15T22:51:19.484 INFO:tasks.workunit.client.1.smithi170.stdout:2/517: creat d0/d28/d2f/d37/d58/d78/fcc x:0 0 0 2024-02-15T22:51:19.484 INFO:tasks.workunit.client.1.smithi170.stdout:2/518: creat d0/d1/d53/fcd x:0 0 0 2024-02-15T22:51:19.487 INFO:tasks.workunit.client.1.smithi170.stdout:2/519: rename d0/d1/d5f/d74/d8e/fb1 to d0/d28/d2f/fce 0 2024-02-15T22:51:19.492 INFO:tasks.workunit.client.1.smithi170.stdout:9/436: truncate f4 1603922 0 2024-02-15T22:51:19.495 INFO:tasks.workunit.client.1.smithi170.stdout:9/437: rmdir de/d1b/d1c/d1f/d20/d27/d28/d80 39 2024-02-15T22:51:19.495 INFO:tasks.workunit.client.1.smithi170.stdout:9/438: chown de/d1b/d1c/d47/f48 2873 1 2024-02-15T22:51:19.496 INFO:tasks.workunit.client.1.smithi170.stdout:1/685: dwrite d3/d24/f61 [0,4194304] 0 2024-02-15T22:51:19.500 INFO:tasks.workunit.client.1.smithi170.stdout:1/686: getdents d3/da2/de2 0 2024-02-15T22:51:19.502 INFO:tasks.workunit.client.1.smithi170.stdout:7/608: dwrite da/d1a/d21/d1b/d69/f97 [0,4194304] 0 2024-02-15T22:51:19.504 INFO:tasks.workunit.client.1.smithi170.stdout:9/439: rmdir de/d1b 39 2024-02-15T22:51:19.506 INFO:tasks.workunit.client.1.smithi170.stdout:1/687: mkdir d3/d24/d2c/d35/df4 0 2024-02-15T22:51:19.506 INFO:tasks.workunit.client.1.smithi170.stdout:1/688: chown d3/d24/d2c/l9f 148 1 2024-02-15T22:51:19.507 INFO:tasks.workunit.client.1.smithi170.stdout:7/609: rename da/d1a/d21/d1b/f79 to da/d1a/d21/fce 0 2024-02-15T22:51:19.509 INFO:tasks.workunit.client.1.smithi170.stdout:9/440: link de/d1b/d1c/d1f/d20/d8c/f8d de/d1b/d1c/d1f/d20/f99 0 2024-02-15T22:51:19.509 INFO:tasks.workunit.client.1.smithi170.stdout:1/689: fdatasync d3/da2/d65/f69 0 2024-02-15T22:51:19.510 INFO:tasks.workunit.client.1.smithi170.stdout:7/610: mknod da/d1a/d21/d2c/d71/ccf 0 2024-02-15T22:51:19.510 INFO:tasks.workunit.client.1.smithi170.stdout:7/611: chown da/d1a/d21/d2c/d2e/l56 2 1 2024-02-15T22:51:19.511 INFO:tasks.workunit.client.1.smithi170.stdout:9/441: creat de/d1b/d1c/d1f/d20/d27/d28/f9a x:0 0 0 2024-02-15T22:51:19.512 INFO:tasks.workunit.client.1.smithi170.stdout:1/690: truncate d3/da2/d65/fb6 4130578 0 2024-02-15T22:51:19.514 INFO:tasks.workunit.client.1.smithi170.stdout:1/691: creat d3/d24/d2c/d94/dd9/ff5 x:0 0 0 2024-02-15T22:51:19.516 INFO:tasks.workunit.client.1.smithi170.stdout:1/692: symlink d3/d24/d2c/d77/dda/lf6 0 2024-02-15T22:51:19.518 INFO:tasks.workunit.client.1.smithi170.stdout:0/470: dwrite f5 [0,4194304] 0 2024-02-15T22:51:19.518 INFO:tasks.workunit.client.1.smithi170.stdout:0/471: write f5 [4436614,48492] 0 2024-02-15T22:51:19.518 INFO:tasks.workunit.client.1.smithi170.stdout:1/693: dread d3/d24/d2c/f49 [0,4194304] 0 2024-02-15T22:51:19.520 INFO:tasks.workunit.client.1.smithi170.stdout:7/612: write da/d1a/d21/d2c/d74/d87/dac/f66 [2940767,31145] 0 2024-02-15T22:51:19.520 INFO:tasks.workunit.client.1.smithi170.stdout:0/472: getdents d8/d14 0 2024-02-15T22:51:19.520 INFO:tasks.workunit.client.1.smithi170.stdout:0/473: dread - d8/df/d13/d36/f95 zero size 2024-02-15T22:51:19.522 INFO:tasks.workunit.client.1.smithi170.stdout:0/474: getdents d8 0 2024-02-15T22:51:19.522 INFO:tasks.workunit.client.1.smithi170.stdout:0/475: fdatasync d8/df/d13/f1f 0 2024-02-15T22:51:19.523 INFO:tasks.workunit.client.1.smithi170.stdout:0/476: readlink d8/df/l69 0 2024-02-15T22:51:19.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/520: dwrite d0/d1d/f93 [0,4194304] 0 2024-02-15T22:51:19.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/521: getdents d0/d28/d2f/d37/d58/d78/da4/dc8 0 2024-02-15T22:51:19.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/522: dread - d0/d1/d5f/d74/f94 zero size 2024-02-15T22:51:19.526 INFO:tasks.workunit.client.1.smithi170.stdout:0/477: creat d8/df/d13/d22/d6a/d8f/f9b x:0 0 0 2024-02-15T22:51:19.527 INFO:tasks.workunit.client.1.smithi170.stdout:2/523: creat d0/d28/fcf x:0 0 0 2024-02-15T22:51:19.527 INFO:tasks.workunit.client.1.smithi170.stdout:2/524: chown d0/d28/c47 28496172 1 2024-02-15T22:51:19.529 INFO:tasks.workunit.client.1.smithi170.stdout:2/525: mknod d0/d28/d83/cd0 0 2024-02-15T22:51:19.532 INFO:tasks.workunit.client.1.smithi170.stdout:2/526: creat d0/d1/d5f/fd1 x:0 0 0 2024-02-15T22:51:19.534 INFO:tasks.workunit.client.1.smithi170.stdout:9/442: dwrite de/d1b/d1c/f62 [4194304,4194304] 0 2024-02-15T22:51:19.534 INFO:tasks.workunit.client.1.smithi170.stdout:9/443: truncate de/d1b/d37/f54 554496 0 2024-02-15T22:51:19.534 INFO:tasks.workunit.client.1.smithi170.stdout:2/527: creat d0/d28/d2f/d37/d58/d78/da4/dc8/fd2 x:0 0 0 2024-02-15T22:51:19.535 INFO:tasks.workunit.client.1.smithi170.stdout:7/613: dread da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:19.539 INFO:tasks.workunit.client.1.smithi170.stdout:9/444: creat de/d1b/d1c/d1f/f9b x:0 0 0 2024-02-15T22:51:19.542 INFO:tasks.workunit.client.1.smithi170.stdout:7/614: rename da/d1a/d21/db2 to da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/dd0 0 2024-02-15T22:51:19.542 INFO:tasks.workunit.client.1.smithi170.stdout:7/615: fdatasync da/d1a/d21/fce 0 2024-02-15T22:51:19.544 INFO:tasks.workunit.client.1.smithi170.stdout:1/694: dwrite d3/d24/d2c/f30 [0,4194304] 0 2024-02-15T22:51:19.547 INFO:tasks.workunit.client.1.smithi170.stdout:1/695: symlink d3/lf7 0 2024-02-15T22:51:19.548 INFO:tasks.workunit.client.1.smithi170.stdout:0/478: dwrite d8/d14/d1c/d3f/d51/f65 [0,4194304] 0 2024-02-15T22:51:19.548 INFO:tasks.workunit.client.1.smithi170.stdout:0/479: chown d8/df/d13/f30 181 1 2024-02-15T22:51:19.548 INFO:tasks.workunit.client.1.smithi170.stdout:0/480: truncate d8/d14/d6f/f98 967541 0 2024-02-15T22:51:19.548 INFO:tasks.workunit.client.1.smithi170.stdout:0/481: fdatasync d8/df/d13/f30 0 2024-02-15T22:51:19.550 INFO:tasks.workunit.client.1.smithi170.stdout:2/528: rmdir d0/d28/d2f/d37/d58/d78/da4/dc8 39 2024-02-15T22:51:19.552 INFO:tasks.workunit.client.1.smithi170.stdout:2/529: creat d0/d28/d2f/d9b/fd3 x:0 0 0 2024-02-15T22:51:19.552 INFO:tasks.workunit.client.1.smithi170.stdout:7/616: dread da/d1a/d21/f46 [0,4194304] 0 2024-02-15T22:51:19.555 INFO:tasks.workunit.client.1.smithi170.stdout:1/696: dread d3/f22 [0,4194304] 0 2024-02-15T22:51:19.562 INFO:tasks.workunit.client.1.smithi170.stdout:2/530: write d0/d1/d11/f50 [3294774,37570] 0 2024-02-15T22:51:19.563 INFO:tasks.workunit.client.1.smithi170.stdout:2/531: write d0/d1/d31/f97 [132138,6346] 0 2024-02-15T22:51:19.563 INFO:tasks.workunit.client.1.smithi170.stdout:2/532: dread - d0/d28/d2f/d37/d58/d78/da4/dc8/fd2 zero size 2024-02-15T22:51:19.563 INFO:tasks.workunit.client.1.smithi170.stdout:0/482: symlink d8/df/d13/d22/l9c 0 2024-02-15T22:51:19.567 INFO:tasks.workunit.client.1.smithi170.stdout:1/697: link d3/d24/d2c/l9f d3/d24/d2c/d77/lf8 0 2024-02-15T22:51:19.567 INFO:tasks.workunit.client.1.smithi170.stdout:1/698: dread - d3/d24/d2c/d77/dce/fe1 zero size 2024-02-15T22:51:19.567 INFO:tasks.workunit.client.1.smithi170.stdout:1/699: dread - d3/d24/fd2 zero size 2024-02-15T22:51:19.568 INFO:tasks.workunit.client.1.smithi170.stdout:2/533: mknod d0/d1/cd4 0 2024-02-15T22:51:19.568 INFO:tasks.workunit.client.1.smithi170.stdout:2/534: creat d0/d28/d2f/d37/d58/d78/da4/fd5 x:0 0 0 2024-02-15T22:51:19.572 INFO:tasks.workunit.client.1.smithi170.stdout:2/535: unlink d0/d13/d59/c8d 0 2024-02-15T22:51:19.572 INFO:tasks.workunit.client.1.smithi170.stdout:7/617: dwrite da/d1a/d21/d2c/d74/d87/dac/d7c/fb3 [0,4194304] 0 2024-02-15T22:51:19.573 INFO:tasks.workunit.client.1.smithi170.stdout:1/700: mknod d3/cf9 0 2024-02-15T22:51:19.575 INFO:tasks.workunit.client.1.smithi170.stdout:2/536: symlink d0/d13/d59/d82/ld6 0 2024-02-15T22:51:19.577 INFO:tasks.workunit.client.1.smithi170.stdout:7/618: creat da/d1a/d21/d2c/fd1 x:0 0 0 2024-02-15T22:51:19.578 INFO:tasks.workunit.client.1.smithi170.stdout:1/701: creat d3/d24/d2c/d77/dda/ffa x:0 0 0 2024-02-15T22:51:19.578 INFO:tasks.workunit.client.1.smithi170.stdout:1/702: fsync d3/d24/d2c/d35/f52 0 2024-02-15T22:51:19.581 INFO:tasks.workunit.client.1.smithi170.stdout:7/619: write da/d1a/d21/d2c/d74/f86 [1107703,48982] 0 2024-02-15T22:51:19.581 INFO:tasks.workunit.client.1.smithi170.stdout:7/620: read da/f13 [947016,47546] 0 2024-02-15T22:51:19.581 INFO:tasks.workunit.client.1.smithi170.stdout:7/621: creat da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/fd2 x:0 0 0 2024-02-15T22:51:19.583 INFO:tasks.workunit.client.1.smithi170.stdout:7/622: symlink da/d63/d8d/ld3 0 2024-02-15T22:51:19.583 INFO:tasks.workunit.client.1.smithi170.stdout:7/623: readlink da/d1a/d21/d2c/d74/d87/dac/l67 0 2024-02-15T22:51:19.583 INFO:tasks.workunit.client.1.smithi170.stdout:7/624: fsync da/d1a/d21/d1b/d69/f76 0 2024-02-15T22:51:19.583 INFO:tasks.workunit.client.1.smithi170.stdout:7/625: mkdir da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/dd4 0 2024-02-15T22:51:19.585 INFO:tasks.workunit.client.1.smithi170.stdout:7/626: rename da/d1a/d21/d2c/d74/d87/dac/lb0 to da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/ld5 0 2024-02-15T22:51:19.585 INFO:tasks.workunit.client.1.smithi170.stdout:7/627: stat da/d1a/d21/d1b/f77 0 2024-02-15T22:51:19.586 INFO:tasks.workunit.client.1.smithi170.stdout:6/578: sync 2024-02-15T22:51:19.586 INFO:tasks.workunit.client.1.smithi170.stdout:6/579: dread - d3/d1d/d1b/d3c/fc1 zero size 2024-02-15T22:51:19.587 INFO:tasks.workunit.client.1.smithi170.stdout:6/580: mkdir d3/d24/d31/dc6 0 2024-02-15T22:51:19.588 INFO:tasks.workunit.client.1.smithi170.stdout:6/581: symlink d3/d1d/d1b/d3e/d5d/lc7 0 2024-02-15T22:51:19.591 INFO:tasks.workunit.client.1.smithi170.stdout:6/582: rename d3/d24/l76 to d3/d24/d31/d94/lc8 0 2024-02-15T22:51:19.591 INFO:tasks.workunit.client.1.smithi170.stdout:6/583: fdatasync d3/d1d/d1b/d3e/f88 0 2024-02-15T22:51:19.592 INFO:tasks.workunit.client.1.smithi170.stdout:6/584: rmdir d3/d1d/d53 39 2024-02-15T22:51:19.593 INFO:tasks.workunit.client.1.smithi170.stdout:6/585: creat d3/d1d/d28/d66/fc9 x:0 0 0 2024-02-15T22:51:19.593 INFO:tasks.workunit.client.1.smithi170.stdout:7/628: dread da/d1a/fa1 [0,4194304] 0 2024-02-15T22:51:19.594 INFO:tasks.workunit.client.1.smithi170.stdout:7/629: chown da/d1a/d21/d2c/d74/d87/dac 183349969 1 2024-02-15T22:51:19.594 INFO:tasks.workunit.client.1.smithi170.stdout:6/586: truncate d3/d1a/f5e 1983181 0 2024-02-15T22:51:19.595 INFO:tasks.workunit.client.1.smithi170.stdout:7/630: mkdir da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/d72/dd4/dd6 0 2024-02-15T22:51:19.596 INFO:tasks.workunit.client.1.smithi170.stdout:6/587: creat d3/d1d/d27/d70/da5/fca x:0 0 0 2024-02-15T22:51:19.596 INFO:tasks.workunit.client.1.smithi170.stdout:0/483: dwrite d8/d14/d1c/d3f/d51/f5a [0,4194304] 0 2024-02-15T22:51:19.599 INFO:tasks.workunit.client.1.smithi170.stdout:0/484: truncate d8/df/d13/d22/d39/d55/f8e 1369327 0 2024-02-15T22:51:19.600 INFO:tasks.workunit.client.1.smithi170.stdout:7/631: dread da/fa8 [0,4194304] 0 2024-02-15T22:51:19.600 INFO:tasks.workunit.client.1.smithi170.stdout:7/632: chown da/d1a/d21/d2c/d74/d87/dac/d7c/fba 1249699 1 2024-02-15T22:51:19.602 INFO:tasks.workunit.client.1.smithi170.stdout:1/703: dread d3/d24/f2b [0,4194304] 0 2024-02-15T22:51:19.607 INFO:tasks.workunit.client.1.smithi170.stdout:6/588: dread d3/d1d/d27/fb3 [0,4194304] 0 2024-02-15T22:51:19.608 INFO:tasks.workunit.client.1.smithi170.stdout:2/537: dwrite d0/d1/f9 [4194304,4194304] 0 2024-02-15T22:51:19.608 INFO:tasks.workunit.client.1.smithi170.stdout:7/633: write da/d1a/d21/fae [2071,20379] 0 2024-02-15T22:51:19.608 INFO:tasks.workunit.client.1.smithi170.stdout:7/634: write da/f13 [1889646,108879] 0 2024-02-15T22:51:19.613 INFO:tasks.workunit.client.1.smithi170.stdout:6/589: mkdir d3/d24/d31/dc6/dcb 0 2024-02-15T22:51:19.613 INFO:tasks.workunit.client.1.smithi170.stdout:6/590: stat d3/d1d/d27/fab 0 2024-02-15T22:51:19.613 INFO:tasks.workunit.client.1.smithi170.stdout:6/591: chown d3/d24/lb7 49275 1 2024-02-15T22:51:19.616 INFO:tasks.workunit.client.1.smithi170.stdout:7/635: rmdir da/d1a/d21/d2c/d74/d87/dac/d7c/d7d/dd0 0 2024-02-15T22:51:19.619 INFO:tasks.workunit.client.1.smithi170.stdout:7/636: getdents da/d1a/d21 0 2024-02-15T22:51:19.619 INFO:tasks.workunit.client.1.smithi170.stdout:0/485: dwrite d8/df/d13/f61 [0,4194304] 0 2024-02-15T22:51:19.619 INFO:tasks.workunit.client.1.smithi170.stdout:0/486: rename d8/df/d13/d22 to d8/df/d13/d22/d6a/d9d 22 2024-02-15T22:51:19.622 INFO:tasks.workunit.client.1.smithi170.stdout:7/637: dread da/d57/f7b [0,4194304] 0 2024-02-15T22:51:19.625 INFO:tasks.workunit.client.1.smithi170.stdout:7/638: mknod da/d1a/d21/d2c/d2e/cd7 0 2024-02-15T22:51:19.626 INFO:tasks.workunit.client.1.smithi170.stdout:7/639: mknod da/d57/dcc/cd8 0 2024-02-15T22:51:19.626 INFO:tasks.workunit.client.1.smithi170.stdout:7/640: creat da/d1a/d21/d2c/d2e/fd9 x:0 0 0 2024-02-15T22:51:19.627 INFO:tasks.workunit.client.1.smithi170.stdout:2/538: dwrite d0/d28/d2f/d37/d58/d78/da4/fd5 [0,4194304] 0 2024-02-15T22:51:19.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/487: write d8/d14/d1c/d3f/d51/f5a [3757349,3985] 0 2024-02-15T22:51:19.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/488: write d8/d14/d70/f8a [108322,103917] 0 2024-02-15T22:51:19.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/489: readlink d8/df/d13/l18 0 2024-02-15T22:51:19.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/490: fdatasync d8/f1b 0 2024-02-15T22:51:19.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/491: fsync d8/d14/d6f/f8d 0 2024-02-15T22:51:19.707 INFO:tasks.workunit.client.1.smithi170.stdout:7/641: creat da/d1a/d21/fda x:0 0 0 2024-02-15T22:51:19.707 INFO:tasks.workunit.client.1.smithi170.stdout:7/642: chown da/l37 1174 1 2024-02-15T22:51:19.714 INFO:tasks.workunit.client.1.smithi170.stdout:0/492: link d8/d14/d1c/d3f/d51/f6c d8/df/f9e 0 2024-02-15T22:51:19.723 INFO:tasks.workunit.client.1.smithi170.stdout:7/643: creat da/d1a/d21/d2c/d74/d87/dac/d7c/dc7/fdb x:0 0 0 2024-02-15T22:51:19.742 INFO:tasks.workunit.client.1.smithi170.stdout:0/493: dwrite d8/d14/f63 [0,4194304] 0 2024-02-15T22:51:19.742 INFO:tasks.workunit.client.1.smithi170.stdout:2/539: dwrite d0/d28/d3e/f60 [0,4194304] 0 2024-02-15T22:51:19.742 INFO:tasks.workunit.client.1.smithi170.stdout:7/644: dwrite da/d1a/d21/d1b/d69/f97 [0,4194304] 0 2024-02-15T22:51:19.742 INFO:tasks.workunit.client.1.smithi170.stdout:0/494: mknod d8/d6d/c9f 0 2024-02-15T22:51:19.744 INFO:tasks.workunit.client.1.smithi170.stdout:7/645: mkdir da/d1a/d21/d2c/d71/ddc 0 2024-02-15T22:51:19.745 INFO:tasks.workunit.client.1.smithi170.stdout:0/495: rename d8/df/d90 to d8/d14/d1c/d82/da0 0 2024-02-15T22:51:19.746 INFO:tasks.workunit.client.1.smithi170.stdout:0/496: fdatasync d8/d14/d6f/f88 0 2024-02-15T22:51:19.747 INFO:tasks.workunit.client.1.smithi170.stdout:0/497: mknod d8/df/d13/ca1 0 2024-02-15T22:51:19.749 INFO:tasks.workunit.client.1.smithi170.stdout:0/498: mkdir d8/df/d13/d36/d60/da2 0 2024-02-15T22:51:19.759 INFO:tasks.workunit.client.1.smithi170.stdout:4/569: sync 2024-02-15T22:51:19.759 INFO:tasks.workunit.client.1.smithi170.stdout:7/646: dwrite da/d1a/d21/fae [0,4194304] 0 2024-02-15T22:51:19.761 INFO:tasks.workunit.client.1.smithi170.stdout:4/570: creat d0/d22/da/d11/da2/fae x:0 0 0 2024-02-15T22:51:19.763 INFO:tasks.workunit.client.1.smithi170.stdout:4/571: link d0/d22/da/d8b/d47/d5e/l87 d0/d22/da/d58/laf 0 2024-02-15T22:51:19.765 INFO:tasks.workunit.client.1.smithi170.stdout:4/572: getdents d0/d22/da/d11/d89 0 2024-02-15T22:51:19.765 INFO:tasks.workunit.client.1.smithi170.stdout:4/573: mknod d0/d22/da/d8b/d47/d67/cb0 0 2024-02-15T22:51:19.766 INFO:tasks.workunit.client.1.smithi170.stdout:4/574: mknod d0/d22/da/d8b/d80/cb1 0 2024-02-15T22:51:19.772 INFO:tasks.workunit.client.1.smithi170.stdout:0/499: dwrite d8/df/d13/f2e [0,4194304] 0 2024-02-15T22:51:19.772 INFO:tasks.workunit.client.1.smithi170.stdout:0/500: stat d8/df/d13/f5c 0 2024-02-15T22:51:19.776 INFO:tasks.workunit.client.1.smithi170.stdout:0/501: mknod d8/df/d13/d36/ca3 0 2024-02-15T22:51:19.776 INFO:tasks.workunit.client.1.smithi170.stdout:0/502: dread - d8/df/d13/d22/d39/f4f zero size 2024-02-15T22:51:19.776 INFO:tasks.workunit.client.1.smithi170.stdout:0/503: chown d8/d14/f16 1208135 1 2024-02-15T22:51:19.776 INFO:tasks.workunit.client.1.smithi170.stdout:0/504: stat d8/df/d13/d22/c23 0 2024-02-15T22:51:19.777 INFO:tasks.workunit.client.1.smithi170.stdout:0/505: creat d8/df/d13/d36/d60/da2/fa4 x:0 0 0 2024-02-15T22:51:19.778 INFO:tasks.workunit.client.1.smithi170.stdout:4/575: read d0/d22/da/d8b/d47/d2b/f68 [2902254,56937] 0 2024-02-15T22:51:19.779 INFO:tasks.workunit.client.1.smithi170.stdout:0/506: symlink d8/d14/la5 0 2024-02-15T22:51:19.779 INFO:tasks.workunit.client.1.smithi170.stdout:0/507: creat d8/df/d13/d22/fa6 x:0 0 0 2024-02-15T22:51:19.779 INFO:tasks.workunit.client.1.smithi170.stdout:4/576: write d0/d22/f34 [4754721,47965] 0 2024-02-15T22:51:19.781 INFO:tasks.workunit.client.1.smithi170.stdout:0/508: creat d8/df/d13/d22/d6a/d7e/fa7 x:0 0 0 2024-02-15T22:51:19.782 INFO:tasks.workunit.client.1.smithi170.stdout:4/577: creat d0/d22/da/d8b/fb2 x:0 0 0 2024-02-15T22:51:19.782 INFO:tasks.workunit.client.1.smithi170.stdout:4/578: truncate d0/d22/da/d8b/d47/da9/f91 960267 0 2024-02-15T22:51:19.783 INFO:tasks.workunit.client.1.smithi170.stdout:4/579: mknod d0/d22/cb3 0 2024-02-15T22:51:19.783 INFO:tasks.workunit.client.1.smithi170.stdout:4/580: mkdir d0/d22/da/d8b/d47/db4 0 2024-02-15T22:51:19.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/581: rename d0/d22/da/d8b/d47/d2b/c63 to d0/d22/da/d8b/d47/d5e/d73/cb5 0 2024-02-15T22:51:19.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/582: fsync d0/d22/da/d8b/d47/d2b/f4c 0 2024-02-15T22:51:19.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/583: chown d0/d22/da/d11/d20/c42 140488156 1 2024-02-15T22:51:19.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/584: read d0/d22/da/d8b/f38 [53043,94747] 0 2024-02-15T22:51:19.787 INFO:tasks.workunit.client.1.smithi170.stdout:4/585: rename d0/d22/da/d8b/d47/d2b/l44 to d0/d22/lb6 0 2024-02-15T22:51:19.790 INFO:tasks.workunit.client.1.smithi170.stdout:0/509: write d8/d14/f76 [3711662,47002] 0 2024-02-15T22:51:19.792 INFO:tasks.workunit.client.1.smithi170.stdout:0/510: rename d8/df/d13/d22/f33 to d8/fa8 0 2024-02-15T22:51:19.793 INFO:tasks.workunit.client.1.smithi170.stdout:0/511: link d8/df/d13/f30 d8/df/d13/d22/d71/fa9 0 2024-02-15T22:51:19.795 INFO:tasks.workunit.client.1.smithi170.stdout:0/512: unlink f6 0 2024-02-15T22:51:19.803 INFO:tasks.workunit.client.1.smithi170.stdout:4/586: dwrite d0/d22/da/d8b/d80/f96 [0,4194304] 0 2024-02-15T22:51:19.810 INFO:tasks.workunit.client.1.smithi170.stdout:0/513: rmdir d8/df/d13/d22 39 2024-02-15T22:51:19.810 INFO:tasks.workunit.client.1.smithi170.stdout:0/514: fdatasync d8/d14/d70/f7a 0 2024-02-15T22:51:19.816 INFO:tasks.workunit.client.1.smithi170.stdout:0/515: dread d8/df/f49 [0,4194304] 0 2024-02-15T22:51:19.817 INFO:tasks.workunit.client.1.smithi170.stdout:0/516: write d8/df/d13/d22/d39/d55/f8e [1938098,104691] 0 2024-02-15T22:51:19.818 INFO:tasks.workunit.client.1.smithi170.stdout:0/517: creat d8/d14/d1c/d82/faa x:0 0 0 2024-02-15T22:51:19.818 INFO:tasks.workunit.client.1.smithi170.stdout:0/518: getdents d8/d14/d1c/d82/da0 0 2024-02-15T22:51:19.818 INFO:tasks.workunit.client.1.smithi170.stdout:0/519: unlink d8/df/d13/d22/d39/f8c 0 2024-02-15T22:51:19.820 INFO:tasks.workunit.client.1.smithi170.stdout:0/520: rename d8/df/d13/d22/d6a/d7e/fa7 to d8/df/d13/d22/d6a/fab 0 2024-02-15T22:51:19.820 INFO:tasks.workunit.client.1.smithi170.stdout:4/587: dwrite d0/d22/da/d8b/d47/d67/f7a [0,4194304] 0 2024-02-15T22:51:19.836 INFO:tasks.workunit.client.1.smithi170.stdout:0/521: dwrite d8/df/d13/d22/d6a/d8f/f9b [0,4194304] 0 2024-02-15T22:51:19.836 INFO:tasks.workunit.client.1.smithi170.stdout:0/522: truncate d8/df/d13/d22/d6a/fab 813210 0 2024-02-15T22:51:19.839 INFO:tasks.workunit.client.1.smithi170.stdout:4/588: dwrite d0/d22/da/d11/f26 [0,4194304] 0 2024-02-15T22:51:19.843 INFO:tasks.workunit.client.1.smithi170.stdout:4/589: rmdir d0/d22/da/d8b/d80 39 2024-02-15T22:51:19.844 INFO:tasks.workunit.client.1.smithi170.stdout:0/523: write d8/d14/d1c/d3f/d51/f65 [320044,72373] 0 2024-02-15T22:51:19.844 INFO:tasks.workunit.client.1.smithi170.stdout:0/524: stat d8/d14/f16 0 2024-02-15T22:51:19.852 INFO:tasks.workunit.client.1.smithi170.stdout:0/525: dread d8/d14/f16 [0,4194304] 0 2024-02-15T22:51:19.854 INFO:tasks.workunit.client.1.smithi170.stdout:8/430: sync 2024-02-15T22:51:19.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/431: creat d9/d18/d32/f88 x:0 0 0 2024-02-15T22:51:19.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/432: chown d9/d18/l87 39141456 1 2024-02-15T22:51:19.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/433: write d9/d18/d32/d3b/f41 [1259937,18056] 0 2024-02-15T22:51:19.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/590: dwrite d0/d22/da/d8b/d47/d67/f7a [0,4194304] 0 2024-02-15T22:51:19.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/591: write d0/d22/da/d11/d20/d49/f53 [4976665,113764] 0 2024-02-15T22:51:19.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/592: fdatasync d0/d22/da/d8b/d47/da9/f91 0 2024-02-15T22:51:19.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/593: chown d0/d9f/la3 60494467 1 2024-02-15T22:51:19.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/594: read d0/d22/da/d11/f45 [6406042,70307] 0 2024-02-15T22:51:19.878 INFO:tasks.workunit.client.1.smithi170.stdout:0/526: dwrite d8/d14/f1a [4194304,4194304] 0 2024-02-15T22:51:19.879 INFO:tasks.workunit.client.1.smithi170.stdout:8/434: dwrite d9/d18/d32/d3b/f40 [0,4194304] 0 2024-02-15T22:51:19.879 INFO:tasks.workunit.client.1.smithi170.stdout:8/435: readlink d9/d18/d32/l34 0 2024-02-15T22:51:19.879 INFO:tasks.workunit.client.1.smithi170.stdout:8/436: symlink d9/d18/d32/d7a/d78/l89 0 2024-02-15T22:51:19.880 INFO:tasks.workunit.client.1.smithi170.stdout:8/437: fsync d9/d18/d26/f3c 0 2024-02-15T22:51:19.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/438: rename d9/c30 to d9/d18/d32/d3b/d42/c8a 0 2024-02-15T22:51:19.882 INFO:tasks.workunit.client.1.smithi170.stdout:8/439: mknod d9/d18/d32/d7a/c8b 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/527: dread d8/d14/d1c/f2b [0,4194304] 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/528: chown d8/df/d13/d22/d6a/d7e 40 1 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:8/440: symlink d9/d18/l8c 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/529: write d8/d14/d70/f87 [767920,87170] 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/530: read - d8/df/d13/f85 zero size 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/531: rename d8/d14 to d8/d14/d1c/d82/da0/dac 22 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/532: fdatasync d8/df/d13/d22/d71/f7b 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:8/441: mknod d9/d18/d32/d3b/d4b/c8d 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:8/442: fdatasync d9/d18/d32/d3b/f41 0 2024-02-15T22:51:19.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/533: mknod d8/df/d13/d22/cad 0 2024-02-15T22:51:19.886 INFO:tasks.workunit.client.1.smithi170.stdout:8/443: creat d9/d18/d32/d3b/d68/f8e x:0 0 0 2024-02-15T22:51:19.889 INFO:tasks.workunit.client.1.smithi170.stdout:8/444: read d9/d18/d32/d3b/d4b/f5e [2441468,40889] 0 2024-02-15T22:51:19.889 INFO:tasks.workunit.client.1.smithi170.stdout:8/445: chown d9/d18/d48/f5b 1991064613 1 2024-02-15T22:51:19.889 INFO:tasks.workunit.client.1.smithi170.stdout:8/446: creat d9/d18/d32/d3b/d4b/f8f x:0 0 0 2024-02-15T22:51:19.889 INFO:tasks.workunit.client.1.smithi170.stdout:8/447: fsync d9/d18/f86 0 2024-02-15T22:51:19.905 INFO:tasks.workunit.client.1.smithi170.stdout:0/534: dwrite d8/d14/d70/f8a [0,4194304] 0 2024-02-15T22:51:19.907 INFO:tasks.workunit.client.1.smithi170.stdout:0/535: mknod d8/df/d13/d22/d6a/d8f/cae 0 2024-02-15T22:51:20.003 INFO:tasks.workunit.client.1.smithi170.stdout:3/489: sync 2024-02-15T22:51:20.004 INFO:tasks.workunit.client.1.smithi170.stdout:3/490: unlink d3/dc/d1c/l2e 0 2024-02-15T22:51:20.020 INFO:tasks.workunit.client.1.smithi170.stdout:3/491: dwrite d3/dc/d13/f28 [0,4194304] 0 2024-02-15T22:51:20.021 INFO:tasks.workunit.client.1.smithi170.stdout:3/492: rename d3/dc/d1c/d26/f52 to d3/dc/f9d 0 2024-02-15T22:51:20.021 INFO:tasks.workunit.client.1.smithi170.stdout:3/493: readlink d3/d1b/d2c/l6d 0 2024-02-15T22:51:20.021 INFO:tasks.workunit.client.1.smithi170.stdout:3/494: creat d3/dc/d1c/d3d/f9e x:0 0 0 2024-02-15T22:51:20.023 INFO:tasks.workunit.client.1.smithi170.stdout:3/495: unlink d3/d1b/d2c/f50 0 2024-02-15T22:51:20.036 INFO:tasks.workunit.client.1.smithi170.stdout:3/496: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:20.037 INFO:tasks.workunit.client.1.smithi170.stdout:3/497: mkdir d3/dc/d1a/d9f 0 2024-02-15T22:51:20.037 INFO:tasks.workunit.client.1.smithi170.stdout:3/498: write d3/f3f [5471018,108978] 0 2024-02-15T22:51:20.053 INFO:tasks.workunit.client.1.smithi170.stdout:3/499: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:20.054 INFO:tasks.workunit.client.1.smithi170.stdout:3/500: write d3/d1b/d51/d6b/f91 [285702,119356] 0 2024-02-15T22:51:20.054 INFO:tasks.workunit.client.1.smithi170.stdout:3/501: write d3/f5 [4800436,10117] 0 2024-02-15T22:51:20.062 INFO:tasks.workunit.client.1.smithi170.stdout:3/502: truncate d3/db/f35 2239164 0 2024-02-15T22:51:20.063 INFO:tasks.workunit.client.1.smithi170.stdout:3/503: rename d3/dc/d1c/d26/d55/d7d/l97 to d3/dc/d1c/d26/la0 0 2024-02-15T22:51:20.065 INFO:tasks.workunit.client.1.smithi170.stdout:3/504: creat d3/db/d1f/fa1 x:0 0 0 2024-02-15T22:51:20.066 INFO:tasks.workunit.client.1.smithi170.stdout:3/505: write d3/dc/d1c/d3d/f80 [164622,112537] 0 2024-02-15T22:51:20.066 INFO:tasks.workunit.client.1.smithi170.stdout:3/506: chown d3/dc/d13 0 1 2024-02-15T22:51:20.066 INFO:tasks.workunit.client.1.smithi170.stdout:3/507: mknod d3/db/d1f/d61/ca2 0 2024-02-15T22:51:20.066 INFO:tasks.workunit.client.1.smithi170.stdout:3/508: chown d3/dc/d1c/d26 107540351 1 2024-02-15T22:51:20.070 INFO:tasks.workunit.client.1.smithi170.stdout:3/509: dread d3/dc/d1c/d3d/f80 [0,4194304] 0 2024-02-15T22:51:20.072 INFO:tasks.workunit.client.1.smithi170.stdout:3/510: dread d3/db/d1f/f41 [0,4194304] 0 2024-02-15T22:51:20.072 INFO:tasks.workunit.client.1.smithi170.stdout:3/511: read - d3/dc/d1c/d3d/f96 zero size 2024-02-15T22:51:20.072 INFO:tasks.workunit.client.1.smithi170.stdout:3/512: chown d3/dc/d1c/d26 3586282 1 2024-02-15T22:51:20.072 INFO:tasks.workunit.client.1.smithi170.stdout:3/513: chown d3/d78/d7a/c84 14234726 1 2024-02-15T22:51:20.072 INFO:tasks.workunit.client.1.smithi170.stdout:3/514: stat d3/dc/ff 0 2024-02-15T22:51:20.073 INFO:tasks.workunit.client.1.smithi170.stdout:3/515: creat d3/d1b/d8a/fa3 x:0 0 0 2024-02-15T22:51:20.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/516: creat d3/db/fa4 x:0 0 0 2024-02-15T22:51:20.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/517: chown d3/d1b/d51/d6b/c6f 161 1 2024-02-15T22:51:20.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/518: fsync d3/dc/d1c/f48 0 2024-02-15T22:51:20.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/519: chown d3/db/d1f/d61 56338941 1 2024-02-15T22:51:20.077 INFO:tasks.workunit.client.1.smithi170.stdout:3/520: rename d3/d1b/d81 to d3/d1b/d2c/d92/da5 0 2024-02-15T22:51:20.077 INFO:tasks.workunit.client.1.smithi170.stdout:3/521: truncate d3/d1b/d2c/d92/da5/f8b 125961 0 2024-02-15T22:51:20.080 INFO:tasks.workunit.client.1.smithi170.stdout:3/522: read d3/dc/f9d [444844,14032] 0 2024-02-15T22:51:20.080 INFO:tasks.workunit.client.1.smithi170.stdout:3/523: readlink d3/dc/d1c/l82 0 2024-02-15T22:51:20.080 INFO:tasks.workunit.client.1.smithi170.stdout:3/524: write d3/db/d1f/fa1 [278389,89947] 0 2024-02-15T22:51:20.081 INFO:tasks.workunit.client.1.smithi170.stdout:3/525: truncate d3/dc/d1c/d26/f46 606743 0 2024-02-15T22:51:20.082 INFO:tasks.workunit.client.1.smithi170.stdout:3/526: dread d3/db/f11 [0,4194304] 0 2024-02-15T22:51:20.089 INFO:tasks.workunit.client.1.smithi170.stdout:3/527: dread d3/db/d1f/f4e [0,4194304] 0 2024-02-15T22:51:20.091 INFO:tasks.workunit.client.1.smithi170.stdout:3/528: rename d3/dc/d13/c32 to d3/d1b/d51/d94/ca6 0 2024-02-15T22:51:20.093 INFO:tasks.workunit.client.1.smithi170.stdout:3/529: mknod d3/dc/d1a/d9f/ca7 0 2024-02-15T22:51:20.094 INFO:tasks.workunit.client.1.smithi170.stdout:3/530: getdents d3/dc/d1c 0 2024-02-15T22:51:20.097 INFO:tasks.workunit.client.1.smithi170.stdout:3/531: read d3/dc/d1c/d26/f46 [103466,69281] 0 2024-02-15T22:51:20.097 INFO:tasks.workunit.client.1.smithi170.stdout:3/532: write d3/dc/d1c/f64 [483442,12361] 0 2024-02-15T22:51:20.100 INFO:tasks.workunit.client.1.smithi170.stdout:3/533: dread d3/f72 [0,4194304] 0 2024-02-15T22:51:20.118 INFO:tasks.workunit.client.1.smithi170.stdout:3/534: dwrite d3/dc/d1c/d3d/f9e [0,4194304] 0 2024-02-15T22:51:20.118 INFO:tasks.workunit.client.1.smithi170.stdout:3/535: creat d3/db/fa8 x:0 0 0 2024-02-15T22:51:20.118 INFO:tasks.workunit.client.1.smithi170.stdout:3/536: fdatasync d3/db/f11 0 2024-02-15T22:51:20.120 INFO:tasks.workunit.client.1.smithi170.stdout:3/537: mkdir d3/dc/d1c/d3d/d5d/da9 0 2024-02-15T22:51:20.120 INFO:tasks.workunit.client.1.smithi170.stdout:3/538: chown d3/dc/d1a 5 1 2024-02-15T22:51:20.135 INFO:tasks.workunit.client.1.smithi170.stdout:3/539: dwrite d3/dc/f1d [0,4194304] 0 2024-02-15T22:51:20.135 INFO:tasks.workunit.client.1.smithi170.stdout:3/540: creat d3/d1b/d8a/faa x:0 0 0 2024-02-15T22:51:20.135 INFO:tasks.workunit.client.1.smithi170.stdout:3/541: write d3/dc/d1c/f73 [616476,54401] 0 2024-02-15T22:51:20.144 INFO:tasks.workunit.client.1.smithi170.stdout:1/704: sync 2024-02-15T22:51:20.144 INFO:tasks.workunit.client.1.smithi170.stdout:9/445: sync 2024-02-15T22:51:20.144 INFO:tasks.workunit.client.1.smithi170.stdout:5/622: sync 2024-02-15T22:51:20.144 INFO:tasks.workunit.client.1.smithi170.stdout:1/705: stat d3/d24/d2c/l9f 0 2024-02-15T22:51:20.144 INFO:tasks.workunit.client.1.smithi170.stdout:1/706: truncate d3/da2/d65/f69 990182 0 2024-02-15T22:51:20.145 INFO:tasks.workunit.client.1.smithi170.stdout:9/446: write de/d1b/d1c/d1f/d20/d27/f66 [1031418,117975] 0 2024-02-15T22:51:20.146 INFO:tasks.workunit.client.1.smithi170.stdout:9/447: creat de/f9c x:0 0 0 2024-02-15T22:51:20.147 INFO:tasks.workunit.client.1.smithi170.stdout:1/707: getdents d3/da2 0 2024-02-15T22:51:20.147 INFO:tasks.workunit.client.1.smithi170.stdout:1/708: dread - d3/d24/d2c/d77/dce/fe1 zero size 2024-02-15T22:51:20.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/448: creat de/d1b/d1c/d1f/d20/d27/d2c/f9d x:0 0 0 2024-02-15T22:51:20.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/449: chown de/l13 26697 1 2024-02-15T22:51:20.148 INFO:tasks.workunit.client.1.smithi170.stdout:1/709: mknod d3/d24/d2c/d94/cfb 0 2024-02-15T22:51:20.148 INFO:tasks.workunit.client.1.smithi170.stdout:1/710: dread - d3/d24/d2c/d35/d83/fee zero size 2024-02-15T22:51:20.150 INFO:tasks.workunit.client.1.smithi170.stdout:9/450: dread de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [0,4194304] 0 2024-02-15T22:51:20.150 INFO:tasks.workunit.client.1.smithi170.stdout:1/711: rename d3/d24/d2c/d35/f40 to d3/d24/d2c/ffc 0 2024-02-15T22:51:20.151 INFO:tasks.workunit.client.1.smithi170.stdout:1/712: write d3/d24/d2c/d35/d83/fee [932275,81302] 0 2024-02-15T22:51:20.151 INFO:tasks.workunit.client.1.smithi170.stdout:1/713: write d3/d24/d2c/d35/d83/fde [260382,104896] 0 2024-02-15T22:51:20.152 INFO:tasks.workunit.client.1.smithi170.stdout:9/451: mknod de/d1b/d1c/d1f/d20/d27/c9e 0 2024-02-15T22:51:20.163 INFO:tasks.workunit.client.1.smithi170.stdout:5/623: dwrite de/d10/d27/d4c/d53/d55/d95/fae [0,4194304] 0 2024-02-15T22:51:20.165 INFO:tasks.workunit.client.1.smithi170.stdout:5/624: symlink de/d10/d7d/db8/dbc/ld9 0 2024-02-15T22:51:20.180 INFO:tasks.workunit.client.1.smithi170.stdout:5/625: dread fd [0,4194304] 0 2024-02-15T22:51:20.180 INFO:tasks.workunit.client.1.smithi170.stdout:5/626: truncate de/d10/d27/d2d/fa2 150980 0 2024-02-15T22:51:20.181 INFO:tasks.workunit.client.1.smithi170.stdout:5/627: mknod de/d10/d33/db2/cda 0 2024-02-15T22:51:20.182 INFO:tasks.workunit.client.1.smithi170.stdout:5/628: symlink de/d10/d27/d2d/ldb 0 2024-02-15T22:51:20.185 INFO:tasks.workunit.client.1.smithi170.stdout:1/714: dwrite d3/d24/d2c/d77/fe5 [0,4194304] 0 2024-02-15T22:51:20.188 INFO:tasks.workunit.client.1.smithi170.stdout:9/452: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f5a [0,4194304] 0 2024-02-15T22:51:20.189 INFO:tasks.workunit.client.1.smithi170.stdout:9/453: rmdir de/d1b/d1c/d1f/d20/d27 39 2024-02-15T22:51:20.196 INFO:tasks.workunit.client.1.smithi170.stdout:9/454: unlink de/d1b/d1c/d1f/d20/d27/f66 0 2024-02-15T22:51:20.197 INFO:tasks.workunit.client.1.smithi170.stdout:9/455: truncate de/d1b/f2b 1470618 0 2024-02-15T22:51:20.200 INFO:tasks.workunit.client.1.smithi170.stdout:5/629: dwrite de/d10/d7d/db8/fd5 [0,4194304] 0 2024-02-15T22:51:20.212 INFO:tasks.workunit.client.1.smithi170.stdout:5/630: write de/f3f [22089,10948] 0 2024-02-15T22:51:20.220 INFO:tasks.workunit.client.1.smithi170.stdout:9/456: dwrite de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [0,4194304] 0 2024-02-15T22:51:20.222 INFO:tasks.workunit.client.1.smithi170.stdout:9/457: unlink de/d1b/d37/f54 0 2024-02-15T22:51:20.244 INFO:tasks.workunit.client.1.smithi170.stdout:5/631: dwrite de/d10/d27/d4c/d53/f63 [0,4194304] 0 2024-02-15T22:51:20.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/458: dwrite de/d1b/d1c/d1f/d20/d8c/f8d [0,4194304] 0 2024-02-15T22:51:20.245 INFO:tasks.workunit.client.1.smithi170.stdout:5/632: creat de/d10/fdc x:0 0 0 2024-02-15T22:51:20.249 INFO:tasks.workunit.client.1.smithi170.stdout:5/633: unlink de/d10/d27/d2d/fa2 0 2024-02-15T22:51:20.249 INFO:tasks.workunit.client.1.smithi170.stdout:5/634: write de/d10/d27/d2d/f98 [627946,5410] 0 2024-02-15T22:51:20.258 INFO:tasks.workunit.client.1.smithi170.stdout:9/459: read de/d1b/d1c/f62 [4754426,31373] 0 2024-02-15T22:51:20.259 INFO:tasks.workunit.client.1.smithi170.stdout:9/460: creat de/d1b/f9f x:0 0 0 2024-02-15T22:51:20.259 INFO:tasks.workunit.client.1.smithi170.stdout:9/461: chown de/d1b/d1c/c59 7733055 1 2024-02-15T22:51:20.260 INFO:tasks.workunit.client.1.smithi170.stdout:9/462: truncate de/d1b/d1c/f2d 3066361 0 2024-02-15T22:51:20.260 INFO:tasks.workunit.client.1.smithi170.stdout:9/463: fsync de/d1b/f7e 0 2024-02-15T22:51:20.261 INFO:tasks.workunit.client.1.smithi170.stdout:5/635: dwrite de/d10/da8/fd4 [0,4194304] 0 2024-02-15T22:51:20.265 INFO:tasks.workunit.client.1.smithi170.stdout:5/636: symlink de/d10/d7d/db8/ldd 0 2024-02-15T22:51:20.267 INFO:tasks.workunit.client.1.smithi170.stdout:5/637: creat de/d29/fde x:0 0 0 2024-02-15T22:51:20.267 INFO:tasks.workunit.client.1.smithi170.stdout:9/464: dread de/f18 [0,4194304] 0 2024-02-15T22:51:20.268 INFO:tasks.workunit.client.1.smithi170.stdout:9/465: rename de/d1b/d1c/d1f/d20/d27/d28 to de/d1b/d1c/d1f/d20/d27/d28/da0 22 2024-02-15T22:51:20.268 INFO:tasks.workunit.client.1.smithi170.stdout:9/466: write de/d1b/d1c/d1f/d20/d78/f8b [711090,29917] 0 2024-02-15T22:51:20.270 INFO:tasks.workunit.client.1.smithi170.stdout:9/467: rename de/d1b/d1c/c3c to de/d1b/d1c/d1f/d20/d27/d28/ca1 0 2024-02-15T22:51:20.270 INFO:tasks.workunit.client.1.smithi170.stdout:9/468: fdatasync de/d1b/d1c/d1f/d20/f22 0 2024-02-15T22:51:20.270 INFO:tasks.workunit.client.1.smithi170.stdout:9/469: read - de/d8e/f96 zero size 2024-02-15T22:51:20.275 INFO:tasks.workunit.client.1.smithi170.stdout:5/638: dread de/d10/d33/d67/fa3 [0,4194304] 0 2024-02-15T22:51:20.276 INFO:tasks.workunit.client.1.smithi170.stdout:5/639: truncate de/d10/d52/f93 599936 0 2024-02-15T22:51:20.278 INFO:tasks.workunit.client.1.smithi170.stdout:9/470: write de/d1b/f6a [1997664,37465] 0 2024-02-15T22:51:20.278 INFO:tasks.workunit.client.1.smithi170.stdout:5/640: creat de/d10/d33/d9f/d7c/d87/fdf x:0 0 0 2024-02-15T22:51:20.278 INFO:tasks.workunit.client.1.smithi170.stdout:5/641: fdatasync de/d10/f23 0 2024-02-15T22:51:20.278 INFO:tasks.workunit.client.1.smithi170.stdout:5/642: chown de/d10/d33/fa9 11 1 2024-02-15T22:51:20.278 INFO:tasks.workunit.client.1.smithi170.stdout:5/643: fsync de/d10/f13 0 2024-02-15T22:51:20.281 INFO:tasks.workunit.client.1.smithi170.stdout:9/471: dread de/d1b/f25 [0,4194304] 0 2024-02-15T22:51:20.281 INFO:tasks.workunit.client.1.smithi170.stdout:9/472: write de/d1b/d1c/d1f/d20/d27/d2c/f44 [142313,87063] 0 2024-02-15T22:51:20.287 INFO:tasks.workunit.client.1.smithi170.stdout:9/473: write fb [1697835,103911] 0 2024-02-15T22:51:20.288 INFO:tasks.workunit.client.1.smithi170.stdout:5/644: dread de/f1a [0,4194304] 0 2024-02-15T22:51:20.288 INFO:tasks.workunit.client.1.smithi170.stdout:5/645: dread - de/d36/d80/dc2/fce zero size 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:4/595: sync 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:6/592: sync 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:7/647: sync 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:8/448: sync 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:2/540: sync 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:8/449: chown d9/d18/l1f 6444 1 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:8/450: readlink d9/d18/d48/l70 0 2024-02-15T22:51:20.290 INFO:tasks.workunit.client.1.smithi170.stdout:8/451: chown d9/d18/d32/d3b 35 1 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:0/536: sync 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:4/596: write d0/d22/da/d8b/d47/d2b/f52 [2280157,80046] 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:5/646: symlink de/d10/d7d/le0 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:6/593: dread d3/d1d/d1b/d3e/d5d/fbf [0,4194304] 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:6/594: readlink d3/d24/l65 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:9/474: link de/d1b/f9f de/d1b/d1c/d1f/d20/d27/d28/fa2 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:9/475: stat de/d1b/d1c/d1f/d20/d27/d2c/c6d 0 2024-02-15T22:51:20.291 INFO:tasks.workunit.client.1.smithi170.stdout:7/648: mknod da/d1a/d21/d2c/d2e/cdd 0 2024-02-15T22:51:20.292 INFO:tasks.workunit.client.1.smithi170.stdout:0/537: mknod d8/df/d13/d22/d6a/d7e/caf 0 2024-02-15T22:51:20.293 INFO:tasks.workunit.client.1.smithi170.stdout:4/597: creat d0/d22/da/d8b/d47/d67/d77/fb7 x:0 0 0 2024-02-15T22:51:20.293 INFO:tasks.workunit.client.1.smithi170.stdout:4/598: readlink d0/d22/da/d8b/l37 0 2024-02-15T22:51:20.293 INFO:tasks.workunit.client.1.smithi170.stdout:4/599: write d0/d22/da/d8b/d47/d5e/d7d/f9c [454047,56389] 0 2024-02-15T22:51:20.294 INFO:tasks.workunit.client.1.smithi170.stdout:5/647: unlink de/l2f 0 2024-02-15T22:51:20.298 INFO:tasks.workunit.client.1.smithi170.stdout:6/595: write d3/d1d/f9f [1202107,114471] 0 2024-02-15T22:51:20.298 INFO:tasks.workunit.client.1.smithi170.stdout:6/596: chown d3/d1d/d27/f43 1819242 1 2024-02-15T22:51:20.300 INFO:tasks.workunit.client.1.smithi170.stdout:0/538: link d8/d14/d1c/d3f/l7d d8/d14/d1c/d82/lb0 0 2024-02-15T22:51:20.301 INFO:tasks.workunit.client.1.smithi170.stdout:4/600: symlink d0/d22/da/d8b/d47/da9/lb8 0 2024-02-15T22:51:20.302 INFO:tasks.workunit.client.1.smithi170.stdout:5/648: link de/d10/d27/c81 de/d10/d27/d4c/d53/ce1 0 2024-02-15T22:51:20.302 INFO:tasks.workunit.client.1.smithi170.stdout:5/649: readlink de/d29/l68 0 2024-02-15T22:51:20.303 INFO:tasks.workunit.client.1.smithi170.stdout:0/539: dread d8/d14/d6f/f8d [0,4194304] 0 2024-02-15T22:51:20.303 INFO:tasks.workunit.client.1.smithi170.stdout:9/476: unlink de/f4e 0 2024-02-15T22:51:20.304 INFO:tasks.workunit.client.1.smithi170.stdout:9/477: chown de/d1b/d1c/d1f/d20/d27/d28/f98 11 1 2024-02-15T22:51:20.304 INFO:tasks.workunit.client.1.smithi170.stdout:6/597: symlink d3/d24/d31/lcc 0 2024-02-15T22:51:20.304 INFO:tasks.workunit.client.1.smithi170.stdout:6/598: fsync d3/d1a/f40 0 2024-02-15T22:51:20.305 INFO:tasks.workunit.client.1.smithi170.stdout:2/541: rename d0/d28 to d0/d1/d89/dd7 0 2024-02-15T22:51:20.307 INFO:tasks.workunit.client.1.smithi170.stdout:0/540: symlink d8/d14/d1c/lb1 0 2024-02-15T22:51:20.308 INFO:tasks.workunit.client.1.smithi170.stdout:6/599: symlink d3/d1d/d27/dc5/lcd 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:8/452: rename d9/d18/d32/f88 to d9/d18/d32/d3b/f90 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:8/453: fdatasync d9/d18/d32/d3b/f40 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:8/454: stat d9/f46 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:8/455: write d9/d18/d32/d3b/d42/f74 [10419,97769] 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:8/456: chown d9/d18/f7e 39824743 1 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:2/542: mknod d0/d1d/d3d/cd8 0 2024-02-15T22:51:20.310 INFO:tasks.workunit.client.1.smithi170.stdout:2/543: fsync d0/d2a/fb5 0 2024-02-15T22:51:20.311 INFO:tasks.workunit.client.1.smithi170.stdout:4/601: getdents d0/d22/da/d8b/d47 0 2024-02-15T22:51:20.311 INFO:tasks.workunit.client.1.smithi170.stdout:4/602: write d0/d22/da/d11/d20/f82 [358753,111663] 0 2024-02-15T22:51:20.311 INFO:tasks.workunit.client.1.smithi170.stdout:4/603: getdents d0/d22/da8 0 2024-02-15T22:51:20.313 INFO:tasks.workunit.client.1.smithi170.stdout:0/541: creat d8/d14/d1c/d3f/d53/fb2 x:0 0 0 2024-02-15T22:51:20.315 INFO:tasks.workunit.client.1.smithi170.stdout:9/478: symlink de/d1b/d1c/d1f/d20/d27/d28/la3 0 2024-02-15T22:51:20.321 INFO:tasks.workunit.client.1.smithi170.stdout:8/457: getdents d9/d18/d32/d7a/d78/d7f 0 2024-02-15T22:51:20.322 INFO:tasks.workunit.client.1.smithi170.stdout:8/458: truncate d9/d18/d32/d3b/d68/f8e 349907 0 2024-02-15T22:51:20.324 INFO:tasks.workunit.client.1.smithi170.stdout:4/604: mkdir d0/d22/db9 0 2024-02-15T22:51:20.325 INFO:tasks.workunit.client.1.smithi170.stdout:9/479: mknod de/d1b/d1c/d1f/d20/ca4 0 2024-02-15T22:51:20.330 INFO:tasks.workunit.client.1.smithi170.stdout:2/544: dwrite d0/d2a/fb5 [0,4194304] 0 2024-02-15T22:51:20.332 INFO:tasks.workunit.client.1.smithi170.stdout:8/459: getdents d9/d18/d32/d3b/d42 0 2024-02-15T22:51:20.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/605: link d0/d22/f34 d0/d22/da/d8b/d47/d2b/fba 0 2024-02-15T22:51:20.333 INFO:tasks.workunit.client.1.smithi170.stdout:4/606: fdatasync d0/d22/da/d8b/d47/f8e 0 2024-02-15T22:51:20.335 INFO:tasks.workunit.client.1.smithi170.stdout:9/480: truncate de/d1b/d1c/f62 6766629 0 2024-02-15T22:51:20.338 INFO:tasks.workunit.client.1.smithi170.stdout:7/649: rename da/d1a/d21/d2c/d74/d87/dac/d7c to da/d1a/d21/d2c/d74/dde 0 2024-02-15T22:51:20.345 INFO:tasks.workunit.client.1.smithi170.stdout:8/460: write d9/fd [1956147,110021] 0 2024-02-15T22:51:20.346 INFO:tasks.workunit.client.1.smithi170.stdout:9/481: mkdir de/d1b/d37/da5 0 2024-02-15T22:51:20.347 INFO:tasks.workunit.client.1.smithi170.stdout:7/650: dread da/f64 [0,4194304] 0 2024-02-15T22:51:20.349 INFO:tasks.workunit.client.1.smithi170.stdout:4/607: dwrite d0/d22/da/d11/d20/f4d [0,4194304] 0 2024-02-15T22:51:20.350 INFO:tasks.workunit.client.1.smithi170.stdout:5/650: rename de/f4b to de/d10/d52/fe2 0 2024-02-15T22:51:20.350 INFO:tasks.workunit.client.1.smithi170.stdout:6/600: rename d3/d1d/d36 to d3/d1d/d36/d56/d6c/dce 22 2024-02-15T22:51:20.351 INFO:tasks.workunit.client.1.smithi170.stdout:6/601: fdatasync f2 0 2024-02-15T22:51:20.351 INFO:tasks.workunit.client.1.smithi170.stdout:6/602: fsync d3/d1d/fb5 0 2024-02-15T22:51:20.351 INFO:tasks.workunit.client.1.smithi170.stdout:5/651: fdatasync de/d29/f61 0 2024-02-15T22:51:20.351 INFO:tasks.workunit.client.1.smithi170.stdout:5/652: write de/d36/f5e [4893127,66740] 0 2024-02-15T22:51:20.354 INFO:tasks.workunit.client.1.smithi170.stdout:2/545: unlink d0/d1d/l3c 0 2024-02-15T22:51:20.356 INFO:tasks.workunit.client.1.smithi170.stdout:7/651: mknod da/d1a/d21/d2c/d71/ddc/cdf 0 2024-02-15T22:51:20.357 INFO:tasks.workunit.client.1.smithi170.stdout:1/715: sync 2024-02-15T22:51:20.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/542: sync 2024-02-15T22:51:20.357 INFO:tasks.workunit.client.1.smithi170.stdout:1/716: chown d3/d24/d2c/d35/df4 422347 1 2024-02-15T22:51:20.357 INFO:tasks.workunit.client.1.smithi170.stdout:1/717: fsync d3/da2/fac 0 2024-02-15T22:51:20.363 INFO:tasks.workunit.client.1.smithi170.stdout:6/603: creat d3/d1d/d36/d56/d6c/dc4/fcf x:0 0 0 2024-02-15T22:51:20.364 INFO:tasks.workunit.client.1.smithi170.stdout:2/546: write d0/d13/fa8 [139178,86894] 0 2024-02-15T22:51:20.364 INFO:tasks.workunit.client.1.smithi170.stdout:2/547: truncate d0/d1/f6f 1544155 0 2024-02-15T22:51:20.365 INFO:tasks.workunit.client.1.smithi170.stdout:9/482: dread de/d1b/d1c/f2d [0,4194304] 0 2024-02-15T22:51:20.366 INFO:tasks.workunit.client.1.smithi170.stdout:7/652: truncate da/d1a/f27 2093939 0 2024-02-15T22:51:20.370 INFO:tasks.workunit.client.1.smithi170.stdout:8/461: dwrite d9/d18/d32/d3b/f41 [0,4194304] 0 2024-02-15T22:51:20.370 INFO:tasks.workunit.client.1.smithi170.stdout:3/543: creat d3/dc/d1a/fab x:0 0 0 2024-02-15T22:51:20.372 INFO:tasks.workunit.client.1.smithi170.stdout:6/604: creat d3/d24/fd0 x:0 0 0 2024-02-15T22:51:20.375 INFO:tasks.workunit.client.1.smithi170.stdout:2/548: symlink d0/d1/d89/dd7/d2f/d37/d58/ld9 0 2024-02-15T22:51:20.380 INFO:tasks.workunit.client.1.smithi170.stdout:8/462: rename d9/l4e to d9/d18/d32/d7a/d78/l91 0 2024-02-15T22:51:20.381 INFO:tasks.workunit.client.1.smithi170.stdout:6/605: write d3/d1d/d36/f14 [4003090,31929] 0 2024-02-15T22:51:20.381 INFO:tasks.workunit.client.1.smithi170.stdout:6/606: dread - d3/d24/fd0 zero size 2024-02-15T22:51:20.381 INFO:tasks.workunit.client.1.smithi170.stdout:6/607: truncate d3/d1d/d27/fa2 917064 0 2024-02-15T22:51:20.382 INFO:tasks.workunit.client.1.smithi170.stdout:3/544: link d3/dc/d1c/f83 d3/d1b/d8a/fac 0 2024-02-15T22:51:20.383 INFO:tasks.workunit.client.1.smithi170.stdout:9/483: dread de/d1b/d1c/f5b [0,4194304] 0 2024-02-15T22:51:20.384 INFO:tasks.workunit.client.1.smithi170.stdout:3/545: mkdir d3/db/d1f/d61/dad 0 2024-02-15T22:51:20.385 INFO:tasks.workunit.client.1.smithi170.stdout:8/463: rename d9/d18/c33 to d9/c92 0 2024-02-15T22:51:20.386 INFO:tasks.workunit.client.1.smithi170.stdout:3/546: mknod d3/db/d1f/d61/cae 0 2024-02-15T22:51:20.387 INFO:tasks.workunit.client.1.smithi170.stdout:3/547: dread - d3/dc/f5b zero size 2024-02-15T22:51:20.388 INFO:tasks.workunit.client.1.smithi170.stdout:6/608: rename d3/d1d/d28/d3b/c67 to d3/d1a/cd1 0 2024-02-15T22:51:20.389 INFO:tasks.workunit.client.1.smithi170.stdout:9/484: mkdir de/da6 0 2024-02-15T22:51:20.389 INFO:tasks.workunit.client.1.smithi170.stdout:9/485: fsync de/d1b/d1c/d1f/d20/d27/d2c/f5a 0 2024-02-15T22:51:20.389 INFO:tasks.workunit.client.1.smithi170.stdout:3/548: creat d3/d78/faf x:0 0 0 2024-02-15T22:51:20.391 INFO:tasks.workunit.client.1.smithi170.stdout:8/464: rename d9/d18/d26/l27 to d9/d18/d32/d3b/l93 0 2024-02-15T22:51:20.391 INFO:tasks.workunit.client.1.smithi170.stdout:8/465: stat d9/d18/d32/d3b 0 2024-02-15T22:51:20.392 INFO:tasks.workunit.client.1.smithi170.stdout:3/549: dread d3/d1b/d8a/f99 [0,4194304] 0 2024-02-15T22:51:20.393 INFO:tasks.workunit.client.1.smithi170.stdout:9/486: link de/d1b/d1c/d1f/d20/d27/d28/c87 de/d8e/ca7 0 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:6/609: write d3/d1d/d1b/d3c/f81 [1718679,5103] 0 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:6/610: chown d3/d1d/d53/c5a 9605 1 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:6/611: fsync d3/d1d/d53/fba 0 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:6/612: chown d3/d1d/d1b/d3e/d9c 3385 1 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:6/613: write d3/d1d/d28/d3b/da3/fa8 [211204,60746] 0 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:4/608: dwrite d0/d22/da/d8b/d47/d2b/f4c [0,4194304] 0 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:4/609: chown d0/d22/da/d8b/d47/da9/lb8 561 1 2024-02-15T22:51:20.399 INFO:tasks.workunit.client.1.smithi170.stdout:4/610: dread - d0/f9a zero size 2024-02-15T22:51:20.400 INFO:tasks.workunit.client.1.smithi170.stdout:5/653: dwrite de/d29/f9b [0,4194304] 0 2024-02-15T22:51:20.400 INFO:tasks.workunit.client.1.smithi170.stdout:4/611: write d0/d22/da/d8b/d47/d67/d77/fb7 [745127,64525] 0 2024-02-15T22:51:20.400 INFO:tasks.workunit.client.1.smithi170.stdout:4/612: creat d0/d22/da/d11/fbb x:0 0 0 2024-02-15T22:51:20.400 INFO:tasks.workunit.client.1.smithi170.stdout:4/613: getdents d0/d22/da8 0 2024-02-15T22:51:20.400 INFO:tasks.workunit.client.1.smithi170.stdout:4/614: stat d0/d22/da/d58/l62 0 2024-02-15T22:51:20.401 INFO:tasks.workunit.client.1.smithi170.stdout:2/549: dwrite d0/d1/f6f [0,4194304] 0 2024-02-15T22:51:20.403 INFO:tasks.workunit.client.1.smithi170.stdout:1/718: dwrite d3/d24/d2c/f59 [0,4194304] 0 2024-02-15T22:51:20.403 INFO:tasks.workunit.client.1.smithi170.stdout:1/719: fdatasync d3/d24/f2b 0 2024-02-15T22:51:20.403 INFO:tasks.workunit.client.1.smithi170.stdout:7/653: dwrite da/d1a/d21/d2c/d74/d87/dac/fb9 [0,4194304] 0 2024-02-15T22:51:20.406 INFO:tasks.workunit.client.1.smithi170.stdout:4/615: rmdir d0/d22/da/d58 39 2024-02-15T22:51:20.406 INFO:tasks.workunit.client.1.smithi170.stdout:4/616: chown d0/d22/da/d8b/d47/f7e 5886938 1 2024-02-15T22:51:20.411 INFO:tasks.workunit.client.1.smithi170.stdout:2/550: read d0/d1/d11/fc1 [1648886,108814] 0 2024-02-15T22:51:20.415 INFO:tasks.workunit.client.1.smithi170.stdout:5/654: rename de/d10/d27/d4c/fa7 to de/d10/d33/fe3 0 2024-02-15T22:51:20.415 INFO:tasks.workunit.client.1.smithi170.stdout:4/617: write d0/d22/da/d11/f36 [1043261,101415] 0 2024-02-15T22:51:20.416 INFO:tasks.workunit.client.1.smithi170.stdout:7/654: link da/d1a/d21/d19/l54 da/d1a/d21/d2c/d74/dde/dc7/le0 0 2024-02-15T22:51:20.416 INFO:tasks.workunit.client.1.smithi170.stdout:2/551: symlink d0/d13/d59/d82/lda 0 2024-02-15T22:51:20.418 INFO:tasks.workunit.client.1.smithi170.stdout:1/720: rename d3/da2/c58 to d3/da2/de2/cfd 0 2024-02-15T22:51:20.418 INFO:tasks.workunit.client.1.smithi170.stdout:1/721: creat d3/d24/d2c/d77/dce/ffe x:0 0 0 2024-02-15T22:51:20.419 INFO:tasks.workunit.client.1.smithi170.stdout:8/466: dwrite d9/d18/d32/d3b/d4b/f8f [0,4194304] 0 2024-02-15T22:51:20.419 INFO:tasks.workunit.client.1.smithi170.stdout:8/467: write d9/d18/d32/d3b/d42/f61 [1229326,279] 0 2024-02-15T22:51:20.419 INFO:tasks.workunit.client.1.smithi170.stdout:9/487: dwrite de/d1b/d1c/d1f/d20/f65 [0,4194304] 0 2024-02-15T22:51:20.419 INFO:tasks.workunit.client.1.smithi170.stdout:9/488: chown de/d1b/d1c/d1f/c76 526939735 1 2024-02-15T22:51:20.421 INFO:tasks.workunit.client.1.smithi170.stdout:7/655: symlink da/d63/le1 0 2024-02-15T22:51:20.422 INFO:tasks.workunit.client.1.smithi170.stdout:7/656: write da/f3b [2348166,97805] 0 2024-02-15T22:51:20.423 INFO:tasks.workunit.client.1.smithi170.stdout:1/722: creat d3/d24/d2c/d94/fff x:0 0 0 2024-02-15T22:51:20.426 INFO:tasks.workunit.client.1.smithi170.stdout:5/655: rename de/d10/d33/d9f/d7c/d99 to de/d10/d33/db2/de4 0 2024-02-15T22:51:20.430 INFO:tasks.workunit.client.1.smithi170.stdout:4/618: rmdir d0/d22/da/d11/d20/d49 39 2024-02-15T22:51:20.434 INFO:tasks.workunit.client.1.smithi170.stdout:7/657: write da/d1a/d21/fae [2749223,103249] 0 2024-02-15T22:51:20.434 INFO:tasks.workunit.client.1.smithi170.stdout:7/658: read - da/d1a/fbf zero size 2024-02-15T22:51:20.435 INFO:tasks.workunit.client.1.smithi170.stdout:9/489: creat de/d1b/d1c/d1f/d20/d27/d28/d69/fa8 x:0 0 0 2024-02-15T22:51:20.438 INFO:tasks.workunit.client.1.smithi170.stdout:1/723: creat d3/d24/d2c/d35/df4/f100 x:0 0 0 2024-02-15T22:51:20.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/656: getdents de/d10/d27 0 2024-02-15T22:51:20.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/657: fsync de/d10/d52/f93 0 2024-02-15T22:51:20.445 INFO:tasks.workunit.client.1.smithi170.stdout:7/659: mkdir da/d1a/d21/d2c/d2e/d7a/de2 0 2024-02-15T22:51:20.445 INFO:tasks.workunit.client.1.smithi170.stdout:2/552: dwrite d0/d1d/d3d/f4c [0,4194304] 0 2024-02-15T22:51:20.446 INFO:tasks.workunit.client.1.smithi170.stdout:7/660: dread - da/d1a/d21/d2c/d74/dde/dc7/fdb zero size 2024-02-15T22:51:20.446 INFO:tasks.workunit.client.1.smithi170.stdout:7/661: creat da/d63/fe3 x:0 0 0 2024-02-15T22:51:20.447 INFO:tasks.workunit.client.1.smithi170.stdout:2/553: write d0/d1/d89/dd7/d2f/d37/d58/f96 [422400,5371] 0 2024-02-15T22:51:20.448 INFO:tasks.workunit.client.1.smithi170.stdout:1/724: truncate d3/d24/f63 250723 0 2024-02-15T22:51:20.449 INFO:tasks.workunit.client.1.smithi170.stdout:8/468: dwrite d9/d18/d26/f55 [0,4194304] 0 2024-02-15T22:51:20.451 INFO:tasks.workunit.client.1.smithi170.stdout:4/619: dwrite d0/d22/da/d8b/d47/d2b/f52 [0,4194304] 0 2024-02-15T22:51:20.456 INFO:tasks.workunit.client.1.smithi170.stdout:7/662: mknod da/d1a/d21/d2c/d74/ce4 0 2024-02-15T22:51:20.456 INFO:tasks.workunit.client.1.smithi170.stdout:7/663: truncate da/d1a/d21/d2c/d2e/d7a/fca 637223 0 2024-02-15T22:51:20.457 INFO:tasks.workunit.client.1.smithi170.stdout:9/490: rmdir de/d1b/d1c/d1f/d20/d27/d28/d7a 39 2024-02-15T22:51:20.457 INFO:tasks.workunit.client.1.smithi170.stdout:9/491: readlink de/d1b/d1c/d1f/d20/d27/d28/la3 0 2024-02-15T22:51:20.457 INFO:tasks.workunit.client.1.smithi170.stdout:9/492: fsync de/d1b/d1c/d1f/d20/f42 0 2024-02-15T22:51:20.459 INFO:tasks.workunit.client.1.smithi170.stdout:2/554: creat d0/d1/d89/dd7/d2f/fdb x:0 0 0 2024-02-15T22:51:20.459 INFO:tasks.workunit.client.1.smithi170.stdout:2/555: fsync d0/d1/fc 0 2024-02-15T22:51:20.462 INFO:tasks.workunit.client.1.smithi170.stdout:8/469: creat d9/d18/d32/d7a/d78/d7f/f94 x:0 0 0 2024-02-15T22:51:20.462 INFO:tasks.workunit.client.1.smithi170.stdout:8/470: write d9/d18/f1e [2502899,47879] 0 2024-02-15T22:51:20.464 INFO:tasks.workunit.client.1.smithi170.stdout:5/658: dwrite de/d10/d33/d67/fcf [0,4194304] 0 2024-02-15T22:51:20.464 INFO:tasks.workunit.client.1.smithi170.stdout:5/659: chown de/d10/d33/d67/dc4/dcd 4656 1 2024-02-15T22:51:20.464 INFO:tasks.workunit.client.1.smithi170.stdout:4/620: mkdir d0/d22/da/d11/d20/d49/dbc 0 2024-02-15T22:51:20.465 INFO:tasks.workunit.client.1.smithi170.stdout:4/621: dread d0/d22/f14 [0,4194304] 0 2024-02-15T22:51:20.466 INFO:tasks.workunit.client.1.smithi170.stdout:7/664: mkdir da/d1a/d21/d2c/d2e/d7a/de2/de5 0 2024-02-15T22:51:20.468 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:20 smithi138 ceph-mon[29229]: pgmap v23: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 94 MiB/s rd, 121 MiB/s wr, 262 op/s 2024-02-15T22:51:20.468 INFO:tasks.workunit.client.1.smithi170.stdout:9/493: link de/d1b/d1c/d1f/d20/d27/d28/d69/c6b de/da6/ca9 0 2024-02-15T22:51:20.469 INFO:tasks.workunit.client.1.smithi170.stdout:8/471: mkdir d9/d18/d32/d7a/d78/d95 0 2024-02-15T22:51:20.469 INFO:tasks.workunit.client.1.smithi170.stdout:8/472: chown d9/d18/d32/d3b/d42 1829090 1 2024-02-15T22:51:20.469 INFO:tasks.workunit.client.1.smithi170.stdout:8/473: write d9/f1a [482600,106425] 0 2024-02-15T22:51:20.471 INFO:tasks.workunit.client.1.smithi170.stdout:2/556: write d0/d2a/fb5 [1672217,63095] 0 2024-02-15T22:51:20.471 INFO:tasks.workunit.client.1.smithi170.stdout:2/557: write d0/d1/d11/f29 [1123268,86295] 0 2024-02-15T22:51:20.473 INFO:tasks.workunit.client.1.smithi170.stdout:5/660: dread de/d36/f41 [0,4194304] 0 2024-02-15T22:51:20.476 INFO:tasks.workunit.client.1.smithi170.stdout:4/622: creat d0/fbd x:0 0 0 2024-02-15T22:51:20.476 INFO:tasks.workunit.client.1.smithi170.stdout:4/623: chown d0/d22/da/c19 0 1 2024-02-15T22:51:20.476 INFO:tasks.workunit.client.1.smithi170.stdout:4/624: dread - d0/d22/da/d8b/f88 zero size 2024-02-15T22:51:20.479 INFO:tasks.workunit.client.1.smithi170.stdout:7/665: link da/fa8 da/d1a/d21/d2c/d74/d87/daf/fe6 0 2024-02-15T22:51:20.479 INFO:tasks.workunit.client.1.smithi170.stdout:7/666: stat da/d1a/d21/d2c/d74/d87/dac/f66 0 2024-02-15T22:51:20.482 INFO:tasks.workunit.client.1.smithi170.stdout:9/494: write de/d1b/d1c/f46 [3790719,111813] 0 2024-02-15T22:51:20.482 INFO:tasks.workunit.client.1.smithi170.stdout:9/495: readlink de/d1b/d37/l50 0 2024-02-15T22:51:20.483 INFO:tasks.workunit.client.1.smithi170.stdout:8/474: rmdir d9/d18/d32/d3b/d42 39 2024-02-15T22:51:20.488 INFO:tasks.workunit.client.1.smithi170.stdout:5/661: dread de/d10/d27/d2d/f31 [0,4194304] 0 2024-02-15T22:51:20.489 INFO:tasks.workunit.client.1.smithi170.stdout:7/667: chown da/d1a/d21/d1b/l6b 4 1 2024-02-15T22:51:20.489 INFO:tasks.workunit.client.1.smithi170.stdout:7/668: truncate da/d1a/d21/d2c/d74/d87/fbe 177937 0 2024-02-15T22:51:20.492 INFO:tasks.workunit.client.1.smithi170.stdout:8/475: mkdir d9/d18/d32/d3b/d4b/d96 0 2024-02-15T22:51:20.498 INFO:tasks.workunit.client.1.smithi170.stdout:2/558: dwrite d0/d1/d89/dd7/d2f/f62 [0,4194304] 0 2024-02-15T22:51:20.499 INFO:tasks.workunit.client.1.smithi170.stdout:2/559: read - d0/d1/d89/dd7/fcf zero size 2024-02-15T22:51:20.505 INFO:tasks.workunit.client.1.smithi170.stdout:2/560: rmdir d0/d1 39 2024-02-15T22:51:20.510 INFO:tasks.workunit.client.1.smithi170.stdout:2/561: creat d0/d1/d31/da3/fdc x:0 0 0 2024-02-15T22:51:20.511 INFO:tasks.workunit.client.1.smithi170.stdout:5/662: dwrite f1 [0,4194304] 0 2024-02-15T22:51:20.512 INFO:tasks.workunit.client.1.smithi170.stdout:2/562: dread d0/d1/d31/f5a [0,4194304] 0 2024-02-15T22:51:20.512 INFO:tasks.workunit.client.1.smithi170.stdout:2/563: creat d0/d2a/fdd x:0 0 0 2024-02-15T22:51:20.512 INFO:tasks.workunit.client.1.smithi170.stdout:2/564: dread - d0/d1d/fb9 zero size 2024-02-15T22:51:20.519 INFO:tasks.workunit.client.1.smithi170.stdout:4/625: rename d0/d22/da/d11 to d0/d22/da/d8b/d47/dbe 0 2024-02-15T22:51:20.519 INFO:tasks.workunit.client.1.smithi170.stdout:4/626: read d0/d22/f50 [744197,128496] 0 2024-02-15T22:51:20.519 INFO:tasks.workunit.client.1.smithi170.stdout:4/627: write d0/d22/da/d8b/d47/f7e [192627,123288] 0 2024-02-15T22:51:20.520 INFO:tasks.workunit.client.1.smithi170.stdout:5/663: rmdir de/d10/d33/d67/dc4/dcd 39 2024-02-15T22:51:20.522 INFO:tasks.workunit.client.1.smithi170.stdout:7/669: dwrite da/d1a/d21/d2c/d74/d87/dac/fb9 [0,4194304] 0 2024-02-15T22:51:20.525 INFO:tasks.workunit.client.1.smithi170.stdout:2/565: mkdir d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde 0 2024-02-15T22:51:20.529 INFO:tasks.workunit.client.1.smithi170.stdout:1/725: write d3/d24/f63 [323031,89702] 0 2024-02-15T22:51:20.531 INFO:tasks.workunit.client.1.smithi170.stdout:8/476: dwrite d9/f82 [0,4194304] 0 2024-02-15T22:51:20.537 INFO:tasks.workunit.client.1.smithi170.stdout:4/628: rmdir d0/d22/da/d8b/d47/d5e/d79 39 2024-02-15T22:51:20.539 INFO:tasks.workunit.client.1.smithi170.stdout:9/496: rename fb to de/d1b/d1c/d1f/d20/d27/d84/faa 0 2024-02-15T22:51:20.540 INFO:tasks.workunit.client.1.smithi170.stdout:5/664: mkdir de/d29/de5 0 2024-02-15T22:51:20.542 INFO:tasks.workunit.client.1.smithi170.stdout:2/566: getdents d0/d1/d11 0 2024-02-15T22:51:20.542 INFO:tasks.workunit.client.1.smithi170.stdout:2/567: fdatasync d0/d1/d89/dd7/fcf 0 2024-02-15T22:51:20.544 INFO:tasks.workunit.client.1.smithi170.stdout:4/629: mknod d0/d22/db9/cbf 0 2024-02-15T22:51:20.545 INFO:tasks.workunit.client.1.smithi170.stdout:9/497: mkdir de/d1b/d37/dab 0 2024-02-15T22:51:20.547 INFO:tasks.workunit.client.1.smithi170.stdout:7/670: getdents da/d1a/d21 0 2024-02-15T22:51:20.547 INFO:tasks.workunit.client.1.smithi170.stdout:7/671: dread - da/d1a/d21/d2c/d2e/d7a/fbb zero size 2024-02-15T22:51:20.547 INFO:tasks.workunit.client.1.smithi170.stdout:7/672: stat da/d1a/d21/d1b/f77 0 2024-02-15T22:51:20.547 INFO:tasks.workunit.client.1.smithi170.stdout:7/673: write da/d1a/d21/d2c/d74/d87/fbe [541047,94566] 0 2024-02-15T22:51:20.548 INFO:tasks.workunit.client.1.smithi170.stdout:2/568: mkdir d0/d1/d89/dd7/d2f/ddf 0 2024-02-15T22:51:20.550 INFO:tasks.workunit.client.1.smithi170.stdout:8/477: link d9/fd d9/f97 0 2024-02-15T22:51:20.551 INFO:tasks.workunit.client.1.smithi170.stdout:4/630: rmdir d0/d22/da/d8b/d47/d5e/d79 39 2024-02-15T22:51:20.552 INFO:tasks.workunit.client.1.smithi170.stdout:9/498: symlink de/d1b/d1c/d1f/d20/d27/d28/d7a/lac 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:1/726: dwrite d3/da2/fc2 [0,4194304] 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:1/727: getdents d3/d24/d2c/d5e/de9 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:1/728: truncate d3/d24/d2c/d35/f82 904982 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:1/729: chown d3/d24/d2c/ffc 20893 1 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:1/730: write d3/d24/d2c/d94/fa5 [1313227,58963] 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:5/665: getdents de/d36 0 2024-02-15T22:51:20.553 INFO:tasks.workunit.client.1.smithi170.stdout:5/666: write de/d10/d33/d9f/d7c/d87/fdf [558418,127129] 0 2024-02-15T22:51:20.558 INFO:tasks.workunit.client.1.smithi170.stdout:2/569: symlink d0/d2a/le0 0 2024-02-15T22:51:20.559 INFO:tasks.workunit.client.1.smithi170.stdout:8/478: unlink d9/d18/d32/d3b/d4b/f6f 0 2024-02-15T22:51:20.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/499: dread de/d1b/d1c/d1f/d20/d27/d2c/f44 [0,4194304] 0 2024-02-15T22:51:20.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/500: getdents de/d97 0 2024-02-15T22:51:20.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/501: chown de/d1b/d37 1 1 2024-02-15T22:51:20.561 INFO:tasks.workunit.client.1.smithi170.stdout:9/502: creat de/d8e/fad x:0 0 0 2024-02-15T22:51:20.565 INFO:tasks.workunit.client.1.smithi170.stdout:1/731: creat d3/da2/f101 x:0 0 0 2024-02-15T22:51:20.565 INFO:tasks.workunit.client.1.smithi170.stdout:4/631: dwrite d0/d22/da/f5b [0,4194304] 0 2024-02-15T22:51:20.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/732: dread d3/fb [0,4194304] 0 2024-02-15T22:51:20.568 INFO:tasks.workunit.client.1.smithi170.stdout:1/733: write d3/da2/de2/fbf [957614,58825] 0 2024-02-15T22:51:20.569 INFO:tasks.workunit.client.1.smithi170.stdout:5/667: truncate de/d10/d27/d2d/f47 3092017 0 2024-02-15T22:51:20.571 INFO:tasks.workunit.client.1.smithi170.stdout:2/570: creat d0/d1d/d3d/d76/fe1 x:0 0 0 2024-02-15T22:51:20.571 INFO:tasks.workunit.client.1.smithi170.stdout:2/571: fsync d0/d1/d53/fb8 0 2024-02-15T22:51:20.572 INFO:tasks.workunit.client.1.smithi170.stdout:2/572: write d0/d1/d89/dd7/d2f/d37/f7c [2212257,33000] 0 2024-02-15T22:51:20.572 INFO:tasks.workunit.client.1.smithi170.stdout:2/573: creat d0/d1/d89/d8b/fe2 x:0 0 0 2024-02-15T22:51:20.572 INFO:tasks.workunit.client.1.smithi170.stdout:8/479: mkdir d9/d18/d32/d7a/d78/d7f/d98 0 2024-02-15T22:51:20.575 INFO:tasks.workunit.client.1.smithi170.stdout:1/734: write d3/d24/d2c/d35/d7f/fa9 [3239920,47017] 0 2024-02-15T22:51:20.575 INFO:tasks.workunit.client.1.smithi170.stdout:9/503: getdents de/d1b/d1c/d1f/d20/d27/d84 0 2024-02-15T22:51:20.578 INFO:tasks.workunit.client.1.smithi170.stdout:0/542: sync 2024-02-15T22:51:20.578 INFO:tasks.workunit.client.1.smithi170.stdout:9/504: dread de/d1b/d1c/d1f/d20/f22 [0,4194304] 0 2024-02-15T22:51:20.578 INFO:tasks.workunit.client.1.smithi170.stdout:9/505: readlink de/d1b/d1c/d1f/d20/d27/d28/d69/l7c 0 2024-02-15T22:51:20.578 INFO:tasks.workunit.client.1.smithi170.stdout:0/543: write d8/df/d13/d22/f6b [308482,87967] 0 2024-02-15T22:51:20.580 INFO:tasks.workunit.client.1.smithi170.stdout:4/632: unlink d0/d22/d6e/l7f 0 2024-02-15T22:51:20.580 INFO:tasks.workunit.client.1.smithi170.stdout:4/633: creat d0/d22/da/d8b/d47/d67/d77/fc0 x:0 0 0 2024-02-15T22:51:20.581 INFO:tasks.workunit.client.1.smithi170.stdout:5/668: mkdir de/d10/d27/d2d/de6 0 2024-02-15T22:51:20.581 INFO:tasks.workunit.client.1.smithi170.stdout:5/669: write de/d36/d80/dc2/fce [993078,24064] 0 2024-02-15T22:51:20.584 INFO:tasks.workunit.client.1.smithi170.stdout:2/574: link d0/d1/d89/dd7/d2f/d37/c4b d0/d13/d59/d82/ce3 0 2024-02-15T22:51:20.585 INFO:tasks.workunit.client.1.smithi170.stdout:2/575: stat d0/d1/l5e 0 2024-02-15T22:51:20.585 INFO:tasks.workunit.client.1.smithi170.stdout:2/576: getdents d0/d1/d89/dd7/d2f/dbe 0 2024-02-15T22:51:20.585 INFO:tasks.workunit.client.1.smithi170.stdout:2/577: chown d0/f67 336 1 2024-02-15T22:51:20.586 INFO:tasks.workunit.client.1.smithi170.stdout:8/480: truncate d9/f2d 1886902 0 2024-02-15T22:51:20.591 INFO:tasks.workunit.client.1.smithi170.stdout:0/544: creat d8/df/d13/d22/d6a/fb3 x:0 0 0 2024-02-15T22:51:20.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/670: symlink de/d10/da8/db6/le7 0 2024-02-15T22:51:20.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/671: fsync de/d10/d33/d9f/f69 0 2024-02-15T22:51:20.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/672: fsync de/d10/d27/d2d/fba 0 2024-02-15T22:51:20.593 INFO:tasks.workunit.client.1.smithi170.stdout:5/673: fdatasync de/d10/d27/d2d/f47 0 2024-02-15T22:51:20.594 INFO:tasks.workunit.client.1.smithi170.stdout:2/578: truncate d0/d1/d53/f7e 82541 0 2024-02-15T22:51:20.596 INFO:tasks.workunit.client.1.smithi170.stdout:8/481: mkdir d9/d18/d32/d99 0 2024-02-15T22:51:20.597 INFO:tasks.workunit.client.1.smithi170.stdout:1/735: rmdir d3/d24/d2c/d35/df4 39 2024-02-15T22:51:20.600 INFO:tasks.workunit.client.1.smithi170.stdout:1/736: read d3/d24/f27 [1733190,3453] 0 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:9/506: rename de/d1b/d37/f8a to de/d1b/d1c/d1f/d20/d27/fae 0 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:9/507: write de/d1b/f7e [502156,71704] 0 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:6/614: sync 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/550: sync 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/551: readlink d3/dc/d1c/d26/d55/l98 0 2024-02-15T22:51:20.601 INFO:tasks.workunit.client.1.smithi170.stdout:3/552: write d3/dc/d1c/f76 [763279,126323] 0 2024-02-15T22:51:20.602 INFO:tasks.workunit.client.1.smithi170.stdout:5/674: creat de/d29/de5/fe8 x:0 0 0 2024-02-15T22:51:20.603 INFO:tasks.workunit.client.1.smithi170.stdout:8/482: truncate d9/fd 1406382 0 2024-02-15T22:51:20.605 INFO:tasks.workunit.client.1.smithi170.stdout:1/737: symlink d3/da2/l102 0 2024-02-15T22:51:20.608 INFO:tasks.workunit.client.1.smithi170.stdout:4/634: rename d0/d22/da/d8b/d47/dbe/f3c to d0/d22/d6e/fc1 0 2024-02-15T22:51:20.608 INFO:tasks.workunit.client.1.smithi170.stdout:4/635: chown d0/d22/da/d58/laf 6540 1 2024-02-15T22:51:20.608 INFO:tasks.workunit.client.1.smithi170.stdout:4/636: truncate d0/d22/da/d8b/fb2 521764 0 2024-02-15T22:51:20.608 INFO:tasks.workunit.client.1.smithi170.stdout:4/637: chown d0/d22/da/d8b/d47/c98 636 1 2024-02-15T22:51:20.608 INFO:tasks.workunit.client.1.smithi170.stdout:0/545: dwrite d8/df/d13/d36/d60/da2/fa4 [0,4194304] 0 2024-02-15T22:51:20.614 INFO:tasks.workunit.client.1.smithi170.stdout:9/508: truncate de/f75 1189019 0 2024-02-15T22:51:20.615 INFO:tasks.workunit.client.1.smithi170.stdout:6/615: creat d3/d1d/d36/d56/d6c/fd2 x:0 0 0 2024-02-15T22:51:20.620 INFO:tasks.workunit.client.1.smithi170.stdout:3/553: mknod d3/d2b/cb0 0 2024-02-15T22:51:20.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/675: dread - de/d10/d27/d4c/d53/f5f zero size 2024-02-15T22:51:20.621 INFO:tasks.workunit.client.1.smithi170.stdout:2/579: rename d0/d1/d31/c98 to d0/d1/d89/dd7/d2f/d37/ce4 0 2024-02-15T22:51:20.621 INFO:tasks.workunit.client.1.smithi170.stdout:2/580: chown d0/d1/d89/dd7/d2f/d37/d58/f6d 66 1 2024-02-15T22:51:20.625 INFO:tasks.workunit.client.1.smithi170.stdout:6/616: unlink d3/d1d/d27/d70/lbd 0 2024-02-15T22:51:20.626 INFO:tasks.workunit.client.1.smithi170.stdout:2/581: mkdir d0/d1/d5f/de5 0 2024-02-15T22:51:20.638 INFO:tasks.workunit.client.1.smithi170.stdout:2/582: dread d0/d1/d89/dd7/d2f/d37/f7c [0,4194304] 0 2024-02-15T22:51:20.638 INFO:tasks.workunit.client.1.smithi170.stdout:2/583: dread - d0/d1/d5f/d74/fb0 zero size 2024-02-15T22:51:20.639 INFO:tasks.workunit.client.1.smithi170.stdout:2/584: write d0/d1/d89/dd7/d2f/fca [4273874,125082] 0 2024-02-15T22:51:20.642 INFO:tasks.workunit.client.1.smithi170.stdout:2/585: rename d0/d1/d89/dd7/d2f/d37/d58/d78/l51 to d0/d1/d11/d26/le6 0 2024-02-15T22:51:20.643 INFO:tasks.workunit.client.1.smithi170.stdout:2/586: creat d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fe7 x:0 0 0 2024-02-15T22:51:20.654 INFO:tasks.workunit.client.1.smithi170.stdout:1/738: dwrite d3/da2/d4a/fd0 [0,4194304] 0 2024-02-15T22:51:20.655 INFO:tasks.workunit.client.1.smithi170.stdout:1/739: creat d3/d24/d2c/d5e/f103 x:0 0 0 2024-02-15T22:51:20.657 INFO:tasks.workunit.client.1.smithi170.stdout:5/676: dread de/d10/d33/d9f/d7c/d87/f8a [0,4194304] 0 2024-02-15T22:51:20.661 INFO:tasks.workunit.client.1.smithi170.stdout:5/677: link de/d10/d27/d4c/d53/d55/f8e de/d10/d33/db2/fe9 0 2024-02-15T22:51:20.663 INFO:tasks.workunit.client.1.smithi170.stdout:5/678: creat de/d10/d27/fea x:0 0 0 2024-02-15T22:51:20.663 INFO:tasks.workunit.client.1.smithi170.stdout:1/740: write d3/d24/f8d [1371459,117250] 0 2024-02-15T22:51:20.663 INFO:tasks.workunit.client.1.smithi170.stdout:1/741: write d3/d24/d2c/d94/fa5 [3235329,32146] 0 2024-02-15T22:51:20.663 INFO:tasks.workunit.client.1.smithi170.stdout:1/742: creat d3/d24/d2c/d77/f104 x:0 0 0 2024-02-15T22:51:20.681 INFO:tasks.workunit.client.1.smithi170.stdout:2/587: write d0/d1/d89/dd7/d2f/f65 [2696109,101015] 0 2024-02-15T22:51:20.683 INFO:tasks.workunit.client.1.smithi170.stdout:2/588: truncate d0/f2c 525880 0 2024-02-15T22:51:20.683 INFO:tasks.workunit.client.1.smithi170.stdout:2/589: stat d0/f25 0 2024-02-15T22:51:20.684 INFO:tasks.workunit.client.1.smithi170.stdout:2/590: unlink d0/d1/fc 0 2024-02-15T22:51:20.686 INFO:tasks.workunit.client.1.smithi170.stdout:2/591: symlink d0/d1d/le8 0 2024-02-15T22:51:20.687 INFO:tasks.workunit.client.1.smithi170.stdout:2/592: mknod d0/d1/d11/d26/d6e/ce9 0 2024-02-15T22:51:20.689 INFO:tasks.workunit.client.1.smithi170.stdout:2/593: link d0/d13/l7b d0/d2a/daa/lea 0 2024-02-15T22:51:20.690 INFO:tasks.workunit.client.1.smithi170.stdout:2/594: link d0/d1/d89/cc0 d0/d2a/ceb 0 2024-02-15T22:51:20.691 INFO:tasks.workunit.client.1.smithi170.stdout:2/595: unlink d0/d1/d53/fb8 0 2024-02-15T22:51:20.692 INFO:tasks.workunit.client.1.smithi170.stdout:2/596: symlink d0/d1d/d3d/d76/lec 0 2024-02-15T22:51:20.692 INFO:tasks.workunit.client.1.smithi170.stdout:2/597: truncate d0/d1/d89/dd7/d2f/d9b/fc9 400906 0 2024-02-15T22:51:20.692 INFO:tasks.workunit.client.1.smithi170.stdout:2/598: read - d0/d2a/f77 zero size 2024-02-15T22:51:20.692 INFO:tasks.workunit.client.1.smithi170.stdout:4/638: dwrite d0/d22/da/d8b/d47/d5e/f69 [0,4194304] 0 2024-02-15T22:51:20.693 INFO:tasks.workunit.client.1.smithi170.stdout:2/599: rename d0/d13/d59/d82/ld6 to d0/d1d/d3d/led 0 2024-02-15T22:51:20.697 INFO:tasks.workunit.client.1.smithi170.stdout:2/600: mknod d0/d13/cee 0 2024-02-15T22:51:20.697 INFO:tasks.workunit.client.1.smithi170.stdout:2/601: read - d0/d1/d53/fcd zero size 2024-02-15T22:51:20.699 INFO:tasks.workunit.client.1.smithi170.stdout:4/639: dread d0/f10 [0,4194304] 0 2024-02-15T22:51:20.700 INFO:tasks.workunit.client.1.smithi170.stdout:4/640: fsync d0/d22/da/d8b/d47/dbe/d20/f23 0 2024-02-15T22:51:20.700 INFO:tasks.workunit.client.1.smithi170.stdout:4/641: fdatasync d0/d22/da/d8b/d47/dbe/da2/f9d 0 2024-02-15T22:51:20.700 INFO:tasks.workunit.client.1.smithi170.stdout:4/642: write d0/d22/da/d8b/d47/dbe/f26 [5138897,90834] 0 2024-02-15T22:51:20.701 INFO:tasks.workunit.client.1.smithi170.stdout:0/546: dwrite d8/f2a [0,4194304] 0 2024-02-15T22:51:20.701 INFO:tasks.workunit.client.1.smithi170.stdout:3/554: dwrite d3/f42 [0,4194304] 0 2024-02-15T22:51:20.701 INFO:tasks.workunit.client.1.smithi170.stdout:9/509: dwrite de/d1b/f4f [0,4194304] 0 2024-02-15T22:51:20.704 INFO:tasks.workunit.client.1.smithi170.stdout:1/743: fdatasync d3/d24/f8d 0 2024-02-15T22:51:20.704 INFO:tasks.workunit.client.1.smithi170.stdout:1/744: chown d3/d24/d2c/d94/cfb 2260700 1 2024-02-15T22:51:20.704 INFO:tasks.workunit.client.1.smithi170.stdout:1/745: creat d3/da2/d4a/f105 x:0 0 0 2024-02-15T22:51:20.706 INFO:tasks.workunit.client.1.smithi170.stdout:6/617: dwrite d3/f4 [0,4194304] 0 2024-02-15T22:51:20.706 INFO:tasks.workunit.client.1.smithi170.stdout:4/643: mkdir d0/dc2 0 2024-02-15T22:51:20.706 INFO:tasks.workunit.client.1.smithi170.stdout:8/483: dwrite d9/f16 [0,4194304] 0 2024-02-15T22:51:20.706 INFO:tasks.workunit.client.1.smithi170.stdout:5/679: dwrite de/d36/f5e [0,4194304] 0 2024-02-15T22:51:20.710 INFO:tasks.workunit.client.1.smithi170.stdout:3/555: dread d3/d1b/d2c/d92/da5/f8b [0,4194304] 0 2024-02-15T22:51:20.725 INFO:tasks.workunit.client.1.smithi170.stdout:4/644: symlink d0/d22/db9/lc3 0 2024-02-15T22:51:20.727 INFO:tasks.workunit.client.1.smithi170.stdout:0/547: dwrite d8/d14/f1a [4194304,4194304] 0 2024-02-15T22:51:20.727 INFO:tasks.workunit.client.1.smithi170.stdout:0/548: read - d8/df/d13/d36/d60/f91 zero size 2024-02-15T22:51:20.727 INFO:tasks.workunit.client.1.smithi170.stdout:0/549: fdatasync f5 0 2024-02-15T22:51:20.728 INFO:tasks.workunit.client.1.smithi170.stdout:8/484: mknod d9/d18/d32/d3b/d42/c9a 0 2024-02-15T22:51:20.730 INFO:tasks.workunit.client.1.smithi170.stdout:4/645: creat d0/d22/da/d8b/d47/dbe/d20/fc4 x:0 0 0 2024-02-15T22:51:20.731 INFO:tasks.workunit.client.1.smithi170.stdout:4/646: write d0/d22/da/d8b/d47/dbe/f36 [2990121,43872] 0 2024-02-15T22:51:20.731 INFO:tasks.workunit.client.1.smithi170.stdout:4/647: write d0/d22/da/d8b/d47/dbe/f36 [1853339,1361] 0 2024-02-15T22:51:20.732 INFO:tasks.workunit.client.1.smithi170.stdout:0/550: symlink d8/df/d13/d22/d71/lb4 0 2024-02-15T22:51:20.734 INFO:tasks.workunit.client.1.smithi170.stdout:4/648: mkdir d0/d22/da/d8b/d47/d67/d77/dc5 0 2024-02-15T22:51:20.734 INFO:tasks.workunit.client.1.smithi170.stdout:4/649: chown d0/d22/da/f6a 2 1 2024-02-15T22:51:20.734 INFO:tasks.workunit.client.1.smithi170.stdout:4/650: write d0/d22/f50 [3639799,111974] 0 2024-02-15T22:51:20.734 INFO:tasks.workunit.client.1.smithi170.stdout:4/651: creat d0/d22/da/d8b/d47/d67/d77/fc6 x:0 0 0 2024-02-15T22:51:20.738 INFO:tasks.workunit.client.1.smithi170.stdout:5/680: dread de/d10/d27/fc9 [0,4194304] 0 2024-02-15T22:51:20.738 INFO:tasks.workunit.client.1.smithi170.stdout:5/681: readlink l2 0 2024-02-15T22:51:20.738 INFO:tasks.workunit.client.1.smithi170.stdout:5/682: creat de/d10/d27/d2d/feb x:0 0 0 2024-02-15T22:51:20.738 INFO:tasks.workunit.client.1.smithi170.stdout:0/551: mknod d8/cb5 0 2024-02-15T22:51:20.738 INFO:tasks.workunit.client.1.smithi170.stdout:0/552: write d8/df/d13/d22/d6a/fb3 [532882,90974] 0 2024-02-15T22:51:20.742 INFO:tasks.workunit.client.1.smithi170.stdout:4/652: symlink d0/d22/da/d8b/d47/d67/lc7 0 2024-02-15T22:51:20.743 INFO:tasks.workunit.client.1.smithi170.stdout:5/683: mkdir de/dec 0 2024-02-15T22:51:20.743 INFO:tasks.workunit.client.1.smithi170.stdout:2/602: dwrite d0/d1d/f22 [0,4194304] 0 2024-02-15T22:51:20.743 INFO:tasks.workunit.client.1.smithi170.stdout:2/603: chown d0/d1/d89/dd7/d3e/f44 1265 1 2024-02-15T22:51:20.744 INFO:tasks.workunit.client.1.smithi170.stdout:0/553: mknod d8/df/d13/d22/d39/cb6 0 2024-02-15T22:51:20.744 INFO:tasks.workunit.client.1.smithi170.stdout:0/554: truncate d8/df/d13/d22/d6a/fb3 873131 0 2024-02-15T22:51:20.744 INFO:tasks.workunit.client.1.smithi170.stdout:5/684: mkdir de/d10/d33/d9f/d7c/d87/ded 0 2024-02-15T22:51:20.745 INFO:tasks.workunit.client.1.smithi170.stdout:2/604: symlink d0/d13/lef 0 2024-02-15T22:51:20.745 INFO:tasks.workunit.client.1.smithi170.stdout:2/605: truncate d0/d1d/f93 4482794 0 2024-02-15T22:51:20.745 INFO:tasks.workunit.client.1.smithi170.stdout:2/606: fsync d0/d1/d5f/fd1 0 2024-02-15T22:51:20.745 INFO:tasks.workunit.client.1.smithi170.stdout:1/746: dwrite d3/da2/fc2 [4194304,4194304] 0 2024-02-15T22:51:20.745 INFO:tasks.workunit.client.1.smithi170.stdout:8/485: write d9/f46 [1679766,19291] 0 2024-02-15T22:51:20.747 INFO:tasks.workunit.client.1.smithi170.stdout:2/607: creat d0/d1/d89/ff0 x:0 0 0 2024-02-15T22:51:20.749 INFO:tasks.workunit.client.1.smithi170.stdout:4/653: dread d0/d22/da/d8b/d47/d2b/f68 [0,4194304] 0 2024-02-15T22:51:20.749 INFO:tasks.workunit.client.1.smithi170.stdout:6/618: dwrite d3/d1d/f7b [0,4194304] 0 2024-02-15T22:51:20.749 INFO:tasks.workunit.client.1.smithi170.stdout:3/556: dwrite d3/d1b/f74 [4194304,4194304] 0 2024-02-15T22:51:20.755 INFO:tasks.workunit.client.1.smithi170.stdout:8/486: getdents d9 0 2024-02-15T22:51:20.755 INFO:tasks.workunit.client.1.smithi170.stdout:8/487: fsync d9/d18/d32/d3b/d4b/f8f 0 2024-02-15T22:51:20.760 INFO:tasks.workunit.client.1.smithi170.stdout:3/557: rename d3/dc/d13/f4a to d3/db/fb1 0 2024-02-15T22:51:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:20 smithi170 ceph-mon[35248]: pgmap v23: 65 pgs: 65 active+clean; 1.9 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 94 MiB/s rd, 121 MiB/s wr, 262 op/s 2024-02-15T22:51:20.761 INFO:tasks.workunit.client.1.smithi170.stdout:0/555: write d8/d14/f63 [958065,126439] 0 2024-02-15T22:51:20.761 INFO:tasks.workunit.client.1.smithi170.stdout:6/619: dread d3/f5 [0,4194304] 0 2024-02-15T22:51:20.762 INFO:tasks.workunit.client.1.smithi170.stdout:4/654: mknod d0/d22/da/d8b/d47/d5e/d7d/cc8 0 2024-02-15T22:51:20.763 INFO:tasks.workunit.client.1.smithi170.stdout:8/488: mknod d9/d18/d32/d7a/d78/d7f/d98/c9b 0 2024-02-15T22:51:20.763 INFO:tasks.workunit.client.1.smithi170.stdout:8/489: write d9/d18/d32/d3b/f90 [284660,96451] 0 2024-02-15T22:51:20.764 INFO:tasks.workunit.client.1.smithi170.stdout:2/608: mknod d0/d1/d11/d26/d6e/cf1 0 2024-02-15T22:51:20.771 INFO:tasks.workunit.client.1.smithi170.stdout:3/558: symlink d3/dc/d1a/lb2 0 2024-02-15T22:51:20.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/747: dwrite d3/d24/d2c/f6d [0,4194304] 0 2024-02-15T22:51:20.774 INFO:tasks.workunit.client.1.smithi170.stdout:0/556: unlink d8/cb5 0 2024-02-15T22:51:20.775 INFO:tasks.workunit.client.1.smithi170.stdout:0/557: chown d8/df/f8b 2974 1 2024-02-15T22:51:20.775 INFO:tasks.workunit.client.1.smithi170.stdout:5/685: dwrite de/f26 [4194304,4194304] 0 2024-02-15T22:51:20.776 INFO:tasks.workunit.client.1.smithi170.stdout:4/655: rename d0/dc2 to d0/d22/da/d8b/d47/d5e/d7d/dc9 0 2024-02-15T22:51:20.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/620: write d3/d1d/d36/f22 [2482260,12799] 0 2024-02-15T22:51:20.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/621: chown d3/d1d/d1b/d3c 456631 1 2024-02-15T22:51:20.778 INFO:tasks.workunit.client.1.smithi170.stdout:6/622: dread - d3/d24/fd0 zero size 2024-02-15T22:51:20.779 INFO:tasks.workunit.client.1.smithi170.stdout:3/559: mknod d3/dc/d1c/d26/d55/cb3 0 2024-02-15T22:51:20.783 INFO:tasks.workunit.client.1.smithi170.stdout:3/560: dread d3/d1b/d8a/f99 [0,4194304] 0 2024-02-15T22:51:20.784 INFO:tasks.workunit.client.1.smithi170.stdout:8/490: dwrite d9/d18/d26/f3c [0,4194304] 0 2024-02-15T22:51:20.787 INFO:tasks.workunit.client.1.smithi170.stdout:2/609: fsync d0/d1/d11/f29 0 2024-02-15T22:51:20.788 INFO:tasks.workunit.client.1.smithi170.stdout:1/748: mkdir d3/d24/d2c/d94/dd9/d106 0 2024-02-15T22:51:20.788 INFO:tasks.workunit.client.1.smithi170.stdout:1/749: chown d3/da2/d65/f69 679505 1 2024-02-15T22:51:20.792 INFO:tasks.workunit.client.1.smithi170.stdout:0/558: write d8/df/d13/f2e [3097401,53654] 0 2024-02-15T22:51:20.792 INFO:tasks.workunit.client.1.smithi170.stdout:0/559: dread - d8/df/d13/d22/d39/f4f zero size 2024-02-15T22:51:20.792 INFO:tasks.workunit.client.1.smithi170.stdout:0/560: dread - d8/df/d13/d36/f95 zero size 2024-02-15T22:51:20.792 INFO:tasks.workunit.client.1.smithi170.stdout:5/686: chown de/d10/d27/d4c/f6c 96 1 2024-02-15T22:51:20.793 INFO:tasks.workunit.client.1.smithi170.stdout:5/687: creat de/d10/d27/d4c/d53/d55/fee x:0 0 0 2024-02-15T22:51:20.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/623: mkdir d3/d1d/dd3 0 2024-02-15T22:51:20.797 INFO:tasks.workunit.client.1.smithi170.stdout:6/624: readlink d3/d24/d31/l69 0 2024-02-15T22:51:20.799 INFO:tasks.workunit.client.1.smithi170.stdout:4/656: dwrite d0/d22/da/d8b/d47/dbe/f6f [8388608,4194304] 0 2024-02-15T22:51:20.803 INFO:tasks.workunit.client.1.smithi170.stdout:3/561: dread d3/dc/f1d [0,4194304] 0 2024-02-15T22:51:20.803 INFO:tasks.workunit.client.1.smithi170.stdout:3/562: write d3/f9 [4466379,92839] 0 2024-02-15T22:51:20.808 INFO:tasks.workunit.client.1.smithi170.stdout:5/688: dread de/d29/f5a [0,4194304] 0 2024-02-15T22:51:20.809 INFO:tasks.workunit.client.1.smithi170.stdout:8/491: dwrite d9/d18/f86 [0,4194304] 0 2024-02-15T22:51:20.810 INFO:tasks.workunit.client.1.smithi170.stdout:6/625: creat d3/d1d/d36/fd4 x:0 0 0 2024-02-15T22:51:20.812 INFO:tasks.workunit.client.1.smithi170.stdout:5/689: mknod de/d10/d33/db2/cef 0 2024-02-15T22:51:20.814 INFO:tasks.workunit.client.1.smithi170.stdout:4/657: write d0/d22/da/d8b/d47/dbe/f45 [8605167,70786] 0 2024-02-15T22:51:20.814 INFO:tasks.workunit.client.1.smithi170.stdout:4/658: stat d0/d22/da/d8b/d47/dbe/d20/f35 0 2024-02-15T22:51:20.818 INFO:tasks.workunit.client.1.smithi170.stdout:6/626: mkdir d3/d1d/d36/d56/daf/dd5 0 2024-02-15T22:51:20.819 INFO:tasks.workunit.client.1.smithi170.stdout:6/627: chown d3/d1a/f40 7 1 2024-02-15T22:51:20.819 INFO:tasks.workunit.client.1.smithi170.stdout:6/628: readlink d3/d1d/d28/d3b/l1f 0 2024-02-15T22:51:20.820 INFO:tasks.workunit.client.1.smithi170.stdout:4/659: link d0/d22/da/d8b/d47/dbe/da2/fae d0/d22/da/d8b/d47/dbe/d20/fca 0 2024-02-15T22:51:20.820 INFO:tasks.workunit.client.1.smithi170.stdout:4/660: chown d0/d22/f50 778738778 1 2024-02-15T22:51:20.823 INFO:tasks.workunit.client.1.smithi170.stdout:8/492: mknod d9/d18/c9c 0 2024-02-15T22:51:20.824 INFO:tasks.workunit.client.1.smithi170.stdout:6/629: mkdir d3/d1d/d28/d66/dd6 0 2024-02-15T22:51:20.825 INFO:tasks.workunit.client.1.smithi170.stdout:1/750: dwrite d3/d24/d2c/d94/fbc [0,4194304] 0 2024-02-15T22:51:20.826 INFO:tasks.workunit.client.1.smithi170.stdout:0/561: dwrite d8/f29 [4194304,4194304] 0 2024-02-15T22:51:20.826 INFO:tasks.workunit.client.1.smithi170.stdout:2/610: dwrite d0/d1/d89/d8b/fe2 [0,4194304] 0 2024-02-15T22:51:20.826 INFO:tasks.workunit.client.1.smithi170.stdout:5/690: dread de/d10/f13 [0,4194304] 0 2024-02-15T22:51:20.827 INFO:tasks.workunit.client.1.smithi170.stdout:8/493: mkdir d9/d18/d32/d7a/d78/d7f/d98/d9d 0 2024-02-15T22:51:20.832 INFO:tasks.workunit.client.1.smithi170.stdout:6/630: symlink d3/d1d/d36/ld7 0 2024-02-15T22:51:20.832 INFO:tasks.workunit.client.1.smithi170.stdout:6/631: write d3/d1d/f9f [2104280,99375] 0 2024-02-15T22:51:20.832 INFO:tasks.workunit.client.1.smithi170.stdout:3/563: dwrite d3/db/fa4 [0,4194304] 0 2024-02-15T22:51:20.836 INFO:tasks.workunit.client.1.smithi170.stdout:3/564: dread d3/dc/d1c/d26/d55/f89 [0,4194304] 0 2024-02-15T22:51:20.837 INFO:tasks.workunit.client.1.smithi170.stdout:1/751: creat d3/d24/f107 x:0 0 0 2024-02-15T22:51:20.837 INFO:tasks.workunit.client.1.smithi170.stdout:1/752: write d3/d24/f63 [516741,127622] 0 2024-02-15T22:51:20.838 INFO:tasks.workunit.client.1.smithi170.stdout:4/661: dread d0/d22/da/d8b/d47/d2b/fba [8388608,4194304] 0 2024-02-15T22:51:20.843 INFO:tasks.workunit.client.1.smithi170.stdout:2/611: creat d0/d1/d89/dd7/d3e/ff2 x:0 0 0 2024-02-15T22:51:20.843 INFO:tasks.workunit.client.1.smithi170.stdout:2/612: write d0/d1/d31/f34 [390536,11856] 0 2024-02-15T22:51:20.846 INFO:tasks.workunit.client.1.smithi170.stdout:8/494: truncate d9/f46 3312076 0 2024-02-15T22:51:20.846 INFO:tasks.workunit.client.1.smithi170.stdout:8/495: fsync d9/f82 0 2024-02-15T22:51:20.846 INFO:tasks.workunit.client.1.smithi170.stdout:8/496: fsync d9/d18/d48/f5b 0 2024-02-15T22:51:20.848 INFO:tasks.workunit.client.1.smithi170.stdout:3/565: dread d3/db/fb1 [0,4194304] 0 2024-02-15T22:51:20.848 INFO:tasks.workunit.client.1.smithi170.stdout:3/566: truncate d3/dc/d1c/d26/d55/f69 2559325 0 2024-02-15T22:51:20.851 INFO:tasks.workunit.client.1.smithi170.stdout:1/753: link d3/d24/f27 d3/d24/d2c/d35/df4/f108 0 2024-02-15T22:51:20.853 INFO:tasks.workunit.client.1.smithi170.stdout:4/662: symlink d0/d22/da/d8b/d47/dbe/lcb 0 2024-02-15T22:51:20.854 INFO:tasks.workunit.client.1.smithi170.stdout:3/567: dread d3/f3c [0,4194304] 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/754: mkdir d3/d24/d2c/d77/dda/d109 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/755: truncate d3/d24/d2c/d94/fff 771094 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/756: chown d3/d24/d2c/d35/c7d 88 1 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:2/613: dread d0/d1/d31/f49 [0,4194304] 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:1/757: write d3/f1f [1908573,121784] 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:5/691: dwrite de/d10/d27/f4f [0,4194304] 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:4/663: stat d0/d22/da/c19 0 2024-02-15T22:51:20.856 INFO:tasks.workunit.client.1.smithi170.stdout:6/632: dwrite d3/d1d/d53/fba [0,4194304] 0 2024-02-15T22:51:20.857 INFO:tasks.workunit.client.1.smithi170.stdout:3/568: creat d3/d1b/d2c/d92/da5/fb4 x:0 0 0 2024-02-15T22:51:20.858 INFO:tasks.workunit.client.1.smithi170.stdout:0/562: dwrite d8/f29 [4194304,4194304] 0 2024-02-15T22:51:20.858 INFO:tasks.workunit.client.1.smithi170.stdout:0/563: fdatasync d8/d14/d1c/f1e 0 2024-02-15T22:51:20.859 INFO:tasks.workunit.client.1.smithi170.stdout:2/614: symlink d0/d2a/lf3 0 2024-02-15T22:51:20.863 INFO:tasks.workunit.client.1.smithi170.stdout:5/692: getdents de/d10/da8/db6 0 2024-02-15T22:51:20.869 INFO:tasks.workunit.client.1.smithi170.stdout:4/664: link d0/d22/da/d8b/d47/dbe/c2e d0/d22/da/d8b/d80/ccc 0 2024-02-15T22:51:20.871 INFO:tasks.workunit.client.1.smithi170.stdout:8/497: dwrite d9/d18/d48/f5b [0,4194304] 0 2024-02-15T22:51:20.871 INFO:tasks.workunit.client.1.smithi170.stdout:1/758: dread d3/fbb [0,4194304] 0 2024-02-15T22:51:20.885 INFO:tasks.workunit.client.1.smithi170.stdout:0/564: dwrite d8/df/f11 [0,4194304] 0 2024-02-15T22:51:20.885 INFO:tasks.workunit.client.1.smithi170.stdout:2/615: mkdir d0/d1/d5f/d74/d8e/df4 0 2024-02-15T22:51:20.886 INFO:tasks.workunit.client.1.smithi170.stdout:4/665: creat d0/d9f/fcd x:0 0 0 2024-02-15T22:51:20.886 INFO:tasks.workunit.client.1.smithi170.stdout:4/666: creat d0/d9f/fce x:0 0 0 2024-02-15T22:51:20.887 INFO:tasks.workunit.client.1.smithi170.stdout:8/498: truncate d9/d18/f86 3740980 0 2024-02-15T22:51:20.889 INFO:tasks.workunit.client.1.smithi170.stdout:5/693: dwrite de/d10/d27/d4c/d53/d55/d95/fae [0,4194304] 0 2024-02-15T22:51:20.889 INFO:tasks.workunit.client.1.smithi170.stdout:5/694: dread - de/d10/d27/fea zero size 2024-02-15T22:51:20.889 INFO:tasks.workunit.client.1.smithi170.stdout:6/633: dwrite d3/d1d/f9f [4194304,4194304] 0 2024-02-15T22:51:20.890 INFO:tasks.workunit.client.1.smithi170.stdout:0/565: truncate d8/df/d13/d22/d39/d55/f8e 970117 0 2024-02-15T22:51:20.890 INFO:tasks.workunit.client.1.smithi170.stdout:0/566: stat d8/df/d13/l1d 0 2024-02-15T22:51:20.892 INFO:tasks.workunit.client.1.smithi170.stdout:2/616: creat d0/d1/d89/dd7/ff5 x:0 0 0 2024-02-15T22:51:20.894 INFO:tasks.workunit.client.1.smithi170.stdout:4/667: symlink d0/d22/da/d8b/d47/d5e/lcf 0 2024-02-15T22:51:20.895 INFO:tasks.workunit.client.1.smithi170.stdout:8/499: truncate d9/d18/d32/d3b/d4b/f5f 1929716 0 2024-02-15T22:51:20.896 INFO:tasks.workunit.client.1.smithi170.stdout:1/759: getdents d3/d24/d2c/d35/d83 0 2024-02-15T22:51:20.897 INFO:tasks.workunit.client.1.smithi170.stdout:1/760: dread d3/d24/d2c/d94/fff [0,4194304] 0 2024-02-15T22:51:20.899 INFO:tasks.workunit.client.1.smithi170.stdout:5/695: rename de/l14 to de/d36/d80/dc2/lf0 0 2024-02-15T22:51:20.900 INFO:tasks.workunit.client.1.smithi170.stdout:8/500: dread d9/f2d [0,4194304] 0 2024-02-15T22:51:20.900 INFO:tasks.workunit.client.1.smithi170.stdout:8/501: write d9/d18/d32/d3b/d68/f8e [1006906,103527] 0 2024-02-15T22:51:20.900 INFO:tasks.workunit.client.1.smithi170.stdout:8/502: chown d9/d18/d48/f76 801484 1 2024-02-15T22:51:20.900 INFO:tasks.workunit.client.1.smithi170.stdout:6/634: symlink d3/d1d/d36/ld8 0 2024-02-15T22:51:20.900 INFO:tasks.workunit.client.1.smithi170.stdout:6/635: write d3/d1d/d28/fbc [996953,11329] 0 2024-02-15T22:51:20.901 INFO:tasks.workunit.client.1.smithi170.stdout:0/567: symlink d8/d14/d1c/d3f/d51/lb7 0 2024-02-15T22:51:20.901 INFO:tasks.workunit.client.1.smithi170.stdout:0/568: fdatasync d8/f2a 0 2024-02-15T22:51:20.902 INFO:tasks.workunit.client.1.smithi170.stdout:2/617: rmdir d0/d2a/daa 39 2024-02-15T22:51:20.903 INFO:tasks.workunit.client.1.smithi170.stdout:4/668: mkdir d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0 0 2024-02-15T22:51:20.904 INFO:tasks.workunit.client.1.smithi170.stdout:4/669: dread d0/d22/f14 [0,4194304] 0 2024-02-15T22:51:20.904 INFO:tasks.workunit.client.1.smithi170.stdout:4/670: chown d0/d22/da/d8b/d47/d2b/c5d 77 1 2024-02-15T22:51:20.905 INFO:tasks.workunit.client.1.smithi170.stdout:1/761: creat d3/d24/d2c/d35/d72/df1/f10a x:0 0 0 2024-02-15T22:51:20.907 INFO:tasks.workunit.client.1.smithi170.stdout:8/503: mkdir d9/d18/d32/d7a/d78/d7f/d98/d9e 0 2024-02-15T22:51:20.908 INFO:tasks.workunit.client.1.smithi170.stdout:1/762: dread d3/d24/d2c/d35/df4/f108 [0,4194304] 0 2024-02-15T22:51:20.909 INFO:tasks.workunit.client.1.smithi170.stdout:6/636: rmdir d3/d24/d31/dc6/dcb 0 2024-02-15T22:51:20.910 INFO:tasks.workunit.client.1.smithi170.stdout:2/618: symlink d0/d1/d11/d26/d6e/d8a/lf6 0 2024-02-15T22:51:20.911 INFO:tasks.workunit.client.1.smithi170.stdout:4/671: symlink d0/d22/da/d8b/d47/dbe/da2/ld1 0 2024-02-15T22:51:20.912 INFO:tasks.workunit.client.1.smithi170.stdout:8/504: creat d9/d18/d32/d7a/d78/d7f/d98/f9f x:0 0 0 2024-02-15T22:51:20.913 INFO:tasks.workunit.client.1.smithi170.stdout:1/763: mknod d3/deb/c10b 0 2024-02-15T22:51:20.916 INFO:tasks.workunit.client.1.smithi170.stdout:6/637: symlink d3/d24/d31/dc6/ld9 0 2024-02-15T22:51:20.919 INFO:tasks.workunit.client.1.smithi170.stdout:2/619: unlink d0/d2a/lb6 0 2024-02-15T22:51:20.919 INFO:tasks.workunit.client.1.smithi170.stdout:7/674: sync 2024-02-15T22:51:20.923 INFO:tasks.workunit.client.1.smithi170.stdout:2/620: rename d0/d2a/daa/cba to d0/d1/d53/cf7 0 2024-02-15T22:51:20.923 INFO:tasks.workunit.client.1.smithi170.stdout:6/638: dread d3/d1d/d36/f14 [0,4194304] 0 2024-02-15T22:51:20.923 INFO:tasks.workunit.client.1.smithi170.stdout:6/639: fsync d3/d1d/d1b/d3e/f88 0 2024-02-15T22:51:20.923 INFO:tasks.workunit.client.1.smithi170.stdout:9/510: sync 2024-02-15T22:51:20.924 INFO:tasks.workunit.client.1.smithi170.stdout:2/621: write d0/d1d/d3d/d76/fa0 [4715256,64562] 0 2024-02-15T22:51:20.924 INFO:tasks.workunit.client.1.smithi170.stdout:2/622: dread - d0/d13/d59/fc2 zero size 2024-02-15T22:51:20.924 INFO:tasks.workunit.client.1.smithi170.stdout:9/511: write de/d1b/d1c/f46 [3581589,108838] 0 2024-02-15T22:51:20.925 INFO:tasks.workunit.client.1.smithi170.stdout:0/569: dwrite d8/d14/f1a [4194304,4194304] 0 2024-02-15T22:51:20.925 INFO:tasks.workunit.client.1.smithi170.stdout:7/675: rename da/d1a/d21/d19/l54 to da/d1a/d21/d2c/d2e/d7a/de2/le7 0 2024-02-15T22:51:20.925 INFO:tasks.workunit.client.1.smithi170.stdout:7/676: fdatasync da/d1a/d21/d1b/f8c 0 2024-02-15T22:51:20.926 INFO:tasks.workunit.client.1.smithi170.stdout:7/677: fsync da/d1a/d21/d1b/f88 0 2024-02-15T22:51:20.926 INFO:tasks.workunit.client.1.smithi170.stdout:7/678: write da/d1a/d21/d1b/f77 [4256003,59524] 0 2024-02-15T22:51:20.928 INFO:tasks.workunit.client.1.smithi170.stdout:0/570: unlink d8/df/d13/d22/d6a/c99 0 2024-02-15T22:51:20.928 INFO:tasks.workunit.client.1.smithi170.stdout:0/571: creat d8/df/d13/d36/d60/da2/fb8 x:0 0 0 2024-02-15T22:51:20.929 INFO:tasks.workunit.client.1.smithi170.stdout:7/679: mkdir da/d1a/d21/d4d/d6e/de8 0 2024-02-15T22:51:20.929 INFO:tasks.workunit.client.1.smithi170.stdout:7/680: fdatasync da/d1a/d21/d19/f94 0 2024-02-15T22:51:20.931 INFO:tasks.workunit.client.1.smithi170.stdout:0/572: write f5 [4481722,110077] 0 2024-02-15T22:51:20.934 INFO:tasks.workunit.client.1.smithi170.stdout:0/573: link d8/d14/d1c/d3f/c50 d8/d14/d1c/d3f/d53/cb9 0 2024-02-15T22:51:20.938 INFO:tasks.workunit.client.1.smithi170.stdout:0/574: rename d8/df/d13/f61 to d8/df/d13/d36/d60/fba 0 2024-02-15T22:51:20.943 INFO:tasks.workunit.client.1.smithi170.stdout:6/640: dread d3/f99 [0,4194304] 0 2024-02-15T22:51:20.943 INFO:tasks.workunit.client.1.smithi170.stdout:6/641: dread - d3/d1d/d1b/d3e/f88 zero size 2024-02-15T22:51:20.943 INFO:tasks.workunit.client.1.smithi170.stdout:6/642: truncate d3/d24/d31/f49 832163 0 2024-02-15T22:51:20.943 INFO:tasks.workunit.client.1.smithi170.stdout:6/643: chown d3/d1d/d27/f2d 119669 1 2024-02-15T22:51:20.944 INFO:tasks.workunit.client.1.smithi170.stdout:0/575: dread f1 [0,4194304] 0 2024-02-15T22:51:20.944 INFO:tasks.workunit.client.1.smithi170.stdout:9/512: write de/d1b/d1c/d1f/d20/f42 [861877,48076] 0 2024-02-15T22:51:20.944 INFO:tasks.workunit.client.1.smithi170.stdout:0/576: fdatasync d8/df/d13/f30 0 2024-02-15T22:51:20.945 INFO:tasks.workunit.client.1.smithi170.stdout:0/577: chown d8/d14/f76 122 1 2024-02-15T22:51:20.949 INFO:tasks.workunit.client.1.smithi170.stdout:7/681: dwrite da/d1a/d21/d2c/d74/f86 [0,4194304] 0 2024-02-15T22:51:20.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/623: dwrite d0/d1/d89/dd7/ff5 [0,4194304] 0 2024-02-15T22:51:20.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/624: chown d0/d1/d53/l79 179 1 2024-02-15T22:51:20.950 INFO:tasks.workunit.client.1.smithi170.stdout:2/625: truncate d0/f67 778680 0 2024-02-15T22:51:20.950 INFO:tasks.workunit.client.1.smithi170.stdout:4/672: dwrite d0/f9a [0,4194304] 0 2024-02-15T22:51:20.952 INFO:tasks.workunit.client.1.smithi170.stdout:7/682: truncate da/d1a/d21/fce 2941070 0 2024-02-15T22:51:20.955 INFO:tasks.workunit.client.1.smithi170.stdout:2/626: mknod d0/d1/d89/dd7/d83/cf8 0 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:4/673: truncate d0/d22/da/d8b/d47/dbe/d20/f4d 2420982 0 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:4/674: write d0/d22/da/d8b/d47/dbe/f36 [1818197,6242] 0 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:4/675: chown d0/d22/da/d8b/d47/d2b/fba 224208 1 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:7/683: mknod da/d1a/d21/d2c/d74/dde/ce9 0 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:7/684: rename da/d1a/d21 to da/d1a/d21/d2c/d74/d87/d9b/dea 22 2024-02-15T22:51:20.960 INFO:tasks.workunit.client.1.smithi170.stdout:2/627: mkdir d0/d1/d89/dd7/d2f/dbe/df9 0 2024-02-15T22:51:20.961 INFO:tasks.workunit.client.1.smithi170.stdout:4/676: creat d0/d22/da/d8b/d47/dbe/da2/fd2 x:0 0 0 2024-02-15T22:51:20.962 INFO:tasks.workunit.client.1.smithi170.stdout:7/685: unlink da/d1a/d21/d19/l5c 0 2024-02-15T22:51:20.963 INFO:tasks.workunit.client.1.smithi170.stdout:2/628: truncate d0/d1/d89/dd7/d2f/d37/f7c 863079 0 2024-02-15T22:51:20.963 INFO:tasks.workunit.client.1.smithi170.stdout:7/686: dread da/d1a/d21/d2c/d2e/d7a/fca [0,4194304] 0 2024-02-15T22:51:20.964 INFO:tasks.workunit.client.1.smithi170.stdout:7/687: dread - da/d1a/d21/d2c/d74/d87/dac/fc5 zero size 2024-02-15T22:51:20.965 INFO:tasks.workunit.client.1.smithi170.stdout:4/677: symlink d0/ld3 0 2024-02-15T22:51:20.965 INFO:tasks.workunit.client.1.smithi170.stdout:4/678: fdatasync d0/d22/da/d8b/d47/d5e/d73/f8c 0 2024-02-15T22:51:20.965 INFO:tasks.workunit.client.1.smithi170.stdout:7/688: dread da/d1a/d21/d2c/d2e/d7a/fca [0,4194304] 0 2024-02-15T22:51:20.965 INFO:tasks.workunit.client.1.smithi170.stdout:7/689: write da/d1a/d21/d1b/d69/f76 [1628391,12938] 0 2024-02-15T22:51:20.966 INFO:tasks.workunit.client.1.smithi170.stdout:9/513: dwrite de/d1b/d1c/d47/f4d [0,4194304] 0 2024-02-15T22:51:20.967 INFO:tasks.workunit.client.1.smithi170.stdout:2/629: mkdir d0/d1/d89/dd7/d83/dfa 0 2024-02-15T22:51:20.967 INFO:tasks.workunit.client.1.smithi170.stdout:2/630: write d0/d1/d31/f97 [207082,15862] 0 2024-02-15T22:51:20.968 INFO:tasks.workunit.client.1.smithi170.stdout:0/578: dwrite d8/df/d13/d22/d6a/d8f/f9b [4194304,4194304] 0 2024-02-15T22:51:20.971 INFO:tasks.workunit.client.1.smithi170.stdout:7/690: link da/d63/c78 da/d1a/d21/d4d/d6e/ceb 0 2024-02-15T22:51:20.980 INFO:tasks.workunit.client.1.smithi170.stdout:0/579: read d8/d14/d1c/d82/f9a [6389182,59175] 0 2024-02-15T22:51:20.982 INFO:tasks.workunit.client.1.smithi170.stdout:9/514: rename de/d1b/d1c/d1f/d20/d27/d84/faa to de/d1b/faf 0 2024-02-15T22:51:20.983 INFO:tasks.workunit.client.1.smithi170.stdout:0/580: getdents d8/df/d13/d22/d6a/d7e 0 2024-02-15T22:51:20.985 INFO:tasks.workunit.client.1.smithi170.stdout:9/515: creat de/d1b/d1c/d1f/d20/fb0 x:0 0 0 2024-02-15T22:51:20.986 INFO:tasks.workunit.client.1.smithi170.stdout:0/581: creat d8/df/d13/d22/d39/fbb x:0 0 0 2024-02-15T22:51:20.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/679: dwrite d0/d22/da/d8b/d47/d2b/f8f [4194304,4194304] 0 2024-02-15T22:51:20.989 INFO:tasks.workunit.client.1.smithi170.stdout:7/691: dwrite da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:20.990 INFO:tasks.workunit.client.1.smithi170.stdout:2/631: dwrite d0/d1/f12 [0,4194304] 0 2024-02-15T22:51:20.999 INFO:tasks.workunit.client.1.smithi170.stdout:2/632: mknod d0/d1/d11/d26/d6e/d8a/cfb 0 2024-02-15T22:51:21.001 INFO:tasks.workunit.client.1.smithi170.stdout:7/692: getdents da/d1a/d21/d1b 0 2024-02-15T22:51:21.004 INFO:tasks.workunit.client.1.smithi170.stdout:7/693: link da/l37 da/d1a/d21/d2c/d71/lec 0 2024-02-15T22:51:21.004 INFO:tasks.workunit.client.1.smithi170.stdout:7/694: read da/d1a/d21/d2c/d2e/d7a/fca [573708,66265] 0 2024-02-15T22:51:21.008 INFO:tasks.workunit.client.1.smithi170.stdout:0/582: dwrite d8/df/d13/d36/d60/f91 [0,4194304] 0 2024-02-15T22:51:21.008 INFO:tasks.workunit.client.1.smithi170.stdout:0/583: write d8/df/d13/f2e [4212121,68830] 0 2024-02-15T22:51:21.008 INFO:tasks.workunit.client.1.smithi170.stdout:0/584: read d8/d14/d1c/f1e [1689689,117913] 0 2024-02-15T22:51:21.008 INFO:tasks.workunit.client.1.smithi170.stdout:0/585: getdents d8/df/d13/d22/d6a/d7e 0 2024-02-15T22:51:21.008 INFO:tasks.workunit.client.1.smithi170.stdout:4/680: dwrite d0/d22/da/d8b/d47/d67/d77/fc0 [0,4194304] 0 2024-02-15T22:51:21.011 INFO:tasks.workunit.client.1.smithi170.stdout:7/695: write da/d1a/fa1 [748096,42924] 0 2024-02-15T22:51:21.012 INFO:tasks.workunit.client.1.smithi170.stdout:2/633: dread d0/d1/d89/dd7/f56 [0,4194304] 0 2024-02-15T22:51:21.016 INFO:tasks.workunit.client.1.smithi170.stdout:4/681: dread d0/d22/da/d8b/d47/d2b/f52 [0,4194304] 0 2024-02-15T22:51:21.020 INFO:tasks.workunit.client.1.smithi170.stdout:2/634: link d0/d1/f27 d0/d1/d5f/d74/d8e/df4/ffc 0 2024-02-15T22:51:21.020 INFO:tasks.workunit.client.1.smithi170.stdout:0/586: getdents d8/d14/d1c/d3f/d53 0 2024-02-15T22:51:21.022 INFO:tasks.workunit.client.1.smithi170.stdout:4/682: creat d0/d22/da/d8b/d47/db4/fd4 x:0 0 0 2024-02-15T22:51:21.023 INFO:tasks.workunit.client.1.smithi170.stdout:2/635: write d0/d1/d89/dd7/d2f/d37/f7c [1485326,108634] 0 2024-02-15T22:51:21.025 INFO:tasks.workunit.client.1.smithi170.stdout:0/587: link d8/d14/l45 d8/d14/d1c/d3f/lbc 0 2024-02-15T22:51:21.025 INFO:tasks.workunit.client.1.smithi170.stdout:0/588: chown d8/df/d13 5 1 2024-02-15T22:51:21.028 INFO:tasks.workunit.client.1.smithi170.stdout:4/683: rename d0/ld3 to d0/d9f/ld5 0 2024-02-15T22:51:21.030 INFO:tasks.workunit.client.1.smithi170.stdout:7/696: dwrite da/f64 [0,4194304] 0 2024-02-15T22:51:21.030 INFO:tasks.workunit.client.1.smithi170.stdout:7/697: creat da/d1a/d21/d2c/d74/d87/daf/fed x:0 0 0 2024-02-15T22:51:21.030 INFO:tasks.workunit.client.1.smithi170.stdout:7/698: fsync da/d1a/d21/d19/f91 0 2024-02-15T22:51:21.031 INFO:tasks.workunit.client.1.smithi170.stdout:0/589: truncate d8/d14/d70/f8a 2158078 0 2024-02-15T22:51:21.039 INFO:tasks.workunit.client.1.smithi170.stdout:7/699: creat da/d1a/d21/d2c/d74/dde/d7d/fee x:0 0 0 2024-02-15T22:51:21.040 INFO:tasks.workunit.client.1.smithi170.stdout:2/636: dwrite d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fc3 [0,4194304] 0 2024-02-15T22:51:21.040 INFO:tasks.workunit.client.1.smithi170.stdout:2/637: chown d0/c30 292509 1 2024-02-15T22:51:21.045 INFO:tasks.workunit.client.1.smithi170.stdout:4/684: dwrite d0/d22/da/d8b/d47/dbe/f26 [4194304,4194304] 0 2024-02-15T22:51:21.045 INFO:tasks.workunit.client.1.smithi170.stdout:4/685: stat d0/d22/d6e/l83 0 2024-02-15T22:51:21.045 INFO:tasks.workunit.client.1.smithi170.stdout:4/686: readlink d0/d22/da/d8b/d47/dbe/l64 0 2024-02-15T22:51:21.046 INFO:tasks.workunit.client.1.smithi170.stdout:4/687: symlink d0/d22/da/d8b/d47/dbe/d89/ld6 0 2024-02-15T22:51:21.048 INFO:tasks.workunit.client.1.smithi170.stdout:7/700: rename da/d63 to da/d1a/def 0 2024-02-15T22:51:21.049 INFO:tasks.workunit.client.1.smithi170.stdout:4/688: creat d0/d22/da/d8b/d47/d67/d77/dc5/fd7 x:0 0 0 2024-02-15T22:51:21.049 INFO:tasks.workunit.client.1.smithi170.stdout:0/590: dwrite d8/d14/d1c/f1e [0,4194304] 0 2024-02-15T22:51:21.050 INFO:tasks.workunit.client.1.smithi170.stdout:2/638: rename d0/d1/d89/dd7/d2f/fdb to d0/d1/d5f/de5/ffd 0 2024-02-15T22:51:21.052 INFO:tasks.workunit.client.1.smithi170.stdout:7/701: mkdir da/d1a/d21/d2c/d74/dde/dc7/df0 0 2024-02-15T22:51:21.052 INFO:tasks.workunit.client.1.smithi170.stdout:7/702: dread - da/fcb zero size 2024-02-15T22:51:21.052 INFO:tasks.workunit.client.1.smithi170.stdout:7/703: write da/d1a/d21/d2c/d74/dde/dc7/fdb [851503,42747] 0 2024-02-15T22:51:21.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/591: mknod d8/d14/d1c/d82/cbd 0 2024-02-15T22:51:21.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/592: write d8/f29 [9431236,43389] 0 2024-02-15T22:51:21.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/593: chown d8/cb 213 1 2024-02-15T22:51:21.056 INFO:tasks.workunit.client.1.smithi170.stdout:2/639: creat d0/d1/d89/dd7/d2f/dbe/ffe x:0 0 0 2024-02-15T22:51:21.056 INFO:tasks.workunit.client.1.smithi170.stdout:2/640: write d0/d1/d89/ff0 [106017,49225] 0 2024-02-15T22:51:21.056 INFO:tasks.workunit.client.1.smithi170.stdout:2/641: fdatasync d0/d1/f27 0 2024-02-15T22:51:21.059 INFO:tasks.workunit.client.1.smithi170.stdout:7/704: mkdir da/d1a/d21/d2c/d74/dde/d7d/d72/df1 0 2024-02-15T22:51:21.059 INFO:tasks.workunit.client.1.smithi170.stdout:7/705: readlink da/d1a/d21/d2c/d2e/la0 0 2024-02-15T22:51:21.059 INFO:tasks.workunit.client.1.smithi170.stdout:7/706: write da/d1a/d21/d19/f96 [352872,51834] 0 2024-02-15T22:51:21.062 INFO:tasks.workunit.client.1.smithi170.stdout:2/642: creat d0/d1/d89/dd7/d2f/ddf/fff x:0 0 0 2024-02-15T22:51:21.063 INFO:tasks.workunit.client.1.smithi170.stdout:7/707: mknod da/d1a/d21/d4d/d6e/de8/cf2 0 2024-02-15T22:51:21.067 INFO:tasks.workunit.client.1.smithi170.stdout:4/689: rename d0/d9f/ld5 to d0/d22/da/d8b/d47/d5e/ld8 0 2024-02-15T22:51:21.068 INFO:tasks.workunit.client.1.smithi170.stdout:0/594: dwrite d8/d14/d44/f79 [0,4194304] 0 2024-02-15T22:51:21.070 INFO:tasks.workunit.client.1.smithi170.stdout:7/708: mkdir da/d57/df3 0 2024-02-15T22:51:21.070 INFO:tasks.workunit.client.1.smithi170.stdout:7/709: dread - da/d1a/d21/d2c/d74/dde/d7d/d72/fbc zero size 2024-02-15T22:51:21.070 INFO:tasks.workunit.client.1.smithi170.stdout:7/710: dread - da/d1a/def/fe3 zero size 2024-02-15T22:51:21.071 INFO:tasks.workunit.client.1.smithi170.stdout:7/711: read da/d1a/d21/d2c/d74/dde/dc7/fdb [98251,62356] 0 2024-02-15T22:51:21.071 INFO:tasks.workunit.client.1.smithi170.stdout:7/712: fdatasync da/d1a/d21/d2c/d74/f86 0 2024-02-15T22:51:21.072 INFO:tasks.workunit.client.1.smithi170.stdout:2/643: rename d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fd5 to d0/d13/d59/d82/f100 0 2024-02-15T22:51:21.082 INFO:tasks.workunit.client.1.smithi170.stdout:7/713: creat da/d1a/d21/d2c/d2e/d7a/de2/de5/ff4 x:0 0 0 2024-02-15T22:51:21.094 INFO:tasks.workunit.client.1.smithi170.stdout:0/595: dwrite d8/d14/d1c/f24 [0,4194304] 0 2024-02-15T22:51:21.094 INFO:tasks.workunit.client.1.smithi170.stdout:0/596: creat d8/d14/d70/fbe x:0 0 0 2024-02-15T22:51:21.102 INFO:tasks.workunit.client.1.smithi170.stdout:7/714: dwrite da/d1a/d21/d2c/d74/d87/dac/f66 [0,4194304] 0 2024-02-15T22:51:21.102 INFO:tasks.workunit.client.1.smithi170.stdout:2/644: dwrite d0/d1/d53/fcd [0,4194304] 0 2024-02-15T22:51:21.103 INFO:tasks.workunit.client.1.smithi170.stdout:7/715: unlink da/d1a/d21/d2c/d2e/la0 0 2024-02-15T22:51:21.103 INFO:tasks.workunit.client.1.smithi170.stdout:7/716: write da/d57/f7b [397592,93831] 0 2024-02-15T22:51:21.103 INFO:tasks.workunit.client.1.smithi170.stdout:7/717: fsync da/d1a/d21/d19/f50 0 2024-02-15T22:51:21.105 INFO:tasks.workunit.client.1.smithi170.stdout:2/645: fsync d0/d1/d11/fc1 0 2024-02-15T22:51:21.109 INFO:tasks.workunit.client.1.smithi170.stdout:7/718: dread da/d1a/d21/d2c/f84 [0,4194304] 0 2024-02-15T22:51:21.111 INFO:tasks.workunit.client.1.smithi170.stdout:0/597: dwrite d8/df/d13/d22/f4b [0,4194304] 0 2024-02-15T22:51:21.111 INFO:tasks.workunit.client.1.smithi170.stdout:0/598: write d8/d14/d1c/d3f/d51/f5a [1727968,49584] 0 2024-02-15T22:51:21.111 INFO:tasks.workunit.client.1.smithi170.stdout:0/599: truncate d8/d6d/f89 322469 0 2024-02-15T22:51:21.112 INFO:tasks.workunit.client.1.smithi170.stdout:0/600: write d8/d6d/f89 [255696,109714] 0 2024-02-15T22:51:21.113 INFO:tasks.workunit.client.1.smithi170.stdout:0/601: mknod d8/df/d13/d22/d39/cbf 0 2024-02-15T22:51:21.118 INFO:tasks.workunit.client.1.smithi170.stdout:7/719: write da/d1a/d21/f70 [4108520,126480] 0 2024-02-15T22:51:21.118 INFO:tasks.workunit.client.1.smithi170.stdout:7/720: chown da/d1a/d21/d19/c44 2 1 2024-02-15T22:51:21.118 INFO:tasks.workunit.client.1.smithi170.stdout:7/721: mknod da/d1a/d21/d2c/cf5 0 2024-02-15T22:51:21.120 INFO:tasks.workunit.client.1.smithi170.stdout:7/722: rename da/c40 to da/d1a/d21/d2c/d74/dde/d7d/d72/dd4/dd6/cf6 0 2024-02-15T22:51:21.120 INFO:tasks.workunit.client.1.smithi170.stdout:7/723: chown da/d1a/d21/d2c/d74/dde/d7d/c65 4 1 2024-02-15T22:51:21.127 INFO:tasks.workunit.client.1.smithi170.stdout:2/646: dwrite d0/d1d/f4e [0,4194304] 0 2024-02-15T22:51:21.127 INFO:tasks.workunit.client.1.smithi170.stdout:2/647: chown d0/d2a 119527987 1 2024-02-15T22:51:21.128 INFO:tasks.workunit.client.1.smithi170.stdout:7/724: dread da/d1a/d21/d2c/f84 [0,4194304] 0 2024-02-15T22:51:21.142 INFO:tasks.workunit.client.1.smithi170.stdout:0/602: dwrite d8/df/d13/f30 [0,4194304] 0 2024-02-15T22:51:21.145 INFO:tasks.workunit.client.1.smithi170.stdout:0/603: dread d8/df/d13/f5c [0,4194304] 0 2024-02-15T22:51:21.146 INFO:tasks.workunit.client.1.smithi170.stdout:0/604: creat d8/df/d13/d22/d39/d55/fc0 x:0 0 0 2024-02-15T22:51:21.147 INFO:tasks.workunit.client.1.smithi170.stdout:0/605: mknod d8/df/d13/d22/d6a/d7e/cc1 0 2024-02-15T22:51:21.148 INFO:tasks.workunit.client.1.smithi170.stdout:2/648: dwrite d0/d1/d11/d26/f9a [0,4194304] 0 2024-02-15T22:51:21.149 INFO:tasks.workunit.client.1.smithi170.stdout:7/725: dwrite da/d1a/d21/d1b/fc3 [0,4194304] 0 2024-02-15T22:51:21.150 INFO:tasks.workunit.client.1.smithi170.stdout:2/649: link d0/d13/fa8 d0/d1/d5f/d74/f101 0 2024-02-15T22:51:21.154 INFO:tasks.workunit.client.1.smithi170.stdout:7/726: mkdir da/d1a/d21/d1b/df7 0 2024-02-15T22:51:21.154 INFO:tasks.workunit.client.1.smithi170.stdout:7/727: chown da/d1a/d21/d2c/lcd 2 1 2024-02-15T22:51:21.155 INFO:tasks.workunit.client.1.smithi170.stdout:0/606: dread d8/d14/f76 [4194304,4194304] 0 2024-02-15T22:51:21.156 INFO:tasks.workunit.client.1.smithi170.stdout:2/650: mknod d0/d1/d89/dd7/c102 0 2024-02-15T22:51:21.157 INFO:tasks.workunit.client.1.smithi170.stdout:7/728: rename da/d1a/d21/fce to da/d1a/d21/d2c/d74/dde/d7d/d72/df1/ff8 0 2024-02-15T22:51:21.160 INFO:tasks.workunit.client.1.smithi170.stdout:0/607: symlink d8/lc2 0 2024-02-15T22:51:21.160 INFO:tasks.workunit.client.1.smithi170.stdout:0/608: write d8/d14/d70/fbe [609059,71458] 0 2024-02-15T22:51:21.176 INFO:tasks.workunit.client.1.smithi170.stdout:2/651: dwrite d0/d1d/d3d/d76/fa0 [0,4194304] 0 2024-02-15T22:51:21.178 INFO:tasks.workunit.client.1.smithi170.stdout:2/652: mknod d0/d1/d11/d26/c103 0 2024-02-15T22:51:21.178 INFO:tasks.workunit.client.1.smithi170.stdout:0/609: dwrite d8/d14/d1c/d3f/f58 [0,4194304] 0 2024-02-15T22:51:21.179 INFO:tasks.workunit.client.1.smithi170.stdout:0/610: write d8/df/f12 [1441879,15676] 0 2024-02-15T22:51:21.179 INFO:tasks.workunit.client.1.smithi170.stdout:2/653: symlink d0/d1/l104 0 2024-02-15T22:51:21.181 INFO:tasks.workunit.client.1.smithi170.stdout:0/611: mknod d8/d6d/d96/cc3 0 2024-02-15T22:51:21.189 INFO:tasks.workunit.client.1.smithi170.stdout:2/654: dread d0/d1/d89/dd7/d2f/fca [0,4194304] 0 2024-02-15T22:51:21.207 INFO:tasks.workunit.client.1.smithi170.stdout:2/655: dwrite d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dc8/fd2 [0,4194304] 0 2024-02-15T22:51:21.207 INFO:tasks.workunit.client.1.smithi170.stdout:2/656: fdatasync d0/f2c 0 2024-02-15T22:51:21.216 INFO:tasks.workunit.client.1.smithi170.stdout:2/657: write d0/d1/d89/dd7/d2f/d37/f4f [3255124,13342] 0 2024-02-15T22:51:21.216 INFO:tasks.workunit.client.1.smithi170.stdout:2/658: chown d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fe7 0 1 2024-02-15T22:51:21.218 INFO:tasks.workunit.client.1.smithi170.stdout:2/659: mkdir d0/d13/d59/d105 0 2024-02-15T22:51:21.218 INFO:tasks.workunit.client.1.smithi170.stdout:2/660: chown d0/d2a/fdd 19427138 1 2024-02-15T22:51:21.218 INFO:tasks.workunit.client.1.smithi170.stdout:2/661: dread - d0/d1/d5f/fd1 zero size 2024-02-15T22:51:21.218 INFO:tasks.workunit.client.1.smithi170.stdout:2/662: chown d0/d1/d89/dd7/d2f/d37/d58 168 1 2024-02-15T22:51:21.231 INFO:tasks.workunit.client.1.smithi170.stdout:2/663: dwrite d0/d1/d89/d8b/fbf [0,4194304] 0 2024-02-15T22:51:21.231 INFO:tasks.workunit.client.1.smithi170.stdout:2/664: truncate d0/d1/d11/d26/f9a 4729478 0 2024-02-15T22:51:21.232 INFO:tasks.workunit.client.1.smithi170.stdout:2/665: dread - d0/d1/d89/dd7/d3e/f43 zero size 2024-02-15T22:51:21.232 INFO:tasks.workunit.client.1.smithi170.stdout:2/666: getdents d0/d1/d5f/de5 0 2024-02-15T22:51:21.233 INFO:tasks.workunit.client.1.smithi170.stdout:2/667: write d0/d1/d89/dd7/d2f/d37/d58/f96 [1141226,29119] 0 2024-02-15T22:51:21.236 INFO:tasks.workunit.client.1.smithi170.stdout:2/668: read d0/d1/f27 [351499,7915] 0 2024-02-15T22:51:21.236 INFO:tasks.workunit.client.1.smithi170.stdout:2/669: chown d0/d2a/c36 2 1 2024-02-15T22:51:21.236 INFO:tasks.workunit.client.1.smithi170.stdout:2/670: fsync d0/d1/d89/dd7/d2f/d37/f7c 0 2024-02-15T22:51:21.243 INFO:tasks.workunit.client.1.smithi170.stdout:2/671: dread d0/d1/d5f/d74/f101 [0,4194304] 0 2024-02-15T22:51:21.243 INFO:tasks.workunit.client.1.smithi170.stdout:2/672: fdatasync d0/d1/d5f/fd1 0 2024-02-15T22:51:21.244 INFO:tasks.workunit.client.1.smithi170.stdout:2/673: unlink d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dc8/fd2 0 2024-02-15T22:51:21.245 INFO:tasks.workunit.client.1.smithi170.stdout:1/764: sync 2024-02-15T22:51:21.245 INFO:tasks.workunit.client.1.smithi170.stdout:3/569: sync 2024-02-15T22:51:21.245 INFO:tasks.workunit.client.1.smithi170.stdout:8/505: sync 2024-02-15T22:51:21.245 INFO:tasks.workunit.client.1.smithi170.stdout:9/516: sync 2024-02-15T22:51:21.245 INFO:tasks.workunit.client.1.smithi170.stdout:6/644: sync 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:5/696: sync 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:1/765: read d3/fb [128601,23392] 0 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:9/517: fdatasync de/d1b/d1c/d1f/d20/d27/d2c/f44 0 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:1/766: fsync d3/d24/d2c/d77/dce/fe1 0 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:3/570: creat d3/d1b/fb5 x:0 0 0 2024-02-15T22:51:21.246 INFO:tasks.workunit.client.1.smithi170.stdout:3/571: truncate d3/dc/d13/f43 683008 0 2024-02-15T22:51:21.247 INFO:tasks.workunit.client.1.smithi170.stdout:8/506: symlink d9/la0 0 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:1/767: creat d3/d24/f10c x:0 0 0 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:1/768: chown d3/da2/ldc 72725543 1 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:1/769: creat d3/d24/d2c/d35/d72/f10d x:0 0 0 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:1/770: fsync d3/da2/f3b 0 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:1/771: truncate d3/d24/d2c/d5e/f8a 730763 0 2024-02-15T22:51:21.249 INFO:tasks.workunit.client.1.smithi170.stdout:6/645: write d3/d1d/f7b [1147085,90895] 0 2024-02-15T22:51:21.250 INFO:tasks.workunit.client.1.smithi170.stdout:3/572: mknod d3/d1b/d51/d6b/d86/cb6 0 2024-02-15T22:51:21.250 INFO:tasks.workunit.client.1.smithi170.stdout:3/573: write d3/d1b/d8a/fac [4019840,4679] 0 2024-02-15T22:51:21.251 INFO:tasks.workunit.client.1.smithi170.stdout:8/507: mknod d9/d18/d32/ca1 0 2024-02-15T22:51:21.251 INFO:tasks.workunit.client.1.smithi170.stdout:8/508: stat d9/d18/d32/d3b/c63 0 2024-02-15T22:51:21.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/518: mkdir de/d1b/d1c/d1f/d20/d27/d28/db1 0 2024-02-15T22:51:21.252 INFO:tasks.workunit.client.1.smithi170.stdout:9/519: stat de/d1b/d1c/c60 0 2024-02-15T22:51:21.253 INFO:tasks.workunit.client.1.smithi170.stdout:2/674: write d0/d1d/d3d/f5c [2250154,87473] 0 2024-02-15T22:51:21.254 INFO:tasks.workunit.client.1.smithi170.stdout:1/772: creat d3/d24/d2c/d5e/de9/f10e x:0 0 0 2024-02-15T22:51:21.255 INFO:tasks.workunit.client.1.smithi170.stdout:9/520: dread de/f75 [0,4194304] 0 2024-02-15T22:51:21.257 INFO:tasks.workunit.client.1.smithi170.stdout:5/697: read de/d10/d27/d4c/d53/f63 [3784937,127216] 0 2024-02-15T22:51:21.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/646: rename d3/d1d/d53/l84 to d3/d1d/d28/d66/lda 0 2024-02-15T22:51:21.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/647: truncate d3/d1d/d27/d70/da5/fca 758701 0 2024-02-15T22:51:21.258 INFO:tasks.workunit.client.1.smithi170.stdout:6/648: chown d3/d1d/d27/d70/c8d 311 1 2024-02-15T22:51:21.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/509: unlink d9/d18/d26/c2c 0 2024-02-15T22:51:21.261 INFO:tasks.workunit.client.1.smithi170.stdout:6/649: dread d3/d1d/d28/d66/f68 [0,4194304] 0 2024-02-15T22:51:21.261 INFO:tasks.workunit.client.1.smithi170.stdout:2/675: mknod d0/d1/d5f/de5/c106 0 2024-02-15T22:51:21.262 INFO:tasks.workunit.client.1.smithi170.stdout:1/773: chown d3/l16 475306 1 2024-02-15T22:51:21.263 INFO:tasks.workunit.client.1.smithi170.stdout:9/521: readlink de/d1b/d1c/d1f/d20/d27/d28/l89 0 2024-02-15T22:51:21.265 INFO:tasks.workunit.client.1.smithi170.stdout:5/698: mkdir de/d10/d33/d67/df1 0 2024-02-15T22:51:21.268 INFO:tasks.workunit.client.1.smithi170.stdout:3/574: dwrite d3/d1b/d8a/fac [0,4194304] 0 2024-02-15T22:51:21.268 INFO:tasks.workunit.client.1.smithi170.stdout:3/575: readlink d3/l62 0 2024-02-15T22:51:21.268 INFO:tasks.workunit.client.1.smithi170.stdout:6/650: symlink d3/d1d/d1b/d3e/d9c/ldb 0 2024-02-15T22:51:21.268 INFO:tasks.workunit.client.1.smithi170.stdout:6/651: chown d3/d24/d31/dc6/ld9 3 1 2024-02-15T22:51:21.271 INFO:tasks.workunit.client.1.smithi170.stdout:2/676: creat d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f107 x:0 0 0 2024-02-15T22:51:21.272 INFO:tasks.workunit.client.1.smithi170.stdout:1/774: creat d3/d24/d2c/d77/d8f/dcd/f10f x:0 0 0 2024-02-15T22:51:21.273 INFO:tasks.workunit.client.1.smithi170.stdout:6/652: dread d3/d1d/d28/f7d [0,4194304] 0 2024-02-15T22:51:21.273 INFO:tasks.workunit.client.1.smithi170.stdout:6/653: chown d3/c1e 11 1 2024-02-15T22:51:21.273 INFO:tasks.workunit.client.1.smithi170.stdout:6/654: chown d3/c60 85 1 2024-02-15T22:51:21.274 INFO:tasks.workunit.client.1.smithi170.stdout:9/522: unlink de/d1b/d37/f3b 0 2024-02-15T22:51:21.275 INFO:tasks.workunit.client.1.smithi170.stdout:8/510: getdents d9/d18/d32/d7a/d78/d7f 0 2024-02-15T22:51:21.275 INFO:tasks.workunit.client.1.smithi170.stdout:8/511: readlink d9/d18/l75 0 2024-02-15T22:51:21.276 INFO:tasks.workunit.client.1.smithi170.stdout:3/576: stat d3/l65 0 2024-02-15T22:51:21.277 INFO:tasks.workunit.client.1.smithi170.stdout:5/699: dwrite de/d10/d27/fc9 [4194304,4194304] 0 2024-02-15T22:51:21.278 INFO:tasks.workunit.client.1.smithi170.stdout:5/700: truncate de/d10/d27/fea 1047682 0 2024-02-15T22:51:21.278 INFO:tasks.workunit.client.1.smithi170.stdout:2/677: truncate d0/f67 828916 0 2024-02-15T22:51:21.279 INFO:tasks.workunit.client.1.smithi170.stdout:1/775: mkdir d3/d24/d2c/d77/d110 0 2024-02-15T22:51:21.279 INFO:tasks.workunit.client.1.smithi170.stdout:1/776: read d3/d24/f8d [480204,9550] 0 2024-02-15T22:51:21.282 INFO:tasks.workunit.client.1.smithi170.stdout:6/655: link d3/f4 d3/db8/d96/fdc 0 2024-02-15T22:51:21.284 INFO:tasks.workunit.client.1.smithi170.stdout:8/512: symlink d9/d18/d32/d7a/d78/d7f/d98/d9d/la2 0 2024-02-15T22:51:21.285 INFO:tasks.workunit.client.1.smithi170.stdout:3/577: link d3/db/f11 d3/d1b/d51/d94/fb7 0 2024-02-15T22:51:21.285 INFO:tasks.workunit.client.1.smithi170.stdout:3/578: dread - d3/d1b/d2c/d92/da5/fb4 zero size 2024-02-15T22:51:21.288 INFO:tasks.workunit.client.1.smithi170.stdout:5/701: rename de/d36/d80/l97 to de/d10/d33/d9f/d7c/lf2 0 2024-02-15T22:51:21.288 INFO:tasks.workunit.client.1.smithi170.stdout:5/702: chown de/d10/f90 0 1 2024-02-15T22:51:21.290 INFO:tasks.workunit.client.1.smithi170.stdout:6/656: creat d3/d1d/d36/d56/daf/fdd x:0 0 0 2024-02-15T22:51:21.292 INFO:tasks.workunit.client.1.smithi170.stdout:2/678: dwrite d0/d13/d59/d82/f100 [0,4194304] 0 2024-02-15T22:51:21.294 INFO:tasks.workunit.client.1.smithi170.stdout:3/579: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:21.294 INFO:tasks.workunit.client.1.smithi170.stdout:3/580: readlink d3/dc/l7c 0 2024-02-15T22:51:21.294 INFO:tasks.workunit.client.1.smithi170.stdout:3/581: dread - d3/d1b/d2c/d92/da5/fb4 zero size 2024-02-15T22:51:21.295 INFO:tasks.workunit.client.1.smithi170.stdout:1/777: getdents d3/da2/d4a 0 2024-02-15T22:51:21.295 INFO:tasks.workunit.client.1.smithi170.stdout:1/778: creat d3/d24/d2c/d35/d72/f111 x:0 0 0 2024-02-15T22:51:21.297 INFO:tasks.workunit.client.1.smithi170.stdout:6/657: truncate d3/d1d/d27/f5b 1133319 0 2024-02-15T22:51:21.302 INFO:tasks.workunit.client.1.smithi170.stdout:3/582: link d3/db/fa8 d3/d78/d7a/fb8 0 2024-02-15T22:51:21.302 INFO:tasks.workunit.client.1.smithi170.stdout:3/583: fdatasync d3/db/f22 0 2024-02-15T22:51:21.302 INFO:tasks.workunit.client.1.smithi170.stdout:3/584: fsync d3/dc/d1c/d3d/f96 0 2024-02-15T22:51:21.303 INFO:tasks.workunit.client.1.smithi170.stdout:1/779: stat d3/da2/de2/cfd 0 2024-02-15T22:51:21.304 INFO:tasks.workunit.client.1.smithi170.stdout:8/513: rmdir d9/d18/d32/d7a/d78/d7f/d98 39 2024-02-15T22:51:21.309 INFO:tasks.workunit.client.1.smithi170.stdout:6/658: mkdir d3/d1d/d28/d3b/dde 0 2024-02-15T22:51:21.309 INFO:tasks.workunit.client.1.smithi170.stdout:3/585: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:21.310 INFO:tasks.workunit.client.1.smithi170.stdout:5/703: dwrite de/d29/fde [0,4194304] 0 2024-02-15T22:51:21.312 INFO:tasks.workunit.client.1.smithi170.stdout:2/679: dwrite d0/d1/d89/dd7/f56 [4194304,4194304] 0 2024-02-15T22:51:21.312 INFO:tasks.workunit.client.1.smithi170.stdout:8/514: rename d9/d18/f85 to d9/d18/d32/d7a/d78/d7f/d98/d9e/fa3 0 2024-02-15T22:51:21.312 INFO:tasks.workunit.client.1.smithi170.stdout:8/515: fdatasync d9/d18/d26/d4f/f80 0 2024-02-15T22:51:21.312 INFO:tasks.workunit.client.1.smithi170.stdout:6/659: getdents d3/d24/d31/dc6 0 2024-02-15T22:51:21.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/586: truncate d3/dc/d13/f28 482226 0 2024-02-15T22:51:21.314 INFO:tasks.workunit.client.1.smithi170.stdout:3/587: write d3/d2b/f57 [282460,45540] 0 2024-02-15T22:51:21.316 INFO:tasks.workunit.client.1.smithi170.stdout:1/780: dwrite d3/d24/d2c/d35/f81 [0,4194304] 0 2024-02-15T22:51:21.316 INFO:tasks.workunit.client.1.smithi170.stdout:1/781: write d3/d24/d2c/ffc [1343116,87296] 0 2024-02-15T22:51:21.317 INFO:tasks.workunit.client.1.smithi170.stdout:1/782: chown d3/d24/d2c/d77/c79 5792200 1 2024-02-15T22:51:21.317 INFO:tasks.workunit.client.1.smithi170.stdout:1/783: fsync d3/d24/f66 0 2024-02-15T22:51:21.317 INFO:tasks.workunit.client.1.smithi170.stdout:5/704: rmdir de/d10/d52 39 2024-02-15T22:51:21.317 INFO:tasks.workunit.client.1.smithi170.stdout:5/705: fsync de/d10/d27/d2d/f65 0 2024-02-15T22:51:21.322 INFO:tasks.workunit.client.1.smithi170.stdout:8/516: creat d9/d18/d32/d3b/d42/fa4 x:0 0 0 2024-02-15T22:51:21.322 INFO:tasks.workunit.client.1.smithi170.stdout:8/517: fsync d9/f82 0 2024-02-15T22:51:21.323 INFO:tasks.workunit.client.1.smithi170.stdout:6/660: symlink d3/d1d/d28/d3b/ldf 0 2024-02-15T22:51:21.328 INFO:tasks.workunit.client.1.smithi170.stdout:5/706: mknod de/d36/cf3 0 2024-02-15T22:51:21.330 INFO:tasks.workunit.client.1.smithi170.stdout:2/680: getdents d0/d1/d89/dd7/d2f/ddf 0 2024-02-15T22:51:21.332 INFO:tasks.workunit.client.1.smithi170.stdout:6/661: rename d3/d1d/d28/d3b/cb2 to d3/d1d/dd3/ce0 0 2024-02-15T22:51:21.334 INFO:tasks.workunit.client.1.smithi170.stdout:5/707: unlink de/d36/lbe 0 2024-02-15T22:51:21.336 INFO:tasks.workunit.client.1.smithi170.stdout:2/681: getdents d0 0 2024-02-15T22:51:21.336 INFO:tasks.workunit.client.1.smithi170.stdout:2/682: read d0/d1/d89/dd7/d2f/f65 [3700153,55485] 0 2024-02-15T22:51:21.336 INFO:tasks.workunit.client.1.smithi170.stdout:2/683: write d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fe7 [83672,5447] 0 2024-02-15T22:51:21.336 INFO:tasks.workunit.client.1.smithi170.stdout:2/684: readlink d0/d1/d89/dd7/d2f/l72 0 2024-02-15T22:51:21.337 INFO:tasks.workunit.client.1.smithi170.stdout:2/685: write d0/d1/d89/dd7/d2f/d37/f4f [320122,37818] 0 2024-02-15T22:51:21.337 INFO:tasks.workunit.client.1.smithi170.stdout:3/588: dwrite d3/f6e [0,4194304] 0 2024-02-15T22:51:21.338 INFO:tasks.workunit.client.1.smithi170.stdout:6/662: creat d3/d1d/d1b/fe1 x:0 0 0 2024-02-15T22:51:21.339 INFO:tasks.workunit.client.1.smithi170.stdout:6/663: write d3/fa [416834,53999] 0 2024-02-15T22:51:21.339 INFO:tasks.workunit.client.1.smithi170.stdout:8/518: dread d9/f16 [0,4194304] 0 2024-02-15T22:51:21.340 INFO:tasks.workunit.client.1.smithi170.stdout:5/708: truncate de/d10/d33/d67/fcf 425226 0 2024-02-15T22:51:21.341 INFO:tasks.workunit.client.1.smithi170.stdout:8/519: dread d9/d18/d32/f4c [0,4194304] 0 2024-02-15T22:51:21.342 INFO:tasks.workunit.client.1.smithi170.stdout:2/686: unlink d0/d1/d89/dd7/d2f/d37/d58/d78/da4/fc3 0 2024-02-15T22:51:21.344 INFO:tasks.workunit.client.1.smithi170.stdout:1/784: dwrite d3/d24/d2c/d77/fe7 [0,4194304] 0 2024-02-15T22:51:21.344 INFO:tasks.workunit.client.1.smithi170.stdout:3/589: creat d3/d1b/d2c/fb9 x:0 0 0 2024-02-15T22:51:21.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/664: creat d3/d1d/d36/d56/daf/dd5/fe2 x:0 0 0 2024-02-15T22:51:21.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/665: stat d3/d24/d31/lcc 0 2024-02-15T22:51:21.347 INFO:tasks.workunit.client.1.smithi170.stdout:5/709: symlink de/d10/d33/d67/lf4 0 2024-02-15T22:51:21.351 INFO:tasks.workunit.client.1.smithi170.stdout:1/785: dread d3/d24/d2c/d5e/fe8 [0,4194304] 0 2024-02-15T22:51:21.353 INFO:tasks.workunit.client.1.smithi170.stdout:2/687: write d0/d1/d89/dd7/ff5 [396072,121914] 0 2024-02-15T22:51:21.353 INFO:tasks.workunit.client.1.smithi170.stdout:2/688: stat d0/d1/d11/d26 0 2024-02-15T22:51:21.353 INFO:tasks.workunit.client.1.smithi170.stdout:2/689: fsync d0/d1/d89/dd7/d2f/dbe/ffe 0 2024-02-15T22:51:21.353 INFO:tasks.workunit.client.1.smithi170.stdout:1/786: dread d3/d24/d2c/d35/fd1 [0,4194304] 0 2024-02-15T22:51:21.354 INFO:tasks.workunit.client.1.smithi170.stdout:1/787: dread d3/d24/d2c/d5e/fd6 [0,4194304] 0 2024-02-15T22:51:21.354 INFO:tasks.workunit.client.1.smithi170.stdout:1/788: dread - d3/d24/d2c/d77/d8f/dcd/f10f zero size 2024-02-15T22:51:21.354 INFO:tasks.workunit.client.1.smithi170.stdout:1/789: read - d3/d24/d2c/d35/d72/df1/f10a zero size 2024-02-15T22:51:21.358 INFO:tasks.workunit.client.1.smithi170.stdout:6/666: write d3/d1d/d28/f47 [2597612,32164] 0 2024-02-15T22:51:21.358 INFO:tasks.workunit.client.1.smithi170.stdout:6/667: creat d3/d1a/fe3 x:0 0 0 2024-02-15T22:51:21.359 INFO:tasks.workunit.client.1.smithi170.stdout:3/590: rename d3/dc/d1c/d3d/f87 to d3/db/d1f/fba 0 2024-02-15T22:51:21.360 INFO:tasks.workunit.client.1.smithi170.stdout:8/520: dwrite d9/d18/d26/d4f/f80 [0,4194304] 0 2024-02-15T22:51:21.361 INFO:tasks.workunit.client.1.smithi170.stdout:2/690: mkdir d0/d1/d89/dd7/d2f/dbe/df9/d108 0 2024-02-15T22:51:21.363 INFO:tasks.workunit.client.1.smithi170.stdout:6/668: creat d3/db8/d96/fe4 x:0 0 0 2024-02-15T22:51:21.365 INFO:tasks.workunit.client.1.smithi170.stdout:1/790: rename d3/d24/d2c/d35/la8 to d3/d24/d2c/d5e/l112 0 2024-02-15T22:51:21.366 INFO:tasks.workunit.client.1.smithi170.stdout:5/710: dwrite de/d10/d52/f73 [0,4194304] 0 2024-02-15T22:51:21.366 INFO:tasks.workunit.client.1.smithi170.stdout:5/711: chown de/d10/d33/d9f/d7c/d87 13 1 2024-02-15T22:51:21.370 INFO:tasks.workunit.client.1.smithi170.stdout:8/521: mkdir d9/d18/d32/d7a/d78/d7f/d98/d9e/da5 0 2024-02-15T22:51:21.371 INFO:tasks.workunit.client.1.smithi170.stdout:6/669: truncate d3/f99 3050009 0 2024-02-15T22:51:21.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/523: sync 2024-02-15T22:51:21.373 INFO:tasks.workunit.client.1.smithi170.stdout:4/690: sync 2024-02-15T22:51:21.373 INFO:tasks.workunit.client.1.smithi170.stdout:4/691: chown d0/d22/da/c5f 0 1 2024-02-15T22:51:21.373 INFO:tasks.workunit.client.1.smithi170.stdout:4/692: readlink d0/d22/db9/lc3 0 2024-02-15T22:51:21.373 INFO:tasks.workunit.client.1.smithi170.stdout:7/729: sync 2024-02-15T22:51:21.376 INFO:tasks.workunit.client.1.smithi170.stdout:0/612: sync 2024-02-15T22:51:21.378 INFO:tasks.workunit.client.1.smithi170.stdout:3/591: unlink d3/db/d1f/fba 0 2024-02-15T22:51:21.381 INFO:tasks.workunit.client.1.smithi170.stdout:6/670: mkdir d3/d1d/d28/d3b/da3/de5 0 2024-02-15T22:51:21.383 INFO:tasks.workunit.client.1.smithi170.stdout:3/592: dread d3/dc/f17 [0,4194304] 0 2024-02-15T22:51:21.383 INFO:tasks.workunit.client.1.smithi170.stdout:2/691: rename d0/d1/d53/cad to d0/d1/d11/c109 0 2024-02-15T22:51:21.383 INFO:tasks.workunit.client.1.smithi170.stdout:2/692: stat d0/d1/d89/dd7/d2f/dbe/ffe 0 2024-02-15T22:51:21.383 INFO:tasks.workunit.client.1.smithi170.stdout:2/693: creat d0/d1/d89/dd7/f10a x:0 0 0 2024-02-15T22:51:21.383 INFO:tasks.workunit.client.1.smithi170.stdout:2/694: chown d0/d1/d89/dd7/d2f/d37/d58/d78/fcc 1 1 2024-02-15T22:51:21.384 INFO:tasks.workunit.client.1.smithi170.stdout:2/695: chown d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f107 9657 1 2024-02-15T22:51:21.384 INFO:tasks.workunit.client.1.smithi170.stdout:9/524: read de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [1787010,109508] 0 2024-02-15T22:51:21.384 INFO:tasks.workunit.client.1.smithi170.stdout:9/525: chown de/d1b/d1c/d1f/d20/d27/d2c/f32 2032182526 1 2024-02-15T22:51:21.385 INFO:tasks.workunit.client.1.smithi170.stdout:9/526: write de/d1b/d1c/f5b [4838856,87197] 0 2024-02-15T22:51:21.385 INFO:tasks.workunit.client.1.smithi170.stdout:9/527: write de/d1b/d1c/d1f/d20/d27/d28/d69/fa8 [218755,76741] 0 2024-02-15T22:51:21.385 INFO:tasks.workunit.client.1.smithi170.stdout:1/791: mknod d3/da2/d65/c113 0 2024-02-15T22:51:21.385 INFO:tasks.workunit.client.1.smithi170.stdout:1/792: readlink d3/d24/d2c/d35/lb4 0 2024-02-15T22:51:21.389 INFO:tasks.workunit.client.1.smithi170.stdout:7/730: creat da/d1a/d21/d2c/d71/ddc/ff9 x:0 0 0 2024-02-15T22:51:21.389 INFO:tasks.workunit.client.1.smithi170.stdout:6/671: dread d3/d1d/d28/f47 [0,4194304] 0 2024-02-15T22:51:21.389 INFO:tasks.workunit.client.1.smithi170.stdout:6/672: truncate d3/d1d/d36/d56/d6c/dc4/fcf 124569 0 2024-02-15T22:51:21.389 INFO:tasks.workunit.client.1.smithi170.stdout:6/673: read d3/d1d/d36/f58 [2575066,59296] 0 2024-02-15T22:51:21.391 INFO:tasks.workunit.client.1.smithi170.stdout:2/696: getdents d0/d1/d89/dd7/d2f/d37 0 2024-02-15T22:51:21.391 INFO:tasks.workunit.client.1.smithi170.stdout:2/697: read d0/d1/f27 [367479,49428] 0 2024-02-15T22:51:21.391 INFO:tasks.workunit.client.1.smithi170.stdout:2/698: fsync d0/d1/d89/dd7/f7a 0 2024-02-15T22:51:21.396 INFO:tasks.workunit.client.1.smithi170.stdout:9/528: creat de/d1b/d1c/d1f/d20/d27/d84/fb2 x:0 0 0 2024-02-15T22:51:21.396 INFO:tasks.workunit.client.1.smithi170.stdout:9/529: truncate de/d1b/d1c/d1f/d20/f22 1855352 0 2024-02-15T22:51:21.396 INFO:tasks.workunit.client.1.smithi170.stdout:1/793: rmdir d3/d24/d2c/d35/d72/d92 39 2024-02-15T22:51:21.396 INFO:tasks.workunit.client.1.smithi170.stdout:1/794: read d3/d24/d2c/d94/fa5 [2345640,44668] 0 2024-02-15T22:51:21.397 INFO:tasks.workunit.client.1.smithi170.stdout:4/693: dwrite d0/d22/f50 [0,4194304] 0 2024-02-15T22:51:21.398 INFO:tasks.workunit.client.1.smithi170.stdout:7/731: mknod da/d1a/d21/d2c/d74/cfa 0 2024-02-15T22:51:21.398 INFO:tasks.workunit.client.1.smithi170.stdout:7/732: chown da/d1a/d21/c2d 8773921 1 2024-02-15T22:51:21.398 INFO:tasks.workunit.client.1.smithi170.stdout:7/733: chown da 100941 1 2024-02-15T22:51:21.400 INFO:tasks.workunit.client.1.smithi170.stdout:1/795: dread d3/d24/d2c/f49 [0,4194304] 0 2024-02-15T22:51:21.401 INFO:tasks.workunit.client.1.smithi170.stdout:2/699: symlink d0/d1/d89/dd7/l10b 0 2024-02-15T22:51:21.401 INFO:tasks.workunit.client.1.smithi170.stdout:2/700: dread - d0/d1/d5f/d74/f94 zero size 2024-02-15T22:51:21.402 INFO:tasks.workunit.client.1.smithi170.stdout:9/530: rename de/d1b/d1c/d1f/d20/d27/c9e to de/d1b/d1c/d47/cb3 0 2024-02-15T22:51:21.402 INFO:tasks.workunit.client.1.smithi170.stdout:9/531: chown de/d1b/d1c/d1f/d20/d27/d28/d80 14820 1 2024-02-15T22:51:21.404 INFO:tasks.workunit.client.1.smithi170.stdout:4/694: unlink d0/d22/da/d8b/f48 0 2024-02-15T22:51:21.405 INFO:tasks.workunit.client.1.smithi170.stdout:2/701: symlink d0/d1/l10c 0 2024-02-15T22:51:21.405 INFO:tasks.workunit.client.1.smithi170.stdout:2/702: readlink d0/d2a/l33 0 2024-02-15T22:51:21.407 INFO:tasks.workunit.client.1.smithi170.stdout:7/734: rename da/d1a/d21/d1b/l1d to da/d1a/d21/d2c/d74/dde/d7d/d72/lfb 0 2024-02-15T22:51:21.408 INFO:tasks.workunit.client.1.smithi170.stdout:9/532: truncate de/f1e 54641 0 2024-02-15T22:51:21.410 INFO:tasks.workunit.client.1.smithi170.stdout:1/796: write d3/d24/d2c/d35/f48 [963510,53419] 0 2024-02-15T22:51:21.410 INFO:tasks.workunit.client.1.smithi170.stdout:4/695: unlink d0/d22/da/d8b/d47/dbe/lcb 0 2024-02-15T22:51:21.410 INFO:tasks.workunit.client.1.smithi170.stdout:2/703: getdents d0/d1/d11/d26/d6e/d8a 0 2024-02-15T22:51:21.411 INFO:tasks.workunit.client.1.smithi170.stdout:0/613: dwrite d8/df/d13/d36/d60/f91 [0,4194304] 0 2024-02-15T22:51:21.412 INFO:tasks.workunit.client.1.smithi170.stdout:6/674: dwrite d3/d1d/d27/fab [0,4194304] 0 2024-02-15T22:51:21.412 INFO:tasks.workunit.client.1.smithi170.stdout:6/675: dread - d3/d1d/d36/d56/d6c/fd2 zero size 2024-02-15T22:51:21.413 INFO:tasks.workunit.client.1.smithi170.stdout:3/593: dwrite d3/dc/d1c/d3d/f9e [0,4194304] 0 2024-02-15T22:51:21.413 INFO:tasks.workunit.client.1.smithi170.stdout:7/735: symlink da/d1a/d21/d4d/lfc 0 2024-02-15T22:51:21.413 INFO:tasks.workunit.client.1.smithi170.stdout:1/797: fsync d3/d24/d2c/d35/f48 0 2024-02-15T22:51:21.414 INFO:tasks.workunit.client.1.smithi170.stdout:9/533: link l5 de/d1b/d1c/d1f/d20/d27/d28/d69/lb4 0 2024-02-15T22:51:21.414 INFO:tasks.workunit.client.1.smithi170.stdout:0/614: dread d8/df/d13/d22/d39/d55/f8e [0,4194304] 0 2024-02-15T22:51:21.416 INFO:tasks.workunit.client.1.smithi170.stdout:6/676: dread d3/d1d/d1b/d3c/f81 [0,4194304] 0 2024-02-15T22:51:21.416 INFO:tasks.workunit.client.1.smithi170.stdout:6/677: readlink d3/d24/d31/lac 0 2024-02-15T22:51:21.418 INFO:tasks.workunit.client.1.smithi170.stdout:2/704: mknod d0/d1/d89/dd7/d2f/d37/d58/c10d 0 2024-02-15T22:51:21.419 INFO:tasks.workunit.client.1.smithi170.stdout:3/594: getdents d3/d1b/d51/d94 0 2024-02-15T22:51:21.421 INFO:tasks.workunit.client.1.smithi170.stdout:0/615: read d8/df/f11 [1377187,22910] 0 2024-02-15T22:51:21.422 INFO:tasks.workunit.client.1.smithi170.stdout:0/616: creat d8/d14/d1c/fc4 x:0 0 0 2024-02-15T22:51:21.422 INFO:tasks.workunit.client.1.smithi170.stdout:0/617: chown c3 84401 1 2024-02-15T22:51:21.426 INFO:tasks.workunit.client.1.smithi170.stdout:7/736: symlink da/d1a/d21/d2c/d2e/d7a/lfd 0 2024-02-15T22:51:21.427 INFO:tasks.workunit.client.1.smithi170.stdout:1/798: symlink d3/d24/d2c/d77/d110/l114 0 2024-02-15T22:51:21.428 INFO:tasks.workunit.client.1.smithi170.stdout:9/534: mknod de/d1b/d1c/d1f/d20/d27/d28/d7a/cb5 0 2024-02-15T22:51:21.430 INFO:tasks.workunit.client.1.smithi170.stdout:9/535: write f4 [1265367,24488] 0 2024-02-15T22:51:21.430 INFO:tasks.workunit.client.1.smithi170.stdout:6/678: creat d3/d1d/d53/d5f/fe6 x:0 0 0 2024-02-15T22:51:21.430 INFO:tasks.workunit.client.1.smithi170.stdout:6/679: read d3/f5 [2157202,28435] 0 2024-02-15T22:51:21.432 INFO:tasks.workunit.client.1.smithi170.stdout:2/705: creat d0/d1/d89/dd7/d2f/dbe/df9/f10e x:0 0 0 2024-02-15T22:51:21.434 INFO:tasks.workunit.client.1.smithi170.stdout:0/618: write d8/d14/f1a [7271275,4404] 0 2024-02-15T22:51:21.434 INFO:tasks.workunit.client.1.smithi170.stdout:0/619: truncate d8/d6d/f89 920247 0 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:7/737: mknod da/cfe 0 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:7/738: truncate da/d1a/fbf 39445 0 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:7/739: truncate da/d1a/d21/d1b/fc3 5232855 0 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:7/740: chown da/d1a/f27 57349787 1 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:7/741: creat da/d1a/d21/d2c/d74/dde/d7d/fff x:0 0 0 2024-02-15T22:51:21.435 INFO:tasks.workunit.client.1.smithi170.stdout:1/799: creat d3/d24/d2c/d35/d83/dd8/f115 x:0 0 0 2024-02-15T22:51:21.437 INFO:tasks.workunit.client.1.smithi170.stdout:9/536: symlink de/d1b/d1c/d1f/d20/d27/d2c/lb6 0 2024-02-15T22:51:21.437 INFO:tasks.workunit.client.1.smithi170.stdout:9/537: chown de/d1b/d1c/d47/l56 15 1 2024-02-15T22:51:21.438 INFO:tasks.workunit.client.1.smithi170.stdout:6/680: mknod d3/d1d/d36/d56/ce7 0 2024-02-15T22:51:21.438 INFO:tasks.workunit.client.1.smithi170.stdout:6/681: readlink d3/d24/lb7 0 2024-02-15T22:51:21.438 INFO:tasks.workunit.client.1.smithi170.stdout:6/682: creat d3/db8/d96/fe8 x:0 0 0 2024-02-15T22:51:21.439 INFO:tasks.workunit.client.1.smithi170.stdout:6/683: readlink d3/l8a 0 2024-02-15T22:51:21.441 INFO:tasks.workunit.client.1.smithi170.stdout:4/696: rename d0/d22/da/d8b/d47/db4 to d0/d22/da/d8b/d47/d5e/d7d/dd9 0 2024-02-15T22:51:21.447 INFO:tasks.workunit.client.1.smithi170.stdout:7/742: write da/f38 [1237567,44888] 0 2024-02-15T22:51:21.447 INFO:tasks.workunit.client.1.smithi170.stdout:7/743: stat da/d1a/fbf 0 2024-02-15T22:51:21.448 INFO:tasks.workunit.client.1.smithi170.stdout:0/620: write d8/f29 [4654891,28740] 0 2024-02-15T22:51:21.448 INFO:tasks.workunit.client.1.smithi170.stdout:0/621: dread - d8/df/d13/d22/d71/f7b zero size 2024-02-15T22:51:21.448 INFO:tasks.workunit.client.1.smithi170.stdout:3/595: rename d3/d78/d7a/c84 to d3/d1b/d2c/cbb 0 2024-02-15T22:51:21.450 INFO:tasks.workunit.client.1.smithi170.stdout:4/697: symlink d0/d22/da/d8b/d47/da9/lda 0 2024-02-15T22:51:21.452 INFO:tasks.workunit.client.1.smithi170.stdout:3/596: dread d3/d2b/f57 [0,4194304] 0 2024-02-15T22:51:21.455 INFO:tasks.workunit.client.1.smithi170.stdout:4/698: mkdir d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb 0 2024-02-15T22:51:21.455 INFO:tasks.workunit.client.1.smithi170.stdout:4/699: chown d0/d22/c15 11143 1 2024-02-15T22:51:21.458 INFO:tasks.workunit.client.1.smithi170.stdout:3/597: creat d3/dc/d1c/d26/fbc x:0 0 0 2024-02-15T22:51:21.458 INFO:tasks.workunit.client.1.smithi170.stdout:1/800: dwrite d3/d24/f8d [0,4194304] 0 2024-02-15T22:51:21.461 INFO:tasks.workunit.client.1.smithi170.stdout:4/700: link d0/d22/da/d8b/d47/dbe/da2/f9d d0/d22/da/d8b/d80/fdc 0 2024-02-15T22:51:21.461 INFO:tasks.workunit.client.1.smithi170.stdout:3/598: mknod d3/dc/cbd 0 2024-02-15T22:51:21.464 INFO:tasks.workunit.client.1.smithi170.stdout:9/538: dwrite de/d1b/d1c/d1f/d20/fb0 [0,4194304] 0 2024-02-15T22:51:21.464 INFO:tasks.workunit.client.1.smithi170.stdout:9/539: chown de/d1b/d1c 9432602 1 2024-02-15T22:51:21.464 INFO:tasks.workunit.client.1.smithi170.stdout:4/701: creat d0/d22/da/d8b/d47/d5e/d73/fdd x:0 0 0 2024-02-15T22:51:21.464 INFO:tasks.workunit.client.1.smithi170.stdout:4/702: creat d0/d22/da/d8b/d47/d2b/fde x:0 0 0 2024-02-15T22:51:21.466 INFO:tasks.workunit.client.1.smithi170.stdout:3/599: truncate d3/dc/f9d 2965180 0 2024-02-15T22:51:21.468 INFO:tasks.workunit.client.1.smithi170.stdout:7/744: dwrite da/d1a/def/fe3 [0,4194304] 0 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:2/706: rename d0/d1/d89/dd7/d2f/dbe to d0/d1/d11/d26/d6e/d10f 0 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/801: dread d3/d24/d2c/f6d [0,4194304] 0 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/802: getdents d3/d24/d2c/d77/dda/d109 0 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/803: dread - d3/d24/d2c/d77/dda/ffa zero size 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/804: chown d3/d24/f67 2 1 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/805: chown d3/d24/d2c/d94 707268745 1 2024-02-15T22:51:21.469 INFO:tasks.workunit.client.1.smithi170.stdout:1/806: chown d3/d24/d2c/d77/dda/fea 444 1 2024-02-15T22:51:21.470 INFO:tasks.workunit.client.1.smithi170.stdout:1/807: write d3/d24/d2c/d94/fa5 [1451209,82481] 0 2024-02-15T22:51:21.470 INFO:tasks.workunit.client.1.smithi170.stdout:1/808: creat d3/d24/d2c/d77/dce/f116 x:0 0 0 2024-02-15T22:51:21.477 INFO:tasks.workunit.client.1.smithi170.stdout:4/703: symlink d0/d22/da/d8b/d47/da9/ldf 0 2024-02-15T22:51:21.477 INFO:tasks.workunit.client.1.smithi170.stdout:3/600: truncate d3/db/d1f/f36 2457501 0 2024-02-15T22:51:21.479 INFO:tasks.workunit.client.1.smithi170.stdout:2/707: write d0/d1/d11/d26/f9a [3719839,112355] 0 2024-02-15T22:51:21.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/708: write d0/d1/d31/f34 [210286,113264] 0 2024-02-15T22:51:21.480 INFO:tasks.workunit.client.1.smithi170.stdout:2/709: stat d0/d1/d11/d26/d6e/d8a 0 2024-02-15T22:51:21.484 INFO:tasks.workunit.client.1.smithi170.stdout:7/745: symlink da/d1a/d21/d2c/d74/dde/dc7/df0/l100 0 2024-02-15T22:51:21.485 INFO:tasks.workunit.client.1.smithi170.stdout:0/622: dwrite d8/d14/f1a [0,4194304] 0 2024-02-15T22:51:21.485 INFO:tasks.workunit.client.1.smithi170.stdout:3/601: dread d3/dc/d1c/d26/d55/f69 [0,4194304] 0 2024-02-15T22:51:21.489 INFO:tasks.workunit.client.1.smithi170.stdout:6/684: rename d3/d1a/dc0 to d3/d1d/d36/d56/d6c/de9 0 2024-02-15T22:51:21.494 INFO:tasks.workunit.client.1.smithi170.stdout:2/710: write d0/d1d/f22 [3995814,100544] 0 2024-02-15T22:51:21.494 INFO:tasks.workunit.client.1.smithi170.stdout:2/711: read - d0/d1/d89/dd7/d2f/fce zero size 2024-02-15T22:51:21.497 INFO:tasks.workunit.client.1.smithi170.stdout:4/704: symlink d0/d22/da/d8b/d47/d67/d77/le0 0 2024-02-15T22:51:21.500 INFO:tasks.workunit.client.1.smithi170.stdout:0/623: creat d8/d14/d1c/d3f/d53/fc5 x:0 0 0 2024-02-15T22:51:21.501 INFO:tasks.workunit.client.1.smithi170.stdout:3/602: rmdir d3/db/d1f/d61 39 2024-02-15T22:51:21.503 INFO:tasks.workunit.client.1.smithi170.stdout:0/624: dread d8/df/d13/d22/d6a/fb3 [0,4194304] 0 2024-02-15T22:51:21.504 INFO:tasks.workunit.client.1.smithi170.stdout:0/625: creat d8/df/d13/d22/d39/fc6 x:0 0 0 2024-02-15T22:51:21.505 INFO:tasks.workunit.client.1.smithi170.stdout:6/685: link d3/d1d/d53/c87 d3/d1d/d36/cea 0 2024-02-15T22:51:21.505 INFO:tasks.workunit.client.1.smithi170.stdout:6/686: read - d3/db8/d96/fe4 zero size 2024-02-15T22:51:21.505 INFO:tasks.workunit.client.1.smithi170.stdout:6/687: read d3/d1d/d28/f47 [3194629,102700] 0 2024-02-15T22:51:21.505 INFO:tasks.workunit.client.1.smithi170.stdout:6/688: write d3/d1d/d28/d66/fc9 [670033,66196] 0 2024-02-15T22:51:21.506 INFO:tasks.workunit.client.1.smithi170.stdout:6/689: stat d3/d1d/d27/l73 0 2024-02-15T22:51:21.508 INFO:tasks.workunit.client.1.smithi170.stdout:4/705: creat d0/d22/da/d8b/d47/d5e/fe1 x:0 0 0 2024-02-15T22:51:21.508 INFO:tasks.workunit.client.1.smithi170.stdout:7/746: dwrite da/f13 [0,4194304] 0 2024-02-15T22:51:21.508 INFO:tasks.workunit.client.1.smithi170.stdout:7/747: write da/d1a/def/d8d/fb5 [509886,111680] 0 2024-02-15T22:51:21.510 INFO:tasks.workunit.client.1.smithi170.stdout:3/603: creat d3/db/d1f/d61/fbe x:0 0 0 2024-02-15T22:51:21.510 INFO:tasks.workunit.client.1.smithi170.stdout:3/604: write d3/dc/d1c/d26/f46 [738734,41616] 0 2024-02-15T22:51:21.510 INFO:tasks.workunit.client.1.smithi170.stdout:6/690: rmdir d3/d24/d31/d94 39 2024-02-15T22:51:21.512 INFO:tasks.workunit.client.1.smithi170.stdout:3/605: unlink d3/db/d1f/c67 0 2024-02-15T22:51:21.513 INFO:tasks.workunit.client.1.smithi170.stdout:2/712: dwrite d0/d13/d59/d82/f100 [4194304,4194304] 0 2024-02-15T22:51:21.518 INFO:tasks.workunit.client.1.smithi170.stdout:6/691: symlink d3/d1d/d28/d3b/dde/leb 0 2024-02-15T22:51:21.518 INFO:tasks.workunit.client.1.smithi170.stdout:6/692: fdatasync d3/d1d/d28/d3b/da3/fa8 0 2024-02-15T22:51:21.518 INFO:tasks.workunit.client.1.smithi170.stdout:6/693: write d3/d1d/d1b/d3e/d5d/fbf [669091,6175] 0 2024-02-15T22:51:21.518 INFO:tasks.workunit.client.1.smithi170.stdout:3/606: dread d3/f9 [0,4194304] 0 2024-02-15T22:51:21.518 INFO:tasks.workunit.client.1.smithi170.stdout:3/607: chown d3/d1b/c68 513679638 1 2024-02-15T22:51:21.521 INFO:tasks.workunit.client.1.smithi170.stdout:6/694: mknod d3/d24/cec 0 2024-02-15T22:51:21.523 INFO:tasks.workunit.client.1.smithi170.stdout:6/695: creat d3/d1d/d36/d51/d54/fed x:0 0 0 2024-02-15T22:51:21.525 INFO:tasks.workunit.client.1.smithi170.stdout:6/696: link d3/d1d/d53/c5a d3/d1d/d36/d56/daf/cee 0 2024-02-15T22:51:21.525 INFO:tasks.workunit.client.1.smithi170.stdout:6/697: chown d3/d1d/d53/d5f 71 1 2024-02-15T22:51:21.529 INFO:tasks.workunit.client.1.smithi170.stdout:3/608: dread d3/f3f [0,4194304] 0 2024-02-15T22:51:21.530 INFO:tasks.workunit.client.1.smithi170.stdout:3/609: symlink d3/d1b/d51/d6b/d86/lbf 0 2024-02-15T22:51:21.532 INFO:tasks.workunit.client.1.smithi170.stdout:3/610: creat d3/d78/d7a/fc0 x:0 0 0 2024-02-15T22:51:21.533 INFO:tasks.workunit.client.1.smithi170.stdout:3/611: mknod d3/dc/d1c/d3d/d5d/cc1 0 2024-02-15T22:51:21.533 INFO:tasks.workunit.client.1.smithi170.stdout:3/612: write d3/db/f11 [1124342,79094] 0 2024-02-15T22:51:21.535 INFO:tasks.workunit.client.1.smithi170.stdout:3/613: mknod d3/d1b/d51/cc2 0 2024-02-15T22:51:21.536 INFO:tasks.workunit.client.1.smithi170.stdout:3/614: creat d3/dc/d1c/d3d/d5d/da9/fc3 x:0 0 0 2024-02-15T22:51:21.538 INFO:tasks.workunit.client.1.smithi170.stdout:3/615: mknod d3/d1b/d51/d6b/d86/cc4 0 2024-02-15T22:51:21.538 INFO:tasks.workunit.client.1.smithi170.stdout:3/616: stat d3/dc/f9c 0 2024-02-15T22:51:21.538 INFO:tasks.workunit.client.1.smithi170.stdout:3/617: dread - d3/d78/d7a/fc0 zero size 2024-02-15T22:51:21.539 INFO:tasks.workunit.client.1.smithi170.stdout:3/618: mkdir d3/d1b/d51/d6b/d86/dc5 0 2024-02-15T22:51:21.539 INFO:tasks.workunit.client.1.smithi170.stdout:3/619: creat d3/dc/fc6 x:0 0 0 2024-02-15T22:51:21.551 INFO:tasks.workunit.client.1.smithi170.stdout:7/748: dwrite da/d1a/d21/d19/f50 [4194304,4194304] 0 2024-02-15T22:51:21.551 INFO:tasks.workunit.client.1.smithi170.stdout:4/706: dwrite d0/d22/da/d8b/d47/d67/f7a [0,4194304] 0 2024-02-15T22:51:21.551 INFO:tasks.workunit.client.1.smithi170.stdout:7/749: creat da/d1a/d21/d2c/d71/ddc/f101 x:0 0 0 2024-02-15T22:51:21.552 INFO:tasks.workunit.client.1.smithi170.stdout:2/713: dwrite d0/d1/d5f/f8c [0,4194304] 0 2024-02-15T22:51:21.552 INFO:tasks.workunit.client.1.smithi170.stdout:2/714: dread - d0/d1/d31/da3/fdc zero size 2024-02-15T22:51:21.555 INFO:tasks.workunit.client.1.smithi170.stdout:6/698: dwrite d3/d1d/d28/d3b/f2b [0,4194304] 0 2024-02-15T22:51:21.555 INFO:tasks.workunit.client.1.smithi170.stdout:6/699: write d3/d1d/d1b/d3e/f88 [99140,36963] 0 2024-02-15T22:51:21.560 INFO:tasks.workunit.client.1.smithi170.stdout:2/715: rename d0/d1/f6f to d0/d1/d5f/d74/d8e/f110 0 2024-02-15T22:51:21.562 INFO:tasks.workunit.client.1.smithi170.stdout:2/716: mknod d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dc8/c111 0 2024-02-15T22:51:21.563 INFO:tasks.workunit.client.1.smithi170.stdout:2/717: chown d0/d2a/fdd 0 1 2024-02-15T22:51:21.564 INFO:tasks.workunit.client.1.smithi170.stdout:2/718: truncate d0/d1d/d3d/f4c 3813487 0 2024-02-15T22:51:21.564 INFO:tasks.workunit.client.1.smithi170.stdout:3/620: dwrite d3/db/d1f/f4e [0,4194304] 0 2024-02-15T22:51:21.564 INFO:tasks.workunit.client.1.smithi170.stdout:3/621: stat d3/dc/d1c/d3d/f63 0 2024-02-15T22:51:21.565 INFO:tasks.workunit.client.1.smithi170.stdout:3/622: creat d3/d1b/d2c/d92/da5/fc7 x:0 0 0 2024-02-15T22:51:21.566 INFO:tasks.workunit.client.1.smithi170.stdout:2/719: link d0/d1d/le8 d0/d1/d89/dd7/d3e/l112 0 2024-02-15T22:51:21.569 INFO:tasks.workunit.client.1.smithi170.stdout:3/623: link d3/f3f d3/d1b/d51/d6b/d86/dc5/fc8 0 2024-02-15T22:51:21.569 INFO:tasks.workunit.client.1.smithi170.stdout:3/624: fsync d3/f42 0 2024-02-15T22:51:21.570 INFO:tasks.workunit.client.1.smithi170.stdout:3/625: dread d3/dc/d1c/f64 [0,4194304] 0 2024-02-15T22:51:21.572 INFO:tasks.workunit.client.1.smithi170.stdout:2/720: creat d0/d1/d11/d26/d6e/d10f/df9/d108/f113 x:0 0 0 2024-02-15T22:51:21.572 INFO:tasks.workunit.client.1.smithi170.stdout:6/700: getdents d3/d1d/d36/d51/d54 0 2024-02-15T22:51:21.576 INFO:tasks.workunit.client.1.smithi170.stdout:3/626: truncate d3/d1b/f8f 3083038 0 2024-02-15T22:51:21.577 INFO:tasks.workunit.client.1.smithi170.stdout:2/721: unlink d0/d13/l15 0 2024-02-15T22:51:21.578 INFO:tasks.workunit.client.1.smithi170.stdout:6/701: symlink d3/d24/lef 0 2024-02-15T22:51:21.579 INFO:tasks.workunit.client.1.smithi170.stdout:4/707: dwrite d0/d22/da/d8b/d47/f3a [0,4194304] 0 2024-02-15T22:51:21.580 INFO:tasks.workunit.client.1.smithi170.stdout:3/627: rmdir d3/dc/d1c/d3d/d5d 39 2024-02-15T22:51:21.580 INFO:tasks.workunit.client.1.smithi170.stdout:3/628: creat d3/d1b/d2c/fc9 x:0 0 0 2024-02-15T22:51:21.580 INFO:tasks.workunit.client.1.smithi170.stdout:3/629: chown d3/dc/d1c/l82 0 1 2024-02-15T22:51:21.580 INFO:tasks.workunit.client.1.smithi170.stdout:7/750: dwrite da/d1a/d21/d2c/d74/f86 [4194304,4194304] 0 2024-02-15T22:51:21.590 INFO:tasks.workunit.client.1.smithi170.stdout:4/708: dread d0/d22/da/d8b/d47/d2b/f4c [4194304,4194304] 0 2024-02-15T22:51:21.597 INFO:tasks.workunit.client.1.smithi170.stdout:2/722: unlink d0/d1/d5f/de5/ffd 0 2024-02-15T22:51:21.597 INFO:tasks.workunit.client.1.smithi170.stdout:2/723: stat d0/d1/d89/dd7/f85 0 2024-02-15T22:51:21.600 INFO:tasks.workunit.client.1.smithi170.stdout:7/751: dwrite da/d1a/d21/d2c/d74/d87/dac/fc5 [0,4194304] 0 2024-02-15T22:51:21.600 INFO:tasks.workunit.client.1.smithi170.stdout:7/752: creat da/d1a/d21/d2c/d74/f102 x:0 0 0 2024-02-15T22:51:21.602 INFO:tasks.workunit.client.1.smithi170.stdout:3/630: link d3/dc/d1c/d26/f46 d3/d1b/d2c/fca 0 2024-02-15T22:51:21.602 INFO:tasks.workunit.client.1.smithi170.stdout:3/631: chown d3/d1b/d51/d6b/d86/dc5 32430084 1 2024-02-15T22:51:21.604 INFO:tasks.workunit.client.1.smithi170.stdout:4/709: mknod d0/d22/ce2 0 2024-02-15T22:51:21.605 INFO:tasks.workunit.client.1.smithi170.stdout:2/724: symlink d0/d1/d89/l114 0 2024-02-15T22:51:21.613 INFO:tasks.workunit.client.1.smithi170.stdout:4/710: write d0/d22/da/f5b [2239749,35624] 0 2024-02-15T22:51:21.613 INFO:tasks.workunit.client.1.smithi170.stdout:4/711: readlink d0/d22/da/d8b/d47/d5e/lcf 0 2024-02-15T22:51:21.613 INFO:tasks.workunit.client.1.smithi170.stdout:4/712: chown d0/d22/da/d8b/d47/d2b/f68 19660 1 2024-02-15T22:51:21.613 INFO:tasks.workunit.client.1.smithi170.stdout:4/713: creat d0/d22/da/d8b/fe3 x:0 0 0 2024-02-15T22:51:21.614 INFO:tasks.workunit.client.1.smithi170.stdout:3/632: mkdir d3/dc/d1a/d9f/dcb 0 2024-02-15T22:51:21.615 INFO:tasks.workunit.client.1.smithi170.stdout:2/725: truncate d0/d1d/f4e 280780 0 2024-02-15T22:51:21.615 INFO:tasks.workunit.client.1.smithi170.stdout:2/726: truncate d0/d1d/f91 679024 0 2024-02-15T22:51:21.616 INFO:tasks.workunit.client.1.smithi170.stdout:6/702: rename d3/d1d/d27/d70/da5 to d3/d1d/d36/d56/daf/dd5/df0 0 2024-02-15T22:51:21.620 INFO:tasks.workunit.client.1.smithi170.stdout:3/633: mkdir d3/d1b/d8a/dcc 0 2024-02-15T22:51:21.620 INFO:tasks.workunit.client.1.smithi170.stdout:3/634: chown d3/d1b/d2c 26399 1 2024-02-15T22:51:21.620 INFO:tasks.workunit.client.1.smithi170.stdout:3/635: chown d3/dc/d1c/d26/l44 249 1 2024-02-15T22:51:21.621 INFO:tasks.workunit.client.1.smithi170.stdout:2/727: mkdir d0/d1/d89/dd7/d2f/d9b/d115 0 2024-02-15T22:51:21.622 INFO:tasks.workunit.client.1.smithi170.stdout:3/636: write d3/dc/f17 [1336890,111695] 0 2024-02-15T22:51:21.622 INFO:tasks.workunit.client.1.smithi170.stdout:3/637: chown d3/dc/d1c 2 1 2024-02-15T22:51:21.622 INFO:tasks.workunit.client.1.smithi170.stdout:3/638: write d3/d78/d7a/fc0 [236698,83030] 0 2024-02-15T22:51:21.622 INFO:tasks.workunit.client.1.smithi170.stdout:6/703: symlink d3/d1d/d27/dc5/lf1 0 2024-02-15T22:51:21.624 INFO:tasks.workunit.client.1.smithi170.stdout:7/753: dwrite da/d1a/d21/f46 [4194304,4194304] 0 2024-02-15T22:51:21.624 INFO:tasks.workunit.client.1.smithi170.stdout:7/754: chown da/f38 3 1 2024-02-15T22:51:21.627 INFO:tasks.workunit.client.1.smithi170.stdout:2/728: truncate d0/d1/d89/dd7/d2f/f65 2904936 0 2024-02-15T22:51:21.630 INFO:tasks.workunit.client.1.smithi170.stdout:6/704: mknod d3/d1d/d28/d3b/cf2 0 2024-02-15T22:51:21.630 INFO:tasks.workunit.client.1.smithi170.stdout:6/705: creat d3/d1a/ff3 x:0 0 0 2024-02-15T22:51:21.632 INFO:tasks.workunit.client.1.smithi170.stdout:7/755: unlink da/d57/fa9 0 2024-02-15T22:51:21.633 INFO:tasks.workunit.client.1.smithi170.stdout:6/706: dread d3/d1d/d27/f4a [0,4194304] 0 2024-02-15T22:51:21.635 INFO:tasks.workunit.client.1.smithi170.stdout:2/729: write d0/d1d/d3d/d76/fa0 [2508722,95834] 0 2024-02-15T22:51:21.635 INFO:tasks.workunit.client.1.smithi170.stdout:7/756: creat da/d1a/d21/d2c/d74/dde/d9e/f103 x:0 0 0 2024-02-15T22:51:21.637 INFO:tasks.workunit.client.1.smithi170.stdout:2/730: creat d0/d1/d11/d26/d6e/d8a/f116 x:0 0 0 2024-02-15T22:51:21.640 INFO:tasks.workunit.client.1.smithi170.stdout:7/757: rename da/d1a/d21/d2c/d2e/c8a to da/d1a/d21/d2c/d74/d87/c104 0 2024-02-15T22:51:21.640 INFO:tasks.workunit.client.1.smithi170.stdout:3/639: dwrite d3/dc/d1c/d26/d55/f69 [0,4194304] 0 2024-02-15T22:51:21.641 INFO:tasks.workunit.client.1.smithi170.stdout:6/707: dread f2 [0,4194304] 0 2024-02-15T22:51:21.642 INFO:tasks.workunit.client.1.smithi170.stdout:3/640: mkdir d3/dcd 0 2024-02-15T22:51:21.643 INFO:tasks.workunit.client.1.smithi170.stdout:7/758: mknod da/d1a/d21/d2c/d71/ddc/c105 0 2024-02-15T22:51:21.645 INFO:tasks.workunit.client.1.smithi170.stdout:6/708: mkdir d3/d1d/d36/d56/d6c/de9/df4 0 2024-02-15T22:51:21.645 INFO:tasks.workunit.client.1.smithi170.stdout:6/709: truncate d3/d1d/d53/f93 700628 0 2024-02-15T22:51:21.646 INFO:tasks.workunit.client.1.smithi170.stdout:3/641: creat d3/d1b/d8a/dcc/fce x:0 0 0 2024-02-15T22:51:21.646 INFO:tasks.workunit.client.1.smithi170.stdout:3/642: write d3/dc/d13/f43 [1535311,86744] 0 2024-02-15T22:51:21.647 INFO:tasks.workunit.client.1.smithi170.stdout:7/759: truncate da/d1a/d21/d2c/d74/d87/fbe 390769 0 2024-02-15T22:51:21.651 INFO:tasks.workunit.client.1.smithi170.stdout:3/643: unlink d3/d1b/d2c/l47 0 2024-02-15T22:51:21.655 INFO:tasks.workunit.client.1.smithi170.stdout:2/731: dwrite d0/d1d/f91 [0,4194304] 0 2024-02-15T22:51:21.655 INFO:tasks.workunit.client.1.smithi170.stdout:6/710: rename d3/d1d/d53/d5f to d3/d1d/d36/d51/d54/df5 0 2024-02-15T22:51:21.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/760: dread da/d1a/d21/f70 [0,4194304] 0 2024-02-15T22:51:21.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/761: fsync da/d1a/d21/d2c/d71/ddc/f101 0 2024-02-15T22:51:21.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/762: dread - da/d1a/d21/d2c/d71/ddc/ff9 zero size 2024-02-15T22:51:21.656 INFO:tasks.workunit.client.1.smithi170.stdout:7/763: truncate da/d1a/d21/d19/f94 1387029 0 2024-02-15T22:51:21.657 INFO:tasks.workunit.client.1.smithi170.stdout:3/644: dread d3/dc/d1c/f73 [0,4194304] 0 2024-02-15T22:51:21.657 INFO:tasks.workunit.client.1.smithi170.stdout:6/711: dread d3/d1d/d53/f93 [0,4194304] 0 2024-02-15T22:51:21.657 INFO:tasks.workunit.client.1.smithi170.stdout:2/732: rename d0/d1/d31/da3/lb2 to d0/d1d/l117 0 2024-02-15T22:51:21.658 INFO:tasks.workunit.client.1.smithi170.stdout:7/764: link da/d1a/d21/d4d/d6e/de8/cf2 da/d1a/d21/d2c/d74/dde/c106 0 2024-02-15T22:51:21.659 INFO:tasks.workunit.client.1.smithi170.stdout:7/765: fdatasync da/fa8 0 2024-02-15T22:51:21.659 INFO:tasks.workunit.client.1.smithi170.stdout:3/645: dread d3/f3c [0,4194304] 0 2024-02-15T22:51:21.660 INFO:tasks.workunit.client.1.smithi170.stdout:6/712: link d3/d1d/d1b/d3c/f6f d3/d1d/d36/d56/d6c/de9/ff6 0 2024-02-15T22:51:21.661 INFO:tasks.workunit.client.1.smithi170.stdout:6/713: chown d3/d24/lb7 0 1 2024-02-15T22:51:21.661 INFO:tasks.workunit.client.1.smithi170.stdout:2/733: creat d0/d1/d89/dd7/d83/f118 x:0 0 0 2024-02-15T22:51:21.662 INFO:tasks.workunit.client.1.smithi170.stdout:2/734: stat d0/d1/d89/dd7 0 2024-02-15T22:51:21.662 INFO:tasks.workunit.client.1.smithi170.stdout:3/646: stat d3/dc/d1c/l3b 0 2024-02-15T22:51:21.663 INFO:tasks.workunit.client.1.smithi170.stdout:2/735: dread d0/d1/d53/f7e [0,4194304] 0 2024-02-15T22:51:21.664 INFO:tasks.workunit.client.1.smithi170.stdout:6/714: link d3/d1a/c5c d3/d24/d31/cf7 0 2024-02-15T22:51:21.666 INFO:tasks.workunit.client.1.smithi170.stdout:2/736: mknod d0/d1/d89/dd7/c119 0 2024-02-15T22:51:21.668 INFO:tasks.workunit.client.1.smithi170.stdout:6/715: creat d3/d1d/d27/ff8 x:0 0 0 2024-02-15T22:51:21.670 INFO:tasks.workunit.client.1.smithi170.stdout:7/766: dread da/d1a/d21/f46 [4194304,4194304] 0 2024-02-15T22:51:21.671 INFO:tasks.workunit.client.1.smithi170.stdout:3/647: rename d3/dc/d1c/d3d/d5d to d3/dcd/dcf 0 2024-02-15T22:51:21.671 INFO:tasks.workunit.client.1.smithi170.stdout:3/648: chown d3/db/d1f/f36 50262 1 2024-02-15T22:51:21.673 INFO:tasks.workunit.client.1.smithi170.stdout:7/767: symlink da/d1a/d21/d2c/d74/dde/d7d/d72/dd4/l107 0 2024-02-15T22:51:21.675 INFO:tasks.workunit.client.1.smithi170.stdout:2/737: dread d0/d1/d89/dd7/d2f/f62 [0,4194304] 0 2024-02-15T22:51:21.679 INFO:tasks.workunit.client.1.smithi170.stdout:7/768: mknod da/d1a/def/c108 0 2024-02-15T22:51:21.681 INFO:tasks.workunit.client.1.smithi170.stdout:3/649: rmdir d3/db/d1f 39 2024-02-15T22:51:21.681 INFO:tasks.workunit.client.1.smithi170.stdout:3/650: chown d3/dc/d1c/d26/la0 6159 1 2024-02-15T22:51:21.683 INFO:tasks.workunit.client.1.smithi170.stdout:2/738: mknod d0/d1/d11/d26/d6e/d10f/c11a 0 2024-02-15T22:51:21.683 INFO:tasks.workunit.client.1.smithi170.stdout:2/739: readlink d0/d1/d53/l79 0 2024-02-15T22:51:21.683 INFO:tasks.workunit.client.1.smithi170.stdout:2/740: write d0/d1/d11/d26/d6e/d10f/df9/f10e [160671,36094] 0 2024-02-15T22:51:21.683 INFO:tasks.workunit.client.1.smithi170.stdout:7/769: symlink da/d1a/d21/d2c/d2e/d7a/l109 0 2024-02-15T22:51:21.685 INFO:tasks.workunit.client.1.smithi170.stdout:3/651: mkdir d3/dc/dd0 0 2024-02-15T22:51:21.686 INFO:tasks.workunit.client.1.smithi170.stdout:2/741: creat d0/d1/d89/dd7/d2f/d9b/d115/f11b x:0 0 0 2024-02-15T22:51:21.686 INFO:tasks.workunit.client.1.smithi170.stdout:2/742: write d0/d1/d5f/d74/d8e/df4/ffc [1180335,103442] 0 2024-02-15T22:51:21.686 INFO:tasks.workunit.client.1.smithi170.stdout:2/743: write d0/d1d/f4e [786611,125693] 0 2024-02-15T22:51:21.689 INFO:tasks.workunit.client.1.smithi170.stdout:7/770: rename da/d1a/d21/d2c/d74/dde/d7d/d72/fbc to da/d1a/d21/d4d/f10a 0 2024-02-15T22:51:21.694 INFO:tasks.workunit.client.1.smithi170.stdout:7/771: mkdir da/d1a/d21/d2c/d74/dde/d7d/d72/d10b 0 2024-02-15T22:51:21.696 INFO:tasks.workunit.client.1.smithi170.stdout:7/772: creat da/f10c x:0 0 0 2024-02-15T22:51:21.703 INFO:tasks.workunit.client.1.smithi170.stdout:3/652: dwrite d3/dc/f17 [0,4194304] 0 2024-02-15T22:51:21.703 INFO:tasks.workunit.client.1.smithi170.stdout:3/653: fsync d3/dc/d1c/d3d/f4d 0 2024-02-15T22:51:21.704 INFO:tasks.workunit.client.1.smithi170.stdout:3/654: creat d3/dc/dd0/fd1 x:0 0 0 2024-02-15T22:51:21.704 INFO:tasks.workunit.client.1.smithi170.stdout:3/655: mkdir d3/dc/d1a/d9f/dcb/dd2 0 2024-02-15T22:51:21.707 INFO:tasks.workunit.client.1.smithi170.stdout:2/744: dwrite d0/d13/d59/d82/f100 [4194304,4194304] 0 2024-02-15T22:51:21.707 INFO:tasks.workunit.client.1.smithi170.stdout:2/745: chown d0/d2a/l33 11011 1 2024-02-15T22:51:21.707 INFO:tasks.workunit.client.1.smithi170.stdout:2/746: creat d0/d1/d89/dd7/d3e/f11c x:0 0 0 2024-02-15T22:51:21.710 INFO:tasks.workunit.client.1.smithi170.stdout:2/747: link d0/d1/d11/d26/d6e/cc6 d0/d1/d89/dd7/d2f/d37/d58/d78/da4/c11d 0 2024-02-15T22:51:21.710 INFO:tasks.workunit.client.1.smithi170.stdout:7/773: write da/d1a/d21/f46 [629267,94452] 0 2024-02-15T22:51:21.711 INFO:tasks.workunit.client.1.smithi170.stdout:7/774: dread - da/d1a/d21/d2c/d74/dde/d9e/f103 zero size 2024-02-15T22:51:21.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/748: getdents d0/d1/d11/d26/d6e/d10f/df9 0 2024-02-15T22:51:21.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/749: read - d0/d2a/f77 zero size 2024-02-15T22:51:21.711 INFO:tasks.workunit.client.1.smithi170.stdout:2/750: chown d0/d1/d89/dd7/d2f/ddf/fff 553547482 1 2024-02-15T22:51:21.719 INFO:tasks.workunit.client.1.smithi170.stdout:3/656: dwrite d3/d1b/d51/d6b/f91 [0,4194304] 0 2024-02-15T22:51:21.719 INFO:tasks.workunit.client.1.smithi170.stdout:3/657: fdatasync d3/db/f22 0 2024-02-15T22:51:21.721 INFO:tasks.workunit.client.1.smithi170.stdout:2/751: dread d0/d1d/f93 [0,4194304] 0 2024-02-15T22:51:21.722 INFO:tasks.workunit.client.1.smithi170.stdout:3/658: rename d3/db/d1f/d61/l70 to d3/dc/d1a/ld3 0 2024-02-15T22:51:21.723 INFO:tasks.workunit.client.1.smithi170.stdout:2/752: mkdir d0/d1/d11/d26/d6e/d11e 0 2024-02-15T22:51:21.724 INFO:tasks.workunit.client.1.smithi170.stdout:2/753: link d0/d1/d11/d26/c103 d0/d1/d89/dd7/c11f 0 2024-02-15T22:51:21.731 INFO:tasks.workunit.client.1.smithi170.stdout:3/659: write d3/d1b/d8a/fac [2865548,82837] 0 2024-02-15T22:51:21.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/754: read d0/d1/d89/d8b/fe2 [900526,56743] 0 2024-02-15T22:51:21.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/755: stat d0/d1/d89/dd7/d3e/f44 0 2024-02-15T22:51:21.733 INFO:tasks.workunit.client.1.smithi170.stdout:7/775: dwrite da/d1a/d21/d2c/d2e/d7a/fb6 [0,4194304] 0 2024-02-15T22:51:21.734 INFO:tasks.workunit.client.1.smithi170.stdout:3/660: rename d3/dc/d1c/d3d to d3/dc/d1c/d26/dd4 0 2024-02-15T22:51:21.738 INFO:tasks.workunit.client.1.smithi170.stdout:3/661: creat d3/dc/d1a/d9f/fd5 x:0 0 0 2024-02-15T22:51:21.740 INFO:tasks.workunit.client.1.smithi170.stdout:7/776: getdents da/d1a/d21/d2c/d74/dde/d9e 0 2024-02-15T22:51:21.740 INFO:tasks.workunit.client.1.smithi170.stdout:7/777: readlink da/d1a/d21/d2c/d74/dde/d7d/d72/lfb 0 2024-02-15T22:51:21.740 INFO:tasks.workunit.client.1.smithi170.stdout:7/778: chown c4 0 1 2024-02-15T22:51:21.742 INFO:tasks.workunit.client.1.smithi170.stdout:3/662: mknod d3/cd6 0 2024-02-15T22:51:21.744 INFO:tasks.workunit.client.1.smithi170.stdout:3/663: mkdir d3/db/d1f/d61/dd7 0 2024-02-15T22:51:21.744 INFO:tasks.workunit.client.1.smithi170.stdout:3/664: write d3/d78/d7a/fc0 [944352,107062] 0 2024-02-15T22:51:21.759 INFO:tasks.workunit.client.1.smithi170.stdout:2/756: dwrite d0/d1/d31/da3/fdc [0,4194304] 0 2024-02-15T22:51:21.762 INFO:tasks.workunit.client.1.smithi170.stdout:2/757: mkdir d0/d1/d11/d26/d6e/d120 0 2024-02-15T22:51:21.762 INFO:tasks.workunit.client.1.smithi170.stdout:2/758: creat d0/d13/f121 x:0 0 0 2024-02-15T22:51:21.763 INFO:tasks.workunit.client.1.smithi170.stdout:2/759: getdents d0/d1/d11/d26/d6e/d10f 0 2024-02-15T22:51:21.763 INFO:tasks.workunit.client.1.smithi170.stdout:2/760: dread - d0/d1/d89/dd7/d3e/f11c zero size 2024-02-15T22:51:21.773 INFO:tasks.workunit.client.1.smithi170.stdout:3/665: dwrite d3/f42 [4194304,4194304] 0 2024-02-15T22:51:21.773 INFO:tasks.workunit.client.1.smithi170.stdout:3/666: creat d3/d1b/d8a/fd8 x:0 0 0 2024-02-15T22:51:21.773 INFO:tasks.workunit.client.1.smithi170.stdout:7/779: dwrite da/d1a/d21/d2c/d2e/d7a/fb6 [0,4194304] 0 2024-02-15T22:51:21.776 INFO:tasks.workunit.client.1.smithi170.stdout:7/780: truncate da/d1a/d21/d1b/d69/f97 3881341 0 2024-02-15T22:51:21.776 INFO:tasks.workunit.client.1.smithi170.stdout:7/781: stat da/d1a/d21/d2c/d74/dde/d9e/f103 0 2024-02-15T22:51:21.776 INFO:tasks.workunit.client.1.smithi170.stdout:7/782: write da/d1a/d21/d2c/d74/dde/fb3 [5391072,105159] 0 2024-02-15T22:51:21.783 INFO:tasks.workunit.client.1.smithi170.stdout:2/761: dwrite d0/d1/d89/dd7/f5d [0,4194304] 0 2024-02-15T22:51:21.788 INFO:tasks.workunit.client.1.smithi170.stdout:7/783: write da/f64 [3478840,41926] 0 2024-02-15T22:51:21.790 INFO:tasks.workunit.client.1.smithi170.stdout:7/784: symlink da/d1a/d21/d2c/d74/d87/dac/l10d 0 2024-02-15T22:51:21.790 INFO:tasks.workunit.client.1.smithi170.stdout:7/785: chown da/d1a/d21/d2c/d74/dde/dc7/fdb 148 1 2024-02-15T22:51:21.790 INFO:tasks.workunit.client.1.smithi170.stdout:7/786: truncate da/d1a/d21/d2c/d2e/d7a/de2/de5/ff4 766291 0 2024-02-15T22:51:21.790 INFO:tasks.workunit.client.1.smithi170.stdout:3/667: dread d3/dc/d1c/f83 [0,4194304] 0 2024-02-15T22:51:21.790 INFO:tasks.workunit.client.1.smithi170.stdout:3/668: chown d3/dc/d1c/d26/dd4 2297207 1 2024-02-15T22:51:21.791 INFO:tasks.workunit.client.1.smithi170.stdout:7/787: write da/f38 [4830917,107469] 0 2024-02-15T22:51:21.791 INFO:tasks.workunit.client.1.smithi170.stdout:7/788: fdatasync da/d1a/d21/d2c/d74/f86 0 2024-02-15T22:51:21.791 INFO:tasks.workunit.client.1.smithi170.stdout:3/669: mknod d3/d1b/d2c/d9a/cd9 0 2024-02-15T22:51:21.792 INFO:tasks.workunit.client.1.smithi170.stdout:7/789: mknod da/d1a/d21/d2c/d2e/d7a/de2/de5/c10e 0 2024-02-15T22:51:21.793 INFO:tasks.workunit.client.1.smithi170.stdout:7/790: mknod da/d1a/d21/d2c/d74/d87/c10f 0 2024-02-15T22:51:21.804 INFO:tasks.workunit.client.1.smithi170.stdout:2/762: dwrite d0/d1/d89/dd7/d3e/f44 [0,4194304] 0 2024-02-15T22:51:21.804 INFO:tasks.workunit.client.1.smithi170.stdout:2/763: truncate d0/d1/d11/fc1 4318351 0 2024-02-15T22:51:21.804 INFO:tasks.workunit.client.1.smithi170.stdout:2/764: chown d0/d1/d89/fcb 488970 1 2024-02-15T22:51:21.816 INFO:tasks.workunit.client.1.smithi170.stdout:2/765: link d0/d1/d89/dd7/d3e/f43 d0/d1/d89/dd7/d2f/ddf/f122 0 2024-02-15T22:51:21.820 INFO:tasks.workunit.client.1.smithi170.stdout:3/670: dwrite d3/dc/d13/f28 [0,4194304] 0 2024-02-15T22:51:21.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/791: dwrite da/d1a/d21/d2c/d2e/fad [0,4194304] 0 2024-02-15T22:51:21.822 INFO:tasks.workunit.client.1.smithi170.stdout:3/671: creat d3/dc/d1c/d26/dd4/fda x:0 0 0 2024-02-15T22:51:21.822 INFO:tasks.workunit.client.1.smithi170.stdout:3/672: truncate d3/db/d1f/d61/fbe 299683 0 2024-02-15T22:51:21.823 INFO:tasks.workunit.client.1.smithi170.stdout:2/766: dread d0/d1/f27 [0,4194304] 0 2024-02-15T22:51:21.825 INFO:tasks.workunit.client.1.smithi170.stdout:7/792: mkdir da/d1a/d21/d2c/d74/d87/d9b/d110 0 2024-02-15T22:51:21.825 INFO:tasks.workunit.client.1.smithi170.stdout:7/793: fsync da/d1a/d21/d2c/d74/d87/dac/fb9 0 2024-02-15T22:51:21.825 INFO:tasks.workunit.client.1.smithi170.stdout:7/794: chown da/d1a/d21/d19/l24 3 1 2024-02-15T22:51:21.826 INFO:tasks.workunit.client.1.smithi170.stdout:3/673: mknod d3/dc/d1a/d9f/dcb/dd2/cdb 0 2024-02-15T22:51:21.826 INFO:tasks.workunit.client.1.smithi170.stdout:3/674: readlink d3/dc/d1c/d26/dd4/l5e 0 2024-02-15T22:51:21.827 INFO:tasks.workunit.client.1.smithi170.stdout:2/767: getdents d0/d1/d89/dd7/d2f/d37/d58/d78 0 2024-02-15T22:51:21.829 INFO:tasks.workunit.client.1.smithi170.stdout:7/795: rename da/d1a/d21/d2c/d74/c9a to da/d1a/d21/d4d/d6e/de8/c111 0 2024-02-15T22:51:21.830 INFO:tasks.workunit.client.1.smithi170.stdout:3/675: symlink d3/d1b/d2c/ldc 0 2024-02-15T22:51:21.830 INFO:tasks.workunit.client.1.smithi170.stdout:3/676: readlink d3/dc/d1c/l3b 0 2024-02-15T22:51:21.833 INFO:tasks.workunit.client.1.smithi170.stdout:8/522: sync 2024-02-15T22:51:21.833 INFO:tasks.workunit.client.1.smithi170.stdout:5/712: sync 2024-02-15T22:51:21.833 INFO:tasks.workunit.client.1.smithi170.stdout:9/540: sync 2024-02-15T22:51:21.833 INFO:tasks.workunit.client.1.smithi170.stdout:5/713: write de/d10/d27/d2d/feb [1009533,126443] 0 2024-02-15T22:51:21.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/714: fdatasync de/d10/d27/d4c/d53/d55/fad 0 2024-02-15T22:51:21.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/715: chown de/d10/d33/d9f/l66 23519986 1 2024-02-15T22:51:21.836 INFO:tasks.workunit.client.1.smithi170.stdout:9/541: fdatasync de/d1b/d1c/d1f/d20/d27/d28/f33 0 2024-02-15T22:51:21.838 INFO:tasks.workunit.client.1.smithi170.stdout:2/768: dread d0/d1/d31/f49 [0,4194304] 0 2024-02-15T22:51:21.839 INFO:tasks.workunit.client.1.smithi170.stdout:7/796: dread da/d1a/d21/d2c/d74/d87/dac/f66 [0,4194304] 0 2024-02-15T22:51:21.842 INFO:tasks.workunit.client.1.smithi170.stdout:7/797: symlink da/d1a/d21/d2c/d74/d87/dac/l112 0 2024-02-15T22:51:21.842 INFO:tasks.workunit.client.1.smithi170.stdout:7/798: write da/f13 [6090522,30390] 0 2024-02-15T22:51:21.842 INFO:tasks.workunit.client.1.smithi170.stdout:8/523: rmdir d9/d18/d26/d4f 39 2024-02-15T22:51:21.842 INFO:tasks.workunit.client.1.smithi170.stdout:8/524: fsync d9/f6d 0 2024-02-15T22:51:21.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/542: mknod de/d1b/cb7 0 2024-02-15T22:51:21.846 INFO:tasks.workunit.client.1.smithi170.stdout:2/769: getdents d0/d1/d89 0 2024-02-15T22:51:21.849 INFO:tasks.workunit.client.1.smithi170.stdout:8/525: creat d9/d18/d32/d99/fa6 x:0 0 0 2024-02-15T22:51:21.852 INFO:tasks.workunit.client.1.smithi170.stdout:9/543: unlink de/d1b/d1c/d1f/d20/d27/d2c/f44 0 2024-02-15T22:51:21.853 INFO:tasks.workunit.client.1.smithi170.stdout:2/770: link d0/d2a/lf3 d0/d1/d89/dd7/l123 0 2024-02-15T22:51:21.855 INFO:tasks.workunit.client.1.smithi170.stdout:8/526: symlink d9/d18/d32/d7a/d78/d95/la7 0 2024-02-15T22:51:21.855 INFO:tasks.workunit.client.1.smithi170.stdout:8/527: truncate d9/d18/d32/d99/fa6 827668 0 2024-02-15T22:51:21.855 INFO:tasks.workunit.client.1.smithi170.stdout:8/528: dread - d9/d18/d48/f76 zero size 2024-02-15T22:51:21.855 INFO:tasks.workunit.client.1.smithi170.stdout:3/677: dwrite d3/db/f22 [0,4194304] 0 2024-02-15T22:51:21.856 INFO:tasks.workunit.client.1.smithi170.stdout:9/544: creat de/d1b/d1c/d1f/d20/d8c/fb8 x:0 0 0 2024-02-15T22:51:21.856 INFO:tasks.workunit.client.1.smithi170.stdout:9/545: dread - de/f9c zero size 2024-02-15T22:51:21.856 INFO:tasks.workunit.client.1.smithi170.stdout:9/546: write de/d1b/d1c/d47/f48 [845115,4585] 0 2024-02-15T22:51:21.856 INFO:tasks.workunit.client.1.smithi170.stdout:9/547: fsync de/d1b/d1c/d1f/f9b 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:2/771: mkdir d0/d2a/daa/d124 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:3/678: symlink d3/d1b/d51/d6b/d86/ldd 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:3/679: write d3/dc/d1c/d26/dd4/f80 [166711,18369] 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:3/680: stat d3/db/d1f/d61/dd7 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:3/681: mkdir d3/db/d1f/dde 0 2024-02-15T22:51:21.860 INFO:tasks.workunit.client.1.smithi170.stdout:3/682: creat d3/db/d1f/d61/dd7/fdf x:0 0 0 2024-02-15T22:51:21.862 INFO:tasks.workunit.client.1.smithi170.stdout:5/716: dwrite de/d10/f13 [0,4194304] 0 2024-02-15T22:51:21.863 INFO:tasks.workunit.client.1.smithi170.stdout:5/717: chown de/d10/d33/db2 67960 1 2024-02-15T22:51:21.863 INFO:tasks.workunit.client.1.smithi170.stdout:5/718: readlink de/d10/d7d/le0 0 2024-02-15T22:51:21.865 INFO:tasks.workunit.client.1.smithi170.stdout:5/719: link de/d10/d33/d9f/cac de/d10/da8/cf5 0 2024-02-15T22:51:21.869 INFO:tasks.workunit.client.1.smithi170.stdout:9/548: dread de/d1b/d1c/d1f/d20/d27/f29 [4194304,4194304] 0 2024-02-15T22:51:21.870 INFO:tasks.workunit.client.1.smithi170.stdout:9/549: rename de/d1b/d1c/d1f/d20/d8c/fb8 to de/d8e/fb9 0 2024-02-15T22:51:21.874 INFO:tasks.workunit.client.1.smithi170.stdout:9/550: rename de/d1b/l23 to de/d8e/lba 0 2024-02-15T22:51:21.874 INFO:tasks.workunit.client.1.smithi170.stdout:3/683: dwrite d3/f72 [0,4194304] 0 2024-02-15T22:51:21.879 INFO:tasks.workunit.client.1.smithi170.stdout:7/799: dwrite da/d1a/d21/fae [0,4194304] 0 2024-02-15T22:51:21.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/529: write d9/f16 [1571516,111352] 0 2024-02-15T22:51:21.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/530: write d9/f46 [1484536,25052] 0 2024-02-15T22:51:21.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/531: write d9/d18/d32/d3b/d42/fa4 [443062,72993] 0 2024-02-15T22:51:21.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/532: creat d9/d18/d32/d3b/d68/fa8 x:0 0 0 2024-02-15T22:51:21.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/533: truncate d9/d18/d32/f3a 886860 0 2024-02-15T22:51:21.900 INFO:tasks.workunit.client.1.smithi170.stdout:7/800: dwrite da/d1a/d21/d2c/d74/dde/dc7/fdb [0,4194304] 0 2024-02-15T22:51:21.900 INFO:tasks.workunit.client.1.smithi170.stdout:7/801: fdatasync da/d1a/d21/d4d/f10a 0 2024-02-15T22:51:21.902 INFO:tasks.workunit.client.1.smithi170.stdout:3/684: dwrite d3/db/fb1 [0,4194304] 0 2024-02-15T22:51:21.902 INFO:tasks.workunit.client.1.smithi170.stdout:7/802: stat da/d1a/d21/d2c/d74/dde/d7d/d72/cb7 0 2024-02-15T22:51:21.903 INFO:tasks.workunit.client.1.smithi170.stdout:3/685: mknod d3/d1b/d8a/ce0 0 2024-02-15T22:51:21.903 INFO:tasks.workunit.client.1.smithi170.stdout:3/686: stat d3/dc/d13/c5a 0 2024-02-15T22:51:21.904 INFO:tasks.workunit.client.1.smithi170.stdout:7/803: mkdir da/d1a/d21/d2c/d74/dde/d7d/d113 0 2024-02-15T22:51:21.905 INFO:tasks.workunit.client.1.smithi170.stdout:3/687: write d3/f9 [1008232,130478] 0 2024-02-15T22:51:21.907 INFO:tasks.workunit.client.1.smithi170.stdout:3/688: unlink d3/dc/f1d 0 2024-02-15T22:51:21.908 INFO:tasks.workunit.client.1.smithi170.stdout:3/689: creat d3/db/d1f/d61/dad/fe1 x:0 0 0 2024-02-15T22:51:21.908 INFO:tasks.workunit.client.1.smithi170.stdout:3/690: rmdir d3/d1b/d2c/d92 39 2024-02-15T22:51:21.910 INFO:tasks.workunit.client.1.smithi170.stdout:3/691: creat d3/dcd/dcf/da9/fe2 x:0 0 0 2024-02-15T22:51:21.910 INFO:tasks.workunit.client.1.smithi170.stdout:3/692: truncate d3/d1b/d8a/fd8 427010 0 2024-02-15T22:51:21.913 INFO:tasks.workunit.client.1.smithi170.stdout:7/804: read da/d1a/def/fb4 [2700755,24463] 0 2024-02-15T22:51:21.913 INFO:tasks.workunit.client.1.smithi170.stdout:7/805: write da/d1a/d21/d2c/d71/fa6 [117412,81832] 0 2024-02-15T22:51:21.923 INFO:tasks.workunit.client.1.smithi170.stdout:9/551: fdatasync de/f1a 0 2024-02-15T22:51:21.923 INFO:tasks.workunit.client.1.smithi170.stdout:2/772: dread d0/d1/d89/dd7/d2f/fca [0,4194304] 0 2024-02-15T22:51:21.924 INFO:tasks.workunit.client.1.smithi170.stdout:9/552: dread - de/d1b/f88 zero size 2024-02-15T22:51:21.924 INFO:tasks.workunit.client.1.smithi170.stdout:9/553: fsync de/d1b/d1c/d1f/f9b 0 2024-02-15T22:51:21.925 INFO:tasks.workunit.client.1.smithi170.stdout:5/720: dread de/d10/d52/f73 [0,4194304] 0 2024-02-15T22:51:21.926 INFO:tasks.workunit.client.1.smithi170.stdout:2/773: truncate d0/d1/d31/f49 2810076 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:9/554: creat de/d1b/d1c/d1f/d20/d27/d28/fbb x:0 0 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:9/555: creat de/d1b/d1c/d1f/d20/fbc x:0 0 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:9/556: readlink de/d1b/d1c/d1f/d20/l5c 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:3/693: write d3/dc/d1c/d26/f46 [597672,83045] 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:8/534: write d9/d18/d32/d3b/f40 [3937862,119012] 0 2024-02-15T22:51:21.930 INFO:tasks.workunit.client.1.smithi170.stdout:3/694: rename d3/d1b/d51/d6b to d3/d1b/d51/d6b/d86/de3 22 2024-02-15T22:51:21.936 INFO:tasks.workunit.client.1.smithi170.stdout:7/806: dwrite da/d1a/d21/d2c/d74/d87/fbe [0,4194304] 0 2024-02-15T22:51:21.936 INFO:tasks.workunit.client.1.smithi170.stdout:7/807: fdatasync da/d1a/d21/d2c/f84 0 2024-02-15T22:51:21.948 INFO:tasks.workunit.client.1.smithi170.stdout:5/721: mkdir de/d10/d7d/df6 0 2024-02-15T22:51:21.948 INFO:tasks.workunit.client.1.smithi170.stdout:5/722: chown de/d10/d27/d2d/f31 162631 1 2024-02-15T22:51:21.948 INFO:tasks.workunit.client.1.smithi170.stdout:2/774: mkdir d0/d1/d11/d26/d6e/d10f/df9/d108/d125 0 2024-02-15T22:51:21.949 INFO:tasks.workunit.client.1.smithi170.stdout:2/775: chown d0/d13 106473 1 2024-02-15T22:51:21.954 INFO:tasks.workunit.client.1.smithi170.stdout:3/695: dwrite d3/d1b/d8a/faa [0,4194304] 0 2024-02-15T22:51:21.954 INFO:tasks.workunit.client.1.smithi170.stdout:7/808: link da/d1a/d21/d2c/d2e/d7a/de2/de5/c10e da/d1a/d21/d2c/c114 0 2024-02-15T22:51:21.954 INFO:tasks.workunit.client.1.smithi170.stdout:9/557: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f32 [0,4194304] 0 2024-02-15T22:51:21.954 INFO:tasks.workunit.client.1.smithi170.stdout:9/558: write f4 [2889581,37981] 0 2024-02-15T22:51:21.955 INFO:tasks.workunit.client.1.smithi170.stdout:9/559: creat de/d8e/fbd x:0 0 0 2024-02-15T22:51:21.955 INFO:tasks.workunit.client.1.smithi170.stdout:9/560: read f4 [1894321,48685] 0 2024-02-15T22:51:21.961 INFO:tasks.workunit.client.1.smithi170.stdout:3/696: creat d3/fe4 x:0 0 0 2024-02-15T22:51:21.962 INFO:tasks.workunit.client.1.smithi170.stdout:9/561: dread de/f14 [0,4194304] 0 2024-02-15T22:51:21.962 INFO:tasks.workunit.client.1.smithi170.stdout:5/723: dwrite de/d36/fab [0,4194304] 0 2024-02-15T22:51:21.963 INFO:tasks.workunit.client.1.smithi170.stdout:7/809: mkdir da/d1a/d21/d115 0 2024-02-15T22:51:21.963 INFO:tasks.workunit.client.1.smithi170.stdout:7/810: write da/d1a/def/fa2 [1440362,51818] 0 2024-02-15T22:51:21.963 INFO:tasks.workunit.client.1.smithi170.stdout:7/811: write da/d1a/d21/d2c/d71/ddc/ff9 [998455,28873] 0 2024-02-15T22:51:21.964 INFO:tasks.workunit.client.1.smithi170.stdout:2/776: rmdir d0/d13/d59/d82 39 2024-02-15T22:51:21.965 INFO:tasks.workunit.client.1.smithi170.stdout:3/697: fdatasync d3/d1b/fb5 0 2024-02-15T22:51:21.967 INFO:tasks.workunit.client.1.smithi170.stdout:5/724: mkdir de/d36/df7 0 2024-02-15T22:51:21.969 INFO:tasks.workunit.client.1.smithi170.stdout:7/812: link da/d1a/d21/d2c/d74/d87/daf/fe6 da/d1a/d21/d2c/d2e/d7a/de2/de5/f116 0 2024-02-15T22:51:21.971 INFO:tasks.workunit.client.1.smithi170.stdout:2/777: creat d0/d1d/f126 x:0 0 0 2024-02-15T22:51:21.972 INFO:tasks.workunit.client.1.smithi170.stdout:1/809: sync 2024-02-15T22:51:21.974 INFO:tasks.workunit.client.1.smithi170.stdout:7/813: creat da/d1a/d21/d2c/d74/dde/d7d/d113/f117 x:0 0 0 2024-02-15T22:51:21.974 INFO:tasks.workunit.client.1.smithi170.stdout:7/814: read da/d1a/def/d8d/fb5 [531543,80719] 0 2024-02-15T22:51:21.975 INFO:tasks.workunit.client.1.smithi170.stdout:1/810: dread d3/fb [0,4194304] 0 2024-02-15T22:51:21.977 INFO:tasks.workunit.client.1.smithi170.stdout:3/698: rename d3/db/d1f/f36 to d3/d1b/d51/d6b/d86/dc5/fe5 0 2024-02-15T22:51:21.977 INFO:tasks.workunit.client.1.smithi170.stdout:5/725: mknod de/d10/d27/d4c/cf8 0 2024-02-15T22:51:21.978 INFO:tasks.workunit.client.1.smithi170.stdout:7/815: symlink da/d57/df3/l118 0 2024-02-15T22:51:21.978 INFO:tasks.workunit.client.1.smithi170.stdout:7/816: fsync da/d1a/d21/fda 0 2024-02-15T22:51:21.978 INFO:tasks.workunit.client.1.smithi170.stdout:5/726: read de/d10/d33/d9f/d7c/d87/fdf [358085,70934] 0 2024-02-15T22:51:21.979 INFO:tasks.workunit.client.1.smithi170.stdout:2/778: rmdir d0/d1/d89/dd7/d83 39 2024-02-15T22:51:21.979 INFO:tasks.workunit.client.1.smithi170.stdout:2/779: write d0/d1/d89/dd7/d2f/d9b/d115/f11b [338137,83946] 0 2024-02-15T22:51:21.983 INFO:tasks.workunit.client.1.smithi170.stdout:2/780: mkdir d0/d1/d11/d26/d6e/d10f/df9/d127 0 2024-02-15T22:51:21.983 INFO:tasks.workunit.client.1.smithi170.stdout:1/811: rmdir d3/d24/d2c/d94/dd9 39 2024-02-15T22:51:21.987 INFO:tasks.workunit.client.1.smithi170.stdout:3/699: creat d3/dcd/dcf/fe6 x:0 0 0 2024-02-15T22:51:21.990 INFO:tasks.workunit.client.1.smithi170.stdout:2/781: mkdir d0/d1/d31/da3/d128 0 2024-02-15T22:51:21.990 INFO:tasks.workunit.client.1.smithi170.stdout:2/782: write d0/d2a/f77 [979566,21954] 0 2024-02-15T22:51:21.990 INFO:tasks.workunit.client.1.smithi170.stdout:2/783: fsync d0/f25 0 2024-02-15T22:51:21.990 INFO:tasks.workunit.client.1.smithi170.stdout:2/784: fsync d0/d1/f48 0 2024-02-15T22:51:21.991 INFO:tasks.workunit.client.1.smithi170.stdout:1/812: mknod d3/d24/d2c/d77/d110/c117 0 2024-02-15T22:51:21.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/785: truncate d0/d1/d11/fc1 660397 0 2024-02-15T22:51:21.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/786: fdatasync d0/d13/d59/d82/f100 0 2024-02-15T22:51:21.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/787: dread - d0/d1/d89/dd7/d2f/d37/d58/d78/fcc zero size 2024-02-15T22:51:21.993 INFO:tasks.workunit.client.1.smithi170.stdout:2/788: chown d0/d1/d11/d26/d6e/d10f 404729345 1 2024-02-15T22:51:21.994 INFO:tasks.workunit.client.1.smithi170.stdout:1/813: mkdir d3/d24/d2c/d77/d110/d118 0 2024-02-15T22:51:21.996 INFO:tasks.workunit.client.1.smithi170.stdout:2/789: mknod d0/d1/d89/dd7/d2f/d9b/d115/c129 0 2024-02-15T22:51:21.996 INFO:tasks.workunit.client.1.smithi170.stdout:2/790: fdatasync d0/d1/d89/dd7/ff5 0 2024-02-15T22:51:21.996 INFO:tasks.workunit.client.1.smithi170.stdout:2/791: fsync d0/d13/d59/d82/f100 0 2024-02-15T22:51:21.996 INFO:tasks.workunit.client.1.smithi170.stdout:2/792: truncate d0/d1/d89/dd7/f10a 426263 0 2024-02-15T22:51:21.997 INFO:tasks.workunit.client.1.smithi170.stdout:7/817: dwrite da/d1a/d21/d2c/d74/dde/d7d/d113/f117 [0,4194304] 0 2024-02-15T22:51:21.997 INFO:tasks.workunit.client.1.smithi170.stdout:7/818: read - da/d1a/d21/d2c/d74/dde/d9e/f103 zero size 2024-02-15T22:51:21.999 INFO:tasks.workunit.client.1.smithi170.stdout:2/793: rename d0/d1/d11/f29 to d0/d1/d89/dd7/d2f/ddf/f12a 0 2024-02-15T22:51:21.999 INFO:tasks.workunit.client.1.smithi170.stdout:2/794: creat d0/d1/d11/d26/d6e/d8a/f12b x:0 0 0 2024-02-15T22:51:22.006 INFO:tasks.workunit.client.1.smithi170.stdout:7/819: creat da/d1a/d21/d4d/d6e/de8/f119 x:0 0 0 2024-02-15T22:51:22.019 INFO:tasks.workunit.client.1.smithi170.stdout:1/814: dwrite d3/d24/d2c/d35/fe3 [0,4194304] 0 2024-02-15T22:51:22.020 INFO:tasks.workunit.client.1.smithi170.stdout:1/815: mknod d3/d24/d2c/d35/d72/d92/c119 0 2024-02-15T22:51:22.020 INFO:tasks.workunit.client.1.smithi170.stdout:1/816: symlink d3/d24/d2c/d77/d110/d118/l11a 0 2024-02-15T22:51:22.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/817: readlink d3/da2/d4a/l7b 0 2024-02-15T22:51:22.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/818: write d3/d24/d2c/d35/d83/dd8/f115 [637080,21349] 0 2024-02-15T22:51:22.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/819: symlink d3/d24/d2c/d35/d83/dd8/l11b 0 2024-02-15T22:51:22.021 INFO:tasks.workunit.client.1.smithi170.stdout:1/820: write d3/d24/d2c/d94/dd9/ff5 [476628,18205] 0 2024-02-15T22:51:22.067 INFO:tasks.workunit.client.1.smithi170.stdout:3/700: dwrite d3/dc/d1c/d26/d55/f69 [0,4194304] 0 2024-02-15T22:51:22.067 INFO:tasks.workunit.client.1.smithi170.stdout:2/795: dwrite d0/d1d/f22 [0,4194304] 0 2024-02-15T22:51:22.068 INFO:tasks.workunit.client.1.smithi170.stdout:3/701: unlink d3/dc/d1c/f1e 0 2024-02-15T22:51:22.072 INFO:tasks.workunit.client.1.smithi170.stdout:2/796: mkdir d0/d13/d59/d12c 0 2024-02-15T22:51:22.073 INFO:tasks.workunit.client.1.smithi170.stdout:3/702: rename d3/db/d1f/dde to d3/dc/d1a/d9f/dcb/de7 0 2024-02-15T22:51:22.074 INFO:tasks.workunit.client.1.smithi170.stdout:3/703: stat d3/dc/d1a/d9f/fd5 0 2024-02-15T22:51:22.074 INFO:tasks.workunit.client.1.smithi170.stdout:2/797: mkdir d0/d1/d31/da3/d12d 0 2024-02-15T22:51:22.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/704: chown d3/d2b/f4f 292943295 1 2024-02-15T22:51:22.075 INFO:tasks.workunit.client.1.smithi170.stdout:3/705: stat d3/d1b/d51/d6b/f91 0 2024-02-15T22:51:22.077 INFO:tasks.workunit.client.1.smithi170.stdout:2/798: mkdir d0/d1/d89/dd7/d2f/ddf/d12e 0 2024-02-15T22:51:22.077 INFO:tasks.workunit.client.1.smithi170.stdout:2/799: fsync d0/d1/f9 0 2024-02-15T22:51:22.078 INFO:tasks.workunit.client.1.smithi170.stdout:2/800: symlink d0/d1/d89/dd7/d2f/ddf/d12e/l12f 0 2024-02-15T22:51:22.078 INFO:tasks.workunit.client.1.smithi170.stdout:2/801: chown d0/d1/d89/dd7/d2f/d37/fc7 39717 1 2024-02-15T22:51:22.082 INFO:tasks.workunit.client.1.smithi170.stdout:2/802: dread d0/d1/f27 [0,4194304] 0 2024-02-15T22:51:22.091 INFO:tasks.workunit.client.1.smithi170.stdout:2/803: dread d0/d1/d5f/f8c [0,4194304] 0 2024-02-15T22:51:22.091 INFO:tasks.workunit.client.1.smithi170.stdout:3/706: dwrite d3/dc/f5b [0,4194304] 0 2024-02-15T22:51:22.099 INFO:tasks.workunit.client.1.smithi170.stdout:2/804: write d0/d1/d89/d8b/fbf [565090,102247] 0 2024-02-15T22:51:22.100 INFO:tasks.workunit.client.1.smithi170.stdout:2/805: fdatasync d0/d1/d89/dd7/d2f/ddf/f12a 0 2024-02-15T22:51:22.100 INFO:tasks.workunit.client.1.smithi170.stdout:2/806: rmdir d0/d1/d89/dd7/d83/dfa 0 2024-02-15T22:51:22.101 INFO:tasks.workunit.client.1.smithi170.stdout:2/807: fsync d0/d1/d11/d26/f9a 0 2024-02-15T22:51:22.102 INFO:tasks.workunit.client.1.smithi170.stdout:2/808: rename d0/d1d/l117 to d0/d1/d89/dd7/d2f/d9b/d115/l130 0 2024-02-15T22:51:22.102 INFO:tasks.workunit.client.1.smithi170.stdout:2/809: creat d0/d13/d59/d12c/f131 x:0 0 0 2024-02-15T22:51:22.103 INFO:tasks.workunit.client.1.smithi170.stdout:2/810: truncate d0/d1d/d3d/f4c 532091 0 2024-02-15T22:51:22.103 INFO:tasks.workunit.client.1.smithi170.stdout:2/811: dread - d0/d13/f121 zero size 2024-02-15T22:51:22.107 INFO:tasks.workunit.client.1.smithi170.stdout:3/707: dwrite d3/db/d1f/d61/dad/fe1 [0,4194304] 0 2024-02-15T22:51:22.111 INFO:tasks.workunit.client.1.smithi170.stdout:3/708: symlink d3/d1b/d2c/d92/da5/le8 0 2024-02-15T22:51:22.208 INFO:tasks.workunit.client.1.smithi170.stdout:6/716: sync 2024-02-15T22:51:22.208 INFO:tasks.workunit.client.1.smithi170.stdout:4/714: sync 2024-02-15T22:51:22.208 INFO:tasks.workunit.client.1.smithi170.stdout:0/626: sync 2024-02-15T22:51:22.208 INFO:tasks.workunit.client.1.smithi170.stdout:4/715: readlink d0/d22/da/d8b/d47/dbe/da2/ld1 0 2024-02-15T22:51:22.208 INFO:tasks.workunit.client.1.smithi170.stdout:6/717: write d3/d1d/d1b/d3c/fb6 [1008389,66235] 0 2024-02-15T22:51:22.210 INFO:tasks.workunit.client.1.smithi170.stdout:4/716: symlink d0/d22/da/d8b/le4 0 2024-02-15T22:51:22.210 INFO:tasks.workunit.client.1.smithi170.stdout:4/717: write d0/d22/da/d8b/d47/d5e/d7d/f9c [1096133,61587] 0 2024-02-15T22:51:22.210 INFO:tasks.workunit.client.1.smithi170.stdout:4/718: truncate d0/d22/da/d8b/d47/dbe/d89/fa4 661352 0 2024-02-15T22:51:22.210 INFO:tasks.workunit.client.1.smithi170.stdout:4/719: creat d0/d22/da/d8b/d47/d67/d77/dc5/fe5 x:0 0 0 2024-02-15T22:51:22.210 INFO:tasks.workunit.client.1.smithi170.stdout:4/720: write d0/d22/da/f6a [438666,19388] 0 2024-02-15T22:51:22.211 INFO:tasks.workunit.client.1.smithi170.stdout:4/721: symlink d0/le6 0 2024-02-15T22:51:22.212 INFO:tasks.workunit.client.1.smithi170.stdout:4/722: getdents d0/d22/da/d8b/d47/d5e/d79 0 2024-02-15T22:51:22.212 INFO:tasks.workunit.client.1.smithi170.stdout:4/723: truncate d0/d22/da/d8b/d47/d67/d77/dc5/fd7 694369 0 2024-02-15T22:51:22.215 INFO:tasks.workunit.client.1.smithi170.stdout:4/724: mkdir d0/d22/da/d8b/d47/da9/de7 0 2024-02-15T22:51:22.215 INFO:tasks.workunit.client.1.smithi170.stdout:4/725: chown d0/d22/da/d8b/d47/dbe/d20/d49/c56 7293 1 2024-02-15T22:51:22.216 INFO:tasks.workunit.client.1.smithi170.stdout:0/627: write d8/d14/d1c/d3f/f58 [348534,98622] 0 2024-02-15T22:51:22.216 INFO:tasks.workunit.client.1.smithi170.stdout:0/628: readlink d8/d14/d1c/d82/lb0 0 2024-02-15T22:51:22.216 INFO:tasks.workunit.client.1.smithi170.stdout:0/629: getdents d8/d14/d70/d93 0 2024-02-15T22:51:22.217 INFO:tasks.workunit.client.1.smithi170.stdout:0/630: creat d8/df/d13/d22/d39/d55/fc7 x:0 0 0 2024-02-15T22:51:22.220 INFO:tasks.workunit.client.1.smithi170.stdout:0/631: symlink d8/df/d13/d36/d60/lc8 0 2024-02-15T22:51:22.223 INFO:tasks.workunit.client.1.smithi170.stdout:4/726: rename d0/d22/da/d8b/d47/d5e/d73 to d0/d22/da/d8b/d47/dbe/d89/de8 0 2024-02-15T22:51:22.223 INFO:tasks.workunit.client.1.smithi170.stdout:4/727: chown d0/d22/da/c19 3980 1 2024-02-15T22:51:22.227 INFO:tasks.workunit.client.1.smithi170.stdout:6/718: dwrite d3/db8/d96/fe8 [0,4194304] 0 2024-02-15T22:51:22.229 INFO:tasks.workunit.client.1.smithi170.stdout:0/632: dread d8/df/f49 [0,4194304] 0 2024-02-15T22:51:22.229 INFO:tasks.workunit.client.1.smithi170.stdout:0/633: chown d8/d14/d1c/d3f/d53/c6e 1220715 1 2024-02-15T22:51:22.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/634: write d8/df/d13/f2e [3167215,106982] 0 2024-02-15T22:51:22.230 INFO:tasks.workunit.client.1.smithi170.stdout:0/635: write d8/df/f8b [844789,14968] 0 2024-02-15T22:51:22.232 INFO:tasks.workunit.client.1.smithi170.stdout:4/728: dread d0/d22/da/fa1 [0,4194304] 0 2024-02-15T22:51:22.232 INFO:tasks.workunit.client.1.smithi170.stdout:0/636: unlink d8/df/d13/d36/f95 0 2024-02-15T22:51:22.234 INFO:tasks.workunit.client.1.smithi170.stdout:4/729: rename d0/d22/da/d8b/d47/d67/lc7 to d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/le9 0 2024-02-15T22:51:22.235 INFO:tasks.workunit.client.1.smithi170.stdout:4/730: dread d0/d22/da/d8b/d47/dbe/d89/fa4 [0,4194304] 0 2024-02-15T22:51:22.235 INFO:tasks.workunit.client.1.smithi170.stdout:4/731: fdatasync d0/d22/da/f6a 0 2024-02-15T22:51:22.235 INFO:tasks.workunit.client.1.smithi170.stdout:0/637: mkdir d8/d14/d1c/d82/dc9 0 2024-02-15T22:51:22.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/638: creat d8/d14/d6f/fca x:0 0 0 2024-02-15T22:51:22.238 INFO:tasks.workunit.client.1.smithi170.stdout:4/732: mkdir d0/d22/da/d8b/d47/d67/d77/dc5/dea 0 2024-02-15T22:51:22.238 INFO:tasks.workunit.client.1.smithi170.stdout:4/733: chown d0/d22/da/d8b/d47/dbe 1739440 1 2024-02-15T22:51:22.238 INFO:tasks.workunit.client.1.smithi170.stdout:4/734: fdatasync d0/d22/da/d8b/d47/dbe/f30 0 2024-02-15T22:51:22.238 INFO:tasks.workunit.client.1.smithi170.stdout:4/735: dread - d0/d22/da/d8b/d47/fab zero size 2024-02-15T22:51:22.240 INFO:tasks.workunit.client.1.smithi170.stdout:0/639: truncate d8/d14/d70/f87 452398 0 2024-02-15T22:51:22.240 INFO:tasks.workunit.client.1.smithi170.stdout:0/640: write d8/d14/f76 [2220167,22225] 0 2024-02-15T22:51:22.249 INFO:tasks.workunit.client.1.smithi170.stdout:0/641: read f5 [2788689,33350] 0 2024-02-15T22:51:22.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/736: dwrite d0/d22/da/d8b/d47/dbe/d20/f3d [0,4194304] 0 2024-02-15T22:51:22.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/737: creat d0/d22/da/d8b/d47/d2b/feb x:0 0 0 2024-02-15T22:51:22.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/738: chown d0/d22/da/d8b/d47/d2b/c78 83 1 2024-02-15T22:51:22.255 INFO:tasks.workunit.client.1.smithi170.stdout:4/739: readlink d0/d22/da/d8b/d47/d5e/lad 0 2024-02-15T22:51:22.259 INFO:tasks.workunit.client.1.smithi170.stdout:4/740: mknod d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/cec 0 2024-02-15T22:51:22.261 INFO:tasks.workunit.client.1.smithi170.stdout:4/741: rename d0/d22/da/d8b/d47/f3a to d0/d22/da/d8b/d47/d67/d77/fed 0 2024-02-15T22:51:22.261 INFO:tasks.workunit.client.1.smithi170.stdout:4/742: truncate d0/d22/da/d8b/d47/d67/d77/dc5/fd7 1221882 0 2024-02-15T22:51:22.261 INFO:tasks.workunit.client.1.smithi170.stdout:4/743: dread - d0/d22/da/d8b/fe3 zero size 2024-02-15T22:51:22.261 INFO:tasks.workunit.client.1.smithi170.stdout:4/744: symlink d0/d22/da/d8b/d47/dbe/d20/lee 0 2024-02-15T22:51:22.261 INFO:tasks.workunit.client.1.smithi170.stdout:4/745: truncate d0/d22/da/fa1 4728880 0 2024-02-15T22:51:22.274 INFO:tasks.workunit.client.1.smithi170.stdout:4/746: dwrite d0/d22/da/d8b/d47/dbe/d20/f82 [0,4194304] 0 2024-02-15T22:51:22.274 INFO:tasks.workunit.client.1.smithi170.stdout:4/747: readlink d0/d22/lb6 0 2024-02-15T22:51:22.274 INFO:tasks.workunit.client.1.smithi170.stdout:4/748: chown d0/d22/da/d8b/d47/dbe/f1e 716760 1 2024-02-15T22:51:22.284 INFO:tasks.workunit.client.1.smithi170.stdout:4/749: dread d0/d22/da/d8b/d47/d2b/f8f [4194304,4194304] 0 2024-02-15T22:51:22.285 INFO:tasks.workunit.client.1.smithi170.stdout:4/750: creat d0/d22/da/d8b/d47/dbe/d20/d49/fef x:0 0 0 2024-02-15T22:51:22.286 INFO:tasks.workunit.client.1.smithi170.stdout:4/751: mknod d0/d9f/cf0 0 2024-02-15T22:51:22.286 INFO:tasks.workunit.client.1.smithi170.stdout:4/752: dread - d0/d22/da/d8b/d47/dbe/d20/fc4 zero size 2024-02-15T22:51:22.286 INFO:tasks.workunit.client.1.smithi170.stdout:4/753: creat d0/ff1 x:0 0 0 2024-02-15T22:51:22.286 INFO:tasks.workunit.client.1.smithi170.stdout:4/754: creat d0/d22/da/d8b/d47/d2b/ff2 x:0 0 0 2024-02-15T22:51:22.286 INFO:tasks.workunit.client.1.smithi170.stdout:4/755: write d0/d22/da/d8b/d47/d67/d77/fed [4883708,71550] 0 2024-02-15T22:51:22.288 INFO:tasks.workunit.client.1.smithi170.stdout:4/756: symlink d0/d22/lf3 0 2024-02-15T22:51:22.288 INFO:tasks.workunit.client.1.smithi170.stdout:4/757: chown d0/d22/da/d8b/d47/dbe/d20/f23 226172 1 2024-02-15T22:51:22.288 INFO:tasks.workunit.client.1.smithi170.stdout:4/758: mkdir d0/d22/da/d8b/d47/d5e/d79/df4 0 2024-02-15T22:51:22.289 INFO:tasks.workunit.client.1.smithi170.stdout:4/759: truncate d0/d22/da/d8b/d47/dbe/d20/d49/f53 4465021 0 2024-02-15T22:51:22.290 INFO:tasks.workunit.client.1.smithi170.stdout:4/760: creat d0/d22/da/d8b/d47/d5e/d7d/dd9/ff5 x:0 0 0 2024-02-15T22:51:22.291 INFO:tasks.workunit.client.1.smithi170.stdout:4/761: dread d0/d22/f14 [0,4194304] 0 2024-02-15T22:51:22.291 INFO:tasks.workunit.client.1.smithi170.stdout:4/762: stat d0/d22/da/d8b/d47/d67/d77/dc5 0 2024-02-15T22:51:22.311 INFO:tasks.workunit.client.1.smithi170.stdout:8/535: sync 2024-02-15T22:51:22.312 INFO:tasks.workunit.client.1.smithi170.stdout:8/536: rmdir d9/d18/d32/d3b/d4b/d96 0 2024-02-15T22:51:22.313 INFO:tasks.workunit.client.1.smithi170.stdout:8/537: getdents d9/d18/d32/d7a/d78/d7f/d98/d9d 0 2024-02-15T22:51:22.314 INFO:tasks.workunit.client.1.smithi170.stdout:8/538: truncate d9/d18/d32/d3b/f41 2401323 0 2024-02-15T22:51:22.315 INFO:tasks.workunit.client.1.smithi170.stdout:8/539: symlink d9/d18/d32/d3b/d68/la9 0 2024-02-15T22:51:22.316 INFO:tasks.workunit.client.1.smithi170.stdout:8/540: mknod d9/d18/d32/caa 0 2024-02-15T22:51:22.317 INFO:tasks.workunit.client.1.smithi170.stdout:8/541: mkdir d9/d18/d32/dab 0 2024-02-15T22:51:22.320 INFO:tasks.workunit.client.1.smithi170.stdout:8/542: creat d9/d18/d32/d7a/d78/d7f/d98/d9d/fac x:0 0 0 2024-02-15T22:51:22.325 INFO:tasks.workunit.client.1.smithi170.stdout:8/543: rmdir d9/d18/d32/d7a 39 2024-02-15T22:51:22.325 INFO:tasks.workunit.client.1.smithi170.stdout:8/544: write d9/d18/d32/d3b/d42/f74 [422705,2461] 0 2024-02-15T22:51:22.326 INFO:tasks.workunit.client.1.smithi170.stdout:8/545: creat d9/d18/d32/d7a/d78/d7f/d98/fad x:0 0 0 2024-02-15T22:51:22.326 INFO:tasks.workunit.client.1.smithi170.stdout:8/546: read - d9/d18/f79 zero size 2024-02-15T22:51:22.327 INFO:tasks.workunit.client.1.smithi170.stdout:8/547: truncate d9/ff 1877853 0 2024-02-15T22:51:22.328 INFO:tasks.workunit.client.1.smithi170.stdout:8/548: unlink d9/d18/d32/d3b/d42/f61 0 2024-02-15T22:51:22.328 INFO:tasks.workunit.client.1.smithi170.stdout:8/549: readlink d9/d18/d32/d3b/d68/la9 0 2024-02-15T22:51:22.329 INFO:tasks.workunit.client.1.smithi170.stdout:8/550: unlink d9/f1a 0 2024-02-15T22:51:22.330 INFO:tasks.workunit.client.1.smithi170.stdout:8/551: mknod d9/cae 0 2024-02-15T22:51:22.409 INFO:tasks.workunit.client.1.smithi170.stdout:9/562: sync 2024-02-15T22:51:22.410 INFO:tasks.workunit.client.1.smithi170.stdout:5/727: sync 2024-02-15T22:51:22.410 INFO:tasks.workunit.client.1.smithi170.stdout:5/728: fdatasync de/d10/d33/f42 0 2024-02-15T22:51:22.411 INFO:tasks.workunit.client.1.smithi170.stdout:5/729: mknod de/d10/d27/dbd/cf9 0 2024-02-15T22:51:22.411 INFO:tasks.workunit.client.1.smithi170.stdout:5/730: unlink de/d10/d27/lb3 0 2024-02-15T22:51:22.411 INFO:tasks.workunit.client.1.smithi170.stdout:5/731: fdatasync de/f21 0 2024-02-15T22:51:22.422 INFO:tasks.workunit.client.1.smithi170.stdout:5/732: dwrite de/d10/d27/d2d/f98 [0,4194304] 0 2024-02-15T22:51:22.422 INFO:tasks.workunit.client.1.smithi170.stdout:5/733: read de/d10/d27/d2d/f35 [1505723,63016] 0 2024-02-15T22:51:22.423 INFO:tasks.workunit.client.1.smithi170.stdout:5/734: mknod de/d10/d33/d9f/cfa 0 2024-02-15T22:51:22.427 INFO:tasks.workunit.client.1.smithi170.stdout:5/735: dread de/d10/d7d/fb1 [0,4194304] 0 2024-02-15T22:51:22.429 INFO:tasks.workunit.client.1.smithi170.stdout:5/736: rename de/d10/d27/d2d/feb to de/d36/df7/ffb 0 2024-02-15T22:51:22.447 INFO:tasks.workunit.client.1.smithi170.stdout:5/737: dwrite de/d29/fde [0,4194304] 0 2024-02-15T22:51:22.510 INFO:tasks.workunit.client.1.smithi170.stdout:7/820: sync 2024-02-15T22:51:22.510 INFO:tasks.workunit.client.1.smithi170.stdout:7/821: truncate da/d1a/d21/d2c/d74/dde/fba 728699 0 2024-02-15T22:51:22.510 INFO:tasks.workunit.client.1.smithi170.stdout:7/822: creat da/d1a/d21/d2c/d74/dde/d7d/d113/f11a x:0 0 0 2024-02-15T22:51:22.527 INFO:tasks.workunit.client.1.smithi170.stdout:7/823: dwrite da/d1a/d21/d2c/d74/dde/fb3 [0,4194304] 0 2024-02-15T22:51:22.529 INFO:tasks.workunit.client.1.smithi170.stdout:7/824: mkdir da/d1a/d21/d2c/d74/dde/dc7/df0/d11b 0 2024-02-15T22:51:22.556 INFO:tasks.workunit.client.1.smithi170.stdout:7/825: dwrite da/d1a/def/fa2 [0,4194304] 0 2024-02-15T22:51:22.574 INFO:tasks.workunit.client.1.smithi170.stdout:7/826: dwrite da/d1a/d21/d2c/d74/dde/dc7/fdb [4194304,4194304] 0 2024-02-15T22:51:22.578 INFO:tasks.workunit.client.1.smithi170.stdout:7/827: dread da/d1a/def/fb4 [0,4194304] 0 2024-02-15T22:51:22.580 INFO:tasks.workunit.client.1.smithi170.stdout:7/828: mknod da/d1a/d21/d2c/d74/dde/d7d/d72/d10b/c11c 0 2024-02-15T22:51:22.580 INFO:tasks.workunit.client.1.smithi170.stdout:7/829: dread - da/d1a/d21/d4d/f10a zero size 2024-02-15T22:51:22.587 INFO:tasks.workunit.client.1.smithi170.stdout:7/830: write da/f13 [2952531,112097] 0 2024-02-15T22:51:22.588 INFO:tasks.workunit.client.1.smithi170.stdout:7/831: symlink da/d1a/d21/d2c/d74/d87/l11d 0 2024-02-15T22:51:22.607 INFO:tasks.workunit.client.1.smithi170.stdout:7/832: dwrite da/d1a/d21/d2c/d74/dde/fb3 [4194304,4194304] 0 2024-02-15T22:51:22.609 INFO:tasks.workunit.client.1.smithi170.stdout:7/833: rmdir da/d1a/d21/d1b/d69 39 2024-02-15T22:51:22.610 INFO:tasks.workunit.client.1.smithi170.stdout:7/834: creat da/d1a/d21/d2c/d74/dde/d7d/d72/d10b/f11e x:0 0 0 2024-02-15T22:51:22.611 INFO:tasks.workunit.client.1.smithi170.stdout:7/835: write da/d1a/d21/d2c/d2e/d7a/fbb [852613,107559] 0 2024-02-15T22:51:22.613 INFO:tasks.workunit.client.1.smithi170.stdout:7/836: link da/d1a/d21/d2c/d74/dde/d7d/d113/f11a da/d1a/d21/d2c/d74/dde/d7d/f11f 0 2024-02-15T22:51:22.613 INFO:tasks.workunit.client.1.smithi170.stdout:7/837: write da/d1a/d21/f70 [5151161,46863] 0 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:1/821: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:3/709: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:2/812: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:4/763: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:0/642: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:9/563: sync 2024-02-15T22:51:22.619 INFO:tasks.workunit.client.1.smithi170.stdout:3/710: stat d3/dc/d1a/d9f/dcb/de7 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/564: chown de/d1b/d1c/d1f/d20/ca4 79309314 1 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/565: truncate de/d1b/d1c/d1f/d20/d78/f8b 1479690 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:1/822: write d3/da2/d65/f93 [265682,26919] 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/738: sync 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:8/552: sync 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:6/719: sync 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/739: write de/d29/fb5 [1295057,89094] 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/740: write de/d10/d33/f45 [364679,14911] 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:6/720: write d3/d24/d31/f34 [1229200,39344] 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:5/741: read de/f1a [4036635,53414] 0 2024-02-15T22:51:22.620 INFO:tasks.workunit.client.1.smithi170.stdout:6/721: creat d3/d1d/d1b/ff9 x:0 0 0 2024-02-15T22:51:22.621 INFO:tasks.workunit.client.1.smithi170.stdout:4/764: dread d0/d22/da/d8b/fb2 [0,4194304] 0 2024-02-15T22:51:22.622 INFO:tasks.workunit.client.1.smithi170.stdout:6/722: write d3/d24/d31/f44 [1438707,104662] 0 2024-02-15T22:51:22.622 INFO:tasks.workunit.client.1.smithi170.stdout:2/813: rename d0/d1/l10c to d0/d1/d89/dd7/d2f/ddf/d12e/l132 0 2024-02-15T22:51:22.622 INFO:tasks.workunit.client.1.smithi170.stdout:2/814: dread - d0/d1/d89/dd7/d3e/f43 zero size 2024-02-15T22:51:22.622 INFO:tasks.workunit.client.1.smithi170.stdout:2/815: dread - d0/d1/d89/dd7/f85 zero size 2024-02-15T22:51:22.624 INFO:tasks.workunit.client.1.smithi170.stdout:3/711: symlink d3/dc/d1c/d26/le9 0 2024-02-15T22:51:22.624 INFO:tasks.workunit.client.1.smithi170.stdout:3/712: creat d3/dc/fea x:0 0 0 2024-02-15T22:51:22.625 INFO:tasks.workunit.client.1.smithi170.stdout:9/566: link de/d1b/d1c/d1f/d20/d27/d28/d7a/lac de/d97/lbe 0 2024-02-15T22:51:22.625 INFO:tasks.workunit.client.1.smithi170.stdout:8/553: write d9/f46 [2280993,98485] 0 2024-02-15T22:51:22.626 INFO:tasks.workunit.client.1.smithi170.stdout:7/838: dread da/d1a/d21/d2c/d2e/fad [0,4194304] 0 2024-02-15T22:51:22.626 INFO:tasks.workunit.client.1.smithi170.stdout:7/839: stat da/d1a/d21/d2c/d2e 0 2024-02-15T22:51:22.627 INFO:tasks.workunit.client.1.smithi170.stdout:4/765: dread d0/d22/da/d8b/d47/da9/f91 [0,4194304] 0 2024-02-15T22:51:22.630 INFO:tasks.workunit.client.1.smithi170.stdout:5/742: mkdir de/d10/da8/dfc 0 2024-02-15T22:51:22.630 INFO:tasks.workunit.client.1.smithi170.stdout:5/743: write de/d36/d80/f9a [4599558,98522] 0 2024-02-15T22:51:22.634 INFO:tasks.workunit.client.1.smithi170.stdout:1/823: rename d3/d24/d2c/d77/dda/fea to d3/da2/d4a/f11c 0 2024-02-15T22:51:22.634 INFO:tasks.workunit.client.1.smithi170.stdout:1/824: fdatasync d3/da2/d65/f87 0 2024-02-15T22:51:22.635 INFO:tasks.workunit.client.1.smithi170.stdout:2/816: symlink d0/d1/d11/d26/d6e/d8a/l133 0 2024-02-15T22:51:22.638 INFO:tasks.workunit.client.1.smithi170.stdout:9/567: rmdir de/d1b/d1c/d1f/d20/d27/d28/db1 0 2024-02-15T22:51:22.638 INFO:tasks.workunit.client.1.smithi170.stdout:9/568: chown de/d1b/f9f 1817784 1 2024-02-15T22:51:22.639 INFO:tasks.workunit.client.1.smithi170.stdout:8/554: getdents d9/d18/d32/dab 0 2024-02-15T22:51:22.642 INFO:tasks.workunit.client.1.smithi170.stdout:0/643: dwrite d8/d14/d6f/f88 [0,4194304] 0 2024-02-15T22:51:22.642 INFO:tasks.workunit.client.1.smithi170.stdout:7/840: unlink da/d1a/c3e 0 2024-02-15T22:51:22.642 INFO:tasks.workunit.client.1.smithi170.stdout:7/841: getdents da/d1a/d21/d1b/df7 0 2024-02-15T22:51:22.643 INFO:tasks.workunit.client.1.smithi170.stdout:4/766: rmdir d0/d22/da/d8b/d47/dbe/d20/d49/dbc 39 2024-02-15T22:51:22.646 INFO:tasks.workunit.client.1.smithi170.stdout:5/744: dread de/d29/f5a [0,4194304] 0 2024-02-15T22:51:22.648 INFO:tasks.workunit.client.1.smithi170.stdout:5/745: dread de/d10/da8/db6/fd0 [0,4194304] 0 2024-02-15T22:51:22.648 INFO:tasks.workunit.client.1.smithi170.stdout:3/713: rename d3/dc/fc6 to d3/dc/d1c/d26/d55/d7d/feb 0 2024-02-15T22:51:22.648 INFO:tasks.workunit.client.1.smithi170.stdout:3/714: fdatasync d3/db/d1f/f41 0 2024-02-15T22:51:22.649 INFO:tasks.workunit.client.1.smithi170.stdout:1/825: write d3/f1c [467430,40282] 0 2024-02-15T22:51:22.649 INFO:tasks.workunit.client.1.smithi170.stdout:1/826: stat d3/da2/f39 0 2024-02-15T22:51:22.649 INFO:tasks.workunit.client.1.smithi170.stdout:8/555: dread d9/d18/d32/f4a [0,4194304] 0 2024-02-15T22:51:22.649 INFO:tasks.workunit.client.1.smithi170.stdout:8/556: write d9/d18/d32/d7a/d78/d7f/d98/d9e/fa3 [211453,54637] 0 2024-02-15T22:51:22.650 INFO:tasks.workunit.client.1.smithi170.stdout:2/817: chown d0/d1/d11/lc5 0 1 2024-02-15T22:51:22.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/569: mknod de/d1b/d1c/cbf 0 2024-02-15T22:51:22.652 INFO:tasks.workunit.client.1.smithi170.stdout:0/644: mkdir d8/df/d13/d36/d60/da2/dcb 0 2024-02-15T22:51:22.654 INFO:tasks.workunit.client.1.smithi170.stdout:4/767: mknod d0/d22/da/d8b/d47/d5e/d79/cf6 0 2024-02-15T22:51:22.654 INFO:tasks.workunit.client.1.smithi170.stdout:4/768: dread - d0/d22/da/d8b/d47/dbe/da2/fae zero size 2024-02-15T22:51:22.654 INFO:tasks.workunit.client.1.smithi170.stdout:4/769: stat d0/d22/da/d8b/d47/da9 0 2024-02-15T22:51:22.655 INFO:tasks.workunit.client.1.smithi170.stdout:3/715: mkdir d3/dc/d1a/d9f/dec 0 2024-02-15T22:51:22.657 INFO:tasks.workunit.client.1.smithi170.stdout:1/827: rename d3/d24/d2c/d77/dce/fdf to d3/d24/d2c/d35/d72/df1/f11d 0 2024-02-15T22:51:22.658 INFO:tasks.workunit.client.1.smithi170.stdout:8/557: fdatasync d9/fd 0 2024-02-15T22:51:22.658 INFO:tasks.workunit.client.1.smithi170.stdout:8/558: readlink d9/d18/d32/d7a/d78/l91 0 2024-02-15T22:51:22.660 INFO:tasks.workunit.client.1.smithi170.stdout:2/818: creat d0/d1/d89/dd7/d2f/d9b/f134 x:0 0 0 2024-02-15T22:51:22.660 INFO:tasks.workunit.client.1.smithi170.stdout:8/559: dread d9/d18/d32/d3b/d42/f74 [0,4194304] 0 2024-02-15T22:51:22.660 INFO:tasks.workunit.client.1.smithi170.stdout:0/645: creat d8/df/d13/d22/fcc x:0 0 0 2024-02-15T22:51:22.663 INFO:tasks.workunit.client.1.smithi170.stdout:9/570: write de/d1b/d1c/d47/f48 [272732,67114] 0 2024-02-15T22:51:22.664 INFO:tasks.workunit.client.1.smithi170.stdout:3/716: mknod d3/d1b/d51/d6b/d86/dc5/ced 0 2024-02-15T22:51:22.664 INFO:tasks.workunit.client.1.smithi170.stdout:3/717: truncate d3/d1b/d8a/fa3 1005369 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:1/828: rename d3/d24/d2c/d77/dda/le4 to d3/d24/d2c/d77/dda/l11e 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:1/829: creat d3/d24/d2c/d5e/f11f x:0 0 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:4/770: dread d0/d22/da/d8b/d47/dbe/f45 [4194304,4194304] 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:4/771: fdatasync d0/d22/da/d8b/d47/dbe/d20/f3d 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:1/830: read d3/d24/d2c/d35/d72/f78 [243871,33865] 0 2024-02-15T22:51:22.666 INFO:tasks.workunit.client.1.smithi170.stdout:1/831: write d3/f2e [540780,99532] 0 2024-02-15T22:51:22.667 INFO:tasks.workunit.client.1.smithi170.stdout:8/560: rename d9/d18/d32/d3b/c63 to d9/d18/d32/caf 0 2024-02-15T22:51:22.668 INFO:tasks.workunit.client.1.smithi170.stdout:0/646: mknod d8/d14/d1c/d82/dc9/ccd 0 2024-02-15T22:51:22.669 INFO:tasks.workunit.client.1.smithi170.stdout:9/571: mknod de/d1b/d37/dab/cc0 0 2024-02-15T22:51:22.675 INFO:tasks.workunit.client.1.smithi170.stdout:1/832: mkdir d3/d24/d2c/d77/d110/d118/d120 0 2024-02-15T22:51:22.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/561: link d9/d18/d32/f81 d9/d18/d32/d3b/d42/fb0 0 2024-02-15T22:51:22.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/562: write d9/d18/f1e [4006690,117463] 0 2024-02-15T22:51:22.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/563: chown d9/d18/d32/d7a/d78 490068 1 2024-02-15T22:51:22.675 INFO:tasks.workunit.client.1.smithi170.stdout:0/647: rmdir d8/d14/d1c/d82/dc9 39 2024-02-15T22:51:22.679 INFO:tasks.workunit.client.1.smithi170.stdout:9/572: unlink de/d1b/d1c/d1f/d20/d27/d28/d80/c81 0 2024-02-15T22:51:22.679 INFO:tasks.workunit.client.1.smithi170.stdout:5/746: dwrite de/d29/f8f [0,4194304] 0 2024-02-15T22:51:22.679 INFO:tasks.workunit.client.1.smithi170.stdout:5/747: truncate de/d10/d33/d67/f8d 468219 0 2024-02-15T22:51:22.679 INFO:tasks.workunit.client.1.smithi170.stdout:7/842: dwrite da/d1a/d21/d2c/d74/f86 [4194304,4194304] 0 2024-02-15T22:51:22.679 INFO:tasks.workunit.client.1.smithi170.stdout:7/843: fdatasync da/d1a/d21/d2c/d74/d87/daf/fc4 0 2024-02-15T22:51:22.680 INFO:tasks.workunit.client.1.smithi170.stdout:8/564: mkdir d9/d18/d32/db1 0 2024-02-15T22:51:22.681 INFO:tasks.workunit.client.1.smithi170.stdout:2/819: dread d0/d1/d89/dd7/d3e/f60 [0,4194304] 0 2024-02-15T22:51:22.682 INFO:tasks.workunit.client.1.smithi170.stdout:9/573: dread de/d1b/d1c/d47/f48 [0,4194304] 0 2024-02-15T22:51:22.682 INFO:tasks.workunit.client.1.smithi170.stdout:9/574: chown de/d1b/d37/da5 508200239 1 2024-02-15T22:51:22.683 INFO:tasks.workunit.client.1.smithi170.stdout:9/575: chown de/d1b/d37/dab 23356 1 2024-02-15T22:51:22.689 INFO:tasks.workunit.client.1.smithi170.stdout:1/833: rename d3/fb9 to d3/d24/d2c/d77/dda/f121 0 2024-02-15T22:51:22.689 INFO:tasks.workunit.client.1.smithi170.stdout:1/834: fsync d3/d24/fd2 0 2024-02-15T22:51:22.690 INFO:tasks.workunit.client.1.smithi170.stdout:0/648: dread d8/d14/d1c/d82/f9a [0,4194304] 0 2024-02-15T22:51:22.690 INFO:tasks.workunit.client.1.smithi170.stdout:0/649: dread - d8/df/d13/d22/fcc zero size 2024-02-15T22:51:22.693 INFO:tasks.workunit.client.1.smithi170.stdout:7/844: symlink da/d1a/d21/d2c/d74/d87/d9b/l120 0 2024-02-15T22:51:22.697 INFO:tasks.workunit.client.1.smithi170.stdout:4/772: dwrite d0/d22/da/d8b/d47/d67/d77/dc5/fe5 [0,4194304] 0 2024-02-15T22:51:22.700 INFO:tasks.workunit.client.1.smithi170.stdout:3/718: dwrite d3/db/f35 [0,4194304] 0 2024-02-15T22:51:22.709 INFO:tasks.workunit.client.1.smithi170.stdout:9/576: dwrite de/d1b/d1c/d1f/d20/d78/f8b [0,4194304] 0 2024-02-15T22:51:22.715 INFO:tasks.workunit.client.1.smithi170.stdout:2/820: rmdir d0/d1/d89/dd7/d2f/d37/d58/d78/da4 39 2024-02-15T22:51:22.719 INFO:tasks.workunit.client.1.smithi170.stdout:3/719: chown d3/l65 1972682444 1 2024-02-15T22:51:22.722 INFO:tasks.workunit.client.1.smithi170.stdout:9/577: getdents de/d97 0 2024-02-15T22:51:22.725 INFO:tasks.workunit.client.1.smithi170.stdout:8/565: rename d9/d18/d32/d7a/d78/d7f/d98/d9d to d9/db2 0 2024-02-15T22:51:22.725 INFO:tasks.workunit.client.1.smithi170.stdout:8/566: dread - d9/d18/d32/d7a/f7b zero size 2024-02-15T22:51:22.726 INFO:tasks.workunit.client.1.smithi170.stdout:5/748: dwrite de/d36/fab [0,4194304] 0 2024-02-15T22:51:22.726 INFO:tasks.workunit.client.1.smithi170.stdout:5/749: fdatasync de/d10/d27/d2d/f65 0 2024-02-15T22:51:22.726 INFO:tasks.workunit.client.1.smithi170.stdout:7/845: dwrite da/d1a/d21/d2c/d74/d87/daf/fc4 [0,4194304] 0 2024-02-15T22:51:22.726 INFO:tasks.workunit.client.1.smithi170.stdout:4/773: dwrite d0/d22/da/d8b/d47/f7e [0,4194304] 0 2024-02-15T22:51:22.726 INFO:tasks.workunit.client.1.smithi170.stdout:1/835: dwrite d3/da2/d65/fb6 [0,4194304] 0 2024-02-15T22:51:22.727 INFO:tasks.workunit.client.1.smithi170.stdout:2/821: mknod d0/d13/d59/d105/c135 0 2024-02-15T22:51:22.730 INFO:tasks.workunit.client.1.smithi170.stdout:3/720: symlink d3/dc/lee 0 2024-02-15T22:51:22.730 INFO:tasks.workunit.client.1.smithi170.stdout:3/721: fsync d3/dc/d1a/fab 0 2024-02-15T22:51:22.731 INFO:tasks.workunit.client.1.smithi170.stdout:5/750: dread de/d10/d33/f42 [0,4194304] 0 2024-02-15T22:51:22.731 INFO:tasks.workunit.client.1.smithi170.stdout:5/751: fdatasync de/d29/f8f 0 2024-02-15T22:51:22.732 INFO:tasks.workunit.client.1.smithi170.stdout:9/578: symlink de/d1b/d1c/d1f/d20/d27/d2c/lc1 0 2024-02-15T22:51:22.732 INFO:tasks.workunit.client.1.smithi170.stdout:9/579: write de/d8e/fbd [548213,25419] 0 2024-02-15T22:51:22.732 INFO:tasks.workunit.client.1.smithi170.stdout:9/580: dread - de/d1b/d1c/d1f/d20/d27/d2c/f85 zero size 2024-02-15T22:51:22.732 INFO:tasks.workunit.client.1.smithi170.stdout:9/581: creat de/d1b/d1c/d1f/fc2 x:0 0 0 2024-02-15T22:51:22.733 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:22 smithi138 ceph-mon[29229]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 176 MiB/s rd, 222 MiB/s wr, 463 op/s 2024-02-15T22:51:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:22 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:22 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:22 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:22.735 INFO:tasks.workunit.client.1.smithi170.stdout:8/567: symlink d9/d18/d32/d3b/d68/lb3 0 2024-02-15T22:51:22.737 INFO:tasks.workunit.client.1.smithi170.stdout:1/836: write d3/da2/f50 [3308971,40339] 0 2024-02-15T22:51:22.741 INFO:tasks.workunit.client.1.smithi170.stdout:7/846: mknod da/d1a/d21/d1b/dc6/c121 0 2024-02-15T22:51:22.744 INFO:tasks.workunit.client.1.smithi170.stdout:4/774: symlink d0/d22/d6e/lf7 0 2024-02-15T22:51:22.745 INFO:tasks.workunit.client.1.smithi170.stdout:4/775: creat d0/d22/da/d8b/d47/d5e/ff8 x:0 0 0 2024-02-15T22:51:22.745 INFO:tasks.workunit.client.1.smithi170.stdout:4/776: readlink d0/d22/da/d8b/l97 0 2024-02-15T22:51:22.749 INFO:tasks.workunit.client.1.smithi170.stdout:9/582: dread f4 [0,4194304] 0 2024-02-15T22:51:22.749 INFO:tasks.workunit.client.1.smithi170.stdout:9/583: read - de/d1b/d1c/d1f/d20/d27/fae zero size 2024-02-15T22:51:22.751 INFO:tasks.workunit.client.1.smithi170.stdout:1/837: mknod d3/d24/d2c/d94/dd9/c122 0 2024-02-15T22:51:22.752 INFO:tasks.workunit.client.1.smithi170.stdout:7/847: write da/d1a/def/fa2 [783940,111948] 0 2024-02-15T22:51:22.755 INFO:tasks.workunit.client.1.smithi170.stdout:4/777: unlink d0/d22/da/l5c 0 2024-02-15T22:51:22.756 INFO:tasks.workunit.client.1.smithi170.stdout:0/650: rename d8/d14/d1c/d82 to d8/d14/d1c/d3f/dce 0 2024-02-15T22:51:22.756 INFO:tasks.workunit.client.1.smithi170.stdout:2/822: rename d0/d1/d89/dd7 to d0/d1/d89/dd7/d83/d136 22 2024-02-15T22:51:22.756 INFO:tasks.workunit.client.1.smithi170.stdout:2/823: fdatasync d0/f25 0 2024-02-15T22:51:22.757 INFO:tasks.workunit.client.1.smithi170.stdout:2/824: chown d0/d1/d89/dd7/d2f/ddf/d12e/l132 49 1 2024-02-15T22:51:22.757 INFO:tasks.workunit.client.1.smithi170.stdout:2/825: chown d0/d1/d11/lc5 355869 1 2024-02-15T22:51:22.757 INFO:tasks.workunit.client.1.smithi170.stdout:9/584: dread de/d1b/d1c/d1f/d20/fb0 [0,4194304] 0 2024-02-15T22:51:22.758 INFO:tasks.workunit.client.1.smithi170.stdout:8/568: getdents d9/d18 0 2024-02-15T22:51:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:22 smithi170 ceph-mon[35248]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 176 MiB/s rd, 222 MiB/s wr, 463 op/s 2024-02-15T22:51:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:22 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:22 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:22 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:22.761 INFO:tasks.workunit.client.1.smithi170.stdout:4/778: symlink d0/d22/da/d8b/lf9 0 2024-02-15T22:51:22.763 INFO:tasks.workunit.client.1.smithi170.stdout:0/651: creat d8/d14/d1c/d3f/fcf x:0 0 0 2024-02-15T22:51:22.764 INFO:tasks.workunit.client.1.smithi170.stdout:2/826: mkdir d0/d1/d89/dd7/d2f/d37/d137 0 2024-02-15T22:51:22.765 INFO:tasks.workunit.client.1.smithi170.stdout:2/827: read - d0/d1/d11/d26/d6e/d8a/f116 zero size 2024-02-15T22:51:22.766 INFO:tasks.workunit.client.1.smithi170.stdout:9/585: symlink de/d1b/d1c/d1f/d20/lc3 0 2024-02-15T22:51:22.767 INFO:tasks.workunit.client.1.smithi170.stdout:8/569: mknod d9/d18/d32/d7a/d78/d7f/d98/d9e/da5/cb4 0 2024-02-15T22:51:22.767 INFO:tasks.workunit.client.1.smithi170.stdout:5/752: dwrite de/d29/f5a [0,4194304] 0 2024-02-15T22:51:22.768 INFO:tasks.workunit.client.1.smithi170.stdout:0/652: dread d8/df/d13/d22/f7c [0,4194304] 0 2024-02-15T22:51:22.768 INFO:tasks.workunit.client.1.smithi170.stdout:0/653: stat d8/d14/d1c/fc4 0 2024-02-15T22:51:22.768 INFO:tasks.workunit.client.1.smithi170.stdout:5/753: write de/d10/d33/f5d [451163,1240] 0 2024-02-15T22:51:22.780 INFO:tasks.workunit.client.1.smithi170.stdout:7/848: dwrite da/d1a/d21/f46 [4194304,4194304] 0 2024-02-15T22:51:22.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/779: link d0/d22/l28 d0/d22/da/lfa 0 2024-02-15T22:51:22.786 INFO:tasks.workunit.client.1.smithi170.stdout:4/780: fdatasync d0/d22/da/d8b/d47/d2b/faa 0 2024-02-15T22:51:22.787 INFO:tasks.workunit.client.1.smithi170.stdout:2/828: symlink d0/d1/d11/d26/d6e/d10f/df9/d127/l138 0 2024-02-15T22:51:22.787 INFO:tasks.workunit.client.1.smithi170.stdout:2/829: readlink d0/d2a/le0 0 2024-02-15T22:51:22.792 INFO:tasks.workunit.client.1.smithi170.stdout:9/586: unlink de/d1b/d1c/d1f/d20/d27/d2c/c31 0 2024-02-15T22:51:22.792 INFO:tasks.workunit.client.1.smithi170.stdout:9/587: chown de/d1b/d1c/d1f/c76 1363920 1 2024-02-15T22:51:22.792 INFO:tasks.workunit.client.1.smithi170.stdout:9/588: fdatasync de/f9c 0 2024-02-15T22:51:22.792 INFO:tasks.workunit.client.1.smithi170.stdout:9/589: stat de/f1a 0 2024-02-15T22:51:22.792 INFO:tasks.workunit.client.1.smithi170.stdout:9/590: write de/d1b/d1c/d1f/d20/f42 [3682881,46767] 0 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:8/570: unlink d9/d18/d32/d3b/d42/fa4 0 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:8/571: creat d9/d18/d26/fb5 x:0 0 0 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:8/572: creat d9/d18/d32/d99/fb6 x:0 0 0 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:1/838: rmdir d3/d24 39 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:1/839: fdatasync d3/d24/d2c/d35/f82 0 2024-02-15T22:51:22.795 INFO:tasks.workunit.client.1.smithi170.stdout:1/840: dread - d3/d24/d2c/d35/d72/f111 zero size 2024-02-15T22:51:22.797 INFO:tasks.workunit.client.1.smithi170.stdout:8/573: write d9/d18/d32/d3b/d68/f8e [966764,39977] 0 2024-02-15T22:51:22.798 INFO:tasks.workunit.client.1.smithi170.stdout:8/574: chown d9 18 1 2024-02-15T22:51:22.800 INFO:tasks.workunit.client.1.smithi170.stdout:5/754: rename de/d10/fdc to de/d10/d33/ffd 0 2024-02-15T22:51:22.801 INFO:tasks.workunit.client.1.smithi170.stdout:7/849: getdents da/d1a/def 0 2024-02-15T22:51:22.801 INFO:tasks.workunit.client.1.smithi170.stdout:7/850: write da/d1a/d21/d4d/d6e/de8/f119 [447740,21548] 0 2024-02-15T22:51:22.801 INFO:tasks.workunit.client.1.smithi170.stdout:7/851: read da/d1a/d21/d1b/d69/f76 [547768,106696] 0 2024-02-15T22:51:22.803 INFO:tasks.workunit.client.1.smithi170.stdout:9/591: link de/d1b/d1c/d1f/d20/f22 de/d97/fc4 0 2024-02-15T22:51:22.804 INFO:tasks.workunit.client.1.smithi170.stdout:1/841: rmdir d3/d24/d2c 39 2024-02-15T22:51:22.806 INFO:tasks.workunit.client.1.smithi170.stdout:5/755: dread de/d10/d33/d67/fcf [0,4194304] 0 2024-02-15T22:51:22.807 INFO:tasks.workunit.client.1.smithi170.stdout:5/756: creat de/d10/d33/d9f/d7c/d87/ffe x:0 0 0 2024-02-15T22:51:22.808 INFO:tasks.workunit.client.1.smithi170.stdout:0/654: rmdir d8/df/d13/d36 39 2024-02-15T22:51:22.810 INFO:tasks.workunit.client.1.smithi170.stdout:2/830: dwrite d0/d1/d89/dd7/d3e/f11c [0,4194304] 0 2024-02-15T22:51:22.810 INFO:tasks.workunit.client.1.smithi170.stdout:2/831: chown d0/d1/d11/d26/d6e/d8a/l133 13916 1 2024-02-15T22:51:22.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/575: mkdir d9/d18/d32/d99/db7 0 2024-02-15T22:51:22.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/576: dread - d9/d18/d32/d99/fb6 zero size 2024-02-15T22:51:22.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/577: creat d9/d18/d32/d7a/d78/d7f/d98/fb8 x:0 0 0 2024-02-15T22:51:22.817 INFO:tasks.workunit.client.1.smithi170.stdout:8/578: creat d9/d18/d32/d3b/d68/fb9 x:0 0 0 2024-02-15T22:51:22.817 INFO:tasks.workunit.client.1.smithi170.stdout:5/757: dread de/d10/d27/d4c/d53/d55/fad [0,4194304] 0 2024-02-15T22:51:22.818 INFO:tasks.workunit.client.1.smithi170.stdout:8/579: dread d9/d18/d32/d3b/f90 [0,4194304] 0 2024-02-15T22:51:22.822 INFO:tasks.workunit.client.1.smithi170.stdout:7/852: rename da/d1a/d21/d2c/d74/dde/d7d/d113/f117 to da/d1a/d21/d2c/d2e/d7a/de2/de5/f122 0 2024-02-15T22:51:22.822 INFO:tasks.workunit.client.1.smithi170.stdout:7/853: write da/d1a/d21/d2c/d71/f75 [1527170,112787] 0 2024-02-15T22:51:22.824 INFO:tasks.workunit.client.1.smithi170.stdout:4/781: creat d0/d22/da/d58/ffb x:0 0 0 2024-02-15T22:51:22.827 INFO:tasks.workunit.client.1.smithi170.stdout:0/655: mkdir d8/d14/d70/d93/dd0 0 2024-02-15T22:51:22.829 INFO:tasks.workunit.client.1.smithi170.stdout:2/832: symlink d0/d1/d89/dd7/d2f/d37/d58/l139 0 2024-02-15T22:51:22.831 INFO:tasks.workunit.client.1.smithi170.stdout:1/842: dwrite d3/d24/d2c/d77/dce/ffe [0,4194304] 0 2024-02-15T22:51:22.832 INFO:tasks.workunit.client.1.smithi170.stdout:1/843: dread - d3/da2/d4a/f105 zero size 2024-02-15T22:51:22.833 INFO:tasks.workunit.client.1.smithi170.stdout:5/758: dread de/d10/d33/d9f/d7c/d87/f8a [0,4194304] 0 2024-02-15T22:51:22.836 INFO:tasks.workunit.client.1.smithi170.stdout:8/580: dread d9/d18/d32/d3b/d4b/f8f [0,4194304] 0 2024-02-15T22:51:22.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/581: creat d9/d18/d26/fba x:0 0 0 2024-02-15T22:51:22.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/582: fsync d9/d18/d32/d3b/f40 0 2024-02-15T22:51:22.838 INFO:tasks.workunit.client.1.smithi170.stdout:5/759: creat de/d10/d33/d67/dc4/fff x:0 0 0 2024-02-15T22:51:22.840 INFO:tasks.workunit.client.1.smithi170.stdout:9/592: rename de/d1b/f2b to de/d1b/d1c/d1f/d20/d27/fc5 0 2024-02-15T22:51:22.842 INFO:tasks.workunit.client.1.smithi170.stdout:2/833: unlink d0/d1/d11/l5b 0 2024-02-15T22:51:22.843 INFO:tasks.workunit.client.1.smithi170.stdout:1/844: write d3/da2/fc2 [1511642,106707] 0 2024-02-15T22:51:22.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/593: dread de/d1b/d1c/d1f/f79 [0,4194304] 0 2024-02-15T22:51:22.845 INFO:tasks.workunit.client.1.smithi170.stdout:8/583: mknod d9/d18/d32/d7a/d78/cbb 0 2024-02-15T22:51:22.848 INFO:tasks.workunit.client.1.smithi170.stdout:4/782: readlink d0/d22/da/d58/l75 0 2024-02-15T22:51:22.850 INFO:tasks.workunit.client.1.smithi170.stdout:8/584: dread d9/d18/d32/f4a [0,4194304] 0 2024-02-15T22:51:22.851 INFO:tasks.workunit.client.1.smithi170.stdout:8/585: chown d9/d18/d32/db1 426244317 1 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:0/656: rename d8/d14/d70/f87 to d8/df/d13/d36/d60/da2/fd1 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:0/657: write d8/df/d13/d22/d39/f74 [108669,54974] 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:0/658: write d8/df/d13/d22/d39/d55/f8e [1842202,12013] 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:2/834: write d0/d1/d31/da3/fdc [771652,93308] 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:2/835: creat d0/d1/d89/dd7/d2f/d9b/d115/f13a x:0 0 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:2/836: creat d0/d1/d89/dd7/f13b x:0 0 0 2024-02-15T22:51:22.852 INFO:tasks.workunit.client.1.smithi170.stdout:2/837: truncate d0/d1/d11/d26/f99 389581 0 2024-02-15T22:51:22.853 INFO:tasks.workunit.client.1.smithi170.stdout:9/594: creat de/d1b/d1c/fc6 x:0 0 0 2024-02-15T22:51:22.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/586: chown d9/f2d 12318 1 2024-02-15T22:51:22.860 INFO:tasks.workunit.client.1.smithi170.stdout:0/659: read d8/d14/d70/f7a [1369897,45446] 0 2024-02-15T22:51:22.860 INFO:tasks.workunit.client.1.smithi170.stdout:0/660: truncate d8/d14/d70/fbe 897781 0 2024-02-15T22:51:22.860 INFO:tasks.workunit.client.1.smithi170.stdout:0/661: write d8/df/f11 [1137353,8212] 0 2024-02-15T22:51:22.861 INFO:tasks.workunit.client.1.smithi170.stdout:9/595: symlink de/d1b/d1c/d1f/d20/d27/d84/lc7 0 2024-02-15T22:51:22.863 INFO:tasks.workunit.client.1.smithi170.stdout:8/587: symlink d9/d18/d32/d7a/d78/d95/lbc 0 2024-02-15T22:51:22.867 INFO:tasks.workunit.client.1.smithi170.stdout:0/662: symlink d8/d14/d1c/d3f/dce/ld2 0 2024-02-15T22:51:22.869 INFO:tasks.workunit.client.1.smithi170.stdout:8/588: creat d9/d18/d26/d4f/fbd x:0 0 0 2024-02-15T22:51:22.869 INFO:tasks.workunit.client.1.smithi170.stdout:4/783: dread d0/d22/da/d8b/d47/dbe/d20/d49/f53 [0,4194304] 0 2024-02-15T22:51:22.870 INFO:tasks.workunit.client.1.smithi170.stdout:0/663: rename d8/df/f11 to d8/d14/d1c/d3f/d53/fd3 0 2024-02-15T22:51:22.872 INFO:tasks.workunit.client.1.smithi170.stdout:5/760: dwrite de/d36/d80/dc2/fce [0,4194304] 0 2024-02-15T22:51:22.872 INFO:tasks.workunit.client.1.smithi170.stdout:8/589: symlink d9/d18/d32/d7a/d78/d7f/d98/d9e/lbe 0 2024-02-15T22:51:22.872 INFO:tasks.workunit.client.1.smithi170.stdout:5/761: write de/d10/d33/db2/fe9 [1059347,16501] 0 2024-02-15T22:51:22.873 INFO:tasks.workunit.client.1.smithi170.stdout:4/784: creat d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb/ffc x:0 0 0 2024-02-15T22:51:22.873 INFO:tasks.workunit.client.1.smithi170.stdout:4/785: creat d0/d22/da/d8b/d47/d5e/ffd x:0 0 0 2024-02-15T22:51:22.873 INFO:tasks.workunit.client.1.smithi170.stdout:4/786: creat d0/d22/da/d8b/d47/dbe/d20/d49/ffe x:0 0 0 2024-02-15T22:51:22.876 INFO:tasks.workunit.client.1.smithi170.stdout:1/845: dwrite d3/d24/d2c/d5e/f5f [0,4194304] 0 2024-02-15T22:51:22.876 INFO:tasks.workunit.client.1.smithi170.stdout:1/846: fdatasync d3/d24/d2c/d35/fd1 0 2024-02-15T22:51:22.876 INFO:tasks.workunit.client.1.smithi170.stdout:1/847: write d3/d24/d2c/d35/f52 [3910892,39795] 0 2024-02-15T22:51:22.880 INFO:tasks.workunit.client.1.smithi170.stdout:8/590: symlink d9/d18/d32/d7a/d78/d7f/lbf 0 2024-02-15T22:51:22.881 INFO:tasks.workunit.client.1.smithi170.stdout:8/591: chown d9/d18/l8c 2 1 2024-02-15T22:51:22.886 INFO:tasks.workunit.client.1.smithi170.stdout:4/787: rename d0/d22/da/d58 to d0/d22/da/d8b/d47/d67/d77/dc5/dff 0 2024-02-15T22:51:22.886 INFO:tasks.workunit.client.1.smithi170.stdout:8/592: mknod d9/d18/d32/dab/cc0 0 2024-02-15T22:51:22.887 INFO:tasks.workunit.client.1.smithi170.stdout:5/762: dread de/d10/d33/db2/fe9 [0,4194304] 0 2024-02-15T22:51:22.887 INFO:tasks.workunit.client.1.smithi170.stdout:5/763: fdatasync de/d10/d27/d4c/d53/d55/f79 0 2024-02-15T22:51:22.888 INFO:tasks.workunit.client.1.smithi170.stdout:1/848: rename d3/d24/d2c/d5e/de9 to d3/d24/d2c/d35/d72/d92/d123 0 2024-02-15T22:51:22.888 INFO:tasks.workunit.client.1.smithi170.stdout:4/788: dread d0/d22/da/d8b/d47/d2b/faa [0,4194304] 0 2024-02-15T22:51:22.888 INFO:tasks.workunit.client.1.smithi170.stdout:8/593: write d9/f17 [627817,95591] 0 2024-02-15T22:51:22.888 INFO:tasks.workunit.client.1.smithi170.stdout:2/838: dwrite d0/d1/d89/dd7/f10a [0,4194304] 0 2024-02-15T22:51:22.889 INFO:tasks.workunit.client.1.smithi170.stdout:9/596: dwrite de/d1b/d1c/d1f/d20/d27/fc5 [0,4194304] 0 2024-02-15T22:51:22.890 INFO:tasks.workunit.client.1.smithi170.stdout:0/664: dwrite d8/df/d13/d36/d60/f91 [0,4194304] 0 2024-02-15T22:51:22.890 INFO:tasks.workunit.client.1.smithi170.stdout:5/764: rename de/d10/c70 to de/d10/d33/d67/dc4/c100 0 2024-02-15T22:51:22.890 INFO:tasks.workunit.client.1.smithi170.stdout:5/765: creat de/d10/da8/f101 x:0 0 0 2024-02-15T22:51:22.890 INFO:tasks.workunit.client.1.smithi170.stdout:0/665: write d8/df/d13/d22/d6a/fb3 [547124,117943] 0 2024-02-15T22:51:22.894 INFO:tasks.workunit.client.1.smithi170.stdout:1/849: unlink d3/d24/d2c/d35/c45 0 2024-02-15T22:51:22.894 INFO:tasks.workunit.client.1.smithi170.stdout:1/850: stat d3/d24/d2c/d35/d83/fee 0 2024-02-15T22:51:22.897 INFO:tasks.workunit.client.1.smithi170.stdout:8/594: rename d9/d18/d32/d3b/d68/f6b to d9/d18/d32/d3b/d68/fc1 0 2024-02-15T22:51:22.902 INFO:tasks.workunit.client.1.smithi170.stdout:9/597: creat de/d1b/d1c/d47/fc8 x:0 0 0 2024-02-15T22:51:22.904 INFO:tasks.workunit.client.1.smithi170.stdout:1/851: dread d3/d24/d2c/d77/fe7 [0,4194304] 0 2024-02-15T22:51:22.904 INFO:tasks.workunit.client.1.smithi170.stdout:1/852: readlink d3/da2/l102 0 2024-02-15T22:51:22.906 INFO:tasks.workunit.client.1.smithi170.stdout:4/789: dwrite d0/d22/da/d8b/d47/dbe/d20/f82 [4194304,4194304] 0 2024-02-15T22:51:22.907 INFO:tasks.workunit.client.1.smithi170.stdout:5/766: rename lb to de/d10/d33/d9f/d7c/d87/l102 0 2024-02-15T22:51:22.907 INFO:tasks.workunit.client.1.smithi170.stdout:5/767: fsync de/d10/d7d/db8/fd5 0 2024-02-15T22:51:22.908 INFO:tasks.workunit.client.1.smithi170.stdout:0/666: link d8/d14/d1c/d3f/d53/cb9 d8/d14/d1c/d3f/cd4 0 2024-02-15T22:51:22.908 INFO:tasks.workunit.client.1.smithi170.stdout:2/839: dwrite d0/d1/d89/dd7/d3e/f43 [0,4194304] 0 2024-02-15T22:51:22.909 INFO:tasks.workunit.client.1.smithi170.stdout:8/595: symlink d9/d18/d32/d99/lc2 0 2024-02-15T22:51:22.910 INFO:tasks.workunit.client.1.smithi170.stdout:1/853: mknod d3/d24/d2c/d77/dce/c124 0 2024-02-15T22:51:22.910 INFO:tasks.workunit.client.1.smithi170.stdout:1/854: chown d3/da2/fac 1 1 2024-02-15T22:51:22.910 INFO:tasks.workunit.client.1.smithi170.stdout:1/855: fdatasync d3/d24/d2c/d35/f82 0 2024-02-15T22:51:22.913 INFO:tasks.workunit.client.1.smithi170.stdout:4/790: truncate d0/d22/da/d8b/d47/dbe/f1c 56970 0 2024-02-15T22:51:22.915 INFO:tasks.workunit.client.1.smithi170.stdout:5/768: rename de/d10/d33/l3e to de/d10/d33/d67/dc4/l103 0 2024-02-15T22:51:22.916 INFO:tasks.workunit.client.1.smithi170.stdout:0/667: mkdir d8/d14/d1c/d3f/dce/dd5 0 2024-02-15T22:51:22.916 INFO:tasks.workunit.client.1.smithi170.stdout:0/668: readlink d8/d14/d1c/d3f/dce/ld2 0 2024-02-15T22:51:22.917 INFO:tasks.workunit.client.1.smithi170.stdout:0/669: write d8/d14/d44/f59 [801911,7522] 0 2024-02-15T22:51:22.920 INFO:tasks.workunit.client.1.smithi170.stdout:2/840: link d0/d1/d89/dd7/d2f/ddf/fff d0/d1/d5f/d74/f13c 0 2024-02-15T22:51:22.920 INFO:tasks.workunit.client.1.smithi170.stdout:2/841: write d0/d1/d11/d26/d6e/d10f/df9/d108/f113 [438814,16907] 0 2024-02-15T22:51:22.921 INFO:tasks.workunit.client.1.smithi170.stdout:2/842: dread - d0/d13/f121 zero size 2024-02-15T22:51:22.924 INFO:tasks.workunit.client.1.smithi170.stdout:4/791: read d0/d22/da/d8b/d47/dbe/f30 [1477806,25454] 0 2024-02-15T22:51:22.925 INFO:tasks.workunit.client.1.smithi170.stdout:1/856: rename d3/d24/d2c/d5e/fd6 to d3/d24/d2c/d77/dda/d109/f125 0 2024-02-15T22:51:22.925 INFO:tasks.workunit.client.1.smithi170.stdout:1/857: chown d3/f2e 155222 1 2024-02-15T22:51:22.926 INFO:tasks.workunit.client.1.smithi170.stdout:1/858: dread d3/da2/f39 [0,4194304] 0 2024-02-15T22:51:22.928 INFO:tasks.workunit.client.1.smithi170.stdout:2/843: mknod d0/d1/d89/dd7/d2f/ddf/c13d 0 2024-02-15T22:51:22.928 INFO:tasks.workunit.client.1.smithi170.stdout:2/844: creat d0/d13/f13e x:0 0 0 2024-02-15T22:51:22.929 INFO:tasks.workunit.client.1.smithi170.stdout:2/845: creat d0/d1/d89/dd7/d3e/f13f x:0 0 0 2024-02-15T22:51:22.929 INFO:tasks.workunit.client.1.smithi170.stdout:2/846: write d0/d1/d89/dd7/ff5 [3307326,75965] 0 2024-02-15T22:51:22.929 INFO:tasks.workunit.client.1.smithi170.stdout:2/847: truncate d0/d1d/d3d/d76/fe1 901114 0 2024-02-15T22:51:22.931 INFO:tasks.workunit.client.1.smithi170.stdout:4/792: symlink d0/d22/da8/l100 0 2024-02-15T22:51:22.933 INFO:tasks.workunit.client.1.smithi170.stdout:1/859: dread d3/d24/d2c/d5e/fe8 [0,4194304] 0 2024-02-15T22:51:22.934 INFO:tasks.workunit.client.1.smithi170.stdout:1/860: chown d3/d24/d2c/d35/d72/df1/f10a 0 1 2024-02-15T22:51:22.937 INFO:tasks.workunit.client.1.smithi170.stdout:4/793: readlink d0/d22/da/d8b/d47/d67/d77/dc5/dff/laf 0 2024-02-15T22:51:22.938 INFO:tasks.workunit.client.1.smithi170.stdout:4/794: write d0/f10 [2067480,125864] 0 2024-02-15T22:51:22.940 INFO:tasks.workunit.client.1.smithi170.stdout:0/670: dwrite d8/d14/d1c/d3f/d53/fd3 [4194304,4194304] 0 2024-02-15T22:51:22.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/596: dwrite d9/d18/d48/f76 [0,4194304] 0 2024-02-15T22:51:22.940 INFO:tasks.workunit.client.1.smithi170.stdout:1/861: creat d3/d24/d2c/d77/d110/d118/d120/f126 x:0 0 0 2024-02-15T22:51:22.942 INFO:tasks.workunit.client.1.smithi170.stdout:1/862: write d3/da2/f39 [672872,72070] 0 2024-02-15T22:51:22.948 INFO:tasks.workunit.client.1.smithi170.stdout:5/769: getdents de/d10/d33/d67/dc4 0 2024-02-15T22:51:22.952 INFO:tasks.workunit.client.1.smithi170.stdout:0/671: truncate d8/d14/d1c/d3f/dce/f9a 5536154 0 2024-02-15T22:51:22.955 INFO:tasks.workunit.client.1.smithi170.stdout:8/597: mknod d9/d18/d32/d7a/d78/d95/cc3 0 2024-02-15T22:51:22.955 INFO:tasks.workunit.client.1.smithi170.stdout:8/598: chown d9/d18/d32/d99 50063 1 2024-02-15T22:51:22.957 INFO:tasks.workunit.client.1.smithi170.stdout:0/672: mkdir d8/d14/d1c/d3f/d51/dd6 0 2024-02-15T22:51:22.959 INFO:tasks.workunit.client.1.smithi170.stdout:0/673: link d8/d14/f76 d8/d14/d1c/d3f/dce/dd5/fd7 0 2024-02-15T22:51:22.964 INFO:tasks.workunit.client.1.smithi170.stdout:0/674: dread d8/d6d/f89 [0,4194304] 0 2024-02-15T22:51:22.974 INFO:tasks.workunit.client.1.smithi170.stdout:2/848: dwrite d0/d1/d11/f50 [0,4194304] 0 2024-02-15T22:51:22.976 INFO:tasks.workunit.client.1.smithi170.stdout:2/849: link d0/d1/d11/cbb d0/d2a/daa/c140 0 2024-02-15T22:51:22.976 INFO:tasks.workunit.client.1.smithi170.stdout:2/850: stat d0/d1/d89/dd7/d2f/d9b 0 2024-02-15T22:51:22.977 INFO:tasks.workunit.client.1.smithi170.stdout:2/851: mknod d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dc8/c141 0 2024-02-15T22:51:22.978 INFO:tasks.workunit.client.1.smithi170.stdout:2/852: read d0/d1/d11/d26/f9a [3037776,11552] 0 2024-02-15T22:51:22.980 INFO:tasks.workunit.client.1.smithi170.stdout:3/722: sync 2024-02-15T22:51:22.981 INFO:tasks.workunit.client.1.smithi170.stdout:6/723: sync 2024-02-15T22:51:22.983 INFO:tasks.workunit.client.1.smithi170.stdout:3/723: truncate d3/d1b/d8a/faa 74868 0 2024-02-15T22:51:22.983 INFO:tasks.workunit.client.1.smithi170.stdout:3/724: readlink d3/dc/lee 0 2024-02-15T22:51:22.984 INFO:tasks.workunit.client.1.smithi170.stdout:3/725: mknod d3/d78/cef 0 2024-02-15T22:51:22.988 INFO:tasks.workunit.client.1.smithi170.stdout:3/726: unlink d3/f6e 0 2024-02-15T22:51:22.990 INFO:tasks.workunit.client.1.smithi170.stdout:3/727: mkdir d3/dc/d1c/d26/d55/d7d/df0 0 2024-02-15T22:51:22.991 INFO:tasks.workunit.client.1.smithi170.stdout:5/770: dwrite de/d10/d52/f73 [0,4194304] 0 2024-02-15T22:51:22.992 INFO:tasks.workunit.client.1.smithi170.stdout:3/728: truncate d3/f42 5674045 0 2024-02-15T22:51:22.992 INFO:tasks.workunit.client.1.smithi170.stdout:3/729: dread - d3/dc/fea zero size 2024-02-15T22:51:22.992 INFO:tasks.workunit.client.1.smithi170.stdout:3/730: fdatasync d3/d1b/d51/d6b/d86/dc5/fe5 0 2024-02-15T22:51:22.992 INFO:tasks.workunit.client.1.smithi170.stdout:3/731: write d3/dc/d13/f24 [1275042,96152] 0 2024-02-15T22:51:22.994 INFO:tasks.workunit.client.1.smithi170.stdout:1/863: dwrite d3/d24/d2c/d77/f104 [0,4194304] 0 2024-02-15T22:51:22.994 INFO:tasks.workunit.client.1.smithi170.stdout:6/724: dread d3/f7 [0,4194304] 0 2024-02-15T22:51:22.994 INFO:tasks.workunit.client.1.smithi170.stdout:1/864: readlink d3/d24/d2c/d5e/l96 0 2024-02-15T22:51:22.994 INFO:tasks.workunit.client.1.smithi170.stdout:6/725: fsync d3/d1a/f40 0 2024-02-15T22:51:22.994 INFO:tasks.workunit.client.1.smithi170.stdout:5/771: symlink de/d10/d33/l104 0 2024-02-15T22:51:22.996 INFO:tasks.workunit.client.1.smithi170.stdout:0/675: dwrite d8/f2a [0,4194304] 0 2024-02-15T22:51:22.997 INFO:tasks.workunit.client.1.smithi170.stdout:3/732: rename d3/d1b/d51/d6b/d86/dc5/fe5 to d3/dc/d1c/d26/d55/d7d/df0/ff1 0 2024-02-15T22:51:23.000 INFO:tasks.workunit.client.1.smithi170.stdout:2/853: dwrite d0/d2a/f77 [0,4194304] 0 2024-02-15T22:51:23.001 INFO:tasks.workunit.client.1.smithi170.stdout:6/726: mknod d3/d1d/d36/d51/d54/df5/cfa 0 2024-02-15T22:51:23.002 INFO:tasks.workunit.client.1.smithi170.stdout:6/727: chown d3/d1d/d27/dc5 30 1 2024-02-15T22:51:23.003 INFO:tasks.workunit.client.1.smithi170.stdout:5/772: creat de/dec/f105 x:0 0 0 2024-02-15T22:51:23.004 INFO:tasks.workunit.client.1.smithi170.stdout:5/773: truncate de/f11 4987544 0 2024-02-15T22:51:23.004 INFO:tasks.workunit.client.1.smithi170.stdout:5/774: chown de/d10/d33/d67/f8d 0 1 2024-02-15T22:51:23.004 INFO:tasks.workunit.client.1.smithi170.stdout:5/775: readlink de/d36/lc1 0 2024-02-15T22:51:23.004 INFO:tasks.workunit.client.1.smithi170.stdout:5/776: truncate de/d36/fb0 800154 0 2024-02-15T22:51:23.004 INFO:tasks.workunit.client.1.smithi170.stdout:5/777: fdatasync de/d10/d27/d4c/d53/d55/f79 0 2024-02-15T22:51:23.005 INFO:tasks.workunit.client.1.smithi170.stdout:0/676: unlink d8/df/d13/d22/fa6 0 2024-02-15T22:51:23.006 INFO:tasks.workunit.client.1.smithi170.stdout:0/677: truncate d8/d14/d6f/f98 1113708 0 2024-02-15T22:51:23.011 INFO:tasks.workunit.client.1.smithi170.stdout:6/728: mkdir d3/d1d/d1b/dfb 0 2024-02-15T22:51:23.011 INFO:tasks.workunit.client.1.smithi170.stdout:6/729: write d3/d1d/d36/d56/f59 [1161997,1832] 0 2024-02-15T22:51:23.011 INFO:tasks.workunit.client.1.smithi170.stdout:6/730: write d3/d24/f35 [342164,23032] 0 2024-02-15T22:51:23.011 INFO:tasks.workunit.client.1.smithi170.stdout:6/731: dread - d3/d1d/d36/d56/daf/dd5/fe2 zero size 2024-02-15T22:51:23.013 INFO:tasks.workunit.client.1.smithi170.stdout:5/778: rename de/d10/d33/db2/fe9 to de/d36/d80/f106 0 2024-02-15T22:51:23.013 INFO:tasks.workunit.client.1.smithi170.stdout:5/779: truncate de/d10/d27/d4c/d53/d55/f79 1091243 0 2024-02-15T22:51:23.014 INFO:tasks.workunit.client.1.smithi170.stdout:0/678: link d8/df/c15 d8/d14/d70/d93/cd8 0 2024-02-15T22:51:23.015 INFO:tasks.workunit.client.1.smithi170.stdout:5/780: dread de/d10/d7d/fc5 [0,4194304] 0 2024-02-15T22:51:23.017 INFO:tasks.workunit.client.1.smithi170.stdout:3/733: dwrite d3/dc/d1c/d26/f46 [0,4194304] 0 2024-02-15T22:51:23.018 INFO:tasks.workunit.client.1.smithi170.stdout:2/854: rmdir d0/d1/d89/dd7/d2f 39 2024-02-15T22:51:23.020 INFO:tasks.workunit.client.1.smithi170.stdout:6/732: rename d3/d1d/d36/d51/f63 to d3/d1d/d36/d56/d6c/dc4/ffc 0 2024-02-15T22:51:23.021 INFO:tasks.workunit.client.1.smithi170.stdout:0/679: getdents d8/df/d13 0 2024-02-15T22:51:23.022 INFO:tasks.workunit.client.1.smithi170.stdout:5/781: symlink de/d36/d80/dc2/l107 0 2024-02-15T22:51:23.023 INFO:tasks.workunit.client.1.smithi170.stdout:5/782: read de/d36/f5e [4820518,66036] 0 2024-02-15T22:51:23.023 INFO:tasks.workunit.client.1.smithi170.stdout:1/865: write d3/d24/d2c/d5e/f8a [117076,28451] 0 2024-02-15T22:51:23.031 INFO:tasks.workunit.client.1.smithi170.stdout:2/855: mkdir d0/d1d/d3d/d76/d142 0 2024-02-15T22:51:23.031 INFO:tasks.workunit.client.1.smithi170.stdout:2/856: creat d0/d13/f143 x:0 0 0 2024-02-15T22:51:23.033 INFO:tasks.workunit.client.1.smithi170.stdout:6/733: rename d3/d1a/cd1 to d3/d1d/d28/d3b/cfd 0 2024-02-15T22:51:23.033 INFO:tasks.workunit.client.1.smithi170.stdout:6/734: creat d3/d24/ffe x:0 0 0 2024-02-15T22:51:23.034 INFO:tasks.workunit.client.1.smithi170.stdout:1/866: creat d3/da2/de2/f127 x:0 0 0 2024-02-15T22:51:23.037 INFO:tasks.workunit.client.1.smithi170.stdout:1/867: write d3/d24/d2c/d35/d83/dd8/f115 [238054,6164] 0 2024-02-15T22:51:23.039 INFO:tasks.workunit.client.1.smithi170.stdout:0/680: dwrite d8/d14/d1c/d3f/fcf [0,4194304] 0 2024-02-15T22:51:23.041 INFO:tasks.workunit.client.1.smithi170.stdout:6/735: rename d3/d1d/d27/dc5 to d3/d1d/d28/d3b/da3/de5/dff 0 2024-02-15T22:51:23.041 INFO:tasks.workunit.client.1.smithi170.stdout:6/736: write d3/d1d/d36/d51/d54/df5/f8c [2302586,96285] 0 2024-02-15T22:51:23.041 INFO:tasks.workunit.client.1.smithi170.stdout:5/783: dwrite de/d10/da8/fd4 [0,4194304] 0 2024-02-15T22:51:23.044 INFO:tasks.workunit.client.1.smithi170.stdout:1/868: creat d3/d24/d2c/d77/dda/f128 x:0 0 0 2024-02-15T22:51:23.046 INFO:tasks.workunit.client.1.smithi170.stdout:2/857: getdents d0/d1/d11/d26 0 2024-02-15T22:51:23.049 INFO:tasks.workunit.client.1.smithi170.stdout:3/734: link d3/dc/d13/c5a d3/d1b/cf2 0 2024-02-15T22:51:23.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/681: rename d8/d14/d1c/d3f/lbc to d8/df/d13/d36/d60/da2/dcb/ld9 0 2024-02-15T22:51:23.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/682: write d8/d14/d1c/d3f/d53/fb2 [980968,116661] 0 2024-02-15T22:51:23.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/683: write d8/df/d13/f5c [948788,102763] 0 2024-02-15T22:51:23.057 INFO:tasks.workunit.client.1.smithi170.stdout:6/737: symlink d3/l100 0 2024-02-15T22:51:23.061 INFO:tasks.workunit.client.1.smithi170.stdout:2/858: mkdir d0/d1/d31/da3/d144 0 2024-02-15T22:51:23.062 INFO:tasks.workunit.client.1.smithi170.stdout:3/735: symlink d3/dc/d1a/d9f/dcb/de7/lf3 0 2024-02-15T22:51:23.066 INFO:tasks.workunit.client.1.smithi170.stdout:5/784: dwrite de/d29/fde [0,4194304] 0 2024-02-15T22:51:23.066 INFO:tasks.workunit.client.1.smithi170.stdout:5/785: truncate de/f26 8477140 0 2024-02-15T22:51:23.067 INFO:tasks.workunit.client.1.smithi170.stdout:6/738: link d3/d24/f77 d3/d1d/d28/d3b/da3/f101 0 2024-02-15T22:51:23.067 INFO:tasks.workunit.client.1.smithi170.stdout:6/739: fdatasync d3/d24/d31/f34 0 2024-02-15T22:51:23.071 INFO:tasks.workunit.client.1.smithi170.stdout:2/859: getdents d0/d1/d89/dd7/d83 0 2024-02-15T22:51:23.071 INFO:tasks.workunit.client.1.smithi170.stdout:2/860: fsync d0/d1/d89/dd7/d2f/d37/d58/d78/f84 0 2024-02-15T22:51:23.072 INFO:tasks.workunit.client.1.smithi170.stdout:1/869: dwrite d3/da2/d65/fb2 [0,4194304] 0 2024-02-15T22:51:23.073 INFO:tasks.workunit.client.1.smithi170.stdout:0/684: dwrite d8/d14/d1c/d3f/f58 [0,4194304] 0 2024-02-15T22:51:23.073 INFO:tasks.workunit.client.1.smithi170.stdout:0/685: dread - d8/df/d13/d22/fcc zero size 2024-02-15T22:51:23.073 INFO:tasks.workunit.client.1.smithi170.stdout:0/686: truncate d8/d14/d1c/d3f/dce/faa 600430 0 2024-02-15T22:51:23.073 INFO:tasks.workunit.client.1.smithi170.stdout:0/687: write d8/df/d13/d22/d39/d55/fc7 [417346,90504] 0 2024-02-15T22:51:23.074 INFO:tasks.workunit.client.1.smithi170.stdout:5/786: mknod de/d29/de5/c108 0 2024-02-15T22:51:23.074 INFO:tasks.workunit.client.1.smithi170.stdout:5/787: stat de/d10/d33/d67/dc4 0 2024-02-15T22:51:23.083 INFO:tasks.workunit.client.1.smithi170.stdout:2/861: mkdir d0/d13/d145 0 2024-02-15T22:51:23.084 INFO:tasks.workunit.client.1.smithi170.stdout:6/740: dwrite d3/d1d/d27/fb3 [0,4194304] 0 2024-02-15T22:51:23.084 INFO:tasks.workunit.client.1.smithi170.stdout:6/741: read d3/f5 [1721026,68001] 0 2024-02-15T22:51:23.088 INFO:tasks.workunit.client.1.smithi170.stdout:0/688: rmdir d8/df/d13/d22/d71 39 2024-02-15T22:51:23.088 INFO:tasks.workunit.client.1.smithi170.stdout:0/689: fdatasync d8/df/d13/f2e 0 2024-02-15T22:51:23.088 INFO:tasks.workunit.client.1.smithi170.stdout:0/690: write d8/d14/d1c/d3f/dce/dd5/fd7 [2703667,6613] 0 2024-02-15T22:51:23.088 INFO:tasks.workunit.client.1.smithi170.stdout:0/691: chown d8/d14/d1c/l72 0 1 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:0/692: truncate d8/d14/f28 538936 0 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:0/693: chown d8/df/d13/d22/d39/d55/c83 893339 1 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:5/788: mkdir de/d10/d33/d109 0 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:5/789: chown de/d10/da8/dfc 12312809 1 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:2/862: link d0/d13/f121 d0/d1/d89/d8b/f146 0 2024-02-15T22:51:23.089 INFO:tasks.workunit.client.1.smithi170.stdout:3/736: rename d3/d2b to d3/dc/d1c/d26/d55/d7d/df4 0 2024-02-15T22:51:23.090 INFO:tasks.workunit.client.1.smithi170.stdout:6/742: rmdir d3/d1d/d1b/d9b 39 2024-02-15T22:51:23.092 INFO:tasks.workunit.client.1.smithi170.stdout:2/863: symlink d0/d13/d59/d82/l147 0 2024-02-15T22:51:23.092 INFO:tasks.workunit.client.1.smithi170.stdout:2/864: write d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f107 [937848,63103] 0 2024-02-15T22:51:23.092 INFO:tasks.workunit.client.1.smithi170.stdout:2/865: fdatasync d0/d1/d89/dd7/f7a 0 2024-02-15T22:51:23.092 INFO:tasks.workunit.client.1.smithi170.stdout:2/866: dread - d0/d1/d89/dd7/d2f/fce zero size 2024-02-15T22:51:23.092 INFO:tasks.workunit.client.1.smithi170.stdout:2/867: dread - d0/d1/d89/dd7/d2f/d9b/f134 zero size 2024-02-15T22:51:23.093 INFO:tasks.workunit.client.1.smithi170.stdout:2/868: read d0/d1/d89/dd7/d2f/d37/f7c [164876,52021] 0 2024-02-15T22:51:23.093 INFO:tasks.workunit.client.1.smithi170.stdout:6/743: symlink d3/d1d/l102 0 2024-02-15T22:51:23.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/870: rename d3/c1a to d3/d24/d2c/d35/d72/d92/c129 0 2024-02-15T22:51:23.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/871: write d3/fbd [1392171,79790] 0 2024-02-15T22:51:23.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/872: dread - d3/d24/f10c zero size 2024-02-15T22:51:23.095 INFO:tasks.workunit.client.1.smithi170.stdout:1/873: truncate d3/d24/d2c/d77/dda/d109/f125 972176 0 2024-02-15T22:51:23.096 INFO:tasks.workunit.client.1.smithi170.stdout:3/737: creat d3/d1b/d51/d6b/d86/ff5 x:0 0 0 2024-02-15T22:51:23.097 INFO:tasks.workunit.client.1.smithi170.stdout:2/869: mkdir d0/d2a/d148 0 2024-02-15T22:51:23.098 INFO:tasks.workunit.client.1.smithi170.stdout:6/744: creat d3/d1d/d1b/d9b/f103 x:0 0 0 2024-02-15T22:51:23.098 INFO:tasks.workunit.client.1.smithi170.stdout:6/745: write d3/d1d/d36/d56/daf/fdd [272285,87958] 0 2024-02-15T22:51:23.098 INFO:tasks.workunit.client.1.smithi170.stdout:6/746: chown d3/l61 30 1 2024-02-15T22:51:23.100 INFO:tasks.workunit.client.1.smithi170.stdout:0/694: rename d8/d14/d1c/d3f/dce/dc9 to d8/d6d/dda 0 2024-02-15T22:51:23.100 INFO:tasks.workunit.client.1.smithi170.stdout:0/695: read d8/d14/d1c/d3f/dce/faa [568349,2805] 0 2024-02-15T22:51:23.101 INFO:tasks.workunit.client.1.smithi170.stdout:1/874: creat d3/d24/d2c/d94/f12a x:0 0 0 2024-02-15T22:51:23.101 INFO:tasks.workunit.client.1.smithi170.stdout:1/875: chown d3/d24/d2c/d35/d7f/c84 191278082 1 2024-02-15T22:51:23.103 INFO:tasks.workunit.client.1.smithi170.stdout:2/870: rename d0/d1/d11/cbb to d0/d1/d89/dd7/d2f/d9b/c149 0 2024-02-15T22:51:23.105 INFO:tasks.workunit.client.1.smithi170.stdout:2/871: creat d0/d1/d11/d26/d6e/d10f/df9/f14a x:0 0 0 2024-02-15T22:51:23.106 INFO:tasks.workunit.client.1.smithi170.stdout:0/696: dread d8/d14/d6f/f98 [0,4194304] 0 2024-02-15T22:51:23.106 INFO:tasks.workunit.client.1.smithi170.stdout:2/872: getdents d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde 0 2024-02-15T22:51:23.108 INFO:tasks.workunit.client.1.smithi170.stdout:2/873: creat d0/d1d/d3d/d76/d142/f14b x:0 0 0 2024-02-15T22:51:23.110 INFO:tasks.workunit.client.1.smithi170.stdout:2/874: rmdir d0/d13/d59/d12c 39 2024-02-15T22:51:23.110 INFO:tasks.workunit.client.1.smithi170.stdout:2/875: dread - d0/d1/d11/d26/d6e/d8a/f12b zero size 2024-02-15T22:51:23.111 INFO:tasks.workunit.client.1.smithi170.stdout:2/876: mkdir d0/d1/d89/dd7/d2f/d9b/d14c 0 2024-02-15T22:51:23.112 INFO:tasks.workunit.client.1.smithi170.stdout:5/790: dwrite de/d10/d27/fea [0,4194304] 0 2024-02-15T22:51:23.112 INFO:tasks.workunit.client.1.smithi170.stdout:3/738: dread d3/dc/d1c/d26/dd4/f9e [0,4194304] 0 2024-02-15T22:51:23.112 INFO:tasks.workunit.client.1.smithi170.stdout:2/877: mknod d0/d1/d89/dd7/d2f/d9b/d115/c14d 0 2024-02-15T22:51:23.114 INFO:tasks.workunit.client.1.smithi170.stdout:5/791: truncate de/d10/d52/f73 2835901 0 2024-02-15T22:51:23.114 INFO:tasks.workunit.client.1.smithi170.stdout:3/739: mknod d3/dc/d1a/d9f/dcb/cf6 0 2024-02-15T22:51:23.117 INFO:tasks.workunit.client.1.smithi170.stdout:3/740: mknod d3/d1b/d2c/d9a/cf7 0 2024-02-15T22:51:23.117 INFO:tasks.workunit.client.1.smithi170.stdout:3/741: dread - d3/d78/faf zero size 2024-02-15T22:51:23.118 INFO:tasks.workunit.client.1.smithi170.stdout:5/792: rename de/d29/de5 to de/d10/d7d/db8/d10a 0 2024-02-15T22:51:23.118 INFO:tasks.workunit.client.1.smithi170.stdout:5/793: chown de/d10/d27/d2d/f31 1201681 1 2024-02-15T22:51:23.120 INFO:tasks.workunit.client.1.smithi170.stdout:3/742: mkdir d3/d1b/d8a/df8 0 2024-02-15T22:51:23.122 INFO:tasks.workunit.client.1.smithi170.stdout:3/743: truncate d3/d1b/d8a/f99 3832147 0 2024-02-15T22:51:23.123 INFO:tasks.workunit.client.1.smithi170.stdout:3/744: symlink d3/d78/d7a/lf9 0 2024-02-15T22:51:23.136 INFO:tasks.workunit.client.1.smithi170.stdout:5/794: dwrite de/d10/d33/fe3 [0,4194304] 0 2024-02-15T22:51:23.138 INFO:tasks.workunit.client.1.smithi170.stdout:5/795: creat de/d10/d52/f10b x:0 0 0 2024-02-15T22:51:23.139 INFO:tasks.workunit.client.1.smithi170.stdout:5/796: truncate de/f11 5144466 0 2024-02-15T22:51:23.144 INFO:tasks.workunit.client.1.smithi170.stdout:3/745: dread d3/dc/d1c/d26/d55/f69 [0,4194304] 0 2024-02-15T22:51:23.145 INFO:tasks.workunit.client.1.smithi170.stdout:3/746: symlink d3/d1b/d8a/dcc/lfa 0 2024-02-15T22:51:23.145 INFO:tasks.workunit.client.1.smithi170.stdout:3/747: write d3/dc/d1c/d26/dd4/f80 [905262,43406] 0 2024-02-15T22:51:23.145 INFO:tasks.workunit.client.1.smithi170.stdout:3/748: chown d3/dc/f5b 130 1 2024-02-15T22:51:23.147 INFO:tasks.workunit.client.1.smithi170.stdout:2/878: dwrite d0/d1/d89/dd7/d2f/d37/d58/f96 [0,4194304] 0 2024-02-15T22:51:23.147 INFO:tasks.workunit.client.1.smithi170.stdout:2/879: read d0/d2a/fb5 [2597811,116352] 0 2024-02-15T22:51:23.147 INFO:tasks.workunit.client.1.smithi170.stdout:3/749: write d3/db/f11 [424562,27029] 0 2024-02-15T22:51:23.148 INFO:tasks.workunit.client.1.smithi170.stdout:1/876: dwrite d3/d24/d2c/d35/d72/f8b [0,4194304] 0 2024-02-15T22:51:23.148 INFO:tasks.workunit.client.1.smithi170.stdout:1/877: fdatasync d3/d24/d2c/d77/d8f/dcd/f10f 0 2024-02-15T22:51:23.148 INFO:tasks.workunit.client.1.smithi170.stdout:6/747: dwrite d3/d24/d31/f49 [0,4194304] 0 2024-02-15T22:51:23.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/748: truncate d3/d24/fd0 3484 0 2024-02-15T22:51:23.149 INFO:tasks.workunit.client.1.smithi170.stdout:5/797: write de/d10/f6b [3607003,15786] 0 2024-02-15T22:51:23.150 INFO:tasks.workunit.client.1.smithi170.stdout:0/697: dwrite d8/df/d13/d36/d60/da2/fa4 [4194304,4194304] 0 2024-02-15T22:51:23.150 INFO:tasks.workunit.client.1.smithi170.stdout:2/880: link d0/d1/d11/d26/d6e/d8a/l95 d0/d13/d59/d82/l14e 0 2024-02-15T22:51:23.153 INFO:tasks.workunit.client.1.smithi170.stdout:6/749: dread d3/d1d/d36/d56/daf/fdd [0,4194304] 0 2024-02-15T22:51:23.154 INFO:tasks.workunit.client.1.smithi170.stdout:3/750: symlink d3/dc/d1c/d26/dd4/lfb 0 2024-02-15T22:51:23.154 INFO:tasks.workunit.client.1.smithi170.stdout:3/751: chown d3/d1b/d51/d6b/d86/dc5 4439 1 2024-02-15T22:51:23.160 INFO:tasks.workunit.client.1.smithi170.stdout:5/798: unlink de/d10/d27/d4c/d53/f60 0 2024-02-15T22:51:23.164 INFO:tasks.workunit.client.1.smithi170.stdout:0/698: creat d8/df/d13/d36/d60/da2/dcb/fdb x:0 0 0 2024-02-15T22:51:23.169 INFO:tasks.workunit.client.1.smithi170.stdout:2/881: dwrite d0/d2a/fdd [0,4194304] 0 2024-02-15T22:51:23.171 INFO:tasks.workunit.client.1.smithi170.stdout:3/752: dwrite d3/db/d1f/f41 [0,4194304] 0 2024-02-15T22:51:23.180 INFO:tasks.workunit.client.1.smithi170.stdout:6/750: symlink d3/d24/d31/dc6/l104 0 2024-02-15T22:51:23.183 INFO:tasks.workunit.client.1.smithi170.stdout:0/699: mkdir d8/d14/d70/d93/ddc 0 2024-02-15T22:51:23.183 INFO:tasks.workunit.client.1.smithi170.stdout:0/700: dread - d8/df/d13/d36/d60/da2/fb8 zero size 2024-02-15T22:51:23.188 INFO:tasks.workunit.client.1.smithi170.stdout:3/753: symlink d3/d1b/d2c/d9a/lfc 0 2024-02-15T22:51:23.188 INFO:tasks.workunit.client.1.smithi170.stdout:3/754: creat d3/dc/d1c/d26/ffd x:0 0 0 2024-02-15T22:51:23.189 INFO:tasks.workunit.client.1.smithi170.stdout:7/854: sync 2024-02-15T22:51:23.189 INFO:tasks.workunit.client.1.smithi170.stdout:7/855: stat da/d1a/d21/d2c/d74/dde/d7d/fff 0 2024-02-15T22:51:23.189 INFO:tasks.workunit.client.1.smithi170.stdout:7/856: creat da/d1a/d21/d2c/d2e/f123 x:0 0 0 2024-02-15T22:51:23.189 INFO:tasks.workunit.client.1.smithi170.stdout:6/751: mkdir d3/d1d/d36/d56/daf/dd5/df0/d105 0 2024-02-15T22:51:23.190 INFO:tasks.workunit.client.1.smithi170.stdout:0/701: link d8/d14/l45 d8/d14/d44/ldd 0 2024-02-15T22:51:23.191 INFO:tasks.workunit.client.1.smithi170.stdout:6/752: write d3/d1d/d28/f7d [1451897,38630] 0 2024-02-15T22:51:23.193 INFO:tasks.workunit.client.1.smithi170.stdout:3/755: getdents d3/d1b/d2c/d92 0 2024-02-15T22:51:23.194 INFO:tasks.workunit.client.1.smithi170.stdout:2/882: dwrite d0/d13/f143 [0,4194304] 0 2024-02-15T22:51:23.194 INFO:tasks.workunit.client.1.smithi170.stdout:2/883: read d0/d1/d31/f34 [148955,62121] 0 2024-02-15T22:51:23.196 INFO:tasks.workunit.client.1.smithi170.stdout:7/857: mkdir da/d1a/d21/d2c/d2e/d7a/de2/de5/d124 0 2024-02-15T22:51:23.197 INFO:tasks.workunit.client.1.smithi170.stdout:0/702: link d8/d14/f1a d8/df/d13/d22/fde 0 2024-02-15T22:51:23.197 INFO:tasks.workunit.client.1.smithi170.stdout:5/799: dwrite de/d10/d27/d4c/f6e [0,4194304] 0 2024-02-15T22:51:23.200 INFO:tasks.workunit.client.1.smithi170.stdout:3/756: link d3/db/d1f/f2f d3/dc/d1a/d9f/dec/ffe 0 2024-02-15T22:51:23.203 INFO:tasks.workunit.client.1.smithi170.stdout:2/884: mkdir d0/d1/d89/dd7/d2f/d9b/d14c/d14f 0 2024-02-15T22:51:23.204 INFO:tasks.workunit.client.1.smithi170.stdout:7/858: dread da/d1a/d21/f51 [0,4194304] 0 2024-02-15T22:51:23.204 INFO:tasks.workunit.client.1.smithi170.stdout:7/859: readlink da/d1a/def/d8d/l9c 0 2024-02-15T22:51:23.204 INFO:tasks.workunit.client.1.smithi170.stdout:7/860: chown da/d1a/d21/d2c/d74/dde/d7d/d72/fd2 381 1 2024-02-15T22:51:23.208 INFO:tasks.workunit.client.1.smithi170.stdout:5/800: link de/d10/d27/d4c/d53/d55/f79 de/d10/d27/dbd/f10c 0 2024-02-15T22:51:23.208 INFO:tasks.workunit.client.1.smithi170.stdout:5/801: read de/d10/d33/f45 [290370,27909] 0 2024-02-15T22:51:23.208 INFO:tasks.workunit.client.1.smithi170.stdout:5/802: fsync de/d10/d33/d67/dc4/fff 0 2024-02-15T22:51:23.208 INFO:tasks.workunit.client.1.smithi170.stdout:5/803: chown de/d10/da8/db6/le7 0 1 2024-02-15T22:51:23.209 INFO:tasks.workunit.client.1.smithi170.stdout:3/757: mkdir d3/d1b/d51/d6b/dff 0 2024-02-15T22:51:23.209 INFO:tasks.workunit.client.1.smithi170.stdout:6/753: dwrite d3/d1a/fa7 [0,4194304] 0 2024-02-15T22:51:23.210 INFO:tasks.workunit.client.1.smithi170.stdout:7/861: link da/l5d da/d1a/d21/d2c/d74/dde/d7d/d72/df1/l125 0 2024-02-15T22:51:23.211 INFO:tasks.workunit.client.1.smithi170.stdout:3/758: dread d3/d78/d7a/fc0 [0,4194304] 0 2024-02-15T22:51:23.212 INFO:tasks.workunit.client.1.smithi170.stdout:0/703: getdents d8 0 2024-02-15T22:51:23.214 INFO:tasks.workunit.client.1.smithi170.stdout:5/804: rename de/d10/d33/d109 to de/dec/d10d 0 2024-02-15T22:51:23.214 INFO:tasks.workunit.client.1.smithi170.stdout:0/704: dread d8/f1b [0,4194304] 0 2024-02-15T22:51:23.217 INFO:tasks.workunit.client.1.smithi170.stdout:6/754: mkdir d3/d24/d31/d106 0 2024-02-15T22:51:23.221 INFO:tasks.workunit.client.1.smithi170.stdout:3/759: rename d3/db/f11 to d3/dc/d1c/d26/f100 0 2024-02-15T22:51:23.221 INFO:tasks.workunit.client.1.smithi170.stdout:3/760: chown d3/dc/d13/f24 81784 1 2024-02-15T22:51:23.221 INFO:tasks.workunit.client.1.smithi170.stdout:3/761: getdents d3/d1b/d51/d94 0 2024-02-15T22:51:23.222 INFO:tasks.workunit.client.1.smithi170.stdout:5/805: rename de/d10/f13 to de/d10/f10e 0 2024-02-15T22:51:23.223 INFO:tasks.workunit.client.1.smithi170.stdout:6/755: symlink d3/l107 0 2024-02-15T22:51:23.224 INFO:tasks.workunit.client.1.smithi170.stdout:6/756: creat d3/d1d/d27/f108 x:0 0 0 2024-02-15T22:51:23.225 INFO:tasks.workunit.client.1.smithi170.stdout:3/762: creat d3/db/d1f/d61/f101 x:0 0 0 2024-02-15T22:51:23.225 INFO:tasks.workunit.client.1.smithi170.stdout:3/763: creat d3/db/d1f/d61/dad/f102 x:0 0 0 2024-02-15T22:51:23.226 INFO:tasks.workunit.client.1.smithi170.stdout:5/806: symlink de/d10/d33/l10f 0 2024-02-15T22:51:23.230 INFO:tasks.workunit.client.1.smithi170.stdout:3/764: unlink d3/d1b/d2c/d92/da5/le8 0 2024-02-15T22:51:23.230 INFO:tasks.workunit.client.1.smithi170.stdout:2/885: dwrite d0/d1/d89/dd7/d3e/f13f [0,4194304] 0 2024-02-15T22:51:23.232 INFO:tasks.workunit.client.1.smithi170.stdout:5/807: rename de/d10/d7d/fc5 to de/d10/d27/dbd/f110 0 2024-02-15T22:51:23.232 INFO:tasks.workunit.client.1.smithi170.stdout:5/808: chown de/d10/d27/dbd/cc0 328573 1 2024-02-15T22:51:23.235 INFO:tasks.workunit.client.1.smithi170.stdout:0/705: dwrite d8/f94 [0,4194304] 0 2024-02-15T22:51:23.235 INFO:tasks.workunit.client.1.smithi170.stdout:0/706: creat d8/df/fdf x:0 0 0 2024-02-15T22:51:23.235 INFO:tasks.workunit.client.1.smithi170.stdout:7/862: dwrite da/d1a/d21/d2c/d74/dde/d7d/d113/f11a [0,4194304] 0 2024-02-15T22:51:23.237 INFO:tasks.workunit.client.1.smithi170.stdout:3/765: rename d3/db/d1f/f2f to d3/dc/d1a/d9f/dcb/f103 0 2024-02-15T22:51:23.237 INFO:tasks.workunit.client.1.smithi170.stdout:3/766: dread - d3/dc/f9c zero size 2024-02-15T22:51:23.237 INFO:tasks.workunit.client.1.smithi170.stdout:3/767: write d3/dc/dd0/fd1 [127242,40629] 0 2024-02-15T22:51:23.237 INFO:tasks.workunit.client.1.smithi170.stdout:3/768: fdatasync d3/dc/d1c/d26/d55/d7d/df0/ff1 0 2024-02-15T22:51:23.238 INFO:tasks.workunit.client.1.smithi170.stdout:5/809: write de/d10/d27/f4f [2164369,41574] 0 2024-02-15T22:51:23.243 INFO:tasks.workunit.client.1.smithi170.stdout:7/863: mkdir da/d1a/d21/d2c/d74/dde/d7d/d126 0 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/886: rename d0/d1d/d3d/d76/fa0 to d0/d1/d89/f150 0 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/887: stat d0/d1/d89/f150 0 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/888: creat d0/d1/d5f/f151 x:0 0 0 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/889: write d0/d1/d89/dd7/d2f/d37/f4f [589567,129855] 0 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/890: chown d0/d1/d11/d26/d6e/d10f/df9/d108 157622310 1 2024-02-15T22:51:23.247 INFO:tasks.workunit.client.1.smithi170.stdout:2/891: fdatasync d0/d1/d53/f7e 0 2024-02-15T22:51:23.248 INFO:tasks.workunit.client.1.smithi170.stdout:3/769: truncate d3/dc/ff 3597751 0 2024-02-15T22:51:23.248 INFO:tasks.workunit.client.1.smithi170.stdout:3/770: truncate d3/dc/d1c/d26/dd4/f96 324979 0 2024-02-15T22:51:23.251 INFO:tasks.workunit.client.1.smithi170.stdout:5/810: unlink de/d10/d33/d9f/cfa 0 2024-02-15T22:51:23.257 INFO:tasks.workunit.client.1.smithi170.stdout:2/892: link d0/l42 d0/d13/d59/l152 0 2024-02-15T22:51:23.259 INFO:tasks.workunit.client.1.smithi170.stdout:3/771: unlink d3/dc/d1c/d26/la0 0 2024-02-15T22:51:23.260 INFO:tasks.workunit.client.1.smithi170.stdout:5/811: symlink de/d10/d33/d67/df1/l111 0 2024-02-15T22:51:23.261 INFO:tasks.workunit.client.1.smithi170.stdout:2/893: symlink d0/d1/d89/dd7/d2f/l153 0 2024-02-15T22:51:23.263 INFO:tasks.workunit.client.1.smithi170.stdout:5/812: symlink de/l112 0 2024-02-15T22:51:23.268 INFO:tasks.workunit.client.1.smithi170.stdout:5/813: rename de/d10/f6b to de/d10/d7d/db8/d10a/f113 0 2024-02-15T22:51:23.273 INFO:tasks.workunit.client.1.smithi170.stdout:7/864: dwrite da/d1a/def/d8d/fb5 [0,4194304] 0 2024-02-15T22:51:23.278 INFO:tasks.workunit.client.1.smithi170.stdout:7/865: creat da/d1a/def/d8d/f127 x:0 0 0 2024-02-15T22:51:23.284 INFO:tasks.workunit.client.1.smithi170.stdout:5/814: dwrite de/d10/f90 [0,4194304] 0 2024-02-15T22:51:23.292 INFO:tasks.workunit.client.1.smithi170.stdout:5/815: write de/d10/f5b [507377,125313] 0 2024-02-15T22:51:23.299 INFO:tasks.workunit.client.1.smithi170.stdout:5/816: dread de/f3f [0,4194304] 0 2024-02-15T22:51:23.299 INFO:tasks.workunit.client.1.smithi170.stdout:5/817: getdents de/d10/d33/d67/dc4 0 2024-02-15T22:51:23.300 INFO:tasks.workunit.client.1.smithi170.stdout:5/818: write de/d10/d33/ffd [886271,45350] 0 2024-02-15T22:51:23.300 INFO:tasks.workunit.client.1.smithi170.stdout:5/819: creat de/d10/da8/dfc/f114 x:0 0 0 2024-02-15T22:51:23.301 INFO:tasks.workunit.client.1.smithi170.stdout:5/820: mknod de/d10/d27/d2d/c115 0 2024-02-15T22:51:23.301 INFO:tasks.workunit.client.1.smithi170.stdout:5/821: chown de/d10/d33/fe3 320079 1 2024-02-15T22:51:23.302 INFO:tasks.workunit.client.1.smithi170.stdout:5/822: truncate de/d10/d27/d2d/f47 128606 0 2024-02-15T22:51:23.304 INFO:tasks.workunit.client.1.smithi170.stdout:5/823: rename de/d10/da8/dfc/f114 to de/d36/d80/f116 0 2024-02-15T22:51:23.304 INFO:tasks.workunit.client.1.smithi170.stdout:5/824: write de/d10/d52/fe2 [6689303,100562] 0 2024-02-15T22:51:23.304 INFO:tasks.workunit.client.1.smithi170.stdout:5/825: chown de/d10/d7d/db8/ldd 113153 1 2024-02-15T22:51:23.304 INFO:tasks.workunit.client.1.smithi170.stdout:5/826: chown de/c1d 1 1 2024-02-15T22:51:23.314 INFO:tasks.workunit.client.1.smithi170.stdout:9/598: sync 2024-02-15T22:51:23.314 INFO:tasks.workunit.client.1.smithi170.stdout:9/599: write de/d1b/d1c/d1f/d20/fbc [11892,70064] 0 2024-02-15T22:51:23.316 INFO:tasks.workunit.client.1.smithi170.stdout:9/600: write de/f75 [89340,112237] 0 2024-02-15T22:51:23.316 INFO:tasks.workunit.client.1.smithi170.stdout:9/601: chown de/d1b/d1c/d47 15317 1 2024-02-15T22:51:23.384 INFO:tasks.workunit.client.1.smithi170.stdout:5/827: read de/d10/d27/d4c/d53/d55/fad [57965,44115] 0 2024-02-15T22:51:23.384 INFO:tasks.workunit.client.1.smithi170.stdout:5/828: chown de/d10/d7d/df6 2 1 2024-02-15T22:51:23.385 INFO:tasks.workunit.client.1.smithi170.stdout:5/829: mkdir de/d36/d80/d117 0 2024-02-15T22:51:23.391 INFO:tasks.workunit.client.1.smithi170.stdout:2/894: dwrite d0/d2a/fdd [0,4194304] 0 2024-02-15T22:51:23.391 INFO:tasks.workunit.client.1.smithi170.stdout:3/772: dwrite d3/d1b/f8f [0,4194304] 0 2024-02-15T22:51:23.391 INFO:tasks.workunit.client.1.smithi170.stdout:3/773: write d3/fe4 [365958,47004] 0 2024-02-15T22:51:23.397 INFO:tasks.workunit.client.1.smithi170.stdout:7/866: dwrite da/f10c [0,4194304] 0 2024-02-15T22:51:23.408 INFO:tasks.workunit.client.1.smithi170.stdout:5/830: dwrite de/d10/f32 [0,4194304] 0 2024-02-15T22:51:23.408 INFO:tasks.workunit.client.1.smithi170.stdout:9/602: dwrite de/d1b/d1c/f5b [0,4194304] 0 2024-02-15T22:51:23.421 INFO:tasks.workunit.client.1.smithi170.stdout:9/603: mknod de/d1b/d1c/d1f/d20/d27/d84/cc9 0 2024-02-15T22:51:23.434 INFO:tasks.workunit.client.1.smithi170.stdout:7/867: unlink da/d1a/d21/d2c/d74/d87/dac/c85 0 2024-02-15T22:51:23.441 INFO:tasks.workunit.client.1.smithi170.stdout:7/868: dread da/d1a/d21/d2c/d2e/f35 [4194304,4194304] 0 2024-02-15T22:51:23.442 INFO:tasks.workunit.client.1.smithi170.stdout:7/869: symlink da/d57/l128 0 2024-02-15T22:51:23.442 INFO:tasks.workunit.client.1.smithi170.stdout:7/870: write da/d1a/d21/d1b/d69/f76 [1477813,61158] 0 2024-02-15T22:51:23.456 INFO:tasks.workunit.client.1.smithi170.stdout:9/604: link de/d97/fc4 de/d1b/d1c/d1f/d20/d27/d28/fca 0 2024-02-15T22:51:23.474 INFO:tasks.workunit.client.1.smithi170.stdout:7/871: dwrite da/d1a/d21/d2c/d74/d87/fbe [0,4194304] 0 2024-02-15T22:51:23.474 INFO:tasks.workunit.client.1.smithi170.stdout:7/872: readlink da/d1a/d21/d2c/d2e/d7a/l109 0 2024-02-15T22:51:23.475 INFO:tasks.workunit.client.1.smithi170.stdout:7/873: chown da/d1a/d21/d19/f91 49 1 2024-02-15T22:51:23.482 INFO:tasks.workunit.client.1.smithi170.stdout:9/605: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f85 [0,4194304] 0 2024-02-15T22:51:23.482 INFO:tasks.workunit.client.1.smithi170.stdout:9/606: creat de/d1b/d1c/d1f/d20/d8c/fcb x:0 0 0 2024-02-15T22:51:23.483 INFO:tasks.workunit.client.1.smithi170.stdout:9/607: read de/f1e [40598,91157] 0 2024-02-15T22:51:23.483 INFO:tasks.workunit.client.1.smithi170.stdout:9/608: fsync de/d1b/d1c/f5b 0 2024-02-15T22:51:23.483 INFO:tasks.workunit.client.1.smithi170.stdout:9/609: creat de/d8e/fcc x:0 0 0 2024-02-15T22:51:23.487 INFO:tasks.workunit.client.1.smithi170.stdout:7/874: write da/d1a/d21/d2c/d74/d87/dac/fc5 [291565,18686] 0 2024-02-15T22:51:23.574 INFO:tasks.workunit.client.1.smithi170.stdout:7/875: link da/d1a/d21/fae da/d1a/d21/d1b/dc6/f129 0 2024-02-15T22:51:23.583 INFO:tasks.workunit.client.1.smithi170.stdout:3/774: creat d3/dc/d1c/d26/dd4/f104 x:0 0 0 2024-02-15T22:51:23.586 INFO:tasks.workunit.client.1.smithi170.stdout:2/895: rename d0/d2a/d148 to d0/d1/d89/dd7/d3e/d154 0 2024-02-15T22:51:23.587 INFO:tasks.workunit.client.1.smithi170.stdout:9/610: rename de/d1b/f53 to de/d8e/fcd 0 2024-02-15T22:51:23.587 INFO:tasks.workunit.client.1.smithi170.stdout:2/896: stat d0/d13/l7b 0 2024-02-15T22:51:23.589 INFO:tasks.workunit.client.1.smithi170.stdout:7/876: rename da/d1a/d21/d2c/d74/dde/c6d to da/d1a/d21/d1b/dc6/c12a 0 2024-02-15T22:51:23.591 INFO:tasks.workunit.client.1.smithi170.stdout:9/611: rename de/d1b/d1c/d1f/d20/d27/d28/fca to de/d1b/d1c/d1f/d20/fce 0 2024-02-15T22:51:23.591 INFO:tasks.workunit.client.1.smithi170.stdout:9/612: write de/d1b/d1c/d1f/d20/d27/d28/f9a [687791,48984] 0 2024-02-15T22:51:23.596 INFO:tasks.workunit.client.1.smithi170.stdout:2/897: read d0/d1d/f91 [1322633,73897] 0 2024-02-15T22:51:23.596 INFO:tasks.workunit.client.1.smithi170.stdout:2/898: write d0/d1/d89/f150 [3571477,125251] 0 2024-02-15T22:51:23.596 INFO:tasks.workunit.client.1.smithi170.stdout:2/899: fsync d0/d1/d89/dd7/d2f/d9b/d115/f11b 0 2024-02-15T22:51:23.596 INFO:tasks.workunit.client.1.smithi170.stdout:2/900: creat d0/d1/d89/dd7/f155 x:0 0 0 2024-02-15T22:51:23.599 INFO:tasks.workunit.client.1.smithi170.stdout:2/901: rmdir d0/d1/d31/da3/d12d 0 2024-02-15T22:51:23.600 INFO:tasks.workunit.client.1.smithi170.stdout:2/902: dread d0/d1d/d3d/f4c [0,4194304] 0 2024-02-15T22:51:23.632 INFO:tasks.workunit.client.1.smithi170.stdout:3/775: write d3/dc/d1c/d26/dd4/f9e [752995,7954] 0 2024-02-15T22:51:23.632 INFO:tasks.workunit.client.1.smithi170.stdout:9/613: dread de/d1b/f57 [0,4194304] 0 2024-02-15T22:51:23.633 INFO:tasks.workunit.client.1.smithi170.stdout:3/776: write d3/d1b/d2c/fc9 [370805,47076] 0 2024-02-15T22:51:23.633 INFO:tasks.workunit.client.1.smithi170.stdout:9/614: rmdir de/d97 39 2024-02-15T22:51:23.634 INFO:tasks.workunit.client.1.smithi170.stdout:9/615: creat de/d1b/d1c/d1f/d20/d27/d28/d80/fcf x:0 0 0 2024-02-15T22:51:23.635 INFO:tasks.workunit.client.1.smithi170.stdout:3/777: getdents d3/d1b/d8a 0 2024-02-15T22:51:23.636 INFO:tasks.workunit.client.1.smithi170.stdout:3/778: write d3/db/d1f/d61/dad/fe1 [5064436,38643] 0 2024-02-15T22:51:23.636 INFO:tasks.workunit.client.1.smithi170.stdout:3/779: readlink d3/d78/d7a/lf9 0 2024-02-15T22:51:23.636 INFO:tasks.workunit.client.1.smithi170.stdout:3/780: write d3/d1b/d51/d6b/f91 [5147165,113038] 0 2024-02-15T22:51:23.651 INFO:tasks.workunit.client.1.smithi170.stdout:7/877: dwrite da/d1a/d21/d2c/d74/f102 [0,4194304] 0 2024-02-15T22:51:23.654 INFO:tasks.workunit.client.1.smithi170.stdout:2/903: dwrite d0/d1/d5f/f8c [0,4194304] 0 2024-02-15T22:51:23.654 INFO:tasks.workunit.client.1.smithi170.stdout:2/904: chown d0/d2a/f2b 28731801 1 2024-02-15T22:51:23.655 INFO:tasks.workunit.client.1.smithi170.stdout:8/599: sync 2024-02-15T22:51:23.655 INFO:tasks.workunit.client.1.smithi170.stdout:4/795: sync 2024-02-15T22:51:23.655 INFO:tasks.workunit.client.1.smithi170.stdout:8/600: write d9/fd [3253133,3695] 0 2024-02-15T22:51:23.655 INFO:tasks.workunit.client.1.smithi170.stdout:1/878: sync 2024-02-15T22:51:23.656 INFO:tasks.workunit.client.1.smithi170.stdout:9/616: unlink de/d8e/fcd 0 2024-02-15T22:51:23.659 INFO:tasks.workunit.client.1.smithi170.stdout:3/781: dread d3/d1b/d2c/fc9 [0,4194304] 0 2024-02-15T22:51:23.659 INFO:tasks.workunit.client.1.smithi170.stdout:3/782: stat d3/dc/d1c/f48 0 2024-02-15T22:51:23.664 INFO:tasks.workunit.client.1.smithi170.stdout:8/601: dread d9/d18/d26/f55 [0,4194304] 0 2024-02-15T22:51:23.665 INFO:tasks.workunit.client.1.smithi170.stdout:9/617: dread de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [0,4194304] 0 2024-02-15T22:51:23.665 INFO:tasks.workunit.client.1.smithi170.stdout:9/618: chown de/d1b/d1c/d1f/d20/d27/d28 1584152 1 2024-02-15T22:51:23.667 INFO:tasks.workunit.client.1.smithi170.stdout:2/905: mkdir d0/d1d/d3d/d156 0 2024-02-15T22:51:23.668 INFO:tasks.workunit.client.1.smithi170.stdout:4/796: mkdir d0/d22/da/d101 0 2024-02-15T22:51:23.669 INFO:tasks.workunit.client.1.smithi170.stdout:4/797: read d0/d22/da/d8b/fb2 [189040,84765] 0 2024-02-15T22:51:23.669 INFO:tasks.workunit.client.1.smithi170.stdout:4/798: creat d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb/f102 x:0 0 0 2024-02-15T22:51:23.671 INFO:tasks.workunit.client.1.smithi170.stdout:1/879: mknod d3/d24/d2c/d35/d72/d92/d123/c12b 0 2024-02-15T22:51:23.673 INFO:tasks.workunit.client.1.smithi170.stdout:3/783: creat d3/dc/d1a/d9f/dcb/f105 x:0 0 0 2024-02-15T22:51:23.674 INFO:tasks.workunit.client.1.smithi170.stdout:8/602: rename d9/d18/d32/d7a/d78/d7f/lbf to d9/d18/d26/d4f/lc4 0 2024-02-15T22:51:23.677 INFO:tasks.workunit.client.1.smithi170.stdout:9/619: chown de/d1b/d1c/d1f/d20/d27/c5e 0 1 2024-02-15T22:51:23.677 INFO:tasks.workunit.client.1.smithi170.stdout:9/620: dread - de/f8f zero size 2024-02-15T22:51:23.678 INFO:tasks.workunit.client.1.smithi170.stdout:2/906: creat d0/d1/d89/f157 x:0 0 0 2024-02-15T22:51:23.680 INFO:tasks.workunit.client.1.smithi170.stdout:4/799: symlink d0/d22/da/d8b/d47/dbe/da2/l103 0 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:1/880: mkdir d3/d24/d2c/d35/d12c 0 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:6/757: sync 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:0/707: sync 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:5/831: sync 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:5/832: fdatasync de/d36/d80/fc3 0 2024-02-15T22:51:23.684 INFO:tasks.workunit.client.1.smithi170.stdout:5/833: fdatasync de/d10/f23 0 2024-02-15T22:51:23.685 INFO:tasks.workunit.client.1.smithi170.stdout:3/784: creat d3/d1b/d8a/df8/f106 x:0 0 0 2024-02-15T22:51:23.685 INFO:tasks.workunit.client.1.smithi170.stdout:2/907: creat d0/d13/d59/d82/f158 x:0 0 0 2024-02-15T22:51:23.685 INFO:tasks.workunit.client.1.smithi170.stdout:2/908: dread - d0/d1/d89/dd7/d2f/d9b/f134 zero size 2024-02-15T22:51:23.688 INFO:tasks.workunit.client.1.smithi170.stdout:4/800: symlink d0/d22/da/d8b/d47/da9/de7/l104 0 2024-02-15T22:51:23.689 INFO:tasks.workunit.client.1.smithi170.stdout:1/881: symlink d3/d24/d2c/d35/d83/dd8/l12d 0 2024-02-15T22:51:23.692 INFO:tasks.workunit.client.1.smithi170.stdout:0/708: rename d8/d14/d1c/f3d to d8/d14/d1c/d3f/d51/fe0 0 2024-02-15T22:51:23.699 INFO:tasks.workunit.client.1.smithi170.stdout:6/758: mknod d3/d24/d31/c109 0 2024-02-15T22:51:23.699 INFO:tasks.workunit.client.1.smithi170.stdout:6/759: creat d3/d1d/d28/f10a x:0 0 0 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:6/760: read d3/d1d/d1b/d3e/d5d/fbf [329961,760] 0 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:6/761: dread - d3/d1d/d1b/fe1 zero size 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:6/762: chown d3/d1d/d1b 78 1 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:5/834: creat de/d10/d27/d4c/d53/d55/d95/f118 x:0 0 0 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:3/785: mkdir d3/dc/d1c/d26/d55/d7d/d107 0 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:0/709: mkdir d8/d14/d1c/d3f/d51/de1 0 2024-02-15T22:51:23.700 INFO:tasks.workunit.client.1.smithi170.stdout:0/710: fsync d8/df/d13/d22/d39/d55/f8e 0 2024-02-15T22:51:23.701 INFO:tasks.workunit.client.1.smithi170.stdout:6/763: mknod d3/d1d/d36/d51/d54/c10b 0 2024-02-15T22:51:23.702 INFO:tasks.workunit.client.1.smithi170.stdout:5/835: creat de/d36/f119 x:0 0 0 2024-02-15T22:51:23.703 INFO:tasks.workunit.client.1.smithi170.stdout:5/836: write de/d10/d27/dbd/f110 [2030062,112132] 0 2024-02-15T22:51:23.704 INFO:tasks.workunit.client.1.smithi170.stdout:3/786: link d3/d1b/d51/d6b/d86/cc4 d3/db/d1f/d61/dd7/c108 0 2024-02-15T22:51:23.705 INFO:tasks.workunit.client.1.smithi170.stdout:6/764: mknod d3/d1d/d27/d70/d82/c10c 0 2024-02-15T22:51:23.705 INFO:tasks.workunit.client.1.smithi170.stdout:0/711: dread d8/d14/d1c/d3f/dce/f9a [0,4194304] 0 2024-02-15T22:51:23.706 INFO:tasks.workunit.client.1.smithi170.stdout:0/712: write d8/d14/f76 [2872226,16587] 0 2024-02-15T22:51:23.706 INFO:tasks.workunit.client.1.smithi170.stdout:9/621: dwrite de/d8e/fad [0,4194304] 0 2024-02-15T22:51:23.706 INFO:tasks.workunit.client.1.smithi170.stdout:9/622: creat de/d1b/d1c/d47/fd0 x:0 0 0 2024-02-15T22:51:23.707 INFO:tasks.workunit.client.1.smithi170.stdout:9/623: truncate de/d8e/f96 372056 0 2024-02-15T22:51:23.707 INFO:tasks.workunit.client.1.smithi170.stdout:9/624: chown de/d1b/d1c/d1f/d20/d27/d28/f33 27 1 2024-02-15T22:51:23.707 INFO:tasks.workunit.client.1.smithi170.stdout:5/837: mkdir de/d36/d80/d117/d11a 0 2024-02-15T22:51:23.709 INFO:tasks.workunit.client.1.smithi170.stdout:3/787: link d3/d1b/d8a/dcc/lfa d3/dc/d1c/d26/d55/d7d/l109 0 2024-02-15T22:51:23.715 INFO:tasks.workunit.client.1.smithi170.stdout:8/603: dwrite d9/d18/d32/d7a/d78/d7f/d98/fad [0,4194304] 0 2024-02-15T22:51:23.719 INFO:tasks.workunit.client.1.smithi170.stdout:3/788: creat d3/db/f10a x:0 0 0 2024-02-15T22:51:23.719 INFO:tasks.workunit.client.1.smithi170.stdout:9/625: symlink de/d1b/d1c/d1f/d20/d27/ld1 0 2024-02-15T22:51:23.719 INFO:tasks.workunit.client.1.smithi170.stdout:9/626: fdatasync de/d1b/d1c/d1f/d20/d27/d28/d69/f70 0 2024-02-15T22:51:23.720 INFO:tasks.workunit.client.1.smithi170.stdout:3/789: mknod d3/d1b/d51/d6b/d86/c10b 0 2024-02-15T22:51:23.721 INFO:tasks.workunit.client.1.smithi170.stdout:2/909: dwrite d0/d1/f27 [0,4194304] 0 2024-02-15T22:51:23.721 INFO:tasks.workunit.client.1.smithi170.stdout:3/790: mknod d3/dc/d1a/d9f/dcb/c10c 0 2024-02-15T22:51:23.721 INFO:tasks.workunit.client.1.smithi170.stdout:3/791: fsync d3/dc/f5b 0 2024-02-15T22:51:23.722 INFO:tasks.workunit.client.1.smithi170.stdout:9/627: symlink de/ld2 0 2024-02-15T22:51:23.725 INFO:tasks.workunit.client.1.smithi170.stdout:2/910: rename d0/d2a/ceb to d0/d1/d31/da3/d128/c159 0 2024-02-15T22:51:23.725 INFO:tasks.workunit.client.1.smithi170.stdout:6/765: write d3/d24/f77 [1385062,3687] 0 2024-02-15T22:51:23.726 INFO:tasks.workunit.client.1.smithi170.stdout:2/911: dread d0/d1d/d3d/f4c [0,4194304] 0 2024-02-15T22:51:23.727 INFO:tasks.workunit.client.1.smithi170.stdout:6/766: mkdir d3/d1d/d36/d56/d6c/d10d 0 2024-02-15T22:51:23.727 INFO:tasks.workunit.client.1.smithi170.stdout:6/767: chown d3/d1d/d36/d51/d54/c98 22389893 1 2024-02-15T22:51:23.727 INFO:tasks.workunit.client.1.smithi170.stdout:6/768: write d3/d1d/d28/f10a [139155,107279] 0 2024-02-15T22:51:23.727 INFO:tasks.workunit.client.1.smithi170.stdout:9/628: mknod de/cd3 0 2024-02-15T22:51:23.728 INFO:tasks.workunit.client.1.smithi170.stdout:2/912: mkdir d0/d1/d5f/de5/d15a 0 2024-02-15T22:51:23.730 INFO:tasks.workunit.client.1.smithi170.stdout:6/769: truncate d3/f4 426297 0 2024-02-15T22:51:23.730 INFO:tasks.workunit.client.1.smithi170.stdout:6/770: truncate d3/d1d/d1b/d9b/f103 91697 0 2024-02-15T22:51:23.730 INFO:tasks.workunit.client.1.smithi170.stdout:6/771: truncate d3/d1d/d27/fa2 1371286 0 2024-02-15T22:51:23.731 INFO:tasks.workunit.client.1.smithi170.stdout:2/913: mknod d0/d1/d89/dd7/d2f/d37/d58/d78/da4/c15b 0 2024-02-15T22:51:23.731 INFO:tasks.workunit.client.1.smithi170.stdout:6/772: mknod d3/d1d/d1b/d3e/d9c/c10e 0 2024-02-15T22:51:23.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/914: mkdir d0/d1/d89/dd7/d2f/d37/d58/d78/da4/d15c 0 2024-02-15T22:51:23.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/915: write d0/d1/d5f/d74/f94 [129525,75338] 0 2024-02-15T22:51:23.733 INFO:tasks.workunit.client.1.smithi170.stdout:2/916: readlink d0/d1/d89/dd7/d2f/d37/d58/d78/l64 0 2024-02-15T22:51:23.734 INFO:tasks.workunit.client.1.smithi170.stdout:2/917: truncate d0/d1/d89/dd7/d2f/d9b/f134 565280 0 2024-02-15T22:51:23.735 INFO:tasks.workunit.client.1.smithi170.stdout:1/882: dwrite d3/d24/f36 [0,4194304] 0 2024-02-15T22:51:23.735 INFO:tasks.workunit.client.1.smithi170.stdout:2/918: creat d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f15d x:0 0 0 2024-02-15T22:51:23.736 INFO:tasks.workunit.client.1.smithi170.stdout:9/629: write f2 [2850220,89556] 0 2024-02-15T22:51:23.736 INFO:tasks.workunit.client.1.smithi170.stdout:2/919: mknod d0/d1/d5f/d74/c15e 0 2024-02-15T22:51:23.736 INFO:tasks.workunit.client.1.smithi170.stdout:2/920: dread - d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f15d zero size 2024-02-15T22:51:23.737 INFO:tasks.workunit.client.1.smithi170.stdout:1/883: creat d3/da2/f12e x:0 0 0 2024-02-15T22:51:23.737 INFO:tasks.workunit.client.1.smithi170.stdout:1/884: stat d3 0 2024-02-15T22:51:23.737 INFO:tasks.workunit.client.1.smithi170.stdout:1/885: chown d3/d24/d2c/d35/f81 25 1 2024-02-15T22:51:23.738 INFO:tasks.workunit.client.1.smithi170.stdout:9/630: unlink de/d1b/d1c/d1f/d20/d27/d2c/lc1 0 2024-02-15T22:51:23.740 INFO:tasks.workunit.client.1.smithi170.stdout:2/921: creat d0/d1/d89/dd7/d2f/d37/d137/f15f x:0 0 0 2024-02-15T22:51:23.740 INFO:tasks.workunit.client.1.smithi170.stdout:2/922: fsync d0/d13/d59/fc2 0 2024-02-15T22:51:23.742 INFO:tasks.workunit.client.1.smithi170.stdout:1/886: rename d3/d24/c6c to d3/d24/d2c/d35/d72/c12f 0 2024-02-15T22:51:23.742 INFO:tasks.workunit.client.1.smithi170.stdout:1/887: dread - d3/d24/d2c/d35/d72/df1/f11d zero size 2024-02-15T22:51:23.743 INFO:tasks.workunit.client.1.smithi170.stdout:9/631: mknod de/d1b/d37/cd4 0 2024-02-15T22:51:23.745 INFO:tasks.workunit.client.1.smithi170.stdout:1/888: mkdir d3/d24/d2c/d77/d110/d118/d130 0 2024-02-15T22:51:23.746 INFO:tasks.workunit.client.1.smithi170.stdout:9/632: creat de/d1b/fd5 x:0 0 0 2024-02-15T22:51:23.746 INFO:tasks.workunit.client.1.smithi170.stdout:9/633: write de/d1b/d1c/d47/fc8 [778156,7844] 0 2024-02-15T22:51:23.746 INFO:tasks.workunit.client.1.smithi170.stdout:9/634: readlink de/d1b/d1c/d1f/l35 0 2024-02-15T22:51:23.746 INFO:tasks.workunit.client.1.smithi170.stdout:4/801: dwrite d0/d22/da/d8b/d47/d5e/ff8 [0,4194304] 0 2024-02-15T22:51:23.748 INFO:tasks.workunit.client.1.smithi170.stdout:9/635: truncate de/f2a 449244 0 2024-02-15T22:51:23.753 INFO:tasks.workunit.client.1.smithi170.stdout:0/713: dwrite d8/df/d13/d36/d60/da2/dcb/fdb [0,4194304] 0 2024-02-15T22:51:23.754 INFO:tasks.workunit.client.1.smithi170.stdout:2/923: write d0/d13/f143 [3067161,119037] 0 2024-02-15T22:51:23.755 INFO:tasks.workunit.client.1.smithi170.stdout:1/889: rmdir d3/da2/d65 39 2024-02-15T22:51:23.755 INFO:tasks.workunit.client.1.smithi170.stdout:1/890: stat d3/f22 0 2024-02-15T22:51:23.756 INFO:tasks.workunit.client.1.smithi170.stdout:8/604: dwrite d9/d18/d32/d99/fb6 [0,4194304] 0 2024-02-15T22:51:23.756 INFO:tasks.workunit.client.1.smithi170.stdout:8/605: write d9/d18/d32/d7a/d78/d7f/d98/fb8 [668441,55650] 0 2024-02-15T22:51:23.757 INFO:tasks.workunit.client.1.smithi170.stdout:8/606: stat d9/d18/l75 0 2024-02-15T22:51:23.758 INFO:tasks.workunit.client.1.smithi170.stdout:5/838: dwrite de/d10/d33/d67/dc4/fff [0,4194304] 0 2024-02-15T22:51:23.758 INFO:tasks.workunit.client.1.smithi170.stdout:6/773: dwrite d3/d1d/d36/fd4 [0,4194304] 0 2024-02-15T22:51:23.759 INFO:tasks.workunit.client.1.smithi170.stdout:0/714: rename d8/d14/d1c/d3f/dce/cbd to d8/d14/d70/d93/dd0/ce2 0 2024-02-15T22:51:23.759 INFO:tasks.workunit.client.1.smithi170.stdout:0/715: write d8/df/d13/f42 [3798220,33945] 0 2024-02-15T22:51:23.762 INFO:tasks.workunit.client.1.smithi170.stdout:2/924: mkdir d0/d1/d11/d26/d6e/d10f/df9/d108/d160 0 2024-02-15T22:51:23.769 INFO:tasks.workunit.client.1.smithi170.stdout:6/774: dread d3/f16 [0,4194304] 0 2024-02-15T22:51:23.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/891: dread d3/d24/f36 [0,4194304] 0 2024-02-15T22:51:23.776 INFO:tasks.workunit.client.1.smithi170.stdout:8/607: mkdir d9/d18/d32/d3b/dc5 0 2024-02-15T22:51:23.783 INFO:tasks.workunit.client.1.smithi170.stdout:5/839: rename de/d10/d27/d2d/cb7 to de/d10/d33/d9f/d7c/d87/c11b 0 2024-02-15T22:51:23.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/802: dwrite d0/d22/da/d8b/d47/d5e/d79/f71 [0,4194304] 0 2024-02-15T22:51:23.785 INFO:tasks.workunit.client.1.smithi170.stdout:0/716: truncate d8/d14/d1c/d3f/dce/f9a 3755115 0 2024-02-15T22:51:23.785 INFO:tasks.workunit.client.1.smithi170.stdout:9/636: dwrite de/d1b/d1c/f5b [0,4194304] 0 2024-02-15T22:51:23.785 INFO:tasks.workunit.client.1.smithi170.stdout:9/637: read - de/d1b/d1c/d1f/f61 zero size 2024-02-15T22:51:23.788 INFO:tasks.workunit.client.1.smithi170.stdout:2/925: mkdir d0/d1/d89/d8b/d161 0 2024-02-15T22:51:23.789 INFO:tasks.workunit.client.1.smithi170.stdout:1/892: write d3/d24/f2b [2626427,62785] 0 2024-02-15T22:51:23.789 INFO:tasks.workunit.client.1.smithi170.stdout:1/893: stat d3/d24/d2c/d94/f12a 0 2024-02-15T22:51:23.789 INFO:tasks.workunit.client.1.smithi170.stdout:1/894: write d3/d24/fd2 [99085,3525] 0 2024-02-15T22:51:23.789 INFO:tasks.workunit.client.1.smithi170.stdout:6/775: creat d3/d1d/d27/d70/d82/f10f x:0 0 0 2024-02-15T22:51:23.789 INFO:tasks.workunit.client.1.smithi170.stdout:6/776: readlink d3/l8a 0 2024-02-15T22:51:23.790 INFO:tasks.workunit.client.1.smithi170.stdout:8/608: chown d9/f97 127786983 1 2024-02-15T22:51:23.794 INFO:tasks.workunit.client.1.smithi170.stdout:4/803: mknod d0/d22/da/d8b/d47/c105 0 2024-02-15T22:51:23.796 INFO:tasks.workunit.client.1.smithi170.stdout:0/717: mkdir d8/d14/d44/de3 0 2024-02-15T22:51:23.797 INFO:tasks.workunit.client.1.smithi170.stdout:9/638: dread de/d1b/d1c/d1f/d20/d27/d2c/f32 [0,4194304] 0 2024-02-15T22:51:23.797 INFO:tasks.workunit.client.1.smithi170.stdout:9/639: write de/d1b/fd5 [730636,130375] 0 2024-02-15T22:51:23.797 INFO:tasks.workunit.client.1.smithi170.stdout:2/926: symlink d0/d1/d11/d26/l162 0 2024-02-15T22:51:23.800 INFO:tasks.workunit.client.1.smithi170.stdout:2/927: dread d0/d1d/f4e [0,4194304] 0 2024-02-15T22:51:23.800 INFO:tasks.workunit.client.1.smithi170.stdout:2/928: write d0/d1d/fb9 [553446,94009] 0 2024-02-15T22:51:23.801 INFO:tasks.workunit.client.1.smithi170.stdout:6/777: mknod d3/d1d/d1b/c110 0 2024-02-15T22:51:23.803 INFO:tasks.workunit.client.1.smithi170.stdout:8/609: creat d9/d18/d32/d7a/d78/d95/fc6 x:0 0 0 2024-02-15T22:51:23.804 INFO:tasks.workunit.client.1.smithi170.stdout:5/840: getdents de/d10/d27 0 2024-02-15T22:51:23.806 INFO:tasks.workunit.client.1.smithi170.stdout:4/804: symlink d0/d22/da/d8b/d47/d5e/d79/df4/l106 0 2024-02-15T22:51:23.807 INFO:tasks.workunit.client.1.smithi170.stdout:0/718: unlink d8/df/d13/d22/d39/f74 0 2024-02-15T22:51:23.808 INFO:tasks.workunit.client.1.smithi170.stdout:0/719: write d8/df/d13/d22/d39/d55/fc7 [314323,86924] 0 2024-02-15T22:51:23.809 INFO:tasks.workunit.client.1.smithi170.stdout:0/720: creat d8/d6d/fe4 x:0 0 0 2024-02-15T22:51:23.809 INFO:tasks.workunit.client.1.smithi170.stdout:1/895: mknod d3/da2/d65/c131 0 2024-02-15T22:51:23.810 INFO:tasks.workunit.client.1.smithi170.stdout:2/929: truncate d0/d1d/f22 3707897 0 2024-02-15T22:51:23.811 INFO:tasks.workunit.client.1.smithi170.stdout:6/778: creat d3/d1d/d36/d56/daf/dd5/df0/f111 x:0 0 0 2024-02-15T22:51:23.811 INFO:tasks.workunit.client.1.smithi170.stdout:6/779: fdatasync d3/d24/d31/f49 0 2024-02-15T22:51:23.811 INFO:tasks.workunit.client.1.smithi170.stdout:6/780: chown d3/d1d/d36/d56/d6c/dc4/fcf 4 1 2024-02-15T22:51:23.813 INFO:tasks.workunit.client.1.smithi170.stdout:8/610: creat d9/d18/fc7 x:0 0 0 2024-02-15T22:51:23.814 INFO:tasks.workunit.client.1.smithi170.stdout:9/640: dwrite de/d1b/d1c/fc6 [0,4194304] 0 2024-02-15T22:51:23.814 INFO:tasks.workunit.client.1.smithi170.stdout:5/841: mkdir de/d10/d33/d67/d11c 0 2024-02-15T22:51:23.816 INFO:tasks.workunit.client.1.smithi170.stdout:4/805: symlink d0/d22/da/d8b/d47/d5e/d7d/dc9/l107 0 2024-02-15T22:51:23.816 INFO:tasks.workunit.client.1.smithi170.stdout:4/806: creat d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb/f108 x:0 0 0 2024-02-15T22:51:23.817 INFO:tasks.workunit.client.1.smithi170.stdout:1/896: getdents d3/d24/d2c/d35/d72/df1 0 2024-02-15T22:51:23.818 INFO:tasks.workunit.client.1.smithi170.stdout:1/897: write d3/f1c [895702,32816] 0 2024-02-15T22:51:23.819 INFO:tasks.workunit.client.1.smithi170.stdout:2/930: symlink d0/d1/d11/d26/d6e/d10f/df9/d108/d160/l163 0 2024-02-15T22:51:23.820 INFO:tasks.workunit.client.1.smithi170.stdout:6/781: symlink d3/db8/d96/l112 0 2024-02-15T22:51:23.821 INFO:tasks.workunit.client.1.smithi170.stdout:8/611: chown d9/f6d 29283627 1 2024-02-15T22:51:23.822 INFO:tasks.workunit.client.1.smithi170.stdout:2/931: dread d0/d1/d89/dd7/f7a [0,4194304] 0 2024-02-15T22:51:23.822 INFO:tasks.workunit.client.1.smithi170.stdout:2/932: truncate d0/d1/d11/d26/d6e/d8a/f12b 2761 0 2024-02-15T22:51:23.822 INFO:tasks.workunit.client.1.smithi170.stdout:0/721: dwrite d8/f94 [0,4194304] 0 2024-02-15T22:51:23.822 INFO:tasks.workunit.client.1.smithi170.stdout:0/722: chown d8/f2a 202875 1 2024-02-15T22:51:23.824 INFO:tasks.workunit.client.1.smithi170.stdout:9/641: mknod de/d1b/d37/da5/cd6 0 2024-02-15T22:51:23.828 INFO:tasks.workunit.client.1.smithi170.stdout:6/782: mkdir d3/d1d/d1b/d113 0 2024-02-15T22:51:23.828 INFO:tasks.workunit.client.1.smithi170.stdout:6/783: stat d3/d1d/d28/d3b/da3/de5/dff/lf1 0 2024-02-15T22:51:23.829 INFO:tasks.workunit.client.1.smithi170.stdout:8/612: creat d9/db2/fc8 x:0 0 0 2024-02-15T22:51:23.831 INFO:tasks.workunit.client.1.smithi170.stdout:2/933: getdents d0/d1/d5f/d74 0 2024-02-15T22:51:23.832 INFO:tasks.workunit.client.1.smithi170.stdout:0/723: mkdir d8/d6d/dda/de5 0 2024-02-15T22:51:23.832 INFO:tasks.workunit.client.1.smithi170.stdout:0/724: fsync d8/df/d13/d22/d39/fbb 0 2024-02-15T22:51:23.832 INFO:tasks.workunit.client.1.smithi170.stdout:0/725: chown d8/d14/d1c/d3f/cd4 98730 1 2024-02-15T22:51:23.832 INFO:tasks.workunit.client.1.smithi170.stdout:1/898: dwrite d3/fbd [0,4194304] 0 2024-02-15T22:51:23.832 INFO:tasks.workunit.client.1.smithi170.stdout:0/726: chown d8/d14/d1c/d3f/d51/lb7 498 1 2024-02-15T22:51:23.835 INFO:tasks.workunit.client.1.smithi170.stdout:4/807: getdents d0/d22/da/d8b/d47/d2b 0 2024-02-15T22:51:23.835 INFO:tasks.workunit.client.1.smithi170.stdout:4/808: creat d0/f109 x:0 0 0 2024-02-15T22:51:23.835 INFO:tasks.workunit.client.1.smithi170.stdout:0/727: write d8/df/d13/f1f [1218632,59747] 0 2024-02-15T22:51:23.836 INFO:tasks.workunit.client.1.smithi170.stdout:6/784: mkdir d3/d1d/d28/d66/d114 0 2024-02-15T22:51:23.837 INFO:tasks.workunit.client.1.smithi170.stdout:6/785: write d3/db8/d96/fe4 [971769,75006] 0 2024-02-15T22:51:23.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/728: dread d8/d14/d6f/f8d [0,4194304] 0 2024-02-15T22:51:23.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/729: dread - d8/df/d13/f85 zero size 2024-02-15T22:51:23.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/730: write d8/df/d13/f85 [9104,1224] 0 2024-02-15T22:51:23.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/731: fdatasync d8/df/d13/d22/f7c 0 2024-02-15T22:51:23.838 INFO:tasks.workunit.client.1.smithi170.stdout:8/613: rmdir d9/d18/d32/dab 39 2024-02-15T22:51:23.841 INFO:tasks.workunit.client.1.smithi170.stdout:2/934: symlink d0/d1/d53/l164 0 2024-02-15T22:51:23.841 INFO:tasks.workunit.client.1.smithi170.stdout:1/899: dread d3/da2/f3b [0,4194304] 0 2024-02-15T22:51:23.846 INFO:tasks.workunit.client.1.smithi170.stdout:9/642: link de/d1b/d1c/d1f/d20/d27/d2c/f85 de/fd7 0 2024-02-15T22:51:23.847 INFO:tasks.workunit.client.1.smithi170.stdout:5/842: rename de/d10/d52 to de/d10/d27/d2d/d11d 0 2024-02-15T22:51:23.851 INFO:tasks.workunit.client.1.smithi170.stdout:0/732: unlink d8/d14/f28 0 2024-02-15T22:51:23.853 INFO:tasks.workunit.client.1.smithi170.stdout:8/614: symlink d9/d18/lc9 0 2024-02-15T22:51:23.853 INFO:tasks.workunit.client.1.smithi170.stdout:1/900: write d3/d24/f8d [990352,8562] 0 2024-02-15T22:51:23.853 INFO:tasks.workunit.client.1.smithi170.stdout:8/615: creat d9/d18/d32/d3b/d4b/fca x:0 0 0 2024-02-15T22:51:23.861 INFO:tasks.workunit.client.1.smithi170.stdout:2/935: rename d0/d1/f48 to d0/d1/d89/dd7/f165 0 2024-02-15T22:51:23.862 INFO:tasks.workunit.client.1.smithi170.stdout:5/843: rmdir de/d10/d33 39 2024-02-15T22:51:23.862 INFO:tasks.workunit.client.1.smithi170.stdout:5/844: fsync de/d10/d33/fe3 0 2024-02-15T22:51:23.872 INFO:tasks.workunit.client.1.smithi170.stdout:9/643: dwrite de/d1b/d1c/d1f/d20/d27/d28/fbb [0,4194304] 0 2024-02-15T22:51:23.872 INFO:tasks.workunit.client.1.smithi170.stdout:2/936: dread d0/d1/d53/fcd [0,4194304] 0 2024-02-15T22:51:23.872 INFO:tasks.workunit.client.1.smithi170.stdout:2/937: write d0/d1/d5f/fac [570857,50967] 0 2024-02-15T22:51:23.873 INFO:tasks.workunit.client.1.smithi170.stdout:8/616: mknod d9/d18/d32/d7a/d78/ccb 0 2024-02-15T22:51:23.873 INFO:tasks.workunit.client.1.smithi170.stdout:1/901: rename d3/da2/le6 to d3/d24/d2c/d35/d72/d7e/l132 0 2024-02-15T22:51:23.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/902: write d3/d24/d2c/d94/dd9/ff5 [1106008,96776] 0 2024-02-15T22:51:23.874 INFO:tasks.workunit.client.1.smithi170.stdout:1/903: write d3/d24/d2c/d35/d7f/fa9 [425314,73679] 0 2024-02-15T22:51:23.876 INFO:tasks.workunit.client.1.smithi170.stdout:9/644: dread de/d1b/fd5 [0,4194304] 0 2024-02-15T22:51:23.877 INFO:tasks.workunit.client.1.smithi170.stdout:2/938: mknod d0/d1/d89/c166 0 2024-02-15T22:51:23.879 INFO:tasks.workunit.client.1.smithi170.stdout:8/617: rename d9/d18/d32/d3b/d42/c8a to d9/d18/d32/d3b/dc5/ccc 0 2024-02-15T22:51:23.882 INFO:tasks.workunit.client.1.smithi170.stdout:1/904: creat d3/d24/d2c/d35/d72/f133 x:0 0 0 2024-02-15T22:51:23.882 INFO:tasks.workunit.client.1.smithi170.stdout:5/845: dwrite de/d10/f90 [0,4194304] 0 2024-02-15T22:51:23.883 INFO:tasks.workunit.client.1.smithi170.stdout:0/733: dwrite d8/d6d/fe4 [0,4194304] 0 2024-02-15T22:51:23.883 INFO:tasks.workunit.client.1.smithi170.stdout:2/939: mkdir d0/d1d/d3d/d167 0 2024-02-15T22:51:23.887 INFO:tasks.workunit.client.1.smithi170.stdout:8/618: rename d9/d18/d32/d7a/d78/d7f/d98/d9e to d9/d18/d32/d7a/dcd 0 2024-02-15T22:51:23.888 INFO:tasks.workunit.client.1.smithi170.stdout:1/905: creat d3/d24/d2c/d35/d83/dd8/f134 x:0 0 0 2024-02-15T22:51:23.891 INFO:tasks.workunit.client.1.smithi170.stdout:5/846: unlink de/d29/fde 0 2024-02-15T22:51:23.891 INFO:tasks.workunit.client.1.smithi170.stdout:4/809: rmdir d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb 39 2024-02-15T22:51:23.891 INFO:tasks.workunit.client.1.smithi170.stdout:4/810: chown d0/d22/ce2 352 1 2024-02-15T22:51:23.892 INFO:tasks.workunit.client.1.smithi170.stdout:9/645: dwrite de/d1b/d1c/d1f/d20/d27/d2c/f85 [0,4194304] 0 2024-02-15T22:51:23.892 INFO:tasks.workunit.client.1.smithi170.stdout:0/734: dread d8/df/d13/d22/fde [0,4194304] 0 2024-02-15T22:51:23.897 INFO:tasks.workunit.client.1.smithi170.stdout:2/940: rename d0/f25 to d0/f168 0 2024-02-15T22:51:23.897 INFO:tasks.workunit.client.1.smithi170.stdout:2/941: write d0/d1/d89/dd7/f7a [1038845,60764] 0 2024-02-15T22:51:23.899 INFO:tasks.workunit.client.1.smithi170.stdout:8/619: truncate d9/d18/d26/d4f/f80 4107347 0 2024-02-15T22:51:23.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/847: dread de/d10/da8/fd4 [0,4194304] 0 2024-02-15T22:51:23.902 INFO:tasks.workunit.client.1.smithi170.stdout:4/811: mkdir d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/d10a 0 2024-02-15T22:51:23.908 INFO:tasks.workunit.client.1.smithi170.stdout:0/735: creat d8/d14/d70/d93/dd0/fe6 x:0 0 0 2024-02-15T22:51:23.912 INFO:tasks.workunit.client.1.smithi170.stdout:4/812: read d0/d22/da/d8b/d47/d67/f7a [1959669,66791] 0 2024-02-15T22:51:23.915 INFO:tasks.workunit.client.1.smithi170.stdout:2/942: symlink d0/d2a/daa/d124/l169 0 2024-02-15T22:51:23.916 INFO:tasks.workunit.client.1.smithi170.stdout:5/848: mknod de/d10/d33/d9f/c11e 0 2024-02-15T22:51:23.917 INFO:tasks.workunit.client.1.smithi170.stdout:2/943: dread d0/d1d/f4e [0,4194304] 0 2024-02-15T22:51:23.917 INFO:tasks.workunit.client.1.smithi170.stdout:2/944: stat d0/d1/d53/fcd 0 2024-02-15T22:51:23.918 INFO:tasks.workunit.client.1.smithi170.stdout:0/736: read d8/df/f49 [2141964,117750] 0 2024-02-15T22:51:23.919 INFO:tasks.workunit.client.1.smithi170.stdout:4/813: write d0/d22/da/d8b/d47/d67/d77/fb7 [479839,72307] 0 2024-02-15T22:51:23.921 INFO:tasks.workunit.client.1.smithi170.stdout:0/737: rename d8/df/d13/d22/d6a/d7e/caf to d8/df/d13/d22/d71/ce7 0 2024-02-15T22:51:23.923 INFO:tasks.workunit.client.1.smithi170.stdout:2/945: dread d0/d1/d53/fcd [0,4194304] 0 2024-02-15T22:51:23.925 INFO:tasks.workunit.client.1.smithi170.stdout:4/814: rename d0/d22/da/f29 to d0/d22/da/d8b/d47/d67/f10b 0 2024-02-15T22:51:23.927 INFO:tasks.workunit.client.1.smithi170.stdout:0/738: mknod d8/df/d13/d36/d60/ce8 0 2024-02-15T22:51:23.928 INFO:tasks.workunit.client.1.smithi170.stdout:9/646: dwrite de/d8e/fcc [0,4194304] 0 2024-02-15T22:51:23.929 INFO:tasks.workunit.client.1.smithi170.stdout:2/946: rmdir d0/d13/d59/d105 39 2024-02-15T22:51:23.930 INFO:tasks.workunit.client.1.smithi170.stdout:0/739: getdents d8/d14/d70/d93 0 2024-02-15T22:51:23.931 INFO:tasks.workunit.client.1.smithi170.stdout:2/947: write d0/f168 [785262,85015] 0 2024-02-15T22:51:23.931 INFO:tasks.workunit.client.1.smithi170.stdout:2/948: stat d0/d13/d59 0 2024-02-15T22:51:23.934 INFO:tasks.workunit.client.1.smithi170.stdout:9/647: mknod de/d1b/d1c/d1f/d20/d27/d28/d7a/cd8 0 2024-02-15T22:51:23.935 INFO:tasks.workunit.client.1.smithi170.stdout:4/815: dread d0/d22/da/d8b/d47/dbe/f26 [4194304,4194304] 0 2024-02-15T22:51:23.935 INFO:tasks.workunit.client.1.smithi170.stdout:4/816: truncate d0/d22/da/d8b/d47/d5e/d7d/dd9/fd4 422795 0 2024-02-15T22:51:23.935 INFO:tasks.workunit.client.1.smithi170.stdout:4/817: fsync d0/d22/da/d8b/d47/dbe/da2/fae 0 2024-02-15T22:51:23.936 INFO:tasks.workunit.client.1.smithi170.stdout:9/648: rename de/d1b/d1c/d1f/d20/ca4 to de/d8e/cd9 0 2024-02-15T22:51:23.937 INFO:tasks.workunit.client.1.smithi170.stdout:4/818: getdents d0/d22/da/d8b/d47/d5e 0 2024-02-15T22:51:23.937 INFO:tasks.workunit.client.1.smithi170.stdout:4/819: write d0/d22/da/d8b/d47/dbe/fbb [547678,51833] 0 2024-02-15T22:51:23.940 INFO:tasks.workunit.client.1.smithi170.stdout:9/649: unlink de/d1b/d1c/d1f/d20/d27/d28/d69/f71 0 2024-02-15T22:51:23.940 INFO:tasks.workunit.client.1.smithi170.stdout:5/849: dwrite de/d29/f8f [0,4194304] 0 2024-02-15T22:51:23.941 INFO:tasks.workunit.client.1.smithi170.stdout:4/820: mkdir d0/d22/d10c 0 2024-02-15T22:51:23.944 INFO:tasks.workunit.client.1.smithi170.stdout:9/650: readlink de/d1b/l4b 0 2024-02-15T22:51:23.945 INFO:tasks.workunit.client.1.smithi170.stdout:4/821: readlink d0/d22/da/d8b/d47/d67/d77/dc5/dff/l62 0 2024-02-15T22:51:23.947 INFO:tasks.workunit.client.1.smithi170.stdout:0/740: write d8/df/d13/d36/d60/da2/fa4 [3782426,120162] 0 2024-02-15T22:51:23.947 INFO:tasks.workunit.client.1.smithi170.stdout:0/741: chown d8/d14/d70/fbe 773451328 1 2024-02-15T22:51:23.947 INFO:tasks.workunit.client.1.smithi170.stdout:0/742: truncate d8/d14/d1c/f1e 5171031 0 2024-02-15T22:51:23.947 INFO:tasks.workunit.client.1.smithi170.stdout:8/620: dwrite d9/d18/d32/d3b/d68/fb9 [0,4194304] 0 2024-02-15T22:51:23.947 INFO:tasks.workunit.client.1.smithi170.stdout:9/651: mknod de/d1b/d1c/d1f/d20/d27/d28/d7a/cda 0 2024-02-15T22:51:23.950 INFO:tasks.workunit.client.1.smithi170.stdout:5/850: dread de/d10/d33/d9f/f92 [0,4194304] 0 2024-02-15T22:51:23.956 INFO:tasks.workunit.client.1.smithi170.stdout:8/621: link d9/d18/d32/d3b/d42/f74 d9/d18/d26/d4f/fce 0 2024-02-15T22:51:23.957 INFO:tasks.workunit.client.1.smithi170.stdout:0/743: getdents d8/d14 0 2024-02-15T22:51:23.962 INFO:tasks.workunit.client.1.smithi170.stdout:8/622: symlink d9/d18/d32/db1/lcf 0 2024-02-15T22:51:23.962 INFO:tasks.workunit.client.1.smithi170.stdout:8/623: stat d9/d18/d32/d99 0 2024-02-15T22:51:23.962 INFO:tasks.workunit.client.1.smithi170.stdout:2/949: dwrite d0/d1/d5f/d74/f94 [0,4194304] 0 2024-02-15T22:51:23.972 INFO:tasks.workunit.client.1.smithi170.stdout:0/744: rmdir d8/d14/d70/d93/dd0 39 2024-02-15T22:51:23.974 INFO:tasks.workunit.client.1.smithi170.stdout:8/624: mkdir d9/dd0 0 2024-02-15T22:51:23.974 INFO:tasks.workunit.client.1.smithi170.stdout:8/625: write d9/d18/d48/f5b [5235311,103087] 0 2024-02-15T22:51:23.975 INFO:tasks.workunit.client.1.smithi170.stdout:0/745: symlink d8/df/d13/le9 0 2024-02-15T22:51:23.975 INFO:tasks.workunit.client.1.smithi170.stdout:0/746: fdatasync d8/d14/d70/f8a 0 2024-02-15T22:51:23.975 INFO:tasks.workunit.client.1.smithi170.stdout:0/747: readlink d8/d14/d1c/d3f/d53/l68 0 2024-02-15T22:51:23.977 INFO:tasks.workunit.client.1.smithi170.stdout:8/626: creat d9/d18/d32/d7a/d78/d7f/fd1 x:0 0 0 2024-02-15T22:51:23.977 INFO:tasks.workunit.client.1.smithi170.stdout:8/627: fdatasync d9/d18/d26/f3c 0 2024-02-15T22:51:23.978 INFO:tasks.workunit.client.1.smithi170.stdout:0/748: truncate d8/d14/d44/f4c 105396 0 2024-02-15T22:51:23.978 INFO:tasks.workunit.client.1.smithi170.stdout:9/652: dwrite de/d1b/d1c/d1f/d20/d27/d28/fa2 [0,4194304] 0 2024-02-15T22:51:23.980 INFO:tasks.workunit.client.1.smithi170.stdout:8/628: symlink d9/d18/d32/d3b/ld2 0 2024-02-15T22:51:23.980 INFO:tasks.workunit.client.1.smithi170.stdout:8/629: read d9/d18/d32/d7a/dcd/fa3 [210629,130325] 0 2024-02-15T22:51:23.981 INFO:tasks.workunit.client.1.smithi170.stdout:0/749: symlink d8/d14/d1c/d3f/lea 0 2024-02-15T22:51:23.982 INFO:tasks.workunit.client.1.smithi170.stdout:9/653: chown de/l41 0 1 2024-02-15T22:51:23.983 INFO:tasks.workunit.client.1.smithi170.stdout:8/630: mknod d9/d18/d32/d3b/d42/cd3 0 2024-02-15T22:51:23.984 INFO:tasks.workunit.client.1.smithi170.stdout:4/822: dwrite d0/d22/da/f43 [0,4194304] 0 2024-02-15T22:51:23.984 INFO:tasks.workunit.client.1.smithi170.stdout:4/823: chown d0/d22/da/d8b/d47/d2b/fde 1842 1 2024-02-15T22:51:23.984 INFO:tasks.workunit.client.1.smithi170.stdout:0/750: mkdir d8/d14/d44/de3/deb 0 2024-02-15T22:51:23.985 INFO:tasks.workunit.client.1.smithi170.stdout:2/950: dwrite d0/d1/d89/dd7/d3e/f43 [0,4194304] 0 2024-02-15T22:51:23.985 INFO:tasks.workunit.client.1.smithi170.stdout:5/851: dwrite de/d10/f5b [0,4194304] 0 2024-02-15T22:51:23.986 INFO:tasks.workunit.client.1.smithi170.stdout:8/631: symlink d9/d18/d32/dab/ld4 0 2024-02-15T22:51:23.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/824: symlink d0/d22/da/d8b/d47/da9/l10d 0 2024-02-15T22:51:23.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/825: stat d0/d22/da/d8b/d47/dbe/d89/de8/fdd 0 2024-02-15T22:51:23.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/826: chown d0/d22/da/d8b/d47/dbe/d20/d49/l57 6 1 2024-02-15T22:51:23.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/827: write d0/d22/da/d8b/d47/dbe/f1e [4965918,73904] 0 2024-02-15T22:51:23.989 INFO:tasks.workunit.client.1.smithi170.stdout:4/828: write d0/d22/da/d8b/d47/d2b/fde [978312,69018] 0 2024-02-15T22:51:23.992 INFO:tasks.workunit.client.1.smithi170.stdout:8/632: mkdir d9/d18/d26/dd5 0 2024-02-15T22:51:23.993 INFO:tasks.workunit.client.1.smithi170.stdout:4/829: symlink d0/d22/da/d8b/d47/d67/d77/dc5/dea/l10e 0 2024-02-15T22:51:23.995 INFO:tasks.workunit.client.1.smithi170.stdout:0/751: rename d8/df/d13/f73 to d8/df/d13/d36/fec 0 2024-02-15T22:51:23.995 INFO:tasks.workunit.client.1.smithi170.stdout:0/752: fsync d8/d14/d70/f7a 0 2024-02-15T22:51:23.995 INFO:tasks.workunit.client.1.smithi170.stdout:0/753: fdatasync d8/d14/d1c/f2b 0 2024-02-15T22:51:23.996 INFO:tasks.workunit.client.1.smithi170.stdout:8/633: creat d9/d18/d32/dab/fd6 x:0 0 0 2024-02-15T22:51:23.998 INFO:tasks.workunit.client.1.smithi170.stdout:4/830: creat d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f10f x:0 0 0 2024-02-15T22:51:24.001 INFO:tasks.workunit.client.1.smithi170.stdout:0/754: creat d8/df/d13/d22/d6a/d8f/fed x:0 0 0 2024-02-15T22:51:24.001 INFO:tasks.workunit.client.1.smithi170.stdout:5/852: dread de/d10/d27/d2d/f31 [0,4194304] 0 2024-02-15T22:51:24.001 INFO:tasks.workunit.client.1.smithi170.stdout:0/755: dread - d8/d14/d6f/fca zero size 2024-02-15T22:51:24.002 INFO:tasks.workunit.client.1.smithi170.stdout:5/853: write de/d36/df7/ffb [969465,28340] 0 2024-02-15T22:51:24.002 INFO:tasks.workunit.client.1.smithi170.stdout:5/854: chown de/dec 7 1 2024-02-15T22:51:24.005 INFO:tasks.workunit.client.1.smithi170.stdout:8/634: rename d9/d18/d32/d7a/dcd to d9/db2/dd7 0 2024-02-15T22:51:24.005 INFO:tasks.workunit.client.1.smithi170.stdout:8/635: creat d9/d18/d26/d4f/fd8 x:0 0 0 2024-02-15T22:51:24.005 INFO:tasks.workunit.client.1.smithi170.stdout:8/636: read d9/db2/dd7/fa3 [237007,62986] 0 2024-02-15T22:51:24.008 INFO:tasks.workunit.client.1.smithi170.stdout:2/951: dwrite d0/d1d/fb9 [0,4194304] 0 2024-02-15T22:51:24.010 INFO:tasks.workunit.client.1.smithi170.stdout:5/855: rename de/d10/d27/d2d/d11d/c72 to de/d29/c11f 0 2024-02-15T22:51:24.010 INFO:tasks.workunit.client.1.smithi170.stdout:5/856: chown de/d10/d33/l10f 243424582 1 2024-02-15T22:51:24.013 INFO:tasks.workunit.client.1.smithi170.stdout:0/756: dread d8/df/d13/d36/d60/da2/dcb/fdb [0,4194304] 0 2024-02-15T22:51:24.014 INFO:tasks.workunit.client.1.smithi170.stdout:0/757: write d8/d14/d70/fbe [613959,93873] 0 2024-02-15T22:51:24.016 INFO:tasks.workunit.client.1.smithi170.stdout:0/758: dread d8/d14/d6f/f8d [0,4194304] 0 2024-02-15T22:51:24.017 INFO:tasks.workunit.client.1.smithi170.stdout:2/952: symlink d0/d1/d11/d26/d6e/d10f/df9/d108/d125/l16a 0 2024-02-15T22:51:24.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/831: dwrite d0/d22/da/d8b/d47/dbe/d20/fc4 [0,4194304] 0 2024-02-15T22:51:24.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/832: truncate d0/d9f/fce 689884 0 2024-02-15T22:51:24.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/833: stat d0/d22/da/f61 0 2024-02-15T22:51:24.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/834: write d0/d22/da/d8b/d47/dbe/d20/fca [519455,1545] 0 2024-02-15T22:51:24.021 INFO:tasks.workunit.client.1.smithi170.stdout:5/857: dread de/d10/d27/d4c/d53/d55/d95/fae [0,4194304] 0 2024-02-15T22:51:24.022 INFO:tasks.workunit.client.1.smithi170.stdout:0/759: unlink d8/d14/d1c/d3f/dce/faa 0 2024-02-15T22:51:24.023 INFO:tasks.workunit.client.1.smithi170.stdout:2/953: symlink d0/d1/d5f/d74/d8e/l16b 0 2024-02-15T22:51:24.023 INFO:tasks.workunit.client.1.smithi170.stdout:2/954: fsync d0/d1/d5f/d74/d8e/f110 0 2024-02-15T22:51:24.025 INFO:tasks.workunit.client.1.smithi170.stdout:8/637: dwrite d9/d18/d26/d4f/fce [0,4194304] 0 2024-02-15T22:51:24.032 INFO:tasks.workunit.client.1.smithi170.stdout:5/858: rmdir de 39 2024-02-15T22:51:24.032 INFO:tasks.workunit.client.1.smithi170.stdout:4/835: dread d0/d22/da/d8b/d47/d5e/f69 [0,4194304] 0 2024-02-15T22:51:24.032 INFO:tasks.workunit.client.1.smithi170.stdout:4/836: write d0/f84 [961055,118456] 0 2024-02-15T22:51:24.034 INFO:tasks.workunit.client.1.smithi170.stdout:2/955: rename d0/d1/d89/dd7/d2f/l55 to d0/d1d/d3d/l16c 0 2024-02-15T22:51:24.036 INFO:tasks.workunit.client.1.smithi170.stdout:8/638: rmdir d9 39 2024-02-15T22:51:24.038 INFO:tasks.workunit.client.1.smithi170.stdout:5/859: creat de/d36/df7/f120 x:0 0 0 2024-02-15T22:51:24.039 INFO:tasks.workunit.client.1.smithi170.stdout:5/860: write de/d10/d27/d2d/d11d/f10b [591060,3688] 0 2024-02-15T22:51:24.039 INFO:tasks.workunit.client.1.smithi170.stdout:0/760: dwrite d8/df/d13/d22/d39/f4f [0,4194304] 0 2024-02-15T22:51:24.040 INFO:tasks.workunit.client.1.smithi170.stdout:4/837: mkdir d0/d22/da/d8b/d47/d67/d77/dc5/d110 0 2024-02-15T22:51:24.040 INFO:tasks.workunit.client.1.smithi170.stdout:4/838: write d0/ff1 [661846,39646] 0 2024-02-15T22:51:24.046 INFO:tasks.workunit.client.1.smithi170.stdout:4/839: creat d0/d22/da/d8b/d47/d5e/d79/df4/f111 x:0 0 0 2024-02-15T22:51:24.051 INFO:tasks.workunit.client.1.smithi170.stdout:4/840: unlink d0/d22/da/d8b/d47/d2b/feb 0 2024-02-15T22:51:24.056 INFO:tasks.workunit.client.1.smithi170.stdout:5/861: write de/d29/f8f [3787734,56126] 0 2024-02-15T22:51:24.056 INFO:tasks.workunit.client.1.smithi170.stdout:5/862: fsync de/d10/da8/db6/fd0 0 2024-02-15T22:51:24.058 INFO:tasks.workunit.client.1.smithi170.stdout:4/841: unlink d0/d22/l28 0 2024-02-15T22:51:24.058 INFO:tasks.workunit.client.1.smithi170.stdout:4/842: dread - d0/d22/da/d8b/d47/d5e/d79/df4/f111 zero size 2024-02-15T22:51:24.063 INFO:tasks.workunit.client.1.smithi170.stdout:7/878: sync 2024-02-15T22:51:24.063 INFO:tasks.workunit.client.1.smithi170.stdout:7/879: readlink da/d1a/d21/d2c/d74/d87/dac/l83 0 2024-02-15T22:51:24.063 INFO:tasks.workunit.client.1.smithi170.stdout:0/761: dwrite d8/d14/d6f/f98 [0,4194304] 0 2024-02-15T22:51:24.063 INFO:tasks.workunit.client.1.smithi170.stdout:0/762: write d8/f29 [6934490,39832] 0 2024-02-15T22:51:24.063 INFO:tasks.workunit.client.1.smithi170.stdout:7/880: mknod da/d1a/d21/d2c/c12b 0 2024-02-15T22:51:24.064 INFO:tasks.workunit.client.1.smithi170.stdout:3/792: sync 2024-02-15T22:51:24.067 INFO:tasks.workunit.client.1.smithi170.stdout:0/763: symlink d8/d14/d1c/d3f/d51/lee 0 2024-02-15T22:51:24.069 INFO:tasks.workunit.client.1.smithi170.stdout:7/881: link da/f13 da/d1a/d21/d2c/d71/f12c 0 2024-02-15T22:51:24.071 INFO:tasks.workunit.client.1.smithi170.stdout:4/843: write d0/d22/da/d8b/d47/d5e/ff8 [3304429,41647] 0 2024-02-15T22:51:24.071 INFO:tasks.workunit.client.1.smithi170.stdout:4/844: write d0/d22/da/d8b/d47/f8e [254331,49541] 0 2024-02-15T22:51:24.072 INFO:tasks.workunit.client.1.smithi170.stdout:0/764: creat d8/df/d13/d22/d6a/d7e/fef x:0 0 0 2024-02-15T22:51:24.072 INFO:tasks.workunit.client.1.smithi170.stdout:0/765: getdents d8/d14 0 2024-02-15T22:51:24.074 INFO:tasks.workunit.client.1.smithi170.stdout:7/882: creat da/d1a/d21/d19/f12d x:0 0 0 2024-02-15T22:51:24.074 INFO:tasks.workunit.client.1.smithi170.stdout:7/883: write da/d1a/d21/d1b/f8c [477389,25957] 0 2024-02-15T22:51:24.074 INFO:tasks.workunit.client.1.smithi170.stdout:7/884: write da/d1a/def/fb4 [3582286,88246] 0 2024-02-15T22:51:24.074 INFO:tasks.workunit.client.1.smithi170.stdout:7/885: creat da/f12e x:0 0 0 2024-02-15T22:51:24.075 INFO:tasks.workunit.client.1.smithi170.stdout:7/886: read - da/d1a/d21/d2c/d74/dde/d7d/d72/fd2 zero size 2024-02-15T22:51:24.075 INFO:tasks.workunit.client.1.smithi170.stdout:7/887: dread - da/d1a/d21/d2c/d74/dde/d7d/fee zero size 2024-02-15T22:51:24.075 INFO:tasks.workunit.client.1.smithi170.stdout:4/845: creat d0/d22/da/d101/f112 x:0 0 0 2024-02-15T22:51:24.075 INFO:tasks.workunit.client.1.smithi170.stdout:4/846: write d0/d22/da/d8b/d47/d67/d77/fc0 [4280665,70865] 0 2024-02-15T22:51:24.075 INFO:tasks.workunit.client.1.smithi170.stdout:4/847: creat d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f113 x:0 0 0 2024-02-15T22:51:24.077 INFO:tasks.workunit.client.1.smithi170.stdout:5/863: dwrite de/d10/d7d/fb1 [0,4194304] 0 2024-02-15T22:51:24.080 INFO:tasks.workunit.client.1.smithi170.stdout:7/888: mknod da/d1a/d21/d2c/d2e/d7a/de2/c12f 0 2024-02-15T22:51:24.085 INFO:tasks.workunit.client.1.smithi170.stdout:4/848: link d0/d22/da/d8b/d47/dbe/fac d0/d22/da/d8b/f114 0 2024-02-15T22:51:24.091 INFO:tasks.workunit.client.1.smithi170.stdout:5/864: mkdir de/d10/d27/d2d/d121 0 2024-02-15T22:51:24.091 INFO:tasks.workunit.client.1.smithi170.stdout:5/865: fdatasync de/d10/d27/d2d/d11d/f93 0 2024-02-15T22:51:24.093 INFO:tasks.workunit.client.1.smithi170.stdout:7/889: symlink da/d1a/d21/d19/l130 0 2024-02-15T22:51:24.093 INFO:tasks.workunit.client.1.smithi170.stdout:7/890: write da/d1a/d21/d2c/d71/f75 [1852655,91080] 0 2024-02-15T22:51:24.093 INFO:tasks.workunit.client.1.smithi170.stdout:7/891: chown da/d1a/d21/d2c/d2e/f35 30823 1 2024-02-15T22:51:24.093 INFO:tasks.workunit.client.1.smithi170.stdout:7/892: creat da/d1a/def/d8d/f131 x:0 0 0 2024-02-15T22:51:24.096 INFO:tasks.workunit.client.1.smithi170.stdout:5/866: creat de/d36/d80/d117/f122 x:0 0 0 2024-02-15T22:51:24.100 INFO:tasks.workunit.client.1.smithi170.stdout:3/793: dwrite d3/f3f [4194304,4194304] 0 2024-02-15T22:51:24.102 INFO:tasks.workunit.client.1.smithi170.stdout:0/766: dwrite d8/df/d13/f2e [0,4194304] 0 2024-02-15T22:51:24.102 INFO:tasks.workunit.client.1.smithi170.stdout:0/767: chown d8/df/d13/d22/d39/d55/c57 0 1 2024-02-15T22:51:24.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/867: mkdir de/d10/d7d/db8/dbc/d123 0 2024-02-15T22:51:24.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/868: write de/d10/d7d/db8/d10a/fe8 [146276,69729] 0 2024-02-15T22:51:24.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/869: creat de/d36/df7/f124 x:0 0 0 2024-02-15T22:51:24.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/870: fdatasync de/f11 0 2024-02-15T22:51:24.103 INFO:tasks.workunit.client.1.smithi170.stdout:5/871: read de/d10/d7d/db8/d10a/f113 [2900600,10324] 0 2024-02-15T22:51:24.104 INFO:tasks.workunit.client.1.smithi170.stdout:7/893: dread da/d1a/d21/d2c/d2e/d7a/de2/de5/f116 [0,4194304] 0 2024-02-15T22:51:24.107 INFO:tasks.workunit.client.1.smithi170.stdout:3/794: creat d3/dc/d13/f10d x:0 0 0 2024-02-15T22:51:24.108 INFO:tasks.workunit.client.1.smithi170.stdout:0/768: mknod d8/d14/d6f/cf0 0 2024-02-15T22:51:24.112 INFO:tasks.workunit.client.1.smithi170.stdout:0/769: dread d8/df/d13/f1f [0,4194304] 0 2024-02-15T22:51:24.112 INFO:tasks.workunit.client.1.smithi170.stdout:0/770: creat d8/d14/d1c/d3f/d51/ff1 x:0 0 0 2024-02-15T22:51:24.115 INFO:tasks.workunit.client.1.smithi170.stdout:7/894: symlink da/d1a/d21/d4d/d6e/de8/l132 0 2024-02-15T22:51:24.117 INFO:tasks.workunit.client.1.smithi170.stdout:3/795: creat d3/db/d1f/f10e x:0 0 0 2024-02-15T22:51:24.117 INFO:tasks.workunit.client.1.smithi170.stdout:5/872: dwrite de/d10/d33/d9f/f92 [0,4194304] 0 2024-02-15T22:51:24.120 INFO:tasks.workunit.client.1.smithi170.stdout:7/895: rename da/d1a/d21/d2c/d74/dde/d7d/d113/f11a to da/f133 0 2024-02-15T22:51:24.124 INFO:tasks.workunit.client.1.smithi170.stdout:3/796: mknod d3/dc/d1a/d9f/dec/c10f 0 2024-02-15T22:51:24.128 INFO:tasks.workunit.client.1.smithi170.stdout:7/896: dread da/d57/f7b [0,4194304] 0 2024-02-15T22:51:24.139 INFO:tasks.workunit.client.1.smithi170.stdout:0/771: dwrite d8/df/d13/f42 [0,4194304] 0 2024-02-15T22:51:24.141 INFO:tasks.workunit.client.1.smithi170.stdout:0/772: mknod d8/df/d13/d22/d6a/cf2 0 2024-02-15T22:51:24.141 INFO:tasks.workunit.client.1.smithi170.stdout:7/897: write da/d1a/def/d8d/fb5 [2473711,54663] 0 2024-02-15T22:51:24.142 INFO:tasks.workunit.client.1.smithi170.stdout:0/773: link d8/d14/d70/fbe d8/d14/d1c/d3f/d51/dd6/ff3 0 2024-02-15T22:51:24.143 INFO:tasks.workunit.client.1.smithi170.stdout:0/774: rename d8/df/d13/d22/l9c to d8/d14/d1c/d3f/lf4 0 2024-02-15T22:51:24.143 INFO:tasks.workunit.client.1.smithi170.stdout:0/775: chown d8/d14/d1c/l62 6 1 2024-02-15T22:51:24.144 INFO:tasks.workunit.client.1.smithi170.stdout:0/776: mkdir d8/d14/d44/df5 0 2024-02-15T22:51:24.149 INFO:tasks.workunit.client.1.smithi170.stdout:7/898: dread da/d1a/d21/d2c/d74/d87/dac/fb9 [0,4194304] 0 2024-02-15T22:51:24.149 INFO:tasks.workunit.client.1.smithi170.stdout:5/873: dwrite de/d10/f5b [0,4194304] 0 2024-02-15T22:51:24.151 INFO:tasks.workunit.client.1.smithi170.stdout:7/899: creat da/d1a/d21/d2c/d74/f134 x:0 0 0 2024-02-15T22:51:24.151 INFO:tasks.workunit.client.1.smithi170.stdout:3/797: dwrite d3/db/fa8 [0,4194304] 0 2024-02-15T22:51:24.153 INFO:tasks.workunit.client.1.smithi170.stdout:7/900: dread da/d1a/fbf [0,4194304] 0 2024-02-15T22:51:24.154 INFO:tasks.workunit.client.1.smithi170.stdout:3/798: dread d3/d78/d7a/fc0 [0,4194304] 0 2024-02-15T22:51:24.154 INFO:tasks.workunit.client.1.smithi170.stdout:7/901: rmdir da/d1a/d21/d2c/d2e/d7a/de2 39 2024-02-15T22:51:24.155 INFO:tasks.workunit.client.1.smithi170.stdout:3/799: stat d3/db/c79 0 2024-02-15T22:51:24.162 INFO:tasks.workunit.client.1.smithi170.stdout:7/902: dread da/d1a/d21/d2c/d74/f102 [0,4194304] 0 2024-02-15T22:51:24.163 INFO:tasks.workunit.client.1.smithi170.stdout:7/903: chown da/d1a/d21/d2c/c5a 75 1 2024-02-15T22:51:24.168 INFO:tasks.workunit.client.1.smithi170.stdout:0/777: dwrite d8/d14/f76 [0,4194304] 0 2024-02-15T22:51:24.168 INFO:tasks.workunit.client.1.smithi170.stdout:5/874: dread f7 [0,4194304] 0 2024-02-15T22:51:24.168 INFO:tasks.workunit.client.1.smithi170.stdout:5/875: creat de/d29/f125 x:0 0 0 2024-02-15T22:51:24.169 INFO:tasks.workunit.client.1.smithi170.stdout:5/876: write de/d10/d27/f4f [173120,11641] 0 2024-02-15T22:51:24.169 INFO:tasks.workunit.client.1.smithi170.stdout:5/877: readlink de/d10/d27/d2d/lb9 0 2024-02-15T22:51:24.169 INFO:tasks.workunit.client.1.smithi170.stdout:5/878: chown de/d36/df7/f124 325 1 2024-02-15T22:51:24.169 INFO:tasks.workunit.client.1.smithi170.stdout:0/778: truncate d8/df/d13/d36/d60/da2/fa4 6507507 0 2024-02-15T22:51:24.169 INFO:tasks.workunit.client.1.smithi170.stdout:0/779: chown d8/d14/d1c/d3f/d51/de1 18266 1 2024-02-15T22:51:24.171 INFO:tasks.workunit.client.1.smithi170.stdout:3/800: dread d3/dc/d1c/f48 [0,4194304] 0 2024-02-15T22:51:24.171 INFO:tasks.workunit.client.1.smithi170.stdout:7/904: dread da/d1a/d21/fae [0,4194304] 0 2024-02-15T22:51:24.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/905: link da/d1a/d21/d2c/d74/dde/dc7/le0 da/d1a/d21/d2c/d2e/l135 0 2024-02-15T22:51:24.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/906: stat da/d1a/d21/d19/l130 0 2024-02-15T22:51:24.174 INFO:tasks.workunit.client.1.smithi170.stdout:7/907: truncate da/d1a/d21/d2c/d71/ddc/ff9 1783882 0 2024-02-15T22:51:24.179 INFO:tasks.workunit.client.1.smithi170.stdout:0/780: write d8/d14/d1c/f1e [1224230,91699] 0 2024-02-15T22:51:24.182 INFO:tasks.workunit.client.1.smithi170.stdout:7/908: rmdir da/d1a/d21/d2c/d2e 39 2024-02-15T22:51:24.182 INFO:tasks.workunit.client.1.smithi170.stdout:3/801: read d3/f72 [1798413,6575] 0 2024-02-15T22:51:24.185 INFO:tasks.workunit.client.1.smithi170.stdout:3/802: getdents d3/db 0 2024-02-15T22:51:24.185 INFO:tasks.workunit.client.1.smithi170.stdout:3/803: creat d3/d1b/d8a/dcc/f110 x:0 0 0 2024-02-15T22:51:24.188 INFO:tasks.workunit.client.1.smithi170.stdout:3/804: rename d3/dc/f17 to d3/dc/d1a/d9f/dcb/de7/f111 0 2024-02-15T22:51:24.188 INFO:tasks.workunit.client.1.smithi170.stdout:3/805: dread - d3/dc/d1c/d26/ffd zero size 2024-02-15T22:51:24.189 INFO:tasks.workunit.client.1.smithi170.stdout:3/806: write d3/db/d1f/d61/dd7/fdf [647310,109610] 0 2024-02-15T22:51:24.189 INFO:tasks.workunit.client.1.smithi170.stdout:5/879: dwrite de/d10/d27/d2d/f91 [0,4194304] 0 2024-02-15T22:51:24.190 INFO:tasks.workunit.client.1.smithi170.stdout:0/781: write d8/d14/f16 [2052264,7626] 0 2024-02-15T22:51:24.197 INFO:tasks.workunit.client.1.smithi170.stdout:5/880: symlink de/d10/d7d/df6/l126 0 2024-02-15T22:51:24.198 INFO:tasks.workunit.client.1.smithi170.stdout:5/881: truncate de/d36/f119 373891 0 2024-02-15T22:51:24.211 INFO:tasks.workunit.client.1.smithi170.stdout:5/882: read de/d10/d27/f54 [175078,127371] 0 2024-02-15T22:51:24.212 INFO:tasks.workunit.client.1.smithi170.stdout:7/909: dwrite da/d1a/d21/d2c/d2e/fad [0,4194304] 0 2024-02-15T22:51:24.213 INFO:tasks.workunit.client.1.smithi170.stdout:7/910: unlink da/d1a/d21/d2c/d2e/cd7 0 2024-02-15T22:51:24.214 INFO:tasks.workunit.client.1.smithi170.stdout:0/782: dwrite d8/df/d13/d22/d39/f4f [0,4194304] 0 2024-02-15T22:51:24.214 INFO:tasks.workunit.client.1.smithi170.stdout:7/911: mkdir da/d1a/d21/d2c/d74/dde/d9e/d136 0 2024-02-15T22:51:24.216 INFO:tasks.workunit.client.1.smithi170.stdout:7/912: creat da/d1a/d21/d2c/d2e/d7a/de2/de5/d124/f137 x:0 0 0 2024-02-15T22:51:24.216 INFO:tasks.workunit.client.1.smithi170.stdout:7/913: chown da/l37 434658 1 2024-02-15T22:51:24.216 INFO:tasks.workunit.client.1.smithi170.stdout:7/914: rename da/d1a/d21/d2c/d71 to da/d1a/d21/d2c/d71/d138 22 2024-02-15T22:51:24.217 INFO:tasks.workunit.client.1.smithi170.stdout:3/807: dwrite d3/d1b/d2c/f77 [0,4194304] 0 2024-02-15T22:51:24.218 INFO:tasks.workunit.client.1.smithi170.stdout:3/808: write d3/dcd/dcf/da9/fc3 [341940,66088] 0 2024-02-15T22:51:24.222 INFO:tasks.workunit.client.1.smithi170.stdout:3/809: symlink d3/dc/d1c/d26/d55/d7d/df0/l112 0 2024-02-15T22:51:24.228 INFO:tasks.workunit.client.1.smithi170.stdout:7/915: dread da/d1a/f27 [0,4194304] 0 2024-02-15T22:51:24.230 INFO:tasks.workunit.client.1.smithi170.stdout:7/916: unlink da/d1a/d21/d2c/d74/dde/ce9 0 2024-02-15T22:51:24.231 INFO:tasks.workunit.client.1.smithi170.stdout:7/917: getdents da/d1a/d21/d2c/d2e/d7a/de2 0 2024-02-15T22:51:24.231 INFO:tasks.workunit.client.1.smithi170.stdout:7/918: creat da/d1a/d21/d2c/f139 x:0 0 0 2024-02-15T22:51:24.231 INFO:tasks.workunit.client.1.smithi170.stdout:7/919: write da/d1a/d21/d2c/d2e/d7a/fbb [1308561,32562] 0 2024-02-15T22:51:24.231 INFO:tasks.workunit.client.1.smithi170.stdout:7/920: read - da/d1a/d21/d2c/d74/f134 zero size 2024-02-15T22:51:24.232 INFO:tasks.workunit.client.1.smithi170.stdout:7/921: symlink da/d1a/d21/d2c/d74/d87/d9b/l13a 0 2024-02-15T22:51:24.235 INFO:tasks.workunit.client.1.smithi170.stdout:5/883: dwrite de/d36/d80/fc3 [0,4194304] 0 2024-02-15T22:51:24.237 INFO:tasks.workunit.client.1.smithi170.stdout:0/783: dwrite d8/d14/d1c/d3f/dce/dd5/fd7 [4194304,4194304] 0 2024-02-15T22:51:24.238 INFO:tasks.workunit.client.1.smithi170.stdout:3/810: dwrite d3/db/f35 [4194304,4194304] 0 2024-02-15T22:51:24.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/884: rename de/d29/fb5 to de/d10/d33/f127 0 2024-02-15T22:51:24.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/885: dread - de/d29/f125 zero size 2024-02-15T22:51:24.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/886: write de/d10/d33/d67/fa0 [445457,78325] 0 2024-02-15T22:51:24.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/887: fsync f0 0 2024-02-15T22:51:24.239 INFO:tasks.workunit.client.1.smithi170.stdout:5/888: readlink de/d10/d27/d2d/lb9 0 2024-02-15T22:51:24.240 INFO:tasks.workunit.client.1.smithi170.stdout:0/784: creat d8/d14/d70/d93/ff6 x:0 0 0 2024-02-15T22:51:24.245 INFO:tasks.workunit.client.1.smithi170.stdout:3/811: rmdir d3/d1b/d2c/d9a 39 2024-02-15T22:51:24.247 INFO:tasks.workunit.client.1.smithi170.stdout:5/889: rename de/d10/d7d/db8/fd5 to de/d10/d33/d67/d11c/f128 0 2024-02-15T22:51:24.249 INFO:tasks.workunit.client.1.smithi170.stdout:0/785: creat d8/d14/d44/ff7 x:0 0 0 2024-02-15T22:51:24.249 INFO:tasks.workunit.client.1.smithi170.stdout:0/786: readlink d8/df/d13/d36/d60/da2/dcb/ld9 0 2024-02-15T22:51:24.250 INFO:tasks.workunit.client.1.smithi170.stdout:3/812: creat d3/d1b/d2c/d92/f113 x:0 0 0 2024-02-15T22:51:24.251 INFO:tasks.workunit.client.1.smithi170.stdout:5/890: mknod de/d10/d27/d4c/d53/d55/c129 0 2024-02-15T22:51:24.251 INFO:tasks.workunit.client.1.smithi170.stdout:5/891: fdatasync de/d36/f5e 0 2024-02-15T22:51:24.252 INFO:tasks.workunit.client.1.smithi170.stdout:0/787: creat d8/d6d/dda/de5/ff8 x:0 0 0 2024-02-15T22:51:24.255 INFO:tasks.workunit.client.1.smithi170.stdout:3/813: getdents d3/d1b/d51/d6b/d86 0 2024-02-15T22:51:24.255 INFO:tasks.workunit.client.1.smithi170.stdout:0/788: rmdir d8/d14/d1c/d3f/dce 39 2024-02-15T22:51:24.256 INFO:tasks.workunit.client.1.smithi170.stdout:1/906: sync 2024-02-15T22:51:24.256 INFO:tasks.workunit.client.1.smithi170.stdout:6/786: sync 2024-02-15T22:51:24.256 INFO:tasks.workunit.client.1.smithi170.stdout:0/789: mkdir d8/d14/d1c/d3f/d53/df9 0 2024-02-15T22:51:24.257 INFO:tasks.workunit.client.1.smithi170.stdout:0/790: chown d8/df/d13/f85 4 1 2024-02-15T22:51:24.257 INFO:tasks.workunit.client.1.smithi170.stdout:0/791: creat d8/d14/d70/ffa x:0 0 0 2024-02-15T22:51:24.260 INFO:tasks.workunit.client.1.smithi170.stdout:6/787: creat d3/d1d/d27/f115 x:0 0 0 2024-02-15T22:51:24.260 INFO:tasks.workunit.client.1.smithi170.stdout:6/788: write d3/d24/ffe [584562,76596] 0 2024-02-15T22:51:24.264 INFO:tasks.workunit.client.1.smithi170.stdout:5/892: dread de/d10/f10e [0,4194304] 0 2024-02-15T22:51:24.264 INFO:tasks.workunit.client.1.smithi170.stdout:5/893: chown de/d29/l83 23424957 1 2024-02-15T22:51:24.264 INFO:tasks.workunit.client.1.smithi170.stdout:5/894: getdents de/d10/da8/db6 0 2024-02-15T22:51:24.265 INFO:tasks.workunit.client.1.smithi170.stdout:1/907: unlink d3/fb1 0 2024-02-15T22:51:24.265 INFO:tasks.workunit.client.1.smithi170.stdout:1/908: chown d3/da2/d65 7 1 2024-02-15T22:51:24.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/789: mknod d3/d1d/d36/d56/daf/dd5/c116 0 2024-02-15T22:51:24.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/790: truncate d3/d1d/d28/fad 356581 0 2024-02-15T22:51:24.272 INFO:tasks.workunit.client.1.smithi170.stdout:6/791: symlink d3/d1d/d36/d56/daf/dd5/df0/d105/l117 0 2024-02-15T22:51:24.277 INFO:tasks.workunit.client.1.smithi170.stdout:3/814: dwrite d3/dc/d1c/d26/f100 [0,4194304] 0 2024-02-15T22:51:24.277 INFO:tasks.workunit.client.1.smithi170.stdout:3/815: chown d3/f42 0 1 2024-02-15T22:51:24.277 INFO:tasks.workunit.client.1.smithi170.stdout:0/792: dwrite f1 [4194304,4194304] 0 2024-02-15T22:51:24.286 INFO:tasks.workunit.client.1.smithi170.stdout:0/793: truncate d8/df/d13/d22/d6a/fb3 665980 0 2024-02-15T22:51:24.287 INFO:tasks.workunit.client.1.smithi170.stdout:0/794: mkdir d8/df/d13/d22/d39/dfb 0 2024-02-15T22:51:24.290 INFO:tasks.workunit.client.1.smithi170.stdout:1/909: dwrite d3/d24/d2c/d35/f81 [0,4194304] 0 2024-02-15T22:51:24.292 INFO:tasks.workunit.client.1.smithi170.stdout:1/910: creat d3/d24/d2c/d77/d110/d118/d130/f135 x:0 0 0 2024-02-15T22:51:24.294 INFO:tasks.workunit.client.1.smithi170.stdout:5/895: dwrite de/d10/d27/fea [0,4194304] 0 2024-02-15T22:51:24.296 INFO:tasks.workunit.client.1.smithi170.stdout:3/816: dwrite d3/d1b/d8a/faa [0,4194304] 0 2024-02-15T22:51:24.296 INFO:tasks.workunit.client.1.smithi170.stdout:5/896: truncate de/d10/d7d/fb1 413271 0 2024-02-15T22:51:24.300 INFO:tasks.workunit.client.1.smithi170.stdout:5/897: rmdir de/d10/da8/db6 39 2024-02-15T22:51:24.300 INFO:tasks.workunit.client.1.smithi170.stdout:5/898: fdatasync de/d10/d33/d9f/f69 0 2024-02-15T22:51:24.300 INFO:tasks.workunit.client.1.smithi170.stdout:5/899: write de/d36/df7/f124 [131521,39335] 0 2024-02-15T22:51:24.300 INFO:tasks.workunit.client.1.smithi170.stdout:3/817: dread d3/dc/d1a/d9f/dcb/de7/f111 [0,4194304] 0 2024-02-15T22:51:24.301 INFO:tasks.workunit.client.1.smithi170.stdout:3/818: truncate d3/d78/faf 136241 0 2024-02-15T22:51:24.301 INFO:tasks.workunit.client.1.smithi170.stdout:5/900: unlink de/f11 0 2024-02-15T22:51:24.303 INFO:tasks.workunit.client.1.smithi170.stdout:3/819: symlink d3/dc/d1a/d9f/dcb/de7/l114 0 2024-02-15T22:51:24.303 INFO:tasks.workunit.client.1.smithi170.stdout:3/820: chown d3/dc/lee 7589430 1 2024-02-15T22:51:24.305 INFO:tasks.workunit.client.1.smithi170.stdout:3/821: stat d3/d1b/f74 0 2024-02-15T22:51:24.305 INFO:tasks.workunit.client.1.smithi170.stdout:0/795: dwrite d8/df/d13/d22/fcc [0,4194304] 0 2024-02-15T22:51:24.305 INFO:tasks.workunit.client.1.smithi170.stdout:0/796: chown d8/d14/d70/fbe 0 1 2024-02-15T22:51:24.305 INFO:tasks.workunit.client.1.smithi170.stdout:0/797: chown d8/d14/d1c/lb1 49817 1 2024-02-15T22:51:24.305 INFO:tasks.workunit.client.1.smithi170.stdout:0/798: chown d8/df/d13/f5c 3 1 2024-02-15T22:51:24.306 INFO:tasks.workunit.client.1.smithi170.stdout:0/799: chown d8/d6d/dda 1056 1 2024-02-15T22:51:24.306 INFO:tasks.workunit.client.1.smithi170.stdout:0/800: readlink d8/df/l2c 0 2024-02-15T22:51:24.307 INFO:tasks.workunit.client.1.smithi170.stdout:3/822: symlink d3/d78/d7a/l115 0 2024-02-15T22:51:24.307 INFO:tasks.workunit.client.1.smithi170.stdout:1/911: dwrite d3/d24/d2c/d35/fe3 [0,4194304] 0 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:1/912: chown d3/f1f 0 1 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:3/823: creat d3/dc/f116 x:0 0 0 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:1/913: dread - d3/da2/d65/fb5 zero size 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:1/914: fdatasync d3/d24/d2c/d5e/f8a 0 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:3/824: fdatasync d3/dc/d1c/d26/d55/d7d/df0/ff1 0 2024-02-15T22:51:24.308 INFO:tasks.workunit.client.1.smithi170.stdout:1/915: write d3/da2/f101 [346258,87264] 0 2024-02-15T22:51:24.311 INFO:tasks.workunit.client.1.smithi170.stdout:0/801: link d8/df/d13/d22/d39/cb6 d8/d14/d70/d93/dd0/cfc 0 2024-02-15T22:51:24.313 INFO:tasks.workunit.client.1.smithi170.stdout:3/825: link d3/d1b/d51/d94/fb7 d3/d1b/d51/d6b/d86/f117 0 2024-02-15T22:51:24.315 INFO:tasks.workunit.client.1.smithi170.stdout:1/916: write d3/d24/d2c/d35/f81 [609970,112725] 0 2024-02-15T22:51:24.315 INFO:tasks.workunit.client.1.smithi170.stdout:0/802: mkdir d8/d14/d44/de3/dfd 0 2024-02-15T22:51:24.316 INFO:tasks.workunit.client.1.smithi170.stdout:5/901: dwrite de/d10/da8/fd4 [0,4194304] 0 2024-02-15T22:51:24.327 INFO:tasks.workunit.client.1.smithi170.stdout:5/902: write f1 [789223,53868] 0 2024-02-15T22:51:24.330 INFO:tasks.workunit.client.1.smithi170.stdout:5/903: creat de/d10/d7d/df6/f12a x:0 0 0 2024-02-15T22:51:24.330 INFO:tasks.workunit.client.1.smithi170.stdout:5/904: dread - de/dec/f105 zero size 2024-02-15T22:51:24.331 INFO:tasks.workunit.client.1.smithi170.stdout:5/905: write de/d10/d27/d4c/d53/f63 [4493810,69565] 0 2024-02-15T22:51:24.332 INFO:tasks.workunit.client.1.smithi170.stdout:5/906: creat de/d10/d27/d4c/d53/f12b x:0 0 0 2024-02-15T22:51:24.332 INFO:tasks.workunit.client.1.smithi170.stdout:5/907: chown de/d10/lb4 5 1 2024-02-15T22:51:24.333 INFO:tasks.workunit.client.1.smithi170.stdout:5/908: creat de/d10/d27/d2d/d11d/f12c x:0 0 0 2024-02-15T22:51:24.348 INFO:tasks.workunit.client.1.smithi170.stdout:3/826: dwrite d3/d1b/d2c/fca [0,4194304] 0 2024-02-15T22:51:24.348 INFO:tasks.workunit.client.1.smithi170.stdout:0/803: dwrite d8/d14/d1c/d3f/f58 [4194304,4194304] 0 2024-02-15T22:51:24.348 INFO:tasks.workunit.client.1.smithi170.stdout:1/917: dwrite d3/d24/d2c/d35/f48 [0,4194304] 0 2024-02-15T22:51:24.351 INFO:tasks.workunit.client.1.smithi170.stdout:0/804: mkdir d8/d6d/dda/de5/dfe 0 2024-02-15T22:51:24.351 INFO:tasks.workunit.client.1.smithi170.stdout:0/805: creat d8/df/d13/d22/d6a/fff x:0 0 0 2024-02-15T22:51:24.357 INFO:tasks.workunit.client.1.smithi170.stdout:1/918: creat d3/d24/d2c/d77/d110/f136 x:0 0 0 2024-02-15T22:51:24.365 INFO:tasks.workunit.client.1.smithi170.stdout:1/919: mknod d3/d24/d2c/d35/d12c/c137 0 2024-02-15T22:51:24.365 INFO:tasks.workunit.client.1.smithi170.stdout:3/827: dwrite d3/dc/d1c/f83 [0,4194304] 0 2024-02-15T22:51:24.365 INFO:tasks.workunit.client.1.smithi170.stdout:0/806: dwrite d8/df/d13/d22/d6a/d7e/fef [0,4194304] 0 2024-02-15T22:51:24.367 INFO:tasks.workunit.client.1.smithi170.stdout:1/920: getdents d3/d24/d2c/d35/d83/dd8 0 2024-02-15T22:51:24.367 INFO:tasks.workunit.client.1.smithi170.stdout:1/921: fsync d3/da2/f50 0 2024-02-15T22:51:24.367 INFO:tasks.workunit.client.1.smithi170.stdout:1/922: dread - d3/d24/d2c/d35/d72/d92/d123/f10e zero size 2024-02-15T22:51:24.367 INFO:tasks.workunit.client.1.smithi170.stdout:1/923: write d3/d24/d2c/d35/d83/fee [1472047,77000] 0 2024-02-15T22:51:24.369 INFO:tasks.workunit.client.1.smithi170.stdout:3/828: mknod d3/dc/d1c/d26/d55/d7d/c118 0 2024-02-15T22:51:24.385 INFO:tasks.workunit.client.1.smithi170.stdout:0/807: dwrite d8/d14/d1c/d3f/d53/fd3 [4194304,4194304] 0 2024-02-15T22:51:24.385 INFO:tasks.workunit.client.1.smithi170.stdout:0/808: fdatasync d8/df/d13/d22/f7c 0 2024-02-15T22:51:24.385 INFO:tasks.workunit.client.1.smithi170.stdout:3/829: dwrite d3/d1b/d2c/fb9 [0,4194304] 0 2024-02-15T22:51:24.387 INFO:tasks.workunit.client.1.smithi170.stdout:0/809: rename d8/d14/d1c/d3f/d51/ff1 to d8/df/d13/d22/d6a/d8f/f100 0 2024-02-15T22:51:24.389 INFO:tasks.workunit.client.1.smithi170.stdout:3/830: mkdir d3/dcd/dcf/d119 0 2024-02-15T22:51:24.390 INFO:tasks.workunit.client.1.smithi170.stdout:3/831: write d3/d78/d7a/fc0 [1972199,109349] 0 2024-02-15T22:51:24.391 INFO:tasks.workunit.client.1.smithi170.stdout:3/832: link d3/d1b/d2c/d92/da5/fb4 d3/dc/d1a/f11a 0 2024-02-15T22:51:24.391 INFO:tasks.workunit.client.1.smithi170.stdout:3/833: write d3/db/d1f/d61/dd7/fdf [1125977,112455] 0 2024-02-15T22:51:24.392 INFO:tasks.workunit.client.1.smithi170.stdout:3/834: dread d3/d1b/d8a/fd8 [0,4194304] 0 2024-02-15T22:51:24.392 INFO:tasks.workunit.client.1.smithi170.stdout:0/810: dread d8/d14/d1c/d3f/dce/f9a [0,4194304] 0 2024-02-15T22:51:24.393 INFO:tasks.workunit.client.1.smithi170.stdout:0/811: chown d8/d14/d1c/c92 412716 1 2024-02-15T22:51:24.395 INFO:tasks.workunit.client.1.smithi170.stdout:0/812: mknod d8/d14/d1c/d3f/d51/c101 0 2024-02-15T22:51:24.396 INFO:tasks.workunit.client.1.smithi170.stdout:3/835: rename d3/d1b/fb5 to d3/dc/d1c/d26/d55/d7d/f11b 0 2024-02-15T22:51:24.399 INFO:tasks.workunit.client.1.smithi170.stdout:0/813: rename d8/df/d13/d36/d60/da2/dcb/ld9 to d8/d14/d1c/d3f/d51/de1/l102 0 2024-02-15T22:51:24.399 INFO:tasks.workunit.client.1.smithi170.stdout:0/814: stat d8/d14/d1c/d3f/d53/fd3 0 2024-02-15T22:51:24.399 INFO:tasks.workunit.client.1.smithi170.stdout:0/815: creat d8/d14/d44/f103 x:0 0 0 2024-02-15T22:51:24.400 INFO:tasks.workunit.client.1.smithi170.stdout:3/836: mkdir d3/d1b/d8a/df8/d11c 0 2024-02-15T22:51:24.400 INFO:tasks.workunit.client.1.smithi170.stdout:3/837: truncate d3/db/d1f/d61/dad/f102 640497 0 2024-02-15T22:51:24.400 INFO:tasks.workunit.client.1.smithi170.stdout:0/816: rmdir d8/d14/d1c/d3f/d51/de1 39 2024-02-15T22:51:24.402 INFO:tasks.workunit.client.1.smithi170.stdout:0/817: getdents d8/df/d13/d22/d6a/d8f 0 2024-02-15T22:51:24.405 INFO:tasks.workunit.client.1.smithi170.stdout:3/838: dread d3/dc/d1c/f48 [0,4194304] 0 2024-02-15T22:51:24.406 INFO:tasks.workunit.client.1.smithi170.stdout:3/839: mknod d3/dcd/dcf/c11d 0 2024-02-15T22:51:24.406 INFO:tasks.workunit.client.1.smithi170.stdout:3/840: write d3/db/d1f/d61/fbe [627700,36204] 0 2024-02-15T22:51:24.407 INFO:tasks.workunit.client.1.smithi170.stdout:3/841: symlink d3/dcd/dcf/d119/l11e 0 2024-02-15T22:51:24.408 INFO:tasks.workunit.client.1.smithi170.stdout:3/842: chown d3/d1b/c68 4019374 1 2024-02-15T22:51:24.409 INFO:tasks.workunit.client.1.smithi170.stdout:0/818: dread d8/f94 [0,4194304] 0 2024-02-15T22:51:24.411 INFO:tasks.workunit.client.1.smithi170.stdout:3/843: rename d3/d1b/d2c/f4b to d3/d1b/d8a/df8/f11f 0 2024-02-15T22:51:24.412 INFO:tasks.workunit.client.1.smithi170.stdout:0/819: symlink d8/d6d/dda/de5/dfe/l104 0 2024-02-15T22:51:24.413 INFO:tasks.workunit.client.1.smithi170.stdout:0/820: creat d8/f105 x:0 0 0 2024-02-15T22:51:24.414 INFO:tasks.workunit.client.1.smithi170.stdout:0/821: creat d8/d14/d44/de3/dfd/f106 x:0 0 0 2024-02-15T22:51:24.414 INFO:tasks.workunit.client.1.smithi170.stdout:0/822: stat d8/df/d13/c5e 0 2024-02-15T22:51:24.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/844: dwrite d3/dc/d13/f10d [0,4194304] 0 2024-02-15T22:51:24.444 INFO:tasks.workunit.client.1.smithi170.stdout:0/823: dwrite f5 [0,4194304] 0 2024-02-15T22:51:24.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/845: readlink d3/d1b/d2c/l6d 0 2024-02-15T22:51:24.444 INFO:tasks.workunit.client.1.smithi170.stdout:3/846: creat d3/dc/d1a/d9f/f120 x:0 0 0 2024-02-15T22:51:24.444 INFO:tasks.workunit.client.1.smithi170.stdout:0/824: write d8/d14/d1c/f2b [3407792,112119] 0 2024-02-15T22:51:24.445 INFO:tasks.workunit.client.1.smithi170.stdout:3/847: dread d3/dc/d1c/f73 [0,4194304] 0 2024-02-15T22:51:24.446 INFO:tasks.workunit.client.1.smithi170.stdout:0/825: getdents d8/d6d/dda 0 2024-02-15T22:51:24.448 INFO:tasks.workunit.client.1.smithi170.stdout:3/848: creat d3/dcd/dcf/d119/f121 x:0 0 0 2024-02-15T22:51:24.449 INFO:tasks.workunit.client.1.smithi170.stdout:0/826: link d8/d14/d6f/f88 d8/d6d/d96/f107 0 2024-02-15T22:51:24.450 INFO:tasks.workunit.client.1.smithi170.stdout:0/827: readlink d8/df/d13/d36/l4d 0 2024-02-15T22:51:24.450 INFO:tasks.workunit.client.1.smithi170.stdout:0/828: dread - d8/df/d13/d22/d71/f7b zero size 2024-02-15T22:51:24.450 INFO:tasks.workunit.client.1.smithi170.stdout:0/829: fsync d8/d14/d1c/d3f/f58 0 2024-02-15T22:51:24.451 INFO:tasks.workunit.client.1.smithi170.stdout:3/849: rename d3/dc/d1c/f83 to d3/dc/d1a/d9f/dec/f122 0 2024-02-15T22:51:24.454 INFO:tasks.workunit.client.1.smithi170.stdout:3/850: creat d3/dc/d1c/d26/f123 x:0 0 0 2024-02-15T22:51:24.478 INFO:tasks.workunit.client.1.smithi170.stdout:3/851: write d3/dc/d1c/d26/f100 [3778497,46167] 0 2024-02-15T22:51:24.478 INFO:tasks.workunit.client.1.smithi170.stdout:0/830: dwrite d8/f2a [0,4194304] 0 2024-02-15T22:51:24.482 INFO:tasks.workunit.client.1.smithi170.stdout:3/852: getdents d3/d1b/d51/d6b 0 2024-02-15T22:51:24.484 INFO:tasks.workunit.client.1.smithi170.stdout:3/853: link d3/d1b/d2c/d92/da5/c8d d3/dc/d1a/d9f/dcb/dd2/c124 0 2024-02-15T22:51:24.484 INFO:tasks.workunit.client.1.smithi170.stdout:3/854: mkdir d3/dc/d1a/d9f/dcb/de7/d125 0 2024-02-15T22:51:24.484 INFO:tasks.workunit.client.1.smithi170.stdout:3/855: creat d3/dcd/dcf/f126 x:0 0 0 2024-02-15T22:51:24.488 INFO:tasks.workunit.client.1.smithi170.stdout:3/856: rename d3/dc/d1a/l20 to d3/dc/d1c/d26/dd4/l127 0 2024-02-15T22:51:24.494 INFO:tasks.workunit.client.1.smithi170.stdout:0/831: dread d8/f2a [0,4194304] 0 2024-02-15T22:51:24.494 INFO:tasks.workunit.client.1.smithi170.stdout:0/832: fdatasync d8/df/d13/d22/d6a/d8f/fed 0 2024-02-15T22:51:24.494 INFO:tasks.workunit.client.1.smithi170.stdout:8/639: sync 2024-02-15T22:51:24.494 INFO:tasks.workunit.client.1.smithi170.stdout:9/654: sync 2024-02-15T22:51:24.495 INFO:tasks.workunit.client.1.smithi170.stdout:2/956: sync 2024-02-15T22:51:24.495 INFO:tasks.workunit.client.1.smithi170.stdout:8/640: chown d9/db2/dd7/lbe 481907 1 2024-02-15T22:51:24.495 INFO:tasks.workunit.client.1.smithi170.stdout:0/833: creat d8/d14/f108 x:0 0 0 2024-02-15T22:51:24.500 INFO:tasks.workunit.client.1.smithi170.stdout:2/957: dread d0/d1/d53/f7e [0,4194304] 0 2024-02-15T22:51:24.513 INFO:tasks.workunit.client.1.smithi170.stdout:2/958: read d0/d1/d5f/d74/f94 [1365911,123909] 0 2024-02-15T22:51:24.513 INFO:tasks.workunit.client.1.smithi170.stdout:2/959: dread - d0/d13/f13e zero size 2024-02-15T22:51:24.515 INFO:tasks.workunit.client.1.smithi170.stdout:2/960: mkdir d0/d1/d89/d8b/d161/d16d 0 2024-02-15T22:51:24.515 INFO:tasks.workunit.client.1.smithi170.stdout:2/961: stat d0/d1/d89/dd7/d3e/f13f 0 2024-02-15T22:51:24.519 INFO:tasks.workunit.client.1.smithi170.stdout:2/962: mkdir d0/d1d/d16e 0 2024-02-15T22:51:24.519 INFO:tasks.workunit.client.1.smithi170.stdout:0/834: dwrite d8/df/d13/d22/d6a/fab [0,4194304] 0 2024-02-15T22:51:24.519 INFO:tasks.workunit.client.1.smithi170.stdout:0/835: chown d8/df/d13/d22/l31 163436 1 2024-02-15T22:51:24.520 INFO:tasks.workunit.client.1.smithi170.stdout:2/963: symlink d0/d1/d89/dd7/d2f/d37/d58/d78/da4/d15c/l16f 0 2024-02-15T22:51:24.523 INFO:tasks.workunit.client.1.smithi170.stdout:0/836: mknod d8/df/d13/d36/d60/da2/dcb/c109 0 2024-02-15T22:51:24.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/964: mkdir d0/d1/d11/d26/d6e/d10f/d170 0 2024-02-15T22:51:24.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/965: truncate d0/d1/d5f/fd1 692920 0 2024-02-15T22:51:24.523 INFO:tasks.workunit.client.1.smithi170.stdout:2/966: chown d0/d1/d5f/d74/f13c 75 1 2024-02-15T22:51:24.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/655: dwrite de/f2a [0,4194304] 0 2024-02-15T22:51:24.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/656: dread - de/d1b/d1c/d1f/f36 zero size 2024-02-15T22:51:24.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/657: stat de/d1b/f4f 0 2024-02-15T22:51:24.546 INFO:tasks.workunit.client.1.smithi170.stdout:2/967: dwrite d0/d1/d5f/fac [0,4194304] 0 2024-02-15T22:51:24.546 INFO:tasks.workunit.client.1.smithi170.stdout:2/968: write d0/d1/d89/dd7/d2f/ddf/fff [249905,77079] 0 2024-02-15T22:51:24.547 INFO:tasks.workunit.client.1.smithi170.stdout:2/969: chown d0/d1/d11/d26/d6e/d10f/df9/d108/d125 0 1 2024-02-15T22:51:24.550 INFO:tasks.workunit.client.1.smithi170.stdout:2/970: rename d0/d1/d89/dd7/d2f/d9b/d14c to d0/d1/d89/dd7/d3e/d154/d171 0 2024-02-15T22:51:24.551 INFO:tasks.workunit.client.1.smithi170.stdout:2/971: chown d0/d1/d89/d8b 28766232 1 2024-02-15T22:51:24.551 INFO:tasks.workunit.client.1.smithi170.stdout:2/972: truncate d0/d1/d89/dd7/f7a 595669 0 2024-02-15T22:51:24.554 INFO:tasks.workunit.client.1.smithi170.stdout:9/658: dwrite de/d1b/d1c/d1f/d20/fbc [0,4194304] 0 2024-02-15T22:51:24.555 INFO:tasks.workunit.client.1.smithi170.stdout:9/659: write de/d1b/d1c/d1f/fc2 [118933,93635] 0 2024-02-15T22:51:24.555 INFO:tasks.workunit.client.1.smithi170.stdout:9/660: creat de/d1b/d1c/d1f/d20/d27/d84/fdb x:0 0 0 2024-02-15T22:51:24.555 INFO:tasks.workunit.client.1.smithi170.stdout:2/973: rmdir d0/d1d 39 2024-02-15T22:51:24.555 INFO:tasks.workunit.client.1.smithi170.stdout:2/974: dread - d0/d1/d89/dd7/f165 zero size 2024-02-15T22:51:24.560 INFO:tasks.workunit.client.1.smithi170.stdout:2/975: link d0/f67 d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dc8/f172 0 2024-02-15T22:51:24.560 INFO:tasks.workunit.client.1.smithi170.stdout:2/976: stat d0/d13/f13e 0 2024-02-15T22:51:24.563 INFO:tasks.workunit.client.1.smithi170.stdout:2/977: mkdir d0/d1/d89/dd7/d2f/d37/d173 0 2024-02-15T22:51:24.566 INFO:tasks.workunit.client.1.smithi170.stdout:2/978: mknod d0/d1/d89/dd7/d2f/ddf/c174 0 2024-02-15T22:51:24.567 INFO:tasks.workunit.client.1.smithi170.stdout:2/979: fsync d0/d1/fe 0 2024-02-15T22:51:24.568 INFO:tasks.workunit.client.1.smithi170.stdout:2/980: dread d0/d1/d11/fc1 [0,4194304] 0 2024-02-15T22:51:24.568 INFO:tasks.workunit.client.1.smithi170.stdout:2/981: chown d0/d1/d5f/d74/d8e/df4/ffc 15560 1 2024-02-15T22:51:24.573 INFO:tasks.workunit.client.1.smithi170.stdout:9/661: rmdir de/d1b/d1c/d1f/d20/d27 39 2024-02-15T22:51:24.575 INFO:tasks.workunit.client.1.smithi170.stdout:9/662: mkdir de/d97/ddc 0 2024-02-15T22:51:24.575 INFO:tasks.workunit.client.1.smithi170.stdout:9/663: chown de/d1b/d1c/d1f/d20/d8c/f8d 23 1 2024-02-15T22:51:24.576 INFO:tasks.workunit.client.1.smithi170.stdout:9/664: link de/d1b/d37/c51 de/d8e/cdd 0 2024-02-15T22:51:24.576 INFO:tasks.workunit.client.1.smithi170.stdout:2/982: read d0/d1/d89/dd7/d3e/f11c [64894,62690] 0 2024-02-15T22:51:24.579 INFO:tasks.workunit.client.1.smithi170.stdout:2/983: creat d0/d1/d89/dd7/d2f/d37/d58/d78/da4/f175 x:0 0 0 2024-02-15T22:51:24.580 INFO:tasks.workunit.client.1.smithi170.stdout:2/984: mknod d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/c176 0 2024-02-15T22:51:24.603 INFO:tasks.workunit.client.1.smithi170.stdout:9/665: dwrite de/d1b/f88 [0,4194304] 0 2024-02-15T22:51:24.604 INFO:tasks.workunit.client.1.smithi170.stdout:9/666: write f2 [3732591,15844] 0 2024-02-15T22:51:24.604 INFO:tasks.workunit.client.1.smithi170.stdout:2/985: dwrite d0/d1/d89/dd7/d3e/f11c [0,4194304] 0 2024-02-15T22:51:24.604 INFO:tasks.workunit.client.1.smithi170.stdout:2/986: dread - d0/d1/d89/dd7/d2f/d37/d137/f15f zero size 2024-02-15T22:51:24.609 INFO:tasks.workunit.client.1.smithi170.stdout:9/667: symlink de/d1b/d1c/d1f/d20/d27/d2c/lde 0 2024-02-15T22:51:24.609 INFO:tasks.workunit.client.1.smithi170.stdout:9/668: fsync de/d1b/d1c/d1f/d20/d27/d28/d69/f72 0 2024-02-15T22:51:24.610 INFO:tasks.workunit.client.1.smithi170.stdout:9/669: truncate de/d1b/d1c/d1f/d20/fbc 2575867 0 2024-02-15T22:51:24.728 INFO:tasks.workunit.client.1.smithi170.stdout:9/670: creat de/d1b/d37/dab/fdf x:0 0 0 2024-02-15T22:51:24.728 INFO:tasks.workunit.client.1.smithi170.stdout:9/671: stat de/d1b/d1c/d1f/l35 0 2024-02-15T22:51:24.728 INFO:tasks.workunit.client.1.smithi170.stdout:9/672: truncate de/f2a 5219459 0 2024-02-15T22:51:24.728 INFO:tasks.workunit.client.1.smithi170.stdout:9/673: write de/d1b/d1c/d1f/d20/d27/f29 [10232734,65447] 0 2024-02-15T22:51:24.728 INFO:tasks.workunit.client.1.smithi170.stdout:9/674: mkdir de/d1b/d37/dab/de0 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/675: creat de/d1b/d1c/d1f/d20/d78/fe1 x:0 0 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/676: creat de/d97/fe2 x:0 0 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/677: readlink de/d1b/d1c/d1f/d20/d27/d28/la3 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/678: link de/d1b/d1c/d1f/d20/c39 de/d1b/ce3 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/679: dread - de/d8e/fb9 zero size 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:4/849: sync 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/987: dwrite d0/d1/d11/d26/d6e/d8a/f12b [0,4194304] 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/680: dwrite de/d1b/d1c/d1f/d20/d27/d28/f64 [0,4194304] 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:9/681: creat de/d1b/d37/dab/fe4 x:0 0 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/988: dwrite d0/d13/d59/d82/f100 [0,4194304] 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/989: fdatasync d0/d1/d89/dd7/f13b 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/990: write d0/d1d/f126 [783332,5178] 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/991: creat d0/d1d/f177 x:0 0 0 2024-02-15T22:51:24.729 INFO:tasks.workunit.client.1.smithi170.stdout:2/992: read d0/d1/d89/dd7/d2f/d9b/f134 [124180,109767] 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/993: mkdir d0/d2a/daa/d124/d178 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/994: truncate d0/d1/d89/dd7/d2f/d37/d58/f96 4424967 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/995: link d0/d1d/fb9 d0/d1/d89/dd7/d2f/d37/d58/d78/da4/dde/f179 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/996: creat d0/d1/d5f/d74/f17a x:0 0 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/997: mkdir d0/d1/d5f/d17b 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:9/682: dwrite de/d1b/d1c/d1f/d20/d27/d28/d69/f72 [4194304,4194304] 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:9/683: mknod de/d1b/d1c/d1f/d20/d27/d84/ce5 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:9/684: stat de/d1b/d1c/d1f/d20/f22 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:9/685: rename de/d1b/d1c/d1f/d20/d8c/f8d to de/d1b/fe6 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/998: dwrite d0/d1/d5f/d74/fb0 [0,4194304] 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:2/999: dwrite d0/d1/d89/dd7/f85 [0,4194304] 0 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:3/857: sync 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:7/922: sync 2024-02-15T22:51:24.730 INFO:tasks.workunit.client.1.smithi170.stdout:6/792: sync 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:5/909: sync 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/924: sync 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:6/793: chown d3/d1d/d1b/d3e/d9c 169 1 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/925: fdatasync d3/d24/d2c/d35/d72/d92/d123/f10e 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/923: dread - da/d1a/d21/d2c/d2e/f123 zero size 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:3/858: dread - d3/dc/d1a/d9f/f120 zero size 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/926: fsync d3/d24/f10c 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/927: truncate d3/da2/f3b 4278567 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:7/924: mknod da/d1a/d21/d2c/d74/dde/dc7/c13b 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:3/859: creat d3/dc/d1c/d26/d55/d7d/df4/f128 x:0 0 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/928: symlink d3/d24/d2c/d35/d12c/l138 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:1/929: write d3/d24/d2c/d94/dd9/ff5 [1180520,23176] 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:5/910: getdents de/d36/d80/dc2 0 2024-02-15T22:51:24.731 INFO:tasks.workunit.client.1.smithi170.stdout:6/794: getdents d3/d1d/d28/d66 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:6/795: dread - d3/d1d/d36/d56/daf/dd5/fe2 zero size 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:6/796: chown d3/d1d/d1b/dfb 0 1 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:6/797: truncate d3/d24/f7a 295495 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:7/925: creat da/d1a/d21/d2c/d74/dde/d7d/d72/dd4/dd6/f13c x:0 0 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:1/930: mkdir d3/d24/d2c/d35/d72/d92/d139 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:1/931: chown d3/d24/d2c/d77/dce/ffe 0 1 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:3/860: rmdir d3/d1b/d8a/dcc 39 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:6/798: write d3/d1d/f9f [6488244,66224] 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:6/799: fdatasync d3/d1d/d27/fb3 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:1/932: mknod d3/d24/d2c/d94/dd9/c13a 0 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:1/933: chown d3/da2/d65/fb2 28803 1 2024-02-15T22:51:24.732 INFO:tasks.workunit.client.1.smithi170.stdout:3/861: truncate d3/dc/d1c/d26/dd4/f9e 2767739 0 2024-02-15T22:51:24.733 INFO:tasks.workunit.client.1.smithi170.stdout:1/934: write d3/d24/d2c/f47 [5522620,91931] 0 2024-02-15T22:51:24.742 INFO:tasks.workunit.client.1.smithi170.stdout:3/862: write d3/f3f [6138611,110626] 0 2024-02-15T22:51:24.743 INFO:tasks.workunit.client.1.smithi170.stdout:3/863: truncate d3/d1b/d2c/d92/f113 459205 0 2024-02-15T22:51:24.745 INFO:tasks.workunit.client.1.smithi170.stdout:1/935: read d3/d24/d2c/d77/dce/ffe [3287539,22415] 0 2024-02-15T22:51:24.745 INFO:tasks.workunit.client.1.smithi170.stdout:1/936: write d3/f22 [415655,111959] 0 2024-02-15T22:51:24.745 INFO:tasks.workunit.client.1.smithi170.stdout:1/937: fdatasync d3/da2/d4a/f105 0 2024-02-15T22:51:24.747 INFO:tasks.workunit.client.1.smithi170.stdout:7/926: dwrite da/d1a/d21/d2c/d74/dde/d7d/f32 [0,4194304] 0 2024-02-15T22:51:24.747 INFO:tasks.workunit.client.1.smithi170.stdout:7/927: dread - da/d1a/d21/d2c/f139 zero size 2024-02-15T22:51:24.748 INFO:tasks.workunit.client.1.smithi170.stdout:5/911: dwrite de/d10/d27/d2d/f91 [0,4194304] 0 2024-02-15T22:51:24.752 INFO:tasks.workunit.client.1.smithi170.stdout:3/864: read d3/d1b/d8a/faa [734378,44464] 0 2024-02-15T22:51:24.763 INFO:tasks.workunit.client.1.smithi170.stdout:5/912: write de/d10/f32 [3196747,55285] 0 2024-02-15T22:51:24.764 INFO:tasks.workunit.client.1.smithi170.stdout:5/913: write de/d10/d33/d67/fa0 [1212812,95007] 0 2024-02-15T22:51:24.764 INFO:tasks.workunit.client.1.smithi170.stdout:5/914: chown de/d10/d33/d9f/d7c/lf2 810288400 1 2024-02-15T22:51:24.764 INFO:tasks.workunit.client.1.smithi170.stdout:5/915: readlink de/d10/d7d/db8/ldd 0 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/916: mknod de/d10/d33/db2/de4/dcb/c12d 0 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/917: stat de/d10/d27/d4c 0 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/918: write de/d10/d27/d2d/f65 [4655312,109176] 0 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/919: chown de/d10/d27/d2d/d11d 3900 1 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/920: chown de/d10/d33/fa9 3793 1 2024-02-15T22:51:24.766 INFO:tasks.workunit.client.1.smithi170.stdout:5/921: mkdir de/d36/d80/d117/d12e 0 2024-02-15T22:51:24.767 INFO:tasks.workunit.client.1.smithi170.stdout:5/922: creat de/d10/da8/f12f x:0 0 0 2024-02-15T22:51:24.769 INFO:tasks.workunit.client.1.smithi170.stdout:5/923: rmdir de/d36/d80/d117/d12e 0 2024-02-15T22:51:24.769 INFO:tasks.workunit.client.1.smithi170.stdout:5/924: read de/f3f [4377237,104672] 0 2024-02-15T22:51:24.770 INFO:tasks.workunit.client.1.smithi170.stdout:1/938: dwrite d3/d24/d2c/f49 [0,4194304] 0 2024-02-15T22:51:24.771 INFO:tasks.workunit.client.1.smithi170.stdout:5/925: link de/d10/d33/d9f/f69 de/d10/d27/d4c/f130 0 2024-02-15T22:51:24.771 INFO:tasks.workunit.client.1.smithi170.stdout:5/926: chown de/d10/d27/dbd/f110 1042189142 1 2024-02-15T22:51:24.771 INFO:tasks.workunit.client.1.smithi170.stdout:1/939: write d3/d24/d2c/d94/fa5 [2786250,69370] 0 2024-02-15T22:51:24.771 INFO:tasks.workunit.client.1.smithi170.stdout:1/940: fsync d3/d24/d2c/d94/f12a 0 2024-02-15T22:51:24.771 INFO:tasks.workunit.client.1.smithi170.stdout:1/941: readlink d3/d24/d2c/d77/d110/l114 0 2024-02-15T22:51:24.772 INFO:tasks.workunit.client.1.smithi170.stdout:5/927: dread de/d10/d27/d2d/d11d/f93 [0,4194304] 0 2024-02-15T22:51:24.772 INFO:tasks.workunit.client.1.smithi170.stdout:5/928: chown de/d10/d27/d2d/f47 78921498 1 2024-02-15T22:51:24.773 INFO:tasks.workunit.client.1.smithi170.stdout:3/865: dwrite d3/f5 [4194304,4194304] 0 2024-02-15T22:51:24.773 INFO:tasks.workunit.client.1.smithi170.stdout:3/866: getdents d3/d1b/d8a/df8/d11c 0 2024-02-15T22:51:24.773 INFO:tasks.workunit.client.1.smithi170.stdout:7/928: dwrite da/d1a/f90 [0,4194304] 0 2024-02-15T22:51:24.773 INFO:tasks.workunit.client.1.smithi170.stdout:1/942: dread d3/fb8 [0,4194304] 0 2024-02-15T22:51:24.774 INFO:tasks.workunit.client.1.smithi170.stdout:5/929: rename de/d10/d33/d67/d11c to de/d10/d27/d2d/d11d/d131 0 2024-02-15T22:51:24.774 INFO:tasks.workunit.client.1.smithi170.stdout:5/930: chown f7 2152 1 2024-02-15T22:51:24.776 INFO:tasks.workunit.client.1.smithi170.stdout:3/867: mkdir d3/dc/d1c/d26/d55/d7d/df4/d129 0 2024-02-15T22:51:24.779 INFO:tasks.workunit.client.1.smithi170.stdout:7/929: mknod da/d1a/d21/d2c/d74/d87/c13d 0 2024-02-15T22:51:24.780 INFO:tasks.workunit.client.1.smithi170.stdout:1/943: rename d3/d24/c76 to d3/d24/d2c/d77/d8f/dcd/c13b 0 2024-02-15T22:51:24.782 INFO:tasks.workunit.client.1.smithi170.stdout:5/931: mkdir de/d10/d33/d67/dc4/dcd/d132 0 2024-02-15T22:51:24.783 INFO:tasks.workunit.client.1.smithi170.stdout:5/932: chown de/d10/d33/d67/f8d 818408 1 2024-02-15T22:51:24.785 INFO:tasks.workunit.client.1.smithi170.stdout:5/933: dread de/d10/d7d/db8/d10a/fe8 [0,4194304] 0 2024-02-15T22:51:24.785 INFO:tasks.workunit.client.1.smithi170.stdout:3/868: chown d3/f9 410935 1 2024-02-15T22:51:24.785 INFO:tasks.workunit.client.1.smithi170.stdout:3/869: truncate d3/db/d1f/d61/f101 889261 0 2024-02-15T22:51:24.788 INFO:tasks.workunit.client.1.smithi170.stdout:3/870: dread d3/dc/f31 [0,4194304] 0 2024-02-15T22:51:24.793 INFO:tasks.workunit.client.1.smithi170.stdout:1/944: unlink d3/da2/de2/cfd 0 2024-02-15T22:51:24.794 INFO:tasks.workunit.client.1.smithi170.stdout:7/930: dwrite da/fcb [0,4194304] 0 2024-02-15T22:51:24.794 INFO:tasks.workunit.client.1.smithi170.stdout:7/931: chown da/d1a/d21/d2c/d74/f102 5 1 2024-02-15T22:51:24.794 INFO:tasks.workunit.client.1.smithi170.stdout:5/934: unlink de/d36/la6 0 2024-02-15T22:51:24.795 INFO:tasks.workunit.client.1.smithi170.stdout:3/871: mkdir d3/d78/d7a/d12a 0 2024-02-15T22:51:24.797 INFO:tasks.workunit.client.1.smithi170.stdout:7/932: mkdir da/d1a/d21/d2c/d74/d87/d9b/d13e 0 2024-02-15T22:51:24.800 INFO:tasks.workunit.client.1.smithi170.stdout:7/933: write da/d1a/d21/d2c/d71/f12c [5511209,79807] 0 2024-02-15T22:51:24.800 INFO:tasks.workunit.client.1.smithi170.stdout:7/934: chown da/d1a/d21/d2c/c114 55 1 2024-02-15T22:51:24.800 INFO:tasks.workunit.client.1.smithi170.stdout:7/935: creat da/d1a/d21/d2c/d74/f13f x:0 0 0 2024-02-15T22:51:24.800 INFO:tasks.workunit.client.1.smithi170.stdout:7/936: fdatasync da/d1a/d21/d2c/d2e/d7a/de2/de5/f122 0 2024-02-15T22:51:24.801 INFO:tasks.workunit.client.1.smithi170.stdout:5/935: link de/d10/d27/d4c/d53/d55/f8e de/d10/d27/d4c/f133 0 2024-02-15T22:51:24.801 INFO:tasks.workunit.client.1.smithi170.stdout:5/936: chown de/d10/d27/d2d/f65 2773 1 2024-02-15T22:51:24.801 INFO:tasks.workunit.client.1.smithi170.stdout:3/872: getdents d3/dc/d13 0 2024-02-15T22:51:24.804 INFO:tasks.workunit.client.1.smithi170.stdout:7/937: mknod da/d57/df3/c140 0 2024-02-15T22:51:24.804 INFO:tasks.workunit.client.1.smithi170.stdout:7/938: fsync da/d1a/d21/d2c/d2e/f35 0 2024-02-15T22:51:24.804 INFO:tasks.workunit.client.1.smithi170.stdout:7/939: dread - da/d1a/d21/d2c/d74/dde/d7d/fee zero size 2024-02-15T22:51:24.806 INFO:tasks.workunit.client.1.smithi170.stdout:5/937: mknod de/dec/d10d/c134 0 2024-02-15T22:51:24.807 INFO:tasks.workunit.client.1.smithi170.stdout:1/945: dread d3/f10 [0,4194304] 0 2024-02-15T22:51:24.808 INFO:tasks.workunit.client.1.smithi170.stdout:1/946: read d3/d24/f63 [343831,84276] 0 2024-02-15T22:51:24.810 INFO:tasks.workunit.client.1.smithi170.stdout:1/947: mknod d3/da2/de2/c13c 0 2024-02-15T22:51:24.814 INFO:tasks.workunit.client.1.smithi170.stdout:1/948: link d3/d24/d2c/d35/d72/df1/f10a d3/d24/d2c/d77/d110/d118/d120/f13d 0 2024-02-15T22:51:24.816 INFO:tasks.workunit.client.1.smithi170.stdout:7/940: dread da/d1a/d21/d2c/d74/f86 [0,4194304] 0 2024-02-15T22:51:24.816 INFO:tasks.workunit.client.1.smithi170.stdout:7/941: stat da/d1a/d21/d2c/d2e/lc9 0 2024-02-15T22:51:24.816 INFO:tasks.workunit.client.1.smithi170.stdout:1/949: symlink d3/d24/d2c/d94/dd9/l13e 0 2024-02-15T22:51:24.817 INFO:tasks.workunit.client.1.smithi170.stdout:3/873: dwrite d3/dc/f116 [0,4194304] 0 2024-02-15T22:51:24.817 INFO:tasks.workunit.client.1.smithi170.stdout:3/874: dread - d3/dcd/dcf/f126 zero size 2024-02-15T22:51:24.819 INFO:tasks.workunit.client.1.smithi170.stdout:3/875: mkdir d3/d1b/d51/d6b/d86/d12b 0 2024-02-15T22:51:24.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/942: dread da/d1a/d21/d2c/d71/f75 [0,4194304] 0 2024-02-15T22:51:24.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/943: readlink da/d1a/d21/d2c/d2e/d7a/lfd 0 2024-02-15T22:51:24.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/944: chown da/d1a/l4e 31 1 2024-02-15T22:51:24.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/945: chown da/d1a/d21/d1b/f77 143 1 2024-02-15T22:51:24.820 INFO:tasks.workunit.client.1.smithi170.stdout:7/946: stat da/d1a/d21/d2c/d74/dde/dc7/df0/d11b 0 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:3/876: creat d3/dcd/f12c x:0 0 0 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:3/877: dread - d3/dc/d1c/d26/fbc zero size 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:3/878: truncate d3/dcd/dcf/fe6 335227 0 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:3/879: chown d3/d1b/d8a/dcc/lfa 114732 1 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:7/947: truncate da/d1a/def/fe3 406065 0 2024-02-15T22:51:24.821 INFO:tasks.workunit.client.1.smithi170.stdout:7/948: write da/d1a/d21/d2c/d2e/d7a/fca [1105202,91745] 0 2024-02-15T22:51:24.822 INFO:tasks.workunit.client.1.smithi170.stdout:3/880: mkdir d3/d78/d7a/d12d 0 2024-02-15T22:51:24.825 INFO:tasks.workunit.client.1.smithi170.stdout:7/949: creat da/d1a/d21/d115/f141 x:0 0 0 2024-02-15T22:51:24.826 INFO:tasks.workunit.client.1.smithi170.stdout:5/938: dwrite de/d10/d27/dbd/f10c [0,4194304] 0 2024-02-15T22:51:24.826 INFO:tasks.workunit.client.1.smithi170.stdout:5/939: write de/d10/d27/d4c/d53/d55/f8e [2072899,61361] 0 2024-02-15T22:51:24.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/940: write de/d10/d33/d67/fa0 [496056,118291] 0 2024-02-15T22:51:24.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/941: chown de/d36/lc1 62 1 2024-02-15T22:51:24.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/942: chown de/d10/d27/d4c/f133 63465 1 2024-02-15T22:51:24.827 INFO:tasks.workunit.client.1.smithi170.stdout:5/943: stat de/d10/d33/ffd 0 2024-02-15T22:51:24.827 INFO:tasks.workunit.client.1.smithi170.stdout:7/950: creat da/d1a/d21/d2c/d2e/f142 x:0 0 0 2024-02-15T22:51:24.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/944: mkdir de/d10/d27/d135 0 2024-02-15T22:51:24.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/945: chown de/d10/d27/d4c/f6c 2252 1 2024-02-15T22:51:24.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/946: truncate de/d36/f74 1364451 0 2024-02-15T22:51:24.834 INFO:tasks.workunit.client.1.smithi170.stdout:5/947: fsync de/d10/d33/d67/fa3 0 2024-02-15T22:51:24.835 INFO:tasks.workunit.client.1.smithi170.stdout:5/948: mknod de/d10/d27/d2d/de6/c136 0 2024-02-15T22:51:24.836 INFO:tasks.workunit.client.1.smithi170.stdout:7/951: rmdir da/d1a/d21/d115 39 2024-02-15T22:51:24.838 INFO:tasks.workunit.client.1.smithi170.stdout:7/952: creat da/d1a/d21/d1b/f143 x:0 0 0 2024-02-15T22:51:24.839 INFO:tasks.workunit.client.1.smithi170.stdout:3/881: dwrite d3/dc/d1c/d26/d55/d7d/feb [0,4194304] 0 2024-02-15T22:51:24.839 INFO:tasks.workunit.client.1.smithi170.stdout:7/953: mknod da/d1a/d21/d1b/df7/c144 0 2024-02-15T22:51:24.839 INFO:tasks.workunit.client.1.smithi170.stdout:7/954: chown da/d1a/d21/d2c/d74/d87/d9b/lc1 775152 1 2024-02-15T22:51:24.841 INFO:tasks.workunit.client.1.smithi170.stdout:8/641: sync 2024-02-15T22:51:24.841 INFO:tasks.workunit.client.1.smithi170.stdout:8/642: readlink d9/d18/d32/d3b/l5c 0 2024-02-15T22:51:24.842 INFO:tasks.workunit.client.1.smithi170.stdout:3/882: symlink d3/dc/l12e 0 2024-02-15T22:51:24.843 INFO:tasks.workunit.client.1.smithi170.stdout:7/955: truncate da/d1a/def/fb4 3712368 0 2024-02-15T22:51:24.844 INFO:tasks.workunit.client.1.smithi170.stdout:5/949: dread de/d10/d33/d67/fa3 [0,4194304] 0 2024-02-15T22:51:24.844 INFO:tasks.workunit.client.1.smithi170.stdout:5/950: fsync de/d10/d33/d9f/d7c/f89 0 2024-02-15T22:51:24.844 INFO:tasks.workunit.client.1.smithi170.stdout:8/643: mknod d9/d18/d32/d7a/d78/d7f/cd9 0 2024-02-15T22:51:24.844 INFO:tasks.workunit.client.1.smithi170.stdout:8/644: chown d9/d18/d32/f3a 1 1 2024-02-15T22:51:24.846 INFO:tasks.workunit.client.1.smithi170.stdout:7/956: rename da/d1a/d21/d2c/d2e/d7a/l109 to da/d1a/d21/d2c/d74/d87/d9b/l145 0 2024-02-15T22:51:24.848 INFO:tasks.workunit.client.1.smithi170.stdout:3/883: symlink d3/l12f 0 2024-02-15T22:51:24.848 INFO:tasks.workunit.client.1.smithi170.stdout:3/884: truncate d3/dc/d1c/d26/d55/d7d/df4/f57 841806 0 2024-02-15T22:51:24.849 INFO:tasks.workunit.client.1.smithi170.stdout:3/885: symlink d3/d1b/d2c/d92/l130 0 2024-02-15T22:51:24.850 INFO:tasks.workunit.client.1.smithi170.stdout:7/957: getdents da/d1a/d21/d2c/d71 0 2024-02-15T22:51:24.851 INFO:tasks.workunit.client.1.smithi170.stdout:7/958: chown da/d57/dcc/cd8 13876 1 2024-02-15T22:51:24.851 INFO:tasks.workunit.client.1.smithi170.stdout:7/959: dread - da/d1a/d21/fda zero size 2024-02-15T22:51:24.852 INFO:tasks.workunit.client.1.smithi170.stdout:3/886: creat d3/d78/d7a/d12a/f131 x:0 0 0 2024-02-15T22:51:24.853 INFO:tasks.workunit.client.1.smithi170.stdout:7/960: symlink da/d1a/d21/d2c/d74/dde/d9e/l146 0 2024-02-15T22:51:24.853 INFO:tasks.workunit.client.1.smithi170.stdout:7/961: creat da/d1a/d21/d2c/f147 x:0 0 0 2024-02-15T22:51:24.853 INFO:tasks.workunit.client.1.smithi170.stdout:7/962: write da/d1a/d21/f46 [3470194,17932] 0 2024-02-15T22:51:24.853 INFO:tasks.workunit.client.1.smithi170.stdout:5/951: dread de/d10/d27/d2d/f91 [0,4194304] 0 2024-02-15T22:51:24.855 INFO:tasks.workunit.client.1.smithi170.stdout:8/645: write d9/f82 [1591411,23494] 0 2024-02-15T22:51:24.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/646: read d9/d18/d32/d3b/f90 [263301,15667] 0 2024-02-15T22:51:24.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/647: write d9/d18/d32/d7a/d78/d7f/d98/fb8 [1051358,112117] 0 2024-02-15T22:51:24.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/648: chown d9/d18/d32/d3b/f90 0 1 2024-02-15T22:51:24.856 INFO:tasks.workunit.client.1.smithi170.stdout:8/649: chown d9/d18/d32/d3b/d42/fb0 54790 1 2024-02-15T22:51:24.857 INFO:tasks.workunit.client.1.smithi170.stdout:5/952: mknod de/d36/df7/c137 0 2024-02-15T22:51:24.859 INFO:tasks.workunit.client.1.smithi170.stdout:3/887: rmdir d3/db/d1f 39 2024-02-15T22:51:24.862 INFO:tasks.workunit.client.1.smithi170.stdout:8/650: creat d9/dd0/fda x:0 0 0 2024-02-15T22:51:24.862 INFO:tasks.workunit.client.1.smithi170.stdout:5/953: mkdir de/dec/d10d/d138 0 2024-02-15T22:51:24.863 INFO:tasks.workunit.client.1.smithi170.stdout:3/888: getdents d3/dc/d1a/d9f/dcb/dd2 0 2024-02-15T22:51:24.863 INFO:tasks.workunit.client.1.smithi170.stdout:3/889: chown d3/d1b/d8a/df8/f11f 98 1 2024-02-15T22:51:24.864 INFO:tasks.workunit.client.1.smithi170.stdout:5/954: mknod de/d36/df7/c139 0 2024-02-15T22:51:24.871 INFO:tasks.workunit.client.1.smithi170.stdout:3/890: dread d3/f3f [4194304,4194304] 0 2024-02-15T22:51:24.873 INFO:tasks.workunit.client.1.smithi170.stdout:3/891: mkdir d3/dc/d1c/d26/d55/d132 0 2024-02-15T22:51:24.874 INFO:tasks.workunit.client.1.smithi170.stdout:5/955: dread de/d10/d27/f4f [0,4194304] 0 2024-02-15T22:51:24.874 INFO:tasks.workunit.client.1.smithi170.stdout:5/956: chown de/d10/d27/d4c/d53/f63 1538999 1 2024-02-15T22:51:24.874 INFO:tasks.workunit.client.1.smithi170.stdout:7/963: dwrite da/d1a/d21/d2c/d2e/fad [0,4194304] 0 2024-02-15T22:51:24.874 INFO:tasks.workunit.client.1.smithi170.stdout:7/964: write da/d1a/d21/d2c/f139 [284223,65767] 0 2024-02-15T22:51:24.874 INFO:tasks.workunit.client.1.smithi170.stdout:7/965: fsync da/d1a/d21/d2c/d71/f75 0 2024-02-15T22:51:24.875 INFO:tasks.workunit.client.1.smithi170.stdout:5/957: creat de/dec/d10d/d138/f13a x:0 0 0 2024-02-15T22:51:24.876 INFO:tasks.workunit.client.1.smithi170.stdout:7/966: mknod da/d1a/d21/d2c/d2e/d7a/de2/de5/c148 0 2024-02-15T22:51:24.882 INFO:tasks.workunit.client.1.smithi170.stdout:3/892: dread d3/dc/d1a/d9f/dec/ffe [0,4194304] 0 2024-02-15T22:51:24.882 INFO:tasks.workunit.client.1.smithi170.stdout:8/651: dwrite d9/d18/d32/d7a/d78/d7f/f94 [0,4194304] 0 2024-02-15T22:51:24.883 INFO:tasks.workunit.client.1.smithi170.stdout:8/652: stat d9/d18/d32/d3b/ld2 0 2024-02-15T22:51:24.883 INFO:tasks.workunit.client.1.smithi170.stdout:3/893: mkdir d3/dc/d1a/d9f/dec/d133 0 2024-02-15T22:51:24.889 INFO:tasks.workunit.client.1.smithi170.stdout:7/967: truncate da/d1a/d21/d2c/d2e/fad 3847997 0 2024-02-15T22:51:24.901 INFO:tasks.workunit.client.1.smithi170.stdout:5/958: dwrite de/d10/d27/d2d/d11d/f93 [0,4194304] 0 2024-02-15T22:51:24.901 INFO:tasks.workunit.client.1.smithi170.stdout:8/653: dread d9/f1d [0,4194304] 0 2024-02-15T22:51:24.901 INFO:tasks.workunit.client.1.smithi170.stdout:8/654: write d9/d18/d32/d3b/d4b/f8f [4364046,3410] 0 2024-02-15T22:51:24.901 INFO:tasks.workunit.client.1.smithi170.stdout:8/655: fsync d9/d18/d26/fb5 0 2024-02-15T22:51:24.902 INFO:tasks.workunit.client.1.smithi170.stdout:5/959: mknod de/d10/d33/d67/dc4/c13b 0 2024-02-15T22:51:24.903 INFO:tasks.workunit.client.1.smithi170.stdout:8/656: mknod d9/d18/d32/cdb 0 2024-02-15T22:51:24.904 INFO:tasks.workunit.client.1.smithi170.stdout:7/968: dread da/f10c [0,4194304] 0 2024-02-15T22:51:24.904 INFO:tasks.workunit.client.1.smithi170.stdout:3/894: dwrite d3/dc/d1c/d26/f46 [0,4194304] 0 2024-02-15T22:51:24.904 INFO:tasks.workunit.client.1.smithi170.stdout:3/895: chown d3/f3f 2167 1 2024-02-15T22:51:24.904 INFO:tasks.workunit.client.1.smithi170.stdout:5/960: mknod de/d10/d7d/c13c 0 2024-02-15T22:51:24.904 INFO:tasks.workunit.client.1.smithi170.stdout:5/961: creat de/dec/f13d x:0 0 0 2024-02-15T22:51:24.906 INFO:tasks.workunit.client.1.smithi170.stdout:3/896: mkdir d3/d1b/d2c/d92/d134 0 2024-02-15T22:51:24.906 INFO:tasks.workunit.client.1.smithi170.stdout:3/897: write d3/dc/d13/f24 [2322456,20042] 0 2024-02-15T22:51:24.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/969: write da/d1a/d21/d2c/d74/d87/dac/fb9 [528381,73515] 0 2024-02-15T22:51:24.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/970: fdatasync da/d1a/d21/d2c/d2e/f35 0 2024-02-15T22:51:24.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/971: truncate da/d1a/d21/d2c/d74/dde/fb3 8984225 0 2024-02-15T22:51:24.915 INFO:tasks.workunit.client.1.smithi170.stdout:7/972: creat da/d1a/d21/d2c/d74/dde/d7d/d72/d10b/f149 x:0 0 0 2024-02-15T22:51:24.918 INFO:tasks.workunit.client.1.smithi170.stdout:8/657: dread d9/d18/d32/d3b/d68/fb9 [0,4194304] 0 2024-02-15T22:51:24.919 INFO:tasks.workunit.client.1.smithi170.stdout:5/962: dwrite de/d10/d33/d9f/d7c/d87/fdf [0,4194304] 0 2024-02-15T22:51:24.919 INFO:tasks.workunit.client.1.smithi170.stdout:5/963: chown de/d10/d7d/fb1 2986 1 2024-02-15T22:51:24.923 INFO:tasks.workunit.client.1.smithi170.stdout:5/964: unlink de/d10/d27/d2d/d11d/f12c 0 2024-02-15T22:51:24.924 INFO:tasks.workunit.client.1.smithi170.stdout:7/973: dread da/d1a/d21/d2c/d74/dde/fb3 [0,4194304] 0 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:8/658: write d9/ff [1144200,53629] 0 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:0/837: sync 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:4/850: sync 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:6/800: sync 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:9/686: sync 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:9/687: write de/d1b/d1c/d1f/d20/f99 [415221,555] 0 2024-02-15T22:51:24.927 INFO:tasks.workunit.client.1.smithi170.stdout:9/688: chown de/d1b/d1c/d1f/d20/d8c/fcb 3 1 2024-02-15T22:51:24.928 INFO:tasks.workunit.client.1.smithi170.stdout:6/801: dread d3/d1d/d36/d56/d6c/dc4/fcf [0,4194304] 0 2024-02-15T22:51:24.929 INFO:tasks.workunit.client.1.smithi170.stdout:9/689: dread de/d1b/f7e [0,4194304] 0 2024-02-15T22:51:24.929 INFO:tasks.workunit.client.1.smithi170.stdout:9/690: creat de/d8e/fe7 x:0 0 0 2024-02-15T22:51:24.930 INFO:tasks.workunit.client.1.smithi170.stdout:7/974: getdents da/d1a/d21/d2c/d2e 0 2024-02-15T22:51:24.931 INFO:tasks.workunit.client.1.smithi170.stdout:8/659: dread d9/f46 [0,4194304] 0 2024-02-15T22:51:24.932 INFO:tasks.workunit.client.1.smithi170.stdout:5/965: write de/d10/d33/d67/fa3 [21624,42844] 0 2024-02-15T22:51:24.932 INFO:tasks.workunit.client.1.smithi170.stdout:6/802: dread d3/d1d/d36/d56/d6c/dc4/fcf [0,4194304] 0 2024-02-15T22:51:24.933 INFO:tasks.workunit.client.1.smithi170.stdout:4/851: mknod d0/d22/da/d8b/d47/d2b/c115 0 2024-02-15T22:51:24.936 INFO:tasks.workunit.client.1.smithi170.stdout:5/966: write de/d36/d80/f106 [1785912,108864] 0 2024-02-15T22:51:24.936 INFO:tasks.workunit.client.1.smithi170.stdout:0/838: dread d8/df/d13/d22/d6a/fab [0,4194304] 0 2024-02-15T22:51:24.936 INFO:tasks.workunit.client.1.smithi170.stdout:9/691: creat de/d1b/d1c/d1f/d20/d27/d28/d7a/fe8 x:0 0 0 2024-02-15T22:51:24.937 INFO:tasks.workunit.client.1.smithi170.stdout:9/692: creat de/d1b/d37/dab/fe9 x:0 0 0 2024-02-15T22:51:24.937 INFO:tasks.workunit.client.1.smithi170.stdout:9/693: read de/d1b/d1c/f46 [3262180,102008] 0 2024-02-15T22:51:24.939 INFO:tasks.workunit.client.1.smithi170.stdout:7/975: rename da/f10c to da/d1a/d21/d1b/df7/f14a 0 2024-02-15T22:51:24.939 INFO:tasks.workunit.client.1.smithi170.stdout:9/694: dread de/d1b/d1c/d1f/fc2 [0,4194304] 0 2024-02-15T22:51:24.941 INFO:tasks.workunit.client.1.smithi170.stdout:7/976: write da/d1a/d21/d2c/d71/f75 [108615,120391] 0 2024-02-15T22:51:24.943 INFO:tasks.workunit.client.1.smithi170.stdout:0/839: dread d8/d14/d6f/f8d [0,4194304] 0 2024-02-15T22:51:24.943 INFO:tasks.workunit.client.1.smithi170.stdout:0/840: fsync d8/df/d13/d36/d60/da2/dcb/fdb 0 2024-02-15T22:51:24.943 INFO:tasks.workunit.client.1.smithi170.stdout:9/695: symlink de/d1b/d1c/d1f/d20/d27/d28/lea 0 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:0/841: mkdir d8/d6d/dda/de5/dfe/d10a 0 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:0/842: chown d8/df/f8b 31025 1 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:0/843: getdents d8/d6d/dda 0 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:5/967: write de/d10/d27/d2d/f65 [2506377,124204] 0 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:5/968: readlink de/d10/d33/d9f/l66 0 2024-02-15T22:51:24.945 INFO:tasks.workunit.client.1.smithi170.stdout:5/969: write de/d29/f125 [982665,93582] 0 2024-02-15T22:51:24.949 INFO:tasks.workunit.client.1.smithi170.stdout:6/803: dread d3/db8/d96/fe8 [0,4194304] 0 2024-02-15T22:51:24.962 INFO:tasks.workunit.client.1.smithi170.stdout:4/852: dwrite d0/d22/da/d8b/d47/d5e/ff8 [0,4194304] 0 2024-02-15T22:51:24.964 INFO:tasks.workunit.client.1.smithi170.stdout:4/853: mkdir d0/d22/da/d8b/d80/d116 0 2024-02-15T22:51:24.964 INFO:tasks.workunit.client.1.smithi170.stdout:4/854: write d0/d22/da/d8b/d47/d67/d77/dc5/dff/ffb [853200,61777] 0 2024-02-15T22:51:24.964 INFO:tasks.workunit.client.1.smithi170.stdout:7/977: dwrite da/d1a/d21/d2c/f147 [0,4194304] 0 2024-02-15T22:51:24.965 INFO:tasks.workunit.client.1.smithi170.stdout:6/804: dread d3/d1d/d36/f22 [0,4194304] 0 2024-02-15T22:51:24.968 INFO:tasks.workunit.client.1.smithi170.stdout:7/978: link da/d1a/d21/d2c/d74/dde/d7d/fee da/d1a/d21/d2c/d74/d87/d9b/f14b 0 2024-02-15T22:51:24.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:24 smithi138 ceph-mon[29229]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 186 MiB/s wr, 373 op/s 2024-02-15T22:51:24.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:24 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:24.988 INFO:tasks.workunit.client.1.smithi170.stdout:7/979: read da/d1a/d21/d1b/fc3 [1986170,37569] 0 2024-02-15T22:51:24.989 INFO:tasks.workunit.client.1.smithi170.stdout:0/844: dwrite d8/df/d13/d22/fde [4194304,4194304] 0 2024-02-15T22:51:24.989 INFO:tasks.workunit.client.1.smithi170.stdout:5/970: dwrite de/d10/d33/d67/fa0 [0,4194304] 0 2024-02-15T22:51:24.990 INFO:tasks.workunit.client.1.smithi170.stdout:7/980: creat da/d57/df3/f14c x:0 0 0 2024-02-15T22:51:24.991 INFO:tasks.workunit.client.1.smithi170.stdout:0/845: link d8/df/d13/d22/d39/cbf d8/d14/d1c/c10b 0 2024-02-15T22:51:24.991 INFO:tasks.workunit.client.1.smithi170.stdout:0/846: stat d8/d6d/c9f 0 2024-02-15T22:51:24.991 INFO:tasks.workunit.client.1.smithi170.stdout:4/855: dwrite d0/d22/da/d8b/d47/dbe/d20/f3d [0,4194304] 0 2024-02-15T22:51:24.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/696: dwrite de/d1b/f4f [0,4194304] 0 2024-02-15T22:51:24.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/697: stat de/l40 0 2024-02-15T22:51:24.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/698: chown de/d1b/d1c/d1f/fc2 1412709 1 2024-02-15T22:51:24.992 INFO:tasks.workunit.client.1.smithi170.stdout:9/699: dread - de/d8e/fe7 zero size 2024-02-15T22:51:24.993 INFO:tasks.workunit.client.1.smithi170.stdout:6/805: dwrite d3/d1d/d27/fb3 [0,4194304] 0 2024-02-15T22:51:25.000 INFO:tasks.workunit.client.1.smithi170.stdout:5/971: creat de/d10/d27/d2d/f13e x:0 0 0 2024-02-15T22:51:25.000 INFO:tasks.workunit.client.1.smithi170.stdout:5/972: truncate de/d10/d27/d2d/f47 530143 0 2024-02-15T22:51:25.003 INFO:tasks.workunit.client.1.smithi170.stdout:4/856: mkdir d0/d22/da/d8b/d80/d117 0 2024-02-15T22:51:25.004 INFO:tasks.workunit.client.1.smithi170.stdout:9/700: unlink de/d1b/d1c/d1f/d20/d8c/fcb 0 2024-02-15T22:51:25.006 INFO:tasks.workunit.client.1.smithi170.stdout:5/973: creat de/d10/da8/db6/f13f x:0 0 0 2024-02-15T22:51:25.008 INFO:tasks.workunit.client.1.smithi170.stdout:5/974: chown de/d10/da8/db6/le7 26453 1 2024-02-15T22:51:25.008 INFO:tasks.workunit.client.1.smithi170.stdout:4/857: rmdir d0/d22/da/d8b/d47/da9 39 2024-02-15T22:51:25.008 INFO:tasks.workunit.client.1.smithi170.stdout:4/858: truncate d0/d22/da/d8b/d47/d2b/f52 635756 0 2024-02-15T22:51:25.010 INFO:tasks.workunit.client.1.smithi170.stdout:7/981: dwrite da/d1a/d21/d1b/dc6/f129 [4194304,4194304] 0 2024-02-15T22:51:25.012 INFO:tasks.workunit.client.1.smithi170.stdout:4/859: rename d0/d22/da/lfa to d0/d22/da/d8b/d47/d67/d77/dc5/dff/l118 0 2024-02-15T22:51:25.014 INFO:tasks.workunit.client.1.smithi170.stdout:5/975: dread de/d10/d33/d67/fa3 [0,4194304] 0 2024-02-15T22:51:25.014 INFO:tasks.workunit.client.1.smithi170.stdout:5/976: chown de/d36/d80/d117/f122 1 1 2024-02-15T22:51:25.014 INFO:tasks.workunit.client.1.smithi170.stdout:5/977: write de/d10/d33/d9f/f69 [594186,107400] 0 2024-02-15T22:51:25.014 INFO:tasks.workunit.client.1.smithi170.stdout:5/978: readlink de/d10/d27/dbd/lc8 0 2024-02-15T22:51:25.015 INFO:tasks.workunit.client.1.smithi170.stdout:4/860: symlink d0/d22/d6e/l119 0 2024-02-15T22:51:25.016 INFO:tasks.workunit.client.1.smithi170.stdout:4/861: creat d0/d22/d10c/f11a x:0 0 0 2024-02-15T22:51:25.017 INFO:tasks.workunit.client.1.smithi170.stdout:5/979: getdents de/d10/d7d/db8 0 2024-02-15T22:51:25.019 INFO:tasks.workunit.client.1.smithi170.stdout:4/862: rename d0/d22/da/d8b/d47/d67/d77/dc5/fe5 to d0/d22/da/d8b/d47/da9/de7/f11b 0 2024-02-15T22:51:25.020 INFO:tasks.workunit.client.1.smithi170.stdout:5/980: mkdir de/d36/d80/d140 0 2024-02-15T22:51:25.020 INFO:tasks.workunit.client.1.smithi170.stdout:4/863: dread d0/d22/da/d8b/d47/dbe/d20/fca [0,4194304] 0 2024-02-15T22:51:25.021 INFO:tasks.workunit.client.1.smithi170.stdout:4/864: mknod d0/d22/da/d8b/d47/d67/c11c 0 2024-02-15T22:51:25.021 INFO:tasks.workunit.client.1.smithi170.stdout:4/865: stat d0/f109 0 2024-02-15T22:51:25.022 INFO:tasks.workunit.client.1.smithi170.stdout:4/866: getdents d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb 0 2024-02-15T22:51:25.027 INFO:tasks.workunit.client.1.smithi170.stdout:5/981: dread de/d10/d33/f127 [0,4194304] 0 2024-02-15T22:51:25.027 INFO:tasks.workunit.client.1.smithi170.stdout:5/982: chown de/d10/d27/d2d/d11d/d131 205164108 1 2024-02-15T22:51:25.031 INFO:tasks.workunit.client.1.smithi170.stdout:0/847: dwrite d8/df/d13/f1f [0,4194304] 0 2024-02-15T22:51:25.031 INFO:tasks.workunit.client.1.smithi170.stdout:6/806: dwrite d3/d1d/d28/d3b/da3/fa8 [0,4194304] 0 2024-02-15T22:51:25.033 INFO:tasks.workunit.client.1.smithi170.stdout:0/848: rename d8/d6d/l97 to d8/d14/d70/d93/dd0/l10c 0 2024-02-15T22:51:25.033 INFO:tasks.workunit.client.1.smithi170.stdout:7/982: dwrite da/d1a/d21/d2c/d74/f86 [4194304,4194304] 0 2024-02-15T22:51:25.033 INFO:tasks.workunit.client.1.smithi170.stdout:0/849: stat d8/d14/d70 0 2024-02-15T22:51:25.033 INFO:tasks.workunit.client.1.smithi170.stdout:0/850: creat d8/d6d/dda/de5/f10d x:0 0 0 2024-02-15T22:51:25.033 INFO:tasks.workunit.client.1.smithi170.stdout:6/807: write d3/d1d/d1b/d3c/fb6 [210829,96274] 0 2024-02-15T22:51:25.042 INFO:tasks.workunit.client.1.smithi170.stdout:0/851: creat d8/df/d13/d22/f10e x:0 0 0 2024-02-15T22:51:25.047 INFO:tasks.workunit.client.1.smithi170.stdout:6/808: dwrite d3/d1d/d27/ff8 [0,4194304] 0 2024-02-15T22:51:25.049 INFO:tasks.workunit.client.1.smithi170.stdout:4/867: fsync d0/d22/d10c/f11a 0 2024-02-15T22:51:25.050 INFO:tasks.workunit.client.1.smithi170.stdout:7/983: dwrite da/d1a/d21/d2c/d74/dde/d7d/d72/d10b/f11e [0,4194304] 0 2024-02-15T22:51:25.052 INFO:tasks.workunit.client.1.smithi170.stdout:6/809: write f2 [1926121,82373] 0 2024-02-15T22:51:25.053 INFO:tasks.workunit.client.1.smithi170.stdout:4/868: creat d0/d22/da/d8b/d47/d67/d77/dc5/dff/f11d x:0 0 0 2024-02-15T22:51:25.053 INFO:tasks.workunit.client.1.smithi170.stdout:4/869: dread - d0/d22/da/d8b/d47/dbe/d89/de8/fdd zero size 2024-02-15T22:51:25.053 INFO:tasks.workunit.client.1.smithi170.stdout:4/870: stat d0/d22/da/d8b/d47/dbe/d20/c42 0 2024-02-15T22:51:25.053 INFO:tasks.workunit.client.1.smithi170.stdout:4/871: stat d0/d22/da/d8b/d47/d2b/f4c 0 2024-02-15T22:51:25.055 INFO:tasks.workunit.client.1.smithi170.stdout:4/872: write d0/d22/da/d8b/d47/d2b/fde [380352,121948] 0 2024-02-15T22:51:25.056 INFO:tasks.workunit.client.1.smithi170.stdout:4/873: write d0/ff1 [497805,18622] 0 2024-02-15T22:51:25.056 INFO:tasks.workunit.client.1.smithi170.stdout:4/874: chown d0/d22/da/d8b/f38 6 1 2024-02-15T22:51:25.056 INFO:tasks.workunit.client.1.smithi170.stdout:7/984: rmdir da/d1a/d21/d2c/d74/dde/dc7/df0/d11b 0 2024-02-15T22:51:25.057 INFO:tasks.workunit.client.1.smithi170.stdout:7/985: write da/d1a/fa1 [4553869,111943] 0 2024-02-15T22:51:25.057 INFO:tasks.workunit.client.1.smithi170.stdout:7/986: readlink da/d1a/d21/d2c/d74/d87/dac/l83 0 2024-02-15T22:51:25.057 INFO:tasks.workunit.client.1.smithi170.stdout:7/987: chown da/d1a/def/d8d/f127 571568 1 2024-02-15T22:51:25.058 INFO:tasks.workunit.client.1.smithi170.stdout:6/810: unlink d3/d1d/d28/l6a 0 2024-02-15T22:51:25.064 INFO:tasks.workunit.client.1.smithi170.stdout:7/988: dread da/d1a/d21/d2c/d74/d87/dac/f89 [0,4194304] 0 2024-02-15T22:51:25.067 INFO:tasks.workunit.client.1.smithi170.stdout:4/875: dread d0/d22/da/d8b/d47/dbe/da2/f9d [0,4194304] 0 2024-02-15T22:51:25.068 INFO:tasks.workunit.client.1.smithi170.stdout:4/876: mknod d0/d22/da/d8b/d47/d5e/d79/c11e 0 2024-02-15T22:51:25.075 INFO:tasks.workunit.client.1.smithi170.stdout:4/877: dread d0/d22/da/d8b/d47/dbe/f36 [0,4194304] 0 2024-02-15T22:51:25.077 INFO:tasks.workunit.client.1.smithi170.stdout:4/878: rename d0/c70 to d0/d22/db9/c11f 0 2024-02-15T22:51:25.077 INFO:tasks.workunit.client.1.smithi170.stdout:4/879: fdatasync d0/d22/d10c/f11a 0 2024-02-15T22:51:25.098 INFO:tasks.workunit.client.1.smithi170.stdout:6/811: dwrite d3/d1d/d27/fab [0,4194304] 0 2024-02-15T22:51:25.099 INFO:tasks.workunit.client.1.smithi170.stdout:6/812: symlink d3/d1d/d27/d70/l118 0 2024-02-15T22:51:25.101 INFO:tasks.workunit.client.1.smithi170.stdout:6/813: creat d3/d24/d31/d106/f119 x:0 0 0 2024-02-15T22:51:25.101 INFO:tasks.workunit.client.1.smithi170.stdout:6/814: readlink d3/d1d/l102 0 2024-02-15T22:51:25.102 INFO:tasks.workunit.client.1.smithi170.stdout:6/815: symlink d3/d24/d31/dc6/l11a 0 2024-02-15T22:51:25.103 INFO:tasks.workunit.client.1.smithi170.stdout:7/989: dwrite da/d1a/d21/d2c/d74/d87/daf/fc4 [0,4194304] 0 2024-02-15T22:51:25.106 INFO:tasks.workunit.client.1.smithi170.stdout:7/990: symlink da/d1a/d21/d2c/d74/l14d 0 2024-02-15T22:51:25.107 INFO:tasks.workunit.client.1.smithi170.stdout:4/880: dwrite d0/d22/da/d8b/f4f [0,4194304] 0 2024-02-15T22:51:25.108 INFO:tasks.workunit.client.1.smithi170.stdout:7/991: creat da/d1a/d21/d1b/df7/f14e x:0 0 0 2024-02-15T22:51:25.110 INFO:tasks.workunit.client.1.smithi170.stdout:4/881: link d0/d22/da/d8b/d47/dbe/d20/f35 d0/d22/db9/f120 0 2024-02-15T22:51:25.110 INFO:tasks.workunit.client.1.smithi170.stdout:4/882: dread - d0/d22/da/d8b/f114 zero size 2024-02-15T22:51:25.113 INFO:tasks.workunit.client.1.smithi170.stdout:4/883: rename d0/d22/l31 to d0/d22/da/d8b/d47/d5e/d7d/l121 0 2024-02-15T22:51:25.115 INFO:tasks.workunit.client.1.smithi170.stdout:4/884: symlink d0/d22/da/d8b/d47/dbe/d89/l122 0 2024-02-15T22:51:25.118 INFO:tasks.workunit.client.1.smithi170.stdout:6/816: dwrite d3/d1a/f33 [0,4194304] 0 2024-02-15T22:51:25.127 INFO:tasks.workunit.client.1.smithi170.stdout:4/885: dread d0/d22/da/d8b/d47/dbe/d20/fc4 [0,4194304] 0 2024-02-15T22:51:25.127 INFO:tasks.workunit.client.1.smithi170.stdout:4/886: chown d0/d22/da/d8b/d47/d67/f9e 1474 1 2024-02-15T22:51:25.127 INFO:tasks.workunit.client.1.smithi170.stdout:7/992: dwrite da/d1a/d21/d19/f94 [0,4194304] 0 2024-02-15T22:51:25.127 INFO:tasks.workunit.client.1.smithi170.stdout:4/887: creat d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f123 x:0 0 0 2024-02-15T22:51:25.127 INFO:tasks.workunit.client.1.smithi170.stdout:4/888: write d0/d22/da/d8b/d47/f8e [1202005,86048] 0 2024-02-15T22:51:25.131 INFO:tasks.workunit.client.1.smithi170.stdout:6/817: dread d3/d1a/f33 [0,4194304] 0 2024-02-15T22:51:25.131 INFO:tasks.workunit.client.1.smithi170.stdout:6/818: creat d3/d1d/d36/d56/d6c/dc4/f11b x:0 0 0 2024-02-15T22:51:25.132 INFO:tasks.workunit.client.1.smithi170.stdout:7/993: unlink da/l37 0 2024-02-15T22:51:25.137 INFO:tasks.workunit.client.1.smithi170.stdout:6/819: mkdir d3/d1d/d28/d66/d114/d11c 0 2024-02-15T22:51:25.137 INFO:tasks.workunit.client.1.smithi170.stdout:6/820: read d3/d1d/d28/d66/f68 [373306,58443] 0 2024-02-15T22:51:25.139 INFO:tasks.workunit.client.1.smithi170.stdout:4/889: rename d0/d22/da/d8b/d47/d5e/d79/c11e to d0/d22/da/d8b/d47/d67/d77/dc5/dff/c124 0 2024-02-15T22:51:25.141 INFO:tasks.workunit.client.1.smithi170.stdout:4/890: creat d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/d10a/f125 x:0 0 0 2024-02-15T22:51:25.149 INFO:tasks.workunit.client.1.smithi170.stdout:6/821: write d3/d1d/d28/d3b/f2b [3532562,76154] 0 2024-02-15T22:51:25.149 INFO:tasks.workunit.client.1.smithi170.stdout:7/994: dwrite da/d1a/d21/d2c/d74/dde/d7d/fff [0,4194304] 0 2024-02-15T22:51:25.149 INFO:tasks.workunit.client.1.smithi170.stdout:4/891: read d0/d22/db9/f120 [104210,68846] 0 2024-02-15T22:51:25.151 INFO:tasks.workunit.client.1.smithi170.stdout:6/822: dread d3/d1d/d28/d66/f68 [0,4194304] 0 2024-02-15T22:51:25.152 INFO:tasks.workunit.client.1.smithi170.stdout:7/995: mkdir da/d1a/d21/d14f 0 2024-02-15T22:51:25.152 INFO:tasks.workunit.client.1.smithi170.stdout:7/996: write da/d1a/d21/d1b/dc6/f129 [9341959,125129] 0 2024-02-15T22:51:25.154 INFO:tasks.workunit.client.1.smithi170.stdout:6/823: mkdir d3/d1d/d28/d3b/da3/de5/dff/d11d 0 2024-02-15T22:51:25.158 INFO:tasks.workunit.client.1.smithi170.stdout:7/997: creat da/d1a/d21/d115/f150 x:0 0 0 2024-02-15T22:51:25.159 INFO:tasks.workunit.client.1.smithi170.stdout:7/998: dread - da/d1a/d21/d4d/f10a zero size 2024-02-15T22:51:25.159 INFO:tasks.workunit.client.1.smithi170.stdout:6/824: mkdir d3/d24/d31/d106/d11e 0 2024-02-15T22:51:25.162 INFO:tasks.workunit.client.1.smithi170.stdout:6/825: creat d3/d24/d31/d106/d11e/f11f x:0 0 0 2024-02-15T22:51:25.166 INFO:tasks.workunit.client.1.smithi170.stdout:4/892: dwrite d0/d22/da/d8b/d47/dbe/f30 [0,4194304] 0 2024-02-15T22:51:25.168 INFO:tasks.workunit.client.1.smithi170.stdout:6/826: rename d3/d1d/d27/fa1 to d3/d24/d31/d106/d11e/f120 0 2024-02-15T22:51:25.170 INFO:tasks.workunit.client.1.smithi170.stdout:6/827: symlink d3/d1d/d36/d56/daf/dd5/df0/d105/l121 0 2024-02-15T22:51:25.170 INFO:tasks.workunit.client.1.smithi170.stdout:6/828: read - d3/d1d/d36/d56/daf/dd5/df0/f111 zero size 2024-02-15T22:51:25.170 INFO:tasks.workunit.client.1.smithi170.stdout:6/829: fdatasync d3/d24/d31/f49 0 2024-02-15T22:51:25.172 INFO:tasks.workunit.client.1.smithi170.stdout:6/830: unlink d3/d1d/d28/fad 0 2024-02-15T22:51:25.173 INFO:tasks.workunit.client.1.smithi170.stdout:6/831: creat d3/d1d/d53/f122 x:0 0 0 2024-02-15T22:51:25.178 INFO:tasks.workunit.client.1.smithi170.stdout:6/832: dread d3/d1d/f7b [0,4194304] 0 2024-02-15T22:51:25.178 INFO:tasks.workunit.client.1.smithi170.stdout:7/999: dwrite da/d1a/d21/d2c/d74/f134 [0,4194304] 0 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:8/660: sync 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:1/950: sync 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:3/898: sync 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:6/833: dwrite d3/d1d/d36/f14 [0,4194304] 0 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:6/834: stat d3/d1d/d28/d3b/da3/f101 0 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:3/899: write d3/dc/d1c/d26/d55/d7d/df4/f57 [1388070,44621] 0 2024-02-15T22:51:25.198 INFO:tasks.workunit.client.1.smithi170.stdout:1/951: mkdir d3/d24/d2c/d35/d72/d7e/d13f 0 2024-02-15T22:51:25.199 INFO:tasks.workunit.client.1.smithi170.stdout:8/661: creat d9/d18/d32/d3b/dc5/fdc x:0 0 0 2024-02-15T22:51:25.200 INFO:tasks.workunit.client.1.smithi170.stdout:6/835: rename d3/l4f to d3/d1d/d1b/d3e/l123 0 2024-02-15T22:51:25.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/900: creat d3/d1b/d2c/d9a/f135 x:0 0 0 2024-02-15T22:51:25.202 INFO:tasks.workunit.client.1.smithi170.stdout:3/901: chown d3/d1b/d51/d6b/f75 2436542 1 2024-02-15T22:51:25.202 INFO:tasks.workunit.client.1.smithi170.stdout:8/662: symlink d9/d18/d32/d3b/ldd 0 2024-02-15T22:51:25.203 INFO:tasks.workunit.client.1.smithi170.stdout:1/952: rename d3/d24/d2c/d94/dd9/l13e to d3/da2/l140 0 2024-02-15T22:51:25.204 INFO:tasks.workunit.client.1.smithi170.stdout:6/836: link d3/f5 d3/d1d/d28/d3b/da3/f124 0 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/902: creat d3/dc/d1a/d9f/dec/f136 x:0 0 0 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/903: truncate d3/dc/d1c/d26/fbc 396163 0 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/904: chown d3/d1b/d2c/d92/da5/f8b 5 1 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/905: getdents d3/dc/d1c/d26/d55/d7d/d107 0 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/906: chown d3/fe4 24706572 1 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/907: write d3/d1b/d8a/dcc/f110 [331483,2234] 0 2024-02-15T22:51:25.206 INFO:tasks.workunit.client.1.smithi170.stdout:3/908: fsync d3/d1b/d2c/f77 0 2024-02-15T22:51:25.207 INFO:tasks.workunit.client.1.smithi170.stdout:8/663: symlink d9/db2/dd7/da5/lde 0 2024-02-15T22:51:25.208 INFO:tasks.workunit.client.1.smithi170.stdout:1/953: mkdir d3/d24/d2c/d77/d8f/d141 0 2024-02-15T22:51:25.210 INFO:tasks.workunit.client.1.smithi170.stdout:6/837: mkdir d3/db8/d125 0 2024-02-15T22:51:25.210 INFO:tasks.workunit.client.1.smithi170.stdout:6/838: read d3/d24/d31/f44 [1353018,14340] 0 2024-02-15T22:51:25.211 INFO:tasks.workunit.client.1.smithi170.stdout:3/909: rename d3/d1b/d51/d6b/c6f to d3/d1b/d2c/d92/d134/c137 0 2024-02-15T22:51:25.214 INFO:tasks.workunit.client.1.smithi170.stdout:8/664: symlink d9/d18/d32/d3b/d4b/ldf 0 2024-02-15T22:51:25.214 INFO:tasks.workunit.client.1.smithi170.stdout:6/839: truncate d3/d1d/d1b/d3e/f92 227862 0 2024-02-15T22:51:25.216 INFO:tasks.workunit.client.1.smithi170.stdout:6/840: rmdir d3/d24/d31/d106/d11e 39 2024-02-15T22:51:25.223 INFO:tasks.workunit.client.1.smithi170.stdout:1/954: dwrite d3/f1c [0,4194304] 0 2024-02-15T22:51:25.228 INFO:tasks.workunit.client.1.smithi170.stdout:1/955: creat d3/d24/d2c/d94/dd9/d106/f142 x:0 0 0 2024-02-15T22:51:25.228 INFO:tasks.workunit.client.1.smithi170.stdout:1/956: chown d3/d24/d2c/d35/df4/f100 54503 1 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/957: rename d3/d24/d2c/d35/f81 to d3/d24/d2c/d35/d72/df1/f143 0 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/958: write d3/da2/f44 [4927627,38933] 0 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/959: fdatasync d3/d24/d2c/d77/fa1 0 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/960: write d3/d24/d2c/d35/d72/d7e/fe0 [385395,80195] 0 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/961: chown d3/d24/d2c/d35/d72/d7e 1 1 2024-02-15T22:51:25.231 INFO:tasks.workunit.client.1.smithi170.stdout:1/962: dread - d3/d24/d2c/d35/d72/d92/d123/f10e zero size 2024-02-15T22:51:25.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/665: dread d9/fd [0,4194304] 0 2024-02-15T22:51:25.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/666: chown d9/d18/d32/d7a/d78/l89 2099 1 2024-02-15T22:51:25.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/667: chown d9/d18/d48/f76 61470 1 2024-02-15T22:51:25.233 INFO:tasks.workunit.client.1.smithi170.stdout:1/963: rmdir d3/d24/d2c/d77/dce 39 2024-02-15T22:51:25.235 INFO:tasks.workunit.client.1.smithi170.stdout:8/668: truncate d9/d18/d26/f55 2369363 0 2024-02-15T22:51:25.235 INFO:tasks.workunit.client.1.smithi170.stdout:3/910: dwrite d3/dc/d1c/d26/d55/d7d/f11b [0,4194304] 0 2024-02-15T22:51:25.236 INFO:tasks.workunit.client.1.smithi170.stdout:8/669: mkdir d9/d18/d32/d99/db7/de0 0 2024-02-15T22:51:25.236 INFO:tasks.workunit.client.1.smithi170.stdout:8/670: readlink d9/d18/d48/l70 0 2024-02-15T22:51:25.238 INFO:tasks.workunit.client.1.smithi170.stdout:8/671: read d9/f17 [855685,40203] 0 2024-02-15T22:51:25.240 INFO:tasks.workunit.client.1.smithi170.stdout:6/841: dwrite d3/d1d/d1b/d3c/fc1 [0,4194304] 0 2024-02-15T22:51:25.241 INFO:tasks.workunit.client.1.smithi170.stdout:3/911: rename d3/dc/d1c/d26/d55/d7d/c118 to d3/db/d1f/d61/c138 0 2024-02-15T22:51:25.243 INFO:tasks.workunit.client.1.smithi170.stdout:8/672: rename d9/d18/d32/d7a/c8b to d9/d18/d32/d7a/ce1 0 2024-02-15T22:51:25.243 INFO:tasks.workunit.client.1.smithi170.stdout:8/673: write d9/d18/d32/d3b/dc5/fdc [482228,128990] 0 2024-02-15T22:51:25.247 INFO:tasks.workunit.client.1.smithi170.stdout:3/912: mkdir d3/dcd/dcf/d139 0 2024-02-15T22:51:25.249 INFO:tasks.workunit.client.1.smithi170.stdout:8/674: truncate d9/d18/d32/f3a 940496 0 2024-02-15T22:51:25.249 INFO:tasks.workunit.client.1.smithi170.stdout:8/675: chown d9/d18/d32/caf 0 1 2024-02-15T22:51:25.250 INFO:tasks.workunit.client.1.smithi170.stdout:3/913: getdents d3/dc/d1c/d26/d55/d7d/df0 0 2024-02-15T22:51:25.250 INFO:tasks.workunit.client.1.smithi170.stdout:3/914: creat d3/d1b/d2c/f13a x:0 0 0 2024-02-15T22:51:25.251 INFO:tasks.workunit.client.1.smithi170.stdout:8/676: truncate d9/d18/d32/d3b/f40 2730196 0 2024-02-15T22:51:25.251 INFO:tasks.workunit.client.1.smithi170.stdout:8/677: write d9/d18/f79 [461791,116090] 0 2024-02-15T22:51:25.253 INFO:tasks.workunit.client.1.smithi170.stdout:3/915: mknod d3/dc/d1c/c13b 0 2024-02-15T22:51:25.253 INFO:tasks.workunit.client.1.smithi170.stdout:3/916: creat d3/dc/d1a/d9f/dec/f13c x:0 0 0 2024-02-15T22:51:25.253 INFO:tasks.workunit.client.1.smithi170.stdout:3/917: fdatasync d3/d1b/d8a/fa3 0 2024-02-15T22:51:25.253 INFO:tasks.workunit.client.1.smithi170.stdout:3/918: fdatasync d3/d1b/d51/d6b/f75 0 2024-02-15T22:51:25.253 INFO:tasks.workunit.client.1.smithi170.stdout:3/919: write d3/d1b/d51/d94/fb7 [2044344,25895] 0 2024-02-15T22:51:25.254 INFO:tasks.workunit.client.1.smithi170.stdout:8/678: rename d9/d18/d32/d7a/d78/d7f/d98/fb8 to d9/d18/d32/d3b/dc5/fe2 0 2024-02-15T22:51:25.255 INFO:tasks.workunit.client.1.smithi170.stdout:3/920: symlink d3/d1b/d2c/d92/l13d 0 2024-02-15T22:51:25.255 INFO:tasks.workunit.client.1.smithi170.stdout:6/842: dwrite d3/d1d/d27/f4a [0,4194304] 0 2024-02-15T22:51:25.257 INFO:tasks.workunit.client.1.smithi170.stdout:3/921: link d3/d1b/d2c/ldc d3/dc/d1c/d26/d55/d7d/df4/l13e 0 2024-02-15T22:51:25.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/679: rename d9/d18/d32/ca1 to d9/ce3 0 2024-02-15T22:51:25.260 INFO:tasks.workunit.client.1.smithi170.stdout:8/680: chown d9/d18/d32/d3b/ld2 13221 1 2024-02-15T22:51:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:24 smithi170 ceph-mon[35248]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 186 MiB/s wr, 373 op/s 2024-02-15T22:51:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:24 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:25.263 INFO:tasks.workunit.client.1.smithi170.stdout:3/922: chown d3/l62 15 1 2024-02-15T22:51:25.264 INFO:tasks.workunit.client.1.smithi170.stdout:8/681: creat d9/d18/d32/d7a/d78/fe4 x:0 0 0 2024-02-15T22:51:25.266 INFO:tasks.workunit.client.1.smithi170.stdout:3/923: creat d3/d1b/d8a/f13f x:0 0 0 2024-02-15T22:51:25.266 INFO:tasks.workunit.client.1.smithi170.stdout:3/924: dread - d3/dc/d1a/f11a zero size 2024-02-15T22:51:25.266 INFO:tasks.workunit.client.1.smithi170.stdout:3/925: creat d3/dc/d1a/d9f/f140 x:0 0 0 2024-02-15T22:51:25.266 INFO:tasks.workunit.client.1.smithi170.stdout:8/682: creat d9/d18/d32/d99/db7/fe5 x:0 0 0 2024-02-15T22:51:25.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/843: dwrite d3/d1d/d1b/d3c/fb6 [0,4194304] 0 2024-02-15T22:51:25.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/844: write d3/fa [1816732,35723] 0 2024-02-15T22:51:25.270 INFO:tasks.workunit.client.1.smithi170.stdout:6/845: write d3/d1d/d27/f5b [2066943,119051] 0 2024-02-15T22:51:25.270 INFO:tasks.workunit.client.1.smithi170.stdout:3/926: creat d3/dc/d1c/d26/d55/d7d/df0/f141 x:0 0 0 2024-02-15T22:51:25.279 INFO:tasks.workunit.client.1.smithi170.stdout:3/927: symlink d3/dcd/dcf/d119/l142 0 2024-02-15T22:51:25.281 INFO:tasks.workunit.client.1.smithi170.stdout:3/928: creat d3/dc/d1c/d26/d55/d132/f143 x:0 0 0 2024-02-15T22:51:25.281 INFO:tasks.workunit.client.1.smithi170.stdout:6/846: write d3/d1a/fa7 [466106,75272] 0 2024-02-15T22:51:25.282 INFO:tasks.workunit.client.1.smithi170.stdout:3/929: rename d3/db/d1f/f41 to d3/d1b/d51/d94/f144 0 2024-02-15T22:51:25.285 INFO:tasks.workunit.client.1.smithi170.stdout:6/847: unlink d3/d1d/d36/f14 0 2024-02-15T22:51:25.286 INFO:tasks.workunit.client.1.smithi170.stdout:6/848: dread - d3/d1d/d1b/fe1 zero size 2024-02-15T22:51:25.288 INFO:tasks.workunit.client.1.smithi170.stdout:6/849: unlink d3/d1a/c5c 0 2024-02-15T22:51:25.290 INFO:tasks.workunit.client.1.smithi170.stdout:6/850: unlink d3/c1e 0 2024-02-15T22:51:25.292 INFO:tasks.workunit.client.1.smithi170.stdout:6/851: creat d3/d1a/f126 x:0 0 0 2024-02-15T22:51:25.292 INFO:tasks.workunit.client.1.smithi170.stdout:6/852: truncate d3/d1d/d36/d51/d54/df5/f8c 3300243 0 2024-02-15T22:51:25.292 INFO:tasks.workunit.client.1.smithi170.stdout:6/853: truncate d3/d1d/d1b/d3c/f6f 1018967 0 2024-02-15T22:51:25.292 INFO:tasks.workunit.client.1.smithi170.stdout:6/854: creat d3/d1d/d27/f127 x:0 0 0 2024-02-15T22:51:25.292 INFO:tasks.workunit.client.1.smithi170.stdout:6/855: creat d3/db8/d96/f128 x:0 0 0 2024-02-15T22:51:25.300 INFO:tasks.workunit.client.1.smithi170.stdout:3/930: dwrite d3/dc/d1c/d26/dd4/f63 [0,4194304] 0 2024-02-15T22:51:25.300 INFO:tasks.workunit.client.1.smithi170.stdout:3/931: write d3/d1b/d2c/f13a [473527,80858] 0 2024-02-15T22:51:25.300 INFO:tasks.workunit.client.1.smithi170.stdout:3/932: getdents d3/db 0 2024-02-15T22:51:25.302 INFO:tasks.workunit.client.1.smithi170.stdout:3/933: unlink d3/db/d1f/f4e 0 2024-02-15T22:51:25.304 INFO:tasks.workunit.client.1.smithi170.stdout:6/856: dread d3/d1d/f9f [0,4194304] 0 2024-02-15T22:51:25.306 INFO:tasks.workunit.client.1.smithi170.stdout:6/857: rename d3/d24/d31/dc6/l11a to d3/d1d/d28/l129 0 2024-02-15T22:51:25.306 INFO:tasks.workunit.client.1.smithi170.stdout:6/858: fsync d3/d1d/d1b/fe1 0 2024-02-15T22:51:25.309 INFO:tasks.workunit.client.1.smithi170.stdout:3/934: write d3/d1b/d8a/fac [1898327,16170] 0 2024-02-15T22:51:25.316 INFO:tasks.workunit.client.1.smithi170.stdout:3/935: dread d3/d1b/d51/d6b/d86/dc5/fc8 [0,4194304] 0 2024-02-15T22:51:25.316 INFO:tasks.workunit.client.1.smithi170.stdout:3/936: chown d3/dc/l7c 4 1 2024-02-15T22:51:25.318 INFO:tasks.workunit.client.1.smithi170.stdout:3/937: symlink d3/db/d1f/d61/dad/l145 0 2024-02-15T22:51:25.318 INFO:tasks.workunit.client.1.smithi170.stdout:3/938: creat d3/dc/d1a/d9f/dcb/f146 x:0 0 0 2024-02-15T22:51:25.318 INFO:tasks.workunit.client.1.smithi170.stdout:3/939: write d3/d78/d7a/fc0 [2074391,127789] 0 2024-02-15T22:51:25.320 INFO:tasks.workunit.client.1.smithi170.stdout:3/940: creat d3/d1b/d51/d6b/d86/d12b/f147 x:0 0 0 2024-02-15T22:51:25.321 INFO:tasks.workunit.client.1.smithi170.stdout:3/941: read d3/d78/d7a/fc0 [538075,64920] 0 2024-02-15T22:51:25.323 INFO:tasks.workunit.client.1.smithi170.stdout:3/942: link d3/c8e d3/d1b/d51/d94/c148 0 2024-02-15T22:51:25.323 INFO:tasks.workunit.client.1.smithi170.stdout:3/943: chown d3/dcd/dcf/c11d 41 1 2024-02-15T22:51:25.324 INFO:tasks.workunit.client.1.smithi170.stdout:3/944: rename d3/dc/d1c/c6a to d3/dc/d1c/d26/c149 0 2024-02-15T22:51:25.325 INFO:tasks.workunit.client.1.smithi170.stdout:3/945: rename d3/d1b/d51/d6b/f75 to d3/dc/d1c/d26/d55/d7d/df4/f14a 0 2024-02-15T22:51:25.326 INFO:tasks.workunit.client.1.smithi170.stdout:3/946: dread - d3/dc/f9c zero size 2024-02-15T22:51:25.329 INFO:tasks.workunit.client.1.smithi170.stdout:6/859: dwrite d3/d1d/d1b/d3e/f92 [0,4194304] 0 2024-02-15T22:51:25.331 INFO:tasks.workunit.client.1.smithi170.stdout:6/860: mknod d3/d1d/d36/d56/daf/dd5/c12a 0 2024-02-15T22:51:25.334 INFO:tasks.workunit.client.1.smithi170.stdout:6/861: mknod d3/d1d/d1b/d3e/d9c/c12b 0 2024-02-15T22:51:25.334 INFO:tasks.workunit.client.1.smithi170.stdout:3/947: dread d3/d1b/d51/d94/fb7 [0,4194304] 0 2024-02-15T22:51:25.334 INFO:tasks.workunit.client.1.smithi170.stdout:6/862: dread d3/d1d/d36/d56/d6c/de9/ff6 [0,4194304] 0 2024-02-15T22:51:25.334 INFO:tasks.workunit.client.1.smithi170.stdout:3/948: rename d3/d1b/d2c/d9a/f135 to d3/dc/f14b 0 2024-02-15T22:51:25.335 INFO:tasks.workunit.client.1.smithi170.stdout:3/949: mknod d3/dc/d1a/d9f/dcb/de7/c14c 0 2024-02-15T22:51:25.340 INFO:tasks.workunit.client.1.smithi170.stdout:3/950: write d3/dc/d1c/d26/d55/d7d/df0/ff1 [1638026,82423] 0 2024-02-15T22:51:25.342 INFO:tasks.workunit.client.1.smithi170.stdout:3/951: symlink d3/d78/d7a/d12a/l14d 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/952: write d3/dc/d1a/fab [729050,79701] 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/953: stat d3/dc/d1a/d9f/dcb/dd2/cdb 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/954: write d3/dcd/f12c [366010,53503] 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/955: creat d3/dc/d1a/f14e x:0 0 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/956: chown d3/dc/f5b 48083 1 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/957: getdents d3/dc/d1c/d26/d55/d7d/d107 0 2024-02-15T22:51:25.343 INFO:tasks.workunit.client.1.smithi170.stdout:3/958: write d3/dc/d1c/d26/fbc [1136715,131035] 0 2024-02-15T22:51:25.344 INFO:tasks.workunit.client.1.smithi170.stdout:3/959: mkdir d3/dc/d1c/d26/d55/d7d/df4/d14f 0 2024-02-15T22:51:25.345 INFO:tasks.workunit.client.1.smithi170.stdout:3/960: dread - d3/dc/d1a/f14e zero size 2024-02-15T22:51:25.345 INFO:tasks.workunit.client.1.smithi170.stdout:3/961: creat d3/dc/d1a/d9f/dcb/f150 x:0 0 0 2024-02-15T22:51:25.345 INFO:tasks.workunit.client.1.smithi170.stdout:3/962: write d3/dcd/f12c [1214449,66068] 0 2024-02-15T22:51:25.345 INFO:tasks.workunit.client.1.smithi170.stdout:3/963: chown d3/f9 1775209 1 2024-02-15T22:51:25.348 INFO:tasks.workunit.client.1.smithi170.stdout:6/863: dwrite d3/d1d/d36/fd4 [4194304,4194304] 0 2024-02-15T22:51:25.349 INFO:tasks.workunit.client.1.smithi170.stdout:6/864: symlink d3/d1d/d36/d56/daf/l12c 0 2024-02-15T22:51:25.350 INFO:tasks.workunit.client.1.smithi170.stdout:6/865: rmdir d3/d1d/d36/d56/daf/dd5/df0/d105 39 2024-02-15T22:51:25.351 INFO:tasks.workunit.client.1.smithi170.stdout:3/964: dread d3/dc/d1a/d9f/dec/f122 [0,4194304] 0 2024-02-15T22:51:25.351 INFO:tasks.workunit.client.1.smithi170.stdout:3/965: write d3/d1b/d51/d6b/d86/dc5/fc8 [7726086,40905] 0 2024-02-15T22:51:25.354 INFO:tasks.workunit.client.1.smithi170.stdout:3/966: fsync d3/d1b/d2c/f13a 0 2024-02-15T22:51:25.354 INFO:tasks.workunit.client.1.smithi170.stdout:3/967: truncate d3/d1b/d51/d6b/d86/ff5 319105 0 2024-02-15T22:51:25.355 INFO:tasks.workunit.client.1.smithi170.stdout:3/968: symlink d3/d1b/d51/d6b/d86/l151 0 2024-02-15T22:51:25.357 INFO:tasks.workunit.client.1.smithi170.stdout:3/969: link d3/d1b/d2c/c4c d3/dc/d1a/d9f/dcb/c152 0 2024-02-15T22:51:25.359 INFO:tasks.workunit.client.1.smithi170.stdout:3/970: creat d3/dc/d13/f153 x:0 0 0 2024-02-15T22:51:25.363 INFO:tasks.workunit.client.1.smithi170.stdout:3/971: dread d3/dc/d1a/d9f/dcb/f103 [0,4194304] 0 2024-02-15T22:51:25.363 INFO:tasks.workunit.client.1.smithi170.stdout:3/972: creat d3/d1b/d8a/f154 x:0 0 0 2024-02-15T22:51:25.363 INFO:tasks.workunit.client.1.smithi170.stdout:3/973: fdatasync d3/dc/f116 0 2024-02-15T22:51:25.363 INFO:tasks.workunit.client.1.smithi170.stdout:3/974: fdatasync d3/d1b/d8a/fd8 0 2024-02-15T22:51:25.363 INFO:tasks.workunit.client.1.smithi170.stdout:3/975: dread - d3/db/f10a zero size 2024-02-15T22:51:25.368 INFO:tasks.workunit.client.1.smithi170.stdout:3/976: dread d3/d78/d7a/fc0 [0,4194304] 0 2024-02-15T22:51:25.368 INFO:tasks.workunit.client.1.smithi170.stdout:3/977: write d3/d1b/d2c/d92/da5/f8b [667519,35504] 0 2024-02-15T22:51:25.368 INFO:tasks.workunit.client.1.smithi170.stdout:3/978: chown d3/dc/d1a/d9f/dec/f136 0 1 2024-02-15T22:51:25.369 INFO:tasks.workunit.client.1.smithi170.stdout:6/866: dwrite d3/d1d/d1b/d9b/f103 [0,4194304] 0 2024-02-15T22:51:25.370 INFO:tasks.workunit.client.1.smithi170.stdout:3/979: link d3/d1b/d2c/d92/l93 d3/d1b/d8a/l155 0 2024-02-15T22:51:25.377 INFO:tasks.workunit.client.1.smithi170.stdout:6/867: dread d3/d1d/d27/f43 [0,4194304] 0 2024-02-15T22:51:25.377 INFO:tasks.workunit.client.1.smithi170.stdout:3/980: rename d3/dc/d1a/d9f/dec/ffe to d3/d1b/d8a/df8/d11c/f156 0 2024-02-15T22:51:25.383 INFO:tasks.workunit.client.1.smithi170.stdout:5/983: sync 2024-02-15T22:51:25.383 INFO:tasks.workunit.client.1.smithi170.stdout:9/701: sync 2024-02-15T22:51:25.383 INFO:tasks.workunit.client.1.smithi170.stdout:9/702: creat de/d1b/d1c/d1f/d20/feb x:0 0 0 2024-02-15T22:51:25.384 INFO:tasks.workunit.client.1.smithi170.stdout:5/984: symlink de/d36/df7/l141 0 2024-02-15T22:51:25.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/868: dwrite d3/db8/d96/fe8 [0,4194304] 0 2024-02-15T22:51:25.420 INFO:tasks.workunit.client.1.smithi170.stdout:9/703: dwrite de/d1b/f9f [0,4194304] 0 2024-02-15T22:51:25.421 INFO:tasks.workunit.client.1.smithi170.stdout:3/981: dwrite d3/d1b/d8a/dcc/fce [0,4194304] 0 2024-02-15T22:51:25.421 INFO:tasks.workunit.client.1.smithi170.stdout:5/985: dwrite de/d29/f5a [4194304,4194304] 0 2024-02-15T22:51:25.421 INFO:tasks.workunit.client.1.smithi170.stdout:5/986: fdatasync de/d10/d27/dbd/f110 0 2024-02-15T22:51:25.423 INFO:tasks.workunit.client.1.smithi170.stdout:6/869: creat d3/d1d/d28/d66/d114/d11c/f12d x:0 0 0 2024-02-15T22:51:25.423 INFO:tasks.workunit.client.1.smithi170.stdout:6/870: stat d3/d1d/d28/d66/dd6 0 2024-02-15T22:51:25.424 INFO:tasks.workunit.client.1.smithi170.stdout:5/987: rmdir de/d10/d33 39 2024-02-15T22:51:25.425 INFO:tasks.workunit.client.1.smithi170.stdout:3/982: mkdir d3/d157 0 2024-02-15T22:51:25.425 INFO:tasks.workunit.client.1.smithi170.stdout:3/983: write d3/d1b/d51/d6b/d86/ff5 [834660,47613] 0 2024-02-15T22:51:25.425 INFO:tasks.workunit.client.1.smithi170.stdout:3/984: chown d3/dc/d1c/d26/f100 85690242 1 2024-02-15T22:51:25.426 INFO:tasks.workunit.client.1.smithi170.stdout:5/988: mknod de/d36/d80/d140/c142 0 2024-02-15T22:51:25.426 INFO:tasks.workunit.client.1.smithi170.stdout:5/989: chown de/d10/d7d/le0 53574 1 2024-02-15T22:51:25.426 INFO:tasks.workunit.client.1.smithi170.stdout:3/985: creat d3/d157/f158 x:0 0 0 2024-02-15T22:51:25.427 INFO:tasks.workunit.client.1.smithi170.stdout:3/986: mknod d3/dc/d1c/d26/d55/d7d/c159 0 2024-02-15T22:51:25.427 INFO:tasks.workunit.client.1.smithi170.stdout:6/871: dread d3/d1d/d28/fbc [0,4194304] 0 2024-02-15T22:51:25.427 INFO:tasks.workunit.client.1.smithi170.stdout:6/872: fsync d3/d1d/d27/f2d 0 2024-02-15T22:51:25.429 INFO:tasks.workunit.client.1.smithi170.stdout:6/873: fdatasync d3/d24/d31/f44 0 2024-02-15T22:51:25.429 INFO:tasks.workunit.client.1.smithi170.stdout:3/987: read d3/d1b/d2c/f13a [110907,101364] 0 2024-02-15T22:51:25.429 INFO:tasks.workunit.client.1.smithi170.stdout:3/988: write d3/dcd/dcf/da9/fe2 [706905,35031] 0 2024-02-15T22:51:25.433 INFO:tasks.workunit.client.1.smithi170.stdout:3/989: unlink d3/db/f10a 0 2024-02-15T22:51:25.433 INFO:tasks.workunit.client.1.smithi170.stdout:3/990: read d3/d1b/d2c/d92/da5/f8b [418803,47936] 0 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:3/991: chown d3/dcd/dcf/fe6 1917 1 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:3/992: fsync d3/f42 0 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:3/993: creat d3/d1b/d2c/d92/da5/f15a x:0 0 0 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:3/994: truncate d3/d1b/f8f 4897964 0 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:6/874: symlink d3/d24/d31/d106/l12e 0 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:6/875: chown d3/d1d/d1b/d9b/f103 2785 1 2024-02-15T22:51:25.434 INFO:tasks.workunit.client.1.smithi170.stdout:9/704: write de/d8e/fad [2500861,28971] 0 2024-02-15T22:51:25.435 INFO:tasks.workunit.client.1.smithi170.stdout:3/995: mkdir d3/dc/d1c/d15b 0 2024-02-15T22:51:25.436 INFO:tasks.workunit.client.1.smithi170.stdout:6/876: symlink d3/d1d/d36/d51/d54/df5/l12f 0 2024-02-15T22:51:25.436 INFO:tasks.workunit.client.1.smithi170.stdout:6/877: dread - d3/d1d/d27/f115 zero size 2024-02-15T22:51:25.438 INFO:tasks.workunit.client.1.smithi170.stdout:9/705: unlink de/d1b/d37/c51 0 2024-02-15T22:51:25.439 INFO:tasks.workunit.client.1.smithi170.stdout:3/996: link d3/d1b/d2c/f13a d3/dc/d1c/d26/d55/f15c 0 2024-02-15T22:51:25.439 INFO:tasks.workunit.client.1.smithi170.stdout:3/997: creat d3/d1b/d51/d6b/d86/d12b/f15d x:0 0 0 2024-02-15T22:51:25.439 INFO:tasks.workunit.client.1.smithi170.stdout:3/998: fdatasync d3/d1b/d2c/f77 0 2024-02-15T22:51:25.440 INFO:tasks.workunit.client.1.smithi170.stdout:5/990: dwrite de/d36/df7/f124 [0,4194304] 0 2024-02-15T22:51:25.440 INFO:tasks.workunit.client.1.smithi170.stdout:6/878: link d3/d1d/d28/d3b/cf2 d3/d1d/d36/d56/daf/dd5/df0/dbe/c130 0 2024-02-15T22:51:25.441 INFO:tasks.workunit.client.1.smithi170.stdout:9/706: mknod de/d1b/d1c/d1f/d20/d8c/cec 0 2024-02-15T22:51:25.441 INFO:tasks.workunit.client.1.smithi170.stdout:9/707: truncate de/d1b/d1c/d47/f48 1728315 0 2024-02-15T22:51:25.441 INFO:tasks.workunit.client.1.smithi170.stdout:9/708: creat de/d1b/d37/dab/fed x:0 0 0 2024-02-15T22:51:25.441 INFO:tasks.workunit.client.1.smithi170.stdout:3/999: rmdir d3/dc/d1c 39 2024-02-15T22:51:25.445 INFO:tasks.workunit.client.1.smithi170.stdout:5/991: creat de/d10/d27/dbd/f143 x:0 0 0 2024-02-15T22:51:25.445 INFO:tasks.workunit.client.1.smithi170.stdout:6/879: mkdir d3/d1a/d6d/d131 0 2024-02-15T22:51:25.447 INFO:tasks.workunit.client.1.smithi170.stdout:9/709: creat de/d1b/d1c/d1f/d20/d27/d28/d69/fee x:0 0 0 2024-02-15T22:51:25.447 INFO:tasks.workunit.client.1.smithi170.stdout:9/710: creat de/d1b/d1c/d47/fef x:0 0 0 2024-02-15T22:51:25.451 INFO:tasks.workunit.client.1.smithi170.stdout:6/880: getdents d3/d1d/d27 0 2024-02-15T22:51:25.453 INFO:tasks.workunit.client.1.smithi170.stdout:5/992: dread de/d36/f5e [0,4194304] 0 2024-02-15T22:51:25.453 INFO:tasks.workunit.client.1.smithi170.stdout:6/881: mkdir d3/d1d/d36/d132 0 2024-02-15T22:51:25.459 INFO:tasks.workunit.client.1.smithi170.stdout:5/993: rename de/cf to de/d10/d27/d4c/d53/d55/c144 0 2024-02-15T22:51:25.469 INFO:tasks.workunit.client.1.smithi170.stdout:6/882: dwrite d3/d1d/d1b/d3c/f81 [0,4194304] 0 2024-02-15T22:51:25.470 INFO:tasks.workunit.client.1.smithi170.stdout:6/883: symlink d3/d1d/d28/d3b/l133 0 2024-02-15T22:51:25.470 INFO:tasks.workunit.client.1.smithi170.stdout:6/884: truncate d3/d24/d31/d106/d11e/f11f 847959 0 2024-02-15T22:51:25.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/885: dread d3/d1d/d1b/d3c/fc1 [0,4194304] 0 2024-02-15T22:51:25.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/886: dread - d3/d1d/d27/f115 zero size 2024-02-15T22:51:25.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/887: chown d3/d1d/d1b/d3c/c4b 66753 1 2024-02-15T22:51:25.485 INFO:tasks.workunit.client.1.smithi170.stdout:6/888: readlink d3/db8/d96/l112 0 2024-02-15T22:51:25.486 INFO:tasks.workunit.client.1.smithi170.stdout:5/994: dwrite de/d10/f10e [4194304,4194304] 0 2024-02-15T22:51:25.486 INFO:tasks.workunit.client.1.smithi170.stdout:5/995: chown de/dec 2 1 2024-02-15T22:51:25.487 INFO:tasks.workunit.client.1.smithi170.stdout:6/889: link d3/d1d/d27/fa2 d3/d1d/d36/d56/d6c/d10d/f134 0 2024-02-15T22:51:25.487 INFO:tasks.workunit.client.1.smithi170.stdout:6/890: truncate d3/db8/d96/fe4 1265102 0 2024-02-15T22:51:25.490 INFO:tasks.workunit.client.1.smithi170.stdout:5/996: mknod de/d10/d33/db2/de4/c145 0 2024-02-15T22:51:25.491 INFO:tasks.workunit.client.1.smithi170.stdout:6/891: mkdir d3/d1d/d28/d3b/d135 0 2024-02-15T22:51:25.491 INFO:tasks.workunit.client.1.smithi170.stdout:6/892: creat d3/d1d/d1b/f136 x:0 0 0 2024-02-15T22:51:25.492 INFO:tasks.workunit.client.1.smithi170.stdout:5/997: truncate de/d10/d33/f5d 289748 0 2024-02-15T22:51:25.492 INFO:tasks.workunit.client.1.smithi170.stdout:5/998: chown de/d10/d33/d9f/d7c/d87/fdf 138729695 1 2024-02-15T22:51:25.492 INFO:tasks.workunit.client.1.smithi170.stdout:5/999: creat de/dec/f146 x:0 0 0 2024-02-15T22:51:25.498 INFO:tasks.workunit.client.1.smithi170.stdout:6/893: fsync d3/d1d/d27/fa2 0 2024-02-15T22:51:25.498 INFO:tasks.workunit.client.1.smithi170.stdout:6/894: chown d3/d1d/d36/d56/daf/dd5/df0/dbe/c6b 1 1 2024-02-15T22:51:25.524 INFO:tasks.workunit.client.1.smithi170.stdout:6/895: dwrite d3/db8/d96/fe4 [0,4194304] 0 2024-02-15T22:51:25.525 INFO:tasks.workunit.client.1.smithi170.stdout:6/896: creat d3/d1d/d28/f137 x:0 0 0 2024-02-15T22:51:25.525 INFO:tasks.workunit.client.1.smithi170.stdout:6/897: dread - d3/d1d/d53/f122 zero size 2024-02-15T22:51:25.528 INFO:tasks.workunit.client.1.smithi170.stdout:6/898: getdents d3/d24/d31/dc6 0 2024-02-15T22:51:25.528 INFO:tasks.workunit.client.1.smithi170.stdout:6/899: creat d3/d1d/d27/d70/d82/f138 x:0 0 0 2024-02-15T22:51:25.528 INFO:tasks.workunit.client.1.smithi170.stdout:6/900: stat d3/d1d/d36/d51/d54/df5/f8c 0 2024-02-15T22:51:25.530 INFO:tasks.workunit.client.1.smithi170.stdout:6/901: symlink d3/d1d/d1b/d3e/d9c/l139 0 2024-02-15T22:51:25.532 INFO:tasks.workunit.client.1.smithi170.stdout:6/902: mkdir d3/d1d/d28/d66/d114/d11c/d13a 0 2024-02-15T22:51:25.532 INFO:tasks.workunit.client.1.smithi170.stdout:6/903: write d3/d1d/d1b/ff9 [417594,37692] 0 2024-02-15T22:51:25.534 INFO:tasks.workunit.client.1.smithi170.stdout:6/904: unlink d3/d1d/d36/d56/c7f 0 2024-02-15T22:51:25.549 INFO:tasks.workunit.client.1.smithi170.stdout:6/905: dwrite d3/d1d/d1b/d3c/fb6 [4194304,4194304] 0 2024-02-15T22:51:25.551 INFO:tasks.workunit.client.1.smithi170.stdout:6/906: mknod d3/d1d/d53/c13b 0 2024-02-15T22:51:25.551 INFO:tasks.workunit.client.1.smithi170.stdout:6/907: chown d3/d1d/d36/l8b 3916969 1 2024-02-15T22:51:25.551 INFO:tasks.workunit.client.1.smithi170.stdout:6/908: mkdir d3/d1d/dd3/d13c 0 2024-02-15T22:51:25.554 INFO:tasks.workunit.client.1.smithi170.stdout:6/909: dread d3/d24/f35 [0,4194304] 0 2024-02-15T22:51:25.556 INFO:tasks.workunit.client.1.smithi170.stdout:6/910: unlink d3/d1d/d36/d56/daf/dd5/df0/lb9 0 2024-02-15T22:51:25.557 INFO:tasks.workunit.client.1.smithi170.stdout:6/911: mkdir d3/d1d/d28/d66/dd6/d13d 0 2024-02-15T22:51:25.558 INFO:tasks.workunit.client.1.smithi170.stdout:6/912: symlink d3/d1d/d28/d3b/d135/l13e 0 2024-02-15T22:51:25.561 INFO:tasks.workunit.client.1.smithi170.stdout:6/913: mkdir d3/d24/d31/d13f 0 2024-02-15T22:51:25.562 INFO:tasks.workunit.client.1.smithi170.stdout:6/914: symlink d3/d1d/d1b/d3c/l140 0 2024-02-15T22:51:25.562 INFO:tasks.workunit.client.1.smithi170.stdout:4/893: sync 2024-02-15T22:51:25.562 INFO:tasks.workunit.client.1.smithi170.stdout:0/852: sync 2024-02-15T22:51:25.564 INFO:tasks.workunit.client.1.smithi170.stdout:6/915: creat d3/d1d/d1b/d3e/d5d/f141 x:0 0 0 2024-02-15T22:51:25.566 INFO:tasks.workunit.client.1.smithi170.stdout:0/853: link d8/d14/l45 d8/d14/l10f 0 2024-02-15T22:51:25.566 INFO:tasks.workunit.client.1.smithi170.stdout:0/854: readlink d8/df/d13/l1d 0 2024-02-15T22:51:25.568 INFO:tasks.workunit.client.1.smithi170.stdout:4/894: symlink d0/d22/da/d8b/d47/dbe/da2/l126 0 2024-02-15T22:51:25.570 INFO:tasks.workunit.client.1.smithi170.stdout:6/916: rename d3/d1d/d28/d3b/da3/fa8 to d3/d1d/d36/d56/daf/dd5/df0/d105/f142 0 2024-02-15T22:51:25.570 INFO:tasks.workunit.client.1.smithi170.stdout:6/917: readlink d3/d24/lef 0 2024-02-15T22:51:25.572 INFO:tasks.workunit.client.1.smithi170.stdout:0/855: link d8/d14/d70/f7a d8/d6d/dda/de5/dfe/f110 0 2024-02-15T22:51:25.574 INFO:tasks.workunit.client.1.smithi170.stdout:4/895: link d0/d22/d10c/f11a d0/d22/da/d8b/d47/d5e/d7d/dd9/f127 0 2024-02-15T22:51:25.575 INFO:tasks.workunit.client.1.smithi170.stdout:6/918: creat d3/d1d/d1b/d113/f143 x:0 0 0 2024-02-15T22:51:25.584 INFO:tasks.workunit.client.1.smithi170.stdout:4/896: write d0/d22/da/d8b/d47/d67/d77/fc0 [4184865,106648] 0 2024-02-15T22:51:25.584 INFO:tasks.workunit.client.1.smithi170.stdout:4/897: chown d0/d22/da/d8b/d47/d67/d77/dc5/dff/f11d 1 1 2024-02-15T22:51:25.585 INFO:tasks.workunit.client.1.smithi170.stdout:4/898: mknod d0/d22/da/d8b/d47/d67/d77/dc5/dea/c128 0 2024-02-15T22:51:25.587 INFO:tasks.workunit.client.1.smithi170.stdout:4/899: symlink d0/d22/da/d8b/d47/d5e/d79/l129 0 2024-02-15T22:51:25.600 INFO:tasks.workunit.client.1.smithi170.stdout:4/900: dread d0/d22/da/d8b/d47/d67/f7a [0,4194304] 0 2024-02-15T22:51:25.601 INFO:tasks.workunit.client.1.smithi170.stdout:6/919: dwrite d3/d1d/d1b/d3e/d5d/f141 [0,4194304] 0 2024-02-15T22:51:25.601 INFO:tasks.workunit.client.1.smithi170.stdout:4/901: creat d0/d22/da/d8b/d47/d67/d77/dc5/d110/f12a x:0 0 0 2024-02-15T22:51:25.602 INFO:tasks.workunit.client.1.smithi170.stdout:0/856: dwrite d8/d14/d6f/fca [0,4194304] 0 2024-02-15T22:51:25.604 INFO:tasks.workunit.client.1.smithi170.stdout:6/920: creat d3/d1d/d36/d56/daf/dd5/df0/dbe/f144 x:0 0 0 2024-02-15T22:51:25.605 INFO:tasks.workunit.client.1.smithi170.stdout:4/902: rename d0/d22/da/d8b/d80 to d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b 0 2024-02-15T22:51:25.608 INFO:tasks.workunit.client.1.smithi170.stdout:0/857: dread d8/d14/d1c/f2b [0,4194304] 0 2024-02-15T22:51:25.612 INFO:tasks.workunit.client.1.smithi170.stdout:6/921: rename d3/d1d/d36/f13 to d3/d1d/d36/d132/f145 0 2024-02-15T22:51:25.614 INFO:tasks.workunit.client.1.smithi170.stdout:4/903: dread d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/f96 [0,4194304] 0 2024-02-15T22:51:25.614 INFO:tasks.workunit.client.1.smithi170.stdout:4/904: write d0/d22/d10c/f11a [422647,33432] 0 2024-02-15T22:51:25.615 INFO:tasks.workunit.client.1.smithi170.stdout:0/858: rename d8/d14/d1c/f35 to d8/d14/d1c/d3f/f111 0 2024-02-15T22:51:25.616 INFO:tasks.workunit.client.1.smithi170.stdout:6/922: mkdir d3/d1a/d6d/d131/d146 0 2024-02-15T22:51:25.616 INFO:tasks.workunit.client.1.smithi170.stdout:6/923: chown d3/d1d/d28/d3b/ldf 155 1 2024-02-15T22:51:25.621 INFO:tasks.workunit.client.1.smithi170.stdout:6/924: dread d3/d24/d31/f44 [0,4194304] 0 2024-02-15T22:51:25.622 INFO:tasks.workunit.client.1.smithi170.stdout:4/905: write d0/d22/da/d8b/d47/dbe/d20/f82 [7029381,66630] 0 2024-02-15T22:51:25.622 INFO:tasks.workunit.client.1.smithi170.stdout:4/906: write d0/d22/da/d8b/d47/dbe/f45 [5433823,1815] 0 2024-02-15T22:51:25.626 INFO:tasks.workunit.client.1.smithi170.stdout:0/859: dread d8/d6d/d96/f107 [0,4194304] 0 2024-02-15T22:51:25.626 INFO:tasks.workunit.client.1.smithi170.stdout:8/683: sync 2024-02-15T22:51:25.627 INFO:tasks.workunit.client.1.smithi170.stdout:1/964: sync 2024-02-15T22:51:25.627 INFO:tasks.workunit.client.1.smithi170.stdout:8/684: chown d9/d18/d32/d7a/d78/d95/lbc 1943 1 2024-02-15T22:51:25.627 INFO:tasks.workunit.client.1.smithi170.stdout:0/860: creat d8/d6d/dda/de5/f112 x:0 0 0 2024-02-15T22:51:25.631 INFO:tasks.workunit.client.1.smithi170.stdout:9/711: sync 2024-02-15T22:51:25.631 INFO:tasks.workunit.client.1.smithi170.stdout:8/685: creat d9/d18/d32/d3b/d42/fe6 x:0 0 0 2024-02-15T22:51:25.632 INFO:tasks.workunit.client.1.smithi170.stdout:9/712: creat de/da6/ff0 x:0 0 0 2024-02-15T22:51:25.634 INFO:tasks.workunit.client.1.smithi170.stdout:8/686: rename d9/d18/d32/d3b/d4b/l56 to d9/d18/d32/d3b/d68/le7 0 2024-02-15T22:51:25.634 INFO:tasks.workunit.client.1.smithi170.stdout:9/713: rmdir de/d1b/d1c/d1f/d20/d27/d2c 39 2024-02-15T22:51:25.636 INFO:tasks.workunit.client.1.smithi170.stdout:9/714: fsync de/d8e/fcc 0 2024-02-15T22:51:25.636 INFO:tasks.workunit.client.1.smithi170.stdout:8/687: getdents d9/d18/d32/dab 0 2024-02-15T22:51:25.638 INFO:tasks.workunit.client.1.smithi170.stdout:9/715: symlink de/d1b/lf1 0 2024-02-15T22:51:25.638 INFO:tasks.workunit.client.1.smithi170.stdout:9/716: dread - de/d1b/d37/dab/fed zero size 2024-02-15T22:51:25.640 INFO:tasks.workunit.client.1.smithi170.stdout:9/717: mkdir de/d1b/d1c/d1f/d20/d27/df2 0 2024-02-15T22:51:25.640 INFO:tasks.workunit.client.1.smithi170.stdout:9/718: truncate de/d1b/d37/dab/fdf 253804 0 2024-02-15T22:51:25.643 INFO:tasks.workunit.client.1.smithi170.stdout:9/719: rmdir de/d97 39 2024-02-15T22:51:25.643 INFO:tasks.workunit.client.1.smithi170.stdout:9/720: truncate de/d1b/d37/dab/fed 62149 0 2024-02-15T22:51:25.645 INFO:tasks.workunit.client.1.smithi170.stdout:9/721: creat de/d1b/d1c/d1f/d20/d27/d84/ff3 x:0 0 0 2024-02-15T22:51:25.645 INFO:tasks.workunit.client.1.smithi170.stdout:9/722: write de/d1b/d37/dab/fe9 [518748,35672] 0 2024-02-15T22:51:25.645 INFO:tasks.workunit.client.1.smithi170.stdout:9/723: creat de/d1b/d1c/ff4 x:0 0 0 2024-02-15T22:51:25.646 INFO:tasks.workunit.client.1.smithi170.stdout:9/724: readlink de/d1b/d1c/d1f/d20/d27/d2c/lb6 0 2024-02-15T22:51:25.646 INFO:tasks.workunit.client.1.smithi170.stdout:9/725: creat de/d1b/d37/dab/ff5 x:0 0 0 2024-02-15T22:51:25.649 INFO:tasks.workunit.client.1.smithi170.stdout:9/726: dread de/d1b/f25 [0,4194304] 0 2024-02-15T22:51:25.649 INFO:tasks.workunit.client.1.smithi170.stdout:9/727: chown de/d1b/fd5 838686 1 2024-02-15T22:51:25.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/728: rmdir de/d1b/d37/dab/de0 0 2024-02-15T22:51:25.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/729: readlink de/d1b/d1c/d1f/d20/l6c 0 2024-02-15T22:51:25.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/730: creat de/d1b/d1c/d1f/d20/ff6 x:0 0 0 2024-02-15T22:51:25.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/731: creat de/d1b/d1c/d1f/d20/d27/d28/d69/ff7 x:0 0 0 2024-02-15T22:51:25.651 INFO:tasks.workunit.client.1.smithi170.stdout:9/732: chown de/d97/lbe 343076 1 2024-02-15T22:51:25.653 INFO:tasks.workunit.client.1.smithi170.stdout:9/733: getdents de/d97 0 2024-02-15T22:51:25.655 INFO:tasks.workunit.client.1.smithi170.stdout:9/734: rmdir de/d1b/d1c/d1f/d20/d27/d28/d7a 39 2024-02-15T22:51:25.655 INFO:tasks.workunit.client.1.smithi170.stdout:9/735: readlink de/d1b/d1c/d1f/d20/d27/d84/lc7 0 2024-02-15T22:51:25.655 INFO:tasks.workunit.client.1.smithi170.stdout:9/736: truncate de/d1b/d1c/d1f/f9b 582497 0 2024-02-15T22:51:25.656 INFO:tasks.workunit.client.1.smithi170.stdout:1/965: dwrite d3/d24/d2c/d77/fe7 [0,4194304] 0 2024-02-15T22:51:25.656 INFO:tasks.workunit.client.1.smithi170.stdout:4/907: dwrite d0/d22/da/d8b/d47/d5e/d7d/f9c [0,4194304] 0 2024-02-15T22:51:25.656 INFO:tasks.workunit.client.1.smithi170.stdout:4/908: readlink d0/d22/da/d8b/d47/d5e/d79/l129 0 2024-02-15T22:51:25.656 INFO:tasks.workunit.client.1.smithi170.stdout:8/688: dwrite d9/fd [4194304,4194304] 0 2024-02-15T22:51:25.656 INFO:tasks.workunit.client.1.smithi170.stdout:8/689: write d9/d18/d32/f4a [4811702,52715] 0 2024-02-15T22:51:25.657 INFO:tasks.workunit.client.1.smithi170.stdout:9/737: creat de/d97/ddc/ff8 x:0 0 0 2024-02-15T22:51:25.658 INFO:tasks.workunit.client.1.smithi170.stdout:1/966: creat d3/f144 x:0 0 0 2024-02-15T22:51:25.663 INFO:tasks.workunit.client.1.smithi170.stdout:8/690: dread d9/d18/d26/d4f/f80 [0,4194304] 0 2024-02-15T22:51:25.663 INFO:tasks.workunit.client.1.smithi170.stdout:9/738: rename de/d1b/d37/dab/ff5 to de/d1b/d1c/ff9 0 2024-02-15T22:51:25.664 INFO:tasks.workunit.client.1.smithi170.stdout:8/691: symlink d9/d18/d32/db1/le8 0 2024-02-15T22:51:25.667 INFO:tasks.workunit.client.1.smithi170.stdout:8/692: mknod d9/d18/d32/d7a/ce9 0 2024-02-15T22:51:25.671 INFO:tasks.workunit.client.1.smithi170.stdout:9/739: rename de/d1b/d1c/d1f/d20/d27/d28/d69 to de/d1b/d1c/d1f/d20/d27/df2/dfa 0 2024-02-15T22:51:25.671 INFO:tasks.workunit.client.1.smithi170.stdout:8/693: rename d9 to d9/d18/d32/d3b/d4b/dea 22 2024-02-15T22:51:25.671 INFO:tasks.workunit.client.1.smithi170.stdout:9/740: dread - de/d1b/d1c/d1f/d20/d27/d2c/f9d zero size 2024-02-15T22:51:25.672 INFO:tasks.workunit.client.1.smithi170.stdout:8/694: symlink d9/d18/d32/dab/leb 0 2024-02-15T22:51:25.674 INFO:tasks.workunit.client.1.smithi170.stdout:1/967: dread d3/d24/d2c/f6d [0,4194304] 0 2024-02-15T22:51:25.675 INFO:tasks.workunit.client.1.smithi170.stdout:8/695: creat d9/db2/dd7/da5/fec x:0 0 0 2024-02-15T22:51:25.676 INFO:tasks.workunit.client.1.smithi170.stdout:9/741: mknod de/d1b/cfb 0 2024-02-15T22:51:25.676 INFO:tasks.workunit.client.1.smithi170.stdout:8/696: mknod d9/d18/d26/dd5/ced 0 2024-02-15T22:51:25.676 INFO:tasks.workunit.client.1.smithi170.stdout:8/697: write d9/d18/d32/d3b/d68/fc1 [1097887,125602] 0 2024-02-15T22:51:25.679 INFO:tasks.workunit.client.1.smithi170.stdout:8/698: creat d9/d18/d26/dd5/fee x:0 0 0 2024-02-15T22:51:25.680 INFO:tasks.workunit.client.1.smithi170.stdout:4/909: dwrite d0/d22/da/d8b/d47/d67/d77/dc5/dff/f11d [0,4194304] 0 2024-02-15T22:51:25.683 INFO:tasks.workunit.client.1.smithi170.stdout:8/699: dread d9/d18/d32/d3b/d42/fb0 [0,4194304] 0 2024-02-15T22:51:25.683 INFO:tasks.workunit.client.1.smithi170.stdout:8/700: chown d9/db2/dd7/da5 0 1 2024-02-15T22:51:25.683 INFO:tasks.workunit.client.1.smithi170.stdout:8/701: fdatasync d9/f97 0 2024-02-15T22:51:25.684 INFO:tasks.workunit.client.1.smithi170.stdout:4/910: link d0/d22/da/d8b/f114 d0/d22/da/d8b/d47/d67/d77/f12c 0 2024-02-15T22:51:25.684 INFO:tasks.workunit.client.1.smithi170.stdout:4/911: write d0/d22/da/d8b/d47/dbe/d89/de8/fdd [235459,48082] 0 2024-02-15T22:51:25.685 INFO:tasks.workunit.client.1.smithi170.stdout:9/742: rename de/d1b/d1c/d1f/d20/d8c to de/d1b/d1c/d1f/d20/d27/dfc 0 2024-02-15T22:51:25.686 INFO:tasks.workunit.client.1.smithi170.stdout:1/968: write d3/da2/f44 [1734760,90469] 0 2024-02-15T22:51:25.687 INFO:tasks.workunit.client.1.smithi170.stdout:4/912: creat d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/d116/f12d x:0 0 0 2024-02-15T22:51:25.688 INFO:tasks.workunit.client.1.smithi170.stdout:1/969: dread d3/d24/d2c/d5e/f8a [0,4194304] 0 2024-02-15T22:51:25.688 INFO:tasks.workunit.client.1.smithi170.stdout:9/743: mkdir de/d1b/d1c/d1f/d20/d78/dfd 0 2024-02-15T22:51:25.690 INFO:tasks.workunit.client.1.smithi170.stdout:8/702: symlink d9/lef 0 2024-02-15T22:51:25.690 INFO:tasks.workunit.client.1.smithi170.stdout:8/703: fdatasync d9/fd 0 2024-02-15T22:51:25.690 INFO:tasks.workunit.client.1.smithi170.stdout:8/704: creat d9/db2/ff0 x:0 0 0 2024-02-15T22:51:25.692 INFO:tasks.workunit.client.1.smithi170.stdout:4/913: creat d0/d22/da/d8b/d47/da9/de7/f12e x:0 0 0 2024-02-15T22:51:25.693 INFO:tasks.workunit.client.1.smithi170.stdout:1/970: symlink d3/d24/d2c/d77/d110/d118/d130/l145 0 2024-02-15T22:51:25.694 INFO:tasks.workunit.client.1.smithi170.stdout:9/744: mknod de/d1b/d37/cfe 0 2024-02-15T22:51:25.697 INFO:tasks.workunit.client.1.smithi170.stdout:8/705: dread d9/d18/d32/d3b/d42/f74 [0,4194304] 0 2024-02-15T22:51:25.701 INFO:tasks.workunit.client.1.smithi170.stdout:4/914: symlink d0/d22/da/d8b/d47/d67/l12f 0 2024-02-15T22:51:25.702 INFO:tasks.workunit.client.1.smithi170.stdout:9/745: creat de/d1b/d1c/d1f/d20/d27/d28/d7a/fff x:0 0 0 2024-02-15T22:51:25.702 INFO:tasks.workunit.client.1.smithi170.stdout:1/971: write d3/d24/d2c/d77/fe5 [1747933,11802] 0 2024-02-15T22:51:25.702 INFO:tasks.workunit.client.1.smithi170.stdout:1/972: chown d3/d24/d2c/d77/dce/ffe 171 1 2024-02-15T22:51:25.703 INFO:tasks.workunit.client.1.smithi170.stdout:8/706: mknod d9/d18/d32/d3b/dc5/cf1 0 2024-02-15T22:51:25.705 INFO:tasks.workunit.client.1.smithi170.stdout:4/915: creat d0/d22/da/d8b/d47/d5e/f130 x:0 0 0 2024-02-15T22:51:25.708 INFO:tasks.workunit.client.1.smithi170.stdout:9/746: unlink de/d1b/d1c/d1f/d20/d27/df2/dfa/ff7 0 2024-02-15T22:51:25.710 INFO:tasks.workunit.client.1.smithi170.stdout:4/916: symlink d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/d10a/l131 0 2024-02-15T22:51:25.710 INFO:tasks.workunit.client.1.smithi170.stdout:4/917: creat d0/d22/da/d8b/d47/d67/d77/dc5/d110/f132 x:0 0 0 2024-02-15T22:51:25.711 INFO:tasks.workunit.client.1.smithi170.stdout:1/973: dread d3/d24/d2c/d35/f75 [0,4194304] 0 2024-02-15T22:51:25.713 INFO:tasks.workunit.client.1.smithi170.stdout:9/747: rename de/d1b/d1c/d1f/fc2 to de/d1b/d1c/d1f/d20/d78/f100 0 2024-02-15T22:51:25.715 INFO:tasks.workunit.client.1.smithi170.stdout:4/918: dread d0/d22/da/d8b/d47/dbe/f36 [0,4194304] 0 2024-02-15T22:51:25.715 INFO:tasks.workunit.client.1.smithi170.stdout:1/974: mknod d3/d24/d2c/d77/d8f/dcd/c146 0 2024-02-15T22:51:25.716 INFO:tasks.workunit.client.1.smithi170.stdout:4/919: mknod d0/d22/da/d8b/d47/d5e/c133 0 2024-02-15T22:51:25.717 INFO:tasks.workunit.client.1.smithi170.stdout:4/920: truncate d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb/f102 486012 0 2024-02-15T22:51:25.718 INFO:tasks.workunit.client.1.smithi170.stdout:1/975: creat d3/d24/d2c/d77/d8f/dcd/f147 x:0 0 0 2024-02-15T22:51:25.719 INFO:tasks.workunit.client.1.smithi170.stdout:4/921: unlink d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/le9 0 2024-02-15T22:51:25.722 INFO:tasks.workunit.client.1.smithi170.stdout:8/707: dwrite d9/d18/d48/f5b [4194304,4194304] 0 2024-02-15T22:51:25.723 INFO:tasks.workunit.client.1.smithi170.stdout:8/708: chown d9/d18/d32/dab/fd6 2 1 2024-02-15T22:51:25.723 INFO:tasks.workunit.client.1.smithi170.stdout:8/709: readlink d9/d18/d32/l52 0 2024-02-15T22:51:25.723 INFO:tasks.workunit.client.1.smithi170.stdout:8/710: truncate d9/d18/d32/d99/fa6 1826255 0 2024-02-15T22:51:25.725 INFO:tasks.workunit.client.1.smithi170.stdout:8/711: rename d9/d18/d32/f3a to d9/d18/d26/ff2 0 2024-02-15T22:51:25.736 INFO:tasks.workunit.client.1.smithi170.stdout:9/748: write de/d1b/d1c/d1f/d20/d27/d2c/f32 [1503862,13343] 0 2024-02-15T22:51:25.736 INFO:tasks.workunit.client.1.smithi170.stdout:9/749: readlink de/d1b/l4b 0 2024-02-15T22:51:25.736 INFO:tasks.workunit.client.1.smithi170.stdout:9/750: creat de/d1b/d1c/d1f/d20/d27/d84/f101 x:0 0 0 2024-02-15T22:51:25.737 INFO:tasks.workunit.client.1.smithi170.stdout:9/751: creat de/d1b/d1c/d1f/d20/d78/f102 x:0 0 0 2024-02-15T22:51:25.737 INFO:tasks.workunit.client.1.smithi170.stdout:9/752: dread - de/d1b/d1c/d1f/d20/d27/d2c/f9d zero size 2024-02-15T22:51:25.739 INFO:tasks.workunit.client.1.smithi170.stdout:9/753: symlink de/d1b/d37/dab/l103 0 2024-02-15T22:51:25.739 INFO:tasks.workunit.client.1.smithi170.stdout:9/754: creat de/da6/f104 x:0 0 0 2024-02-15T22:51:25.740 INFO:tasks.workunit.client.1.smithi170.stdout:9/755: mknod de/d1b/d1c/d1f/d20/d27/d2c/c105 0 2024-02-15T22:51:25.745 INFO:tasks.workunit.client.1.smithi170.stdout:4/922: dwrite d0/f21 [0,4194304] 0 2024-02-15T22:51:25.751 INFO:tasks.workunit.client.1.smithi170.stdout:8/712: dwrite d9/d18/d32/d7a/d78/d7f/d98/f9f [0,4194304] 0 2024-02-15T22:51:25.753 INFO:tasks.workunit.client.1.smithi170.stdout:1/976: dwrite d3/d24/d2c/d77/fe5 [0,4194304] 0 2024-02-15T22:51:25.767 INFO:tasks.workunit.client.1.smithi170.stdout:4/923: dwrite d0/d22/da/d8b/d47/f7e [0,4194304] 0 2024-02-15T22:51:25.768 INFO:tasks.workunit.client.1.smithi170.stdout:4/924: getdents d0/d22/da/d8b/d47 0 2024-02-15T22:51:25.769 INFO:tasks.workunit.client.1.smithi170.stdout:9/756: dwrite de/d1b/d1c/fc6 [0,4194304] 0 2024-02-15T22:51:25.769 INFO:tasks.workunit.client.1.smithi170.stdout:4/925: symlink d0/d22/d10c/l134 0 2024-02-15T22:51:25.770 INFO:tasks.workunit.client.1.smithi170.stdout:9/757: creat de/d1b/d1c/d1f/d20/d27/d28/f106 x:0 0 0 2024-02-15T22:51:25.770 INFO:tasks.workunit.client.1.smithi170.stdout:9/758: write de/d1b/d1c/d1f/d20/d27/d28/d80/fcf [348168,82697] 0 2024-02-15T22:51:25.772 INFO:tasks.workunit.client.1.smithi170.stdout:4/926: creat d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/f135 x:0 0 0 2024-02-15T22:51:25.772 INFO:tasks.workunit.client.1.smithi170.stdout:4/927: stat d0/d22/da/d8b/d47/d67/d77/dc5/dea/c128 0 2024-02-15T22:51:25.774 INFO:tasks.workunit.client.1.smithi170.stdout:4/928: link d0/d22/da/f5b d0/d22/da/d8b/d47/d2b/f136 0 2024-02-15T22:51:25.781 INFO:tasks.workunit.client.1.smithi170.stdout:4/929: dread d0/d22/da/d8b/d47/dbe/d20/f23 [0,4194304] 0 2024-02-15T22:51:25.781 INFO:tasks.workunit.client.1.smithi170.stdout:8/713: dwrite d9/d18/d32/d3b/f40 [0,4194304] 0 2024-02-15T22:51:25.782 INFO:tasks.workunit.client.1.smithi170.stdout:4/930: unlink d0/d22/da/d8b/d47/d5e/d79/cf6 0 2024-02-15T22:51:25.783 INFO:tasks.workunit.client.1.smithi170.stdout:8/714: creat d9/d18/d32/d7a/ff3 x:0 0 0 2024-02-15T22:51:25.785 INFO:tasks.workunit.client.1.smithi170.stdout:4/931: rmdir d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/d116 39 2024-02-15T22:51:25.786 INFO:tasks.workunit.client.1.smithi170.stdout:4/932: fsync d0/d22/db9/f120 0 2024-02-15T22:51:25.786 INFO:tasks.workunit.client.1.smithi170.stdout:4/933: chown d0/d22/ce2 901 1 2024-02-15T22:51:25.786 INFO:tasks.workunit.client.1.smithi170.stdout:4/934: mknod d0/c137 0 2024-02-15T22:51:25.787 INFO:tasks.workunit.client.1.smithi170.stdout:4/935: truncate d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f113 489380 0 2024-02-15T22:51:25.787 INFO:tasks.workunit.client.1.smithi170.stdout:4/936: creat d0/d22/da/f138 x:0 0 0 2024-02-15T22:51:25.788 INFO:tasks.workunit.client.1.smithi170.stdout:4/937: mknod d0/c139 0 2024-02-15T22:51:25.789 INFO:tasks.workunit.client.1.smithi170.stdout:4/938: symlink d0/l13a 0 2024-02-15T22:51:25.790 INFO:tasks.workunit.client.1.smithi170.stdout:1/977: dwrite d3/d24/fd2 [0,4194304] 0 2024-02-15T22:51:25.790 INFO:tasks.workunit.client.1.smithi170.stdout:1/978: write d3/d24/d2c/d35/d72/f78 [1175527,2475] 0 2024-02-15T22:51:25.790 INFO:tasks.workunit.client.1.smithi170.stdout:9/759: dwrite de/f8f [0,4194304] 0 2024-02-15T22:51:25.790 INFO:tasks.workunit.client.1.smithi170.stdout:9/760: chown de/da6/f104 25 1 2024-02-15T22:51:25.790 INFO:tasks.workunit.client.1.smithi170.stdout:9/761: write de/d1b/d1c/d47/fef [203071,22703] 0 2024-02-15T22:51:25.791 INFO:tasks.workunit.client.1.smithi170.stdout:9/762: write f4 [3123495,118917] 0 2024-02-15T22:51:25.794 INFO:tasks.workunit.client.1.smithi170.stdout:1/979: symlink d3/d24/d2c/d77/dce/l148 0 2024-02-15T22:51:25.798 INFO:tasks.workunit.client.1.smithi170.stdout:4/939: dread d0/d22/da/d8b/d47/f7e [0,4194304] 0 2024-02-15T22:51:25.798 INFO:tasks.workunit.client.1.smithi170.stdout:4/940: stat d0/c139 0 2024-02-15T22:51:25.806 INFO:tasks.workunit.client.1.smithi170.stdout:8/715: dwrite d9/d18/d32/d3b/f6c [0,4194304] 0 2024-02-15T22:51:25.806 INFO:tasks.workunit.client.1.smithi170.stdout:8/716: fsync d9/d18/d32/d3b/d4b/f8f 0 2024-02-15T22:51:25.806 INFO:tasks.workunit.client.1.smithi170.stdout:8/717: truncate d9/d18/d32/d3b/d68/fa8 119795 0 2024-02-15T22:51:25.806 INFO:tasks.workunit.client.1.smithi170.stdout:1/980: symlink d3/d24/d2c/d35/d83/l149 0 2024-02-15T22:51:25.807 INFO:tasks.workunit.client.1.smithi170.stdout:4/941: creat d0/d22/da8/f13b x:0 0 0 2024-02-15T22:51:25.807 INFO:tasks.workunit.client.1.smithi170.stdout:4/942: stat d0/d22/da/d8b/d47/dbe/d89 0 2024-02-15T22:51:25.808 INFO:tasks.workunit.client.1.smithi170.stdout:9/763: rmdir de/d1b/d1c/d1f/d20/d27/d84 39 2024-02-15T22:51:25.812 INFO:tasks.workunit.client.1.smithi170.stdout:8/718: mknod d9/d18/d32/d3b/d68/cf4 0 2024-02-15T22:51:25.812 INFO:tasks.workunit.client.1.smithi170.stdout:8/719: stat d9/db2/dd7 0 2024-02-15T22:51:25.814 INFO:tasks.workunit.client.1.smithi170.stdout:1/981: rename d3/d24/d2c/d94/dd9/c13a to d3/d24/d2c/c14a 0 2024-02-15T22:51:25.814 INFO:tasks.workunit.client.1.smithi170.stdout:1/982: readlink d3/d24/d2c/d35/d72/d7e/lc4 0 2024-02-15T22:51:25.814 INFO:tasks.workunit.client.1.smithi170.stdout:1/983: stat d3/d24/d2c/d35/d72/df1 0 2024-02-15T22:51:25.815 INFO:tasks.workunit.client.1.smithi170.stdout:9/764: creat de/d1b/d1c/d1f/d20/d27/d28/d80/f107 x:0 0 0 2024-02-15T22:51:25.816 INFO:tasks.workunit.client.1.smithi170.stdout:8/720: dread d9/f82 [0,4194304] 0 2024-02-15T22:51:25.817 INFO:tasks.workunit.client.1.smithi170.stdout:1/984: creat d3/d24/d2c/d77/d110/d118/f14b x:0 0 0 2024-02-15T22:51:25.817 INFO:tasks.workunit.client.1.smithi170.stdout:1/985: write d3/d24/d2c/d5e/f8a [296328,1633] 0 2024-02-15T22:51:25.818 INFO:tasks.workunit.client.1.smithi170.stdout:9/765: creat de/d1b/d1c/d1f/d20/d78/dfd/f108 x:0 0 0 2024-02-15T22:51:25.818 INFO:tasks.workunit.client.1.smithi170.stdout:9/766: write de/d1b/f6a [1934498,118392] 0 2024-02-15T22:51:25.819 INFO:tasks.workunit.client.1.smithi170.stdout:1/986: mkdir d3/d24/d2c/d35/d72/d92/d14c 0 2024-02-15T22:51:25.820 INFO:tasks.workunit.client.1.smithi170.stdout:0/861: sync 2024-02-15T22:51:25.820 INFO:tasks.workunit.client.1.smithi170.stdout:6/925: sync 2024-02-15T22:51:25.820 INFO:tasks.workunit.client.1.smithi170.stdout:6/926: rename d3/d1d/d36/d56 to d3/d1d/d36/d56/daf/dd5/df0/dbe/d147 22 2024-02-15T22:51:25.820 INFO:tasks.workunit.client.1.smithi170.stdout:6/927: dread - d3/d1d/d1b/fe1 zero size 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:8/721: read d9/d18/d32/d3b/d42/f74 [2207206,42889] 0 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:8/722: chown d9/d18/d26 677 1 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:4/943: dwrite d0/d22/da/d8b/d47/dbe/d20/d49/fef [0,4194304] 0 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:4/944: write d0/d22/da/d8b/d47/d2b/faa [1175565,59919] 0 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:1/987: write d3/d24/d2c/d35/f82 [590147,128941] 0 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:9/767: mkdir de/d1b/d1c/d1f/d20/d27/dfc/d109 0 2024-02-15T22:51:25.821 INFO:tasks.workunit.client.1.smithi170.stdout:9/768: creat de/d1b/d1c/d47/f10a x:0 0 0 2024-02-15T22:51:25.822 INFO:tasks.workunit.client.1.smithi170.stdout:6/928: creat d3/d1d/d36/d56/d6c/d10d/f148 x:0 0 0 2024-02-15T22:51:25.822 INFO:tasks.workunit.client.1.smithi170.stdout:6/929: readlink d3/d1d/d36/d56/daf/dd5/df0/d105/l117 0 2024-02-15T22:51:25.823 INFO:tasks.workunit.client.1.smithi170.stdout:8/723: mkdir d9/d18/d32/d3b/dc5/df5 0 2024-02-15T22:51:25.826 INFO:tasks.workunit.client.1.smithi170.stdout:4/945: unlink d0/d22/cb3 0 2024-02-15T22:51:25.826 INFO:tasks.workunit.client.1.smithi170.stdout:4/946: fdatasync d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/fdc 0 2024-02-15T22:51:25.827 INFO:tasks.workunit.client.1.smithi170.stdout:4/947: read d0/d22/d10c/f11a [211365,87832] 0 2024-02-15T22:51:25.827 INFO:tasks.workunit.client.1.smithi170.stdout:0/862: read d8/df/d13/d22/d6a/d7e/fef [1423751,5539] 0 2024-02-15T22:51:25.828 INFO:tasks.workunit.client.1.smithi170.stdout:1/988: link d3/fb d3/d24/d2c/d77/d110/d118/d130/f14d 0 2024-02-15T22:51:25.830 INFO:tasks.workunit.client.1.smithi170.stdout:9/769: symlink de/d97/ddc/l10b 0 2024-02-15T22:51:25.830 INFO:tasks.workunit.client.1.smithi170.stdout:6/930: write d3/d1d/d27/f4a [3282509,130761] 0 2024-02-15T22:51:25.832 INFO:tasks.workunit.client.1.smithi170.stdout:8/724: mknod d9/d18/d26/cf6 0 2024-02-15T22:51:25.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/770: dread de/f75 [0,4194304] 0 2024-02-15T22:51:25.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/771: chown de/f12 5 1 2024-02-15T22:51:25.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/772: truncate de/d1b/d1c/ff9 754498 0 2024-02-15T22:51:25.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/773: chown de/d1b/d1c/d1f/d20/d78/f100 4180382 1 2024-02-15T22:51:25.834 INFO:tasks.workunit.client.1.smithi170.stdout:9/774: fdatasync de/d1b/d1c/d1f/d20/d27/d28/f9a 0 2024-02-15T22:51:25.835 INFO:tasks.workunit.client.1.smithi170.stdout:4/948: write d0/d22/da/d8b/d47/dbe/d20/fc4 [3326903,10483] 0 2024-02-15T22:51:25.835 INFO:tasks.workunit.client.1.smithi170.stdout:1/989: unlink d3/d24/d2c/d35/d72/d7e/cdd 0 2024-02-15T22:51:25.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/725: symlink d9/db2/dd7/lf7 0 2024-02-15T22:51:25.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/726: creat d9/d18/d32/d7a/d78/d7f/ff8 x:0 0 0 2024-02-15T22:51:25.837 INFO:tasks.workunit.client.1.smithi170.stdout:8/727: truncate d9/f6d 579499 0 2024-02-15T22:51:25.838 INFO:tasks.workunit.client.1.smithi170.stdout:1/990: dread d3/da2/f39 [0,4194304] 0 2024-02-15T22:51:25.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/863: rmdir d8/d6d/dda/de5 39 2024-02-15T22:51:25.839 INFO:tasks.workunit.client.1.smithi170.stdout:9/775: creat de/d8e/f10c x:0 0 0 2024-02-15T22:51:25.841 INFO:tasks.workunit.client.1.smithi170.stdout:4/949: rename d0/d22/da/d8b/d47/d67/f10b to d0/d22/da/d8b/d47/dbe/d89/de8/f13c 0 2024-02-15T22:51:25.845 INFO:tasks.workunit.client.1.smithi170.stdout:1/991: creat d3/d24/d2c/d35/d72/d92/d123/f14e x:0 0 0 2024-02-15T22:51:25.845 INFO:tasks.workunit.client.1.smithi170.stdout:1/992: truncate d3/d24/d2c/d5e/f8a 1052505 0 2024-02-15T22:51:25.847 INFO:tasks.workunit.client.1.smithi170.stdout:0/864: creat d8/d14/d70/d93/ddc/f113 x:0 0 0 2024-02-15T22:51:25.848 INFO:tasks.workunit.client.1.smithi170.stdout:4/950: getdents d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/d116 0 2024-02-15T22:51:25.849 INFO:tasks.workunit.client.1.smithi170.stdout:4/951: dread - d0/d22/da/d8b/d47/dbe/da2/fd2 zero size 2024-02-15T22:51:25.849 INFO:tasks.workunit.client.1.smithi170.stdout:6/931: dwrite d3/d1d/d1b/ff9 [0,4194304] 0 2024-02-15T22:51:25.849 INFO:tasks.workunit.client.1.smithi170.stdout:6/932: dread - d3/db8/d96/f128 zero size 2024-02-15T22:51:25.849 INFO:tasks.workunit.client.1.smithi170.stdout:4/952: write d0/f84 [571505,6517] 0 2024-02-15T22:51:25.850 INFO:tasks.workunit.client.1.smithi170.stdout:8/728: link d9/l36 d9/d18/d32/d7a/lf9 0 2024-02-15T22:51:25.852 INFO:tasks.workunit.client.1.smithi170.stdout:1/993: unlink d3/d24/d2c/d35/d12c/l138 0 2024-02-15T22:51:25.852 INFO:tasks.workunit.client.1.smithi170.stdout:1/994: creat d3/d24/d2c/d35/d72/d92/d123/f14f x:0 0 0 2024-02-15T22:51:25.852 INFO:tasks.workunit.client.1.smithi170.stdout:1/995: fdatasync d3/d24/d2c/d35/fe3 0 2024-02-15T22:51:25.853 INFO:tasks.workunit.client.1.smithi170.stdout:9/776: truncate de/f12 1698842 0 2024-02-15T22:51:25.853 INFO:tasks.workunit.client.1.smithi170.stdout:9/777: creat de/d1b/d1c/d1f/d20/d78/f10d x:0 0 0 2024-02-15T22:51:25.856 INFO:tasks.workunit.client.1.smithi170.stdout:4/953: rmdir d0/d22/da/d8b/d47/dbe/d89/de8 39 2024-02-15T22:51:25.857 INFO:tasks.workunit.client.1.smithi170.stdout:8/729: unlink d9/db2/dd7/da5/cb4 0 2024-02-15T22:51:25.857 INFO:tasks.workunit.client.1.smithi170.stdout:8/730: truncate d9/d18/d32/d7a/ff3 285733 0 2024-02-15T22:51:25.857 INFO:tasks.workunit.client.1.smithi170.stdout:8/731: dread - d9/d18/d26/fba zero size 2024-02-15T22:51:25.858 INFO:tasks.workunit.client.1.smithi170.stdout:8/732: chown d9/d18/d32/d99/db7/de0 4 1 2024-02-15T22:51:25.859 INFO:tasks.workunit.client.1.smithi170.stdout:0/865: link d8/df/d13/d22/d39/cb6 d8/df/d13/d36/c114 0 2024-02-15T22:51:25.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/996: dread d3/da2/f44 [0,4194304] 0 2024-02-15T22:51:25.863 INFO:tasks.workunit.client.1.smithi170.stdout:1/997: fdatasync d3/d24/d2c/d77/d8f/dcd/f147 0 2024-02-15T22:51:25.864 INFO:tasks.workunit.client.1.smithi170.stdout:1/998: chown d3/d24/d2c/f30 1694593445 1 2024-02-15T22:51:25.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/954: mkdir d0/d22/d6e/d13d 0 2024-02-15T22:51:25.864 INFO:tasks.workunit.client.1.smithi170.stdout:4/955: fsync d0/d22/da/d8b/d47/d5e/ff8 0 2024-02-15T22:51:25.865 INFO:tasks.workunit.client.1.smithi170.stdout:0/866: symlink d8/d14/d1c/d3f/d53/df9/l115 0 2024-02-15T22:51:25.865 INFO:tasks.workunit.client.1.smithi170.stdout:4/956: write d0/d22/da/d8b/d47/d2b/f52 [253789,112177] 0 2024-02-15T22:51:25.866 INFO:tasks.workunit.client.1.smithi170.stdout:6/933: dwrite d3/d1d/d28/d66/d114/d11c/f12d [0,4194304] 0 2024-02-15T22:51:25.866 INFO:tasks.workunit.client.1.smithi170.stdout:0/867: mknod d8/d14/d1c/d3f/dce/dd5/c116 0 2024-02-15T22:51:25.868 INFO:tasks.workunit.client.1.smithi170.stdout:1/999: write d3/d24/d2c/d35/f75 [1161149,122291] 0 2024-02-15T22:51:25.870 INFO:tasks.workunit.client.1.smithi170.stdout:6/934: symlink d3/d1d/d36/d56/d6c/de9/l149 0 2024-02-15T22:51:25.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/935: dread - d3/d1d/d36/d56/daf/dd5/fe2 zero size 2024-02-15T22:51:25.871 INFO:tasks.workunit.client.1.smithi170.stdout:6/936: creat d3/d1d/d28/d66/d114/d11c/f14a x:0 0 0 2024-02-15T22:51:25.872 INFO:tasks.workunit.client.1.smithi170.stdout:0/868: link d8/d14/d1c/fc4 d8/df/f117 0 2024-02-15T22:51:25.872 INFO:tasks.workunit.client.1.smithi170.stdout:0/869: fdatasync d8/d14/d70/d93/ddc/f113 0 2024-02-15T22:51:25.873 INFO:tasks.workunit.client.1.smithi170.stdout:6/937: dread d3/d1d/d1b/d3e/d5d/fbf [0,4194304] 0 2024-02-15T22:51:25.883 INFO:tasks.workunit.client.1.smithi170.stdout:9/778: dwrite de/d1b/d1c/d47/f4d [4194304,4194304] 0 2024-02-15T22:51:25.883 INFO:tasks.workunit.client.1.smithi170.stdout:9/779: write de/d1b/d37/dab/fdf [946735,5567] 0 2024-02-15T22:51:25.885 INFO:tasks.workunit.client.1.smithi170.stdout:8/733: dwrite d9/d18/d32/d3b/dc5/fdc [0,4194304] 0 2024-02-15T22:51:25.887 INFO:tasks.workunit.client.1.smithi170.stdout:9/780: mknod de/d1b/d1c/d1f/d20/c10e 0 2024-02-15T22:51:25.910 INFO:tasks.workunit.client.1.smithi170.stdout:4/957: dwrite d0/d22/da/d8b/d47/f8e [0,4194304] 0 2024-02-15T22:51:25.910 INFO:tasks.workunit.client.1.smithi170.stdout:0/870: dwrite d8/df/d13/f5c [0,4194304] 0 2024-02-15T22:51:25.911 INFO:tasks.workunit.client.1.smithi170.stdout:6/938: dwrite d3/d1d/d36/d56/daf/dd5/df0/f111 [0,4194304] 0 2024-02-15T22:51:25.911 INFO:tasks.workunit.client.1.smithi170.stdout:6/939: chown d3/d1d/d28/d3b/ldf 211 1 2024-02-15T22:51:25.911 INFO:tasks.workunit.client.1.smithi170.stdout:9/781: dwrite de/d1b/d1c/d1f/d20/d78/f102 [0,4194304] 0 2024-02-15T22:51:25.911 INFO:tasks.workunit.client.1.smithi170.stdout:9/782: creat de/d1b/d1c/f10f x:0 0 0 2024-02-15T22:51:25.912 INFO:tasks.workunit.client.1.smithi170.stdout:8/734: dwrite d9/d18/d26/fba [0,4194304] 0 2024-02-15T22:51:25.912 INFO:tasks.workunit.client.1.smithi170.stdout:8/735: creat d9/dd0/ffa x:0 0 0 2024-02-15T22:51:25.913 INFO:tasks.workunit.client.1.smithi170.stdout:4/958: mknod d0/d22/da/d8b/d47/d5e/d7d/c13e 0 2024-02-15T22:51:25.918 INFO:tasks.workunit.client.1.smithi170.stdout:0/871: read d8/df/d13/d36/d60/fba [2900116,79063] 0 2024-02-15T22:51:25.918 INFO:tasks.workunit.client.1.smithi170.stdout:0/872: stat d8/df/d13/d22/f10e 0 2024-02-15T22:51:25.920 INFO:tasks.workunit.client.1.smithi170.stdout:6/940: rename d3/d1d/d1b/d3e/d9c to d3/d1a/d6d/d131/d14b 0 2024-02-15T22:51:25.924 INFO:tasks.workunit.client.1.smithi170.stdout:8/736: mknod d9/dd0/cfb 0 2024-02-15T22:51:25.925 INFO:tasks.workunit.client.1.smithi170.stdout:0/873: dread d8/d14/d70/f7a [0,4194304] 0 2024-02-15T22:51:25.926 INFO:tasks.workunit.client.1.smithi170.stdout:4/959: creat d0/d22/da/d8b/d47/d67/d77/dc5/dea/f13f x:0 0 0 2024-02-15T22:51:25.927 INFO:tasks.workunit.client.1.smithi170.stdout:6/941: readlink d3/d24/d31/lcc 0 2024-02-15T22:51:25.928 INFO:tasks.workunit.client.1.smithi170.stdout:8/737: mknod d9/d18/d32/d7a/d78/cfc 0 2024-02-15T22:51:25.930 INFO:tasks.workunit.client.1.smithi170.stdout:4/960: creat d0/d22/da/d8b/d47/d5e/d7d/dd9/d12b/d117/f140 x:0 0 0 2024-02-15T22:51:25.931 INFO:tasks.workunit.client.1.smithi170.stdout:9/783: rename de/d8e/fb9 to de/d1b/d37/f110 0 2024-02-15T22:51:25.931 INFO:tasks.workunit.client.1.smithi170.stdout:9/784: creat de/da6/f111 x:0 0 0 2024-02-15T22:51:25.933 INFO:tasks.workunit.client.1.smithi170.stdout:6/942: mkdir d3/d1d/d27/d70/d82/d14c 0 2024-02-15T22:51:25.936 INFO:tasks.workunit.client.1.smithi170.stdout:8/738: mkdir d9/d18/d32/d99/db7/de0/dfd 0 2024-02-15T22:51:25.936 INFO:tasks.workunit.client.1.smithi170.stdout:8/739: chown d9/d18/d32/d3b/d68/fc1 30 1 2024-02-15T22:51:25.940 INFO:tasks.workunit.client.1.smithi170.stdout:8/740: rename d9/d18/d32/d3b/d42 to d9/d18/d32/d3b/dfe 0 2024-02-15T22:51:25.941 INFO:tasks.workunit.client.1.smithi170.stdout:6/943: write d3/d24/d31/f34 [949200,129158] 0 2024-02-15T22:51:25.943 INFO:tasks.workunit.client.1.smithi170.stdout:8/741: unlink d9/l2f 0 2024-02-15T22:51:25.944 INFO:tasks.workunit.client.1.smithi170.stdout:6/944: truncate d3/fa 979256 0 2024-02-15T22:51:25.948 INFO:tasks.workunit.client.1.smithi170.stdout:6/945: write d3/d1d/d28/d3b/da3/f124 [4093329,47244] 0 2024-02-15T22:51:25.949 INFO:tasks.workunit.client.1.smithi170.stdout:8/742: dread d9/fd [0,4194304] 0 2024-02-15T22:51:25.949 INFO:tasks.workunit.client.1.smithi170.stdout:8/743: fdatasync d9/ff 0 2024-02-15T22:51:25.951 INFO:tasks.workunit.client.1.smithi170.stdout:8/744: symlink d9/d18/d32/d7a/d78/lff 0 2024-02-15T22:51:25.951 INFO:tasks.workunit.client.1.smithi170.stdout:8/745: dread - d9/d18/fc7 zero size 2024-02-15T22:51:25.952 INFO:tasks.workunit.client.1.smithi170.stdout:8/746: rename d9/d18/d32/d3b/ldd to d9/db2/l100 0 2024-02-15T22:51:25.954 INFO:tasks.workunit.client.1.smithi170.stdout:8/747: link d9/d18/d32/d7a/ce1 d9/d18/d32/d3b/dc5/df5/c101 0 2024-02-15T22:51:25.954 INFO:tasks.workunit.client.1.smithi170.stdout:8/748: chown d9/d18/d32/d99/db7/fe5 31 1 2024-02-15T22:51:25.954 INFO:tasks.workunit.client.1.smithi170.stdout:8/749: dread - d9/d18/d32/d7a/f7b zero size 2024-02-15T22:51:25.955 INFO:tasks.workunit.client.1.smithi170.stdout:8/750: getdents d9/d18/d32/dab 0 2024-02-15T22:51:25.956 INFO:tasks.workunit.client.1.smithi170.stdout:8/751: getdents d9/d18/d26/d4f 0 2024-02-15T22:51:25.956 INFO:tasks.workunit.client.1.smithi170.stdout:8/752: chown d9/d18/f23 31828445 1 2024-02-15T22:51:25.957 INFO:tasks.workunit.client.1.smithi170.stdout:0/874: dwrite d8/df/d13/d22/f7c [0,4194304] 0 2024-02-15T22:51:25.957 INFO:tasks.workunit.client.1.smithi170.stdout:0/875: fsync d8/d14/d44/f103 0 2024-02-15T22:51:25.957 INFO:tasks.workunit.client.1.smithi170.stdout:4/961: dwrite d0/d22/da/d8b/d47/da9/de7/f12e [0,4194304] 0 2024-02-15T22:51:25.957 INFO:tasks.workunit.client.1.smithi170.stdout:4/962: write d0/d22/da8/f13b [138625,11875] 0 2024-02-15T22:51:25.963 INFO:tasks.workunit.client.1.smithi170.stdout:8/753: read d9/d18/d32/f4a [568944,73251] 0 2024-02-15T22:51:25.963 INFO:tasks.workunit.client.1.smithi170.stdout:0/876: rename d8/d14/d1c/d3f/d51/lb7 to d8/df/d13/d22/d6a/d7e/l118 0 2024-02-15T22:51:25.965 INFO:tasks.workunit.client.1.smithi170.stdout:4/963: mknod d0/d22/da/d8b/d47/d2b/c141 0 2024-02-15T22:51:25.968 INFO:tasks.workunit.client.1.smithi170.stdout:8/754: read d9/d18/d32/d3b/f41 [1773739,40111] 0 2024-02-15T22:51:25.982 INFO:tasks.workunit.client.1.smithi170.stdout:8/755: dwrite d9/d18/d26/fba [0,4194304] 0 2024-02-15T22:51:25.983 INFO:tasks.workunit.client.1.smithi170.stdout:8/756: chown d9/d18/d48/c72 459902 1 2024-02-15T22:51:25.983 INFO:tasks.workunit.client.1.smithi170.stdout:8/757: creat d9/d18/d32/d7a/d78/d7f/d98/f102 x:0 0 0 2024-02-15T22:51:25.985 INFO:tasks.workunit.client.1.smithi170.stdout:8/758: mkdir d9/d18/d32/d99/d103 0 2024-02-15T22:51:25.985 INFO:tasks.workunit.client.1.smithi170.stdout:8/759: symlink d9/d18/l104 0 2024-02-15T22:51:25.985 INFO:tasks.workunit.client.1.smithi170.stdout:8/760: dread - d9/d18/d26/dd5/fee zero size 2024-02-15T22:51:26.007 INFO:tasks.workunit.client.1.smithi170.stdout:8/761: dwrite d9/d18/d32/d7a/d78/d7f/d98/f102 [0,4194304] 0 2024-02-15T22:51:26.007 INFO:tasks.workunit.client.1.smithi170.stdout:8/762: stat d9/f6d 0 2024-02-15T22:51:26.008 INFO:tasks.workunit.client.1.smithi170.stdout:8/763: stat d9/l57 0 2024-02-15T22:51:26.010 INFO:tasks.workunit.client.1.smithi170.stdout:8/764: rmdir d9/d18/d26 39 2024-02-15T22:51:26.010 INFO:tasks.workunit.client.1.smithi170.stdout:8/765: creat d9/d18/d32/d99/db7/f105 x:0 0 0 2024-02-15T22:51:26.011 INFO:tasks.workunit.client.1.smithi170.stdout:8/766: write d9/d18/d32/d3b/f90 [1180403,54888] 0 2024-02-15T22:51:26.130 INFO:tasks.workunit.client.1.smithi170.stdout:9/785: sync 2024-02-15T22:51:26.130 INFO:tasks.workunit.client.1.smithi170.stdout:9/786: symlink de/d1b/d1c/d1f/d20/d27/df2/dfa/l112 0 2024-02-15T22:51:26.132 INFO:tasks.workunit.client.1.smithi170.stdout:9/787: unlink de/d1b/d1c/d1f/d20/fbc 0 2024-02-15T22:51:26.132 INFO:tasks.workunit.client.1.smithi170.stdout:9/788: fdatasync de/d1b/d1c/d47/f10a 0 2024-02-15T22:51:26.223 INFO:tasks.workunit.client.1.smithi170.stdout:8/767: sync 2024-02-15T22:51:26.223 INFO:tasks.workunit.client.1.smithi170.stdout:6/946: sync 2024-02-15T22:51:26.223 INFO:tasks.workunit.client.1.smithi170.stdout:0/877: sync 2024-02-15T22:51:26.223 INFO:tasks.workunit.client.1.smithi170.stdout:4/964: sync 2024-02-15T22:51:26.223 INFO:tasks.workunit.client.1.smithi170.stdout:8/768: creat d9/d18/f106 x:0 0 0 2024-02-15T22:51:26.225 INFO:tasks.workunit.client.1.smithi170.stdout:4/965: mknod d0/d22/da/d8b/d47/d67/d77/dc5/dea/c142 0 2024-02-15T22:51:26.230 INFO:tasks.workunit.client.1.smithi170.stdout:8/769: rename d9/d18/f23 to d9/d18/d32/d3b/f107 0 2024-02-15T22:51:26.231 INFO:tasks.workunit.client.1.smithi170.stdout:4/966: mkdir d0/d22/d10c/d143 0 2024-02-15T22:51:26.232 INFO:tasks.workunit.client.1.smithi170.stdout:0/878: read d8/d14/d1c/d3f/f111 [588770,60642] 0 2024-02-15T22:51:26.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/770: mknod d9/d18/d32/d99/db7/de0/dfd/c108 0 2024-02-15T22:51:26.232 INFO:tasks.workunit.client.1.smithi170.stdout:8/771: fdatasync d9/d18/d32/d3b/d68/f8e 0 2024-02-15T22:51:26.234 INFO:tasks.workunit.client.1.smithi170.stdout:0/879: mknod d8/df/d13/d36/d60/da2/c119 0 2024-02-15T22:51:26.235 INFO:tasks.workunit.client.1.smithi170.stdout:8/772: creat d9/d18/d32/db1/f109 x:0 0 0 2024-02-15T22:51:26.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/880: mknod d8/d14/d1c/d3f/d51/de1/c11a 0 2024-02-15T22:51:26.236 INFO:tasks.workunit.client.1.smithi170.stdout:0/881: readlink d8/d14/d1c/d3f/d53/df9/l115 0 2024-02-15T22:51:26.237 INFO:tasks.workunit.client.1.smithi170.stdout:8/773: rename d9/d18/d32/d3b/dc5/fdc to d9/d18/d26/dd5/f10a 0 2024-02-15T22:51:26.238 INFO:tasks.workunit.client.1.smithi170.stdout:8/774: read d9/d18/d32/d3b/d68/fc1 [1347853,51553] 0 2024-02-15T22:51:26.238 INFO:tasks.workunit.client.1.smithi170.stdout:8/775: readlink d9/d18/d32/dab/ld4 0 2024-02-15T22:51:26.238 INFO:tasks.workunit.client.1.smithi170.stdout:8/776: rename d9/d18/d32 to d9/d18/d32/db1/d10b 22 2024-02-15T22:51:26.238 INFO:tasks.workunit.client.1.smithi170.stdout:6/947: dwrite d3/d1d/d1b/d3e/d5d/fbf [0,4194304] 0 2024-02-15T22:51:26.238 INFO:tasks.workunit.client.1.smithi170.stdout:0/882: creat d8/df/d13/f11b x:0 0 0 2024-02-15T22:51:26.239 INFO:tasks.workunit.client.1.smithi170.stdout:4/967: rmdir d0/d22/da/d8b/d47/d67/d77/dc5/dea 39 2024-02-15T22:51:26.246 INFO:tasks.workunit.client.1.smithi170.stdout:4/968: mknod d0/d22/d10c/d143/c144 0 2024-02-15T22:51:26.248 INFO:tasks.workunit.client.1.smithi170.stdout:4/969: truncate d0/d22/da/d8b/d47/f7e 3949783 0 2024-02-15T22:51:26.249 INFO:tasks.workunit.client.1.smithi170.stdout:0/883: dread d8/fa8 [0,4194304] 0 2024-02-15T22:51:26.252 INFO:tasks.workunit.client.1.smithi170.stdout:4/970: symlink d0/l145 0 2024-02-15T22:51:26.252 INFO:tasks.workunit.client.1.smithi170.stdout:8/777: dwrite d9/d18/d32/d99/db7/f105 [0,4194304] 0 2024-02-15T22:51:26.252 INFO:tasks.workunit.client.1.smithi170.stdout:8/778: readlink d9/d18/d32/d7a/d78/l89 0 2024-02-15T22:51:26.252 INFO:tasks.workunit.client.1.smithi170.stdout:8/779: fsync d9/d18/d32/d3b/d68/f8e 0 2024-02-15T22:51:26.253 INFO:tasks.workunit.client.1.smithi170.stdout:9/789: sync 2024-02-15T22:51:26.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/971: unlink d0/d22/da/d8b/d47/d5e/d7d/dd9/f127 0 2024-02-15T22:51:26.254 INFO:tasks.workunit.client.1.smithi170.stdout:4/972: fdatasync d0/d22/da/d8b/d47/dbe/d20/d49/ffe 0 2024-02-15T22:51:26.256 INFO:tasks.workunit.client.1.smithi170.stdout:6/948: truncate d3/d1d/d1b/d3e/d5d/fbf 1355855 0 2024-02-15T22:51:26.258 INFO:tasks.workunit.client.1.smithi170.stdout:0/884: write d8/f94 [975650,16231] 0 2024-02-15T22:51:26.258 INFO:tasks.workunit.client.1.smithi170.stdout:0/885: dread - d8/d14/d70/d93/ff6 zero size 2024-02-15T22:51:26.258 INFO:tasks.workunit.client.1.smithi170.stdout:8/780: creat d9/d18/d32/d99/d103/f10c x:0 0 0 2024-02-15T22:51:26.258 INFO:tasks.workunit.client.1.smithi170.stdout:8/781: stat d9/d18/d32/d7a/d78 0 2024-02-15T22:51:26.260 INFO:tasks.workunit.client.1.smithi170.stdout:4/973: unlink d0/d22/da/d8b/d47/dbe/l64 0 2024-02-15T22:51:26.261 INFO:tasks.workunit.client.1.smithi170.stdout:6/949: link d3/d1d/d1b/d3e/f88 d3/d1d/d28/d66/d114/d11c/f14d 0 2024-02-15T22:51:26.263 INFO:tasks.workunit.client.1.smithi170.stdout:9/790: dread de/d1b/d1c/f5b [0,4194304] 0 2024-02-15T22:51:26.263 INFO:tasks.workunit.client.1.smithi170.stdout:9/791: creat de/d1b/d1c/d1f/d20/d78/dfd/f113 x:0 0 0 2024-02-15T22:51:26.263 INFO:tasks.workunit.client.1.smithi170.stdout:0/886: creat d8/df/d13/d36/d60/da2/f11c x:0 0 0 2024-02-15T22:51:26.265 INFO:tasks.workunit.client.1.smithi170.stdout:0/887: dread d8/df/d13/f85 [0,4194304] 0 2024-02-15T22:51:26.265 INFO:tasks.workunit.client.1.smithi170.stdout:8/782: link d9/d18/f1e d9/d18/d32/d3b/f10d 0 2024-02-15T22:51:26.267 INFO:tasks.workunit.client.1.smithi170.stdout:6/950: getdents d3/d1d/d36/d132 0 2024-02-15T22:51:26.272 INFO:tasks.workunit.client.1.smithi170.stdout:0/888: rename d8/d14/f76 to d8/d6d/dda/de5/dfe/f11d 0 2024-02-15T22:51:26.272 INFO:tasks.workunit.client.1.smithi170.stdout:0/889: read f1 [1262099,64611] 0 2024-02-15T22:51:26.273 INFO:tasks.workunit.client.1.smithi170.stdout:4/974: getdents d0 0 2024-02-15T22:51:26.274 INFO:tasks.workunit.client.1.smithi170.stdout:4/975: fsync d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f10f 0 2024-02-15T22:51:26.274 INFO:tasks.workunit.client.1.smithi170.stdout:4/976: fdatasync d0/d22/da/d8b/d47/f4b 0 2024-02-15T22:51:26.275 INFO:tasks.workunit.client.1.smithi170.stdout:6/951: creat d3/d1d/d36/d56/d6c/de9/f14e x:0 0 0 2024-02-15T22:51:26.275 INFO:tasks.workunit.client.1.smithi170.stdout:6/952: chown d3/d1d/d53/f93 150393 1 2024-02-15T22:51:26.276 INFO:tasks.workunit.client.1.smithi170.stdout:0/890: mkdir d8/df/d13/d36/d60/da2/d11e 0 2024-02-15T22:51:26.278 INFO:tasks.workunit.client.1.smithi170.stdout:4/977: symlink d0/d22/da/d8b/d47/d5e/d7d/dc9/ddb/l146 0 2024-02-15T22:51:26.278 INFO:tasks.workunit.client.1.smithi170.stdout:4/978: fsync d0/d22/da/d8b/d47/dbe/d20/fa0 0 2024-02-15T22:51:26.278 INFO:tasks.workunit.client.1.smithi170.stdout:4/979: truncate d0/d22/d6e/fc1 5107839 0 2024-02-15T22:51:26.279 INFO:tasks.workunit.client.1.smithi170.stdout:6/953: stat d3/d24/d31/l69 0 2024-02-15T22:51:26.279 INFO:tasks.workunit.client.1.smithi170.stdout:6/954: creat d3/d1d/d36/d56/d6c/d10d/f14f x:0 0 0 2024-02-15T22:51:26.283 INFO:tasks.workunit.client.1.smithi170.stdout:6/955: rename d3/d1a/fa7 to d3/d1d/d28/d3b/da3/de5/f150 0 2024-02-15T22:51:26.284 INFO:tasks.workunit.client.1.smithi170.stdout:6/956: write d3/d1d/d36/d56/daf/dd5/df0/fca [150090,81919] 0 2024-02-15T22:51:26.286 INFO:tasks.workunit.client.1.smithi170.stdout:6/957: creat d3/d1d/d28/d66/d114/f151 x:0 0 0 2024-02-15T22:51:26.287 INFO:tasks.workunit.client.1.smithi170.stdout:6/958: symlink d3/d1d/d1b/d3e/d5d/l152 0 2024-02-15T22:51:26.287 INFO:tasks.workunit.client.1.smithi170.stdout:6/959: dread - d3/d1d/d36/d56/d6c/dc4/f11b zero size 2024-02-15T22:51:26.287 INFO:tasks.workunit.client.1.smithi170.stdout:6/960: read d3/d24/ffe [379483,81828] 0 2024-02-15T22:51:26.287 INFO:tasks.workunit.client.1.smithi170.stdout:6/961: creat d3/d24/d31/d106/f153 x:0 0 0 2024-02-15T22:51:26.289 INFO:tasks.workunit.client.1.smithi170.stdout:6/962: symlink d3/d1d/d53/l154 0 2024-02-15T22:51:26.298 INFO:tasks.workunit.client.1.smithi170.stdout:9/792: dwrite de/d8e/fad [4194304,4194304] 0 2024-02-15T22:51:26.298 INFO:tasks.workunit.client.1.smithi170.stdout:4/980: dwrite d0/d22/da/d8b/d47/dbe/f26 [0,4194304] 0 2024-02-15T22:51:26.298 INFO:tasks.workunit.client.1.smithi170.stdout:9/793: chown de/d1b/d1c/d1f/d20/fce 767091336 1 2024-02-15T22:51:26.300 INFO:tasks.workunit.client.1.smithi170.stdout:9/794: mknod de/da6/c114 0 2024-02-15T22:51:26.300 INFO:tasks.workunit.client.1.smithi170.stdout:9/795: truncate de/d1b/d1c/d47/f10a 601283 0 2024-02-15T22:51:26.300 INFO:tasks.workunit.client.1.smithi170.stdout:9/796: dread - de/d97/ddc/ff8 zero size 2024-02-15T22:51:26.300 INFO:tasks.workunit.client.1.smithi170.stdout:9/797: write de/d1b/d1c/d1f/d20/feb [40216,18588] 0 2024-02-15T22:51:26.301 INFO:tasks.workunit.client.1.smithi170.stdout:9/798: chown de/da6 218 1 2024-02-15T22:51:26.301 INFO:tasks.workunit.client.1.smithi170.stdout:8/783: dwrite d9/d18/fc7 [0,4194304] 0 2024-02-15T22:51:26.301 INFO:tasks.workunit.client.1.smithi170.stdout:8/784: write d9/db2/dd7/da5/fec [567455,57802] 0 2024-02-15T22:51:26.301 INFO:tasks.workunit.client.1.smithi170.stdout:8/785: truncate d9/dd0/fda 294891 0 2024-02-15T22:51:26.304 INFO:tasks.workunit.client.1.smithi170.stdout:8/786: link d9/d18/d48/f5b d9/d18/f10e 0 2024-02-15T22:51:26.307 INFO:tasks.workunit.client.1.smithi170.stdout:0/891: write d8/df/d13/f2e [2308857,32113] 0 2024-02-15T22:51:26.308 INFO:tasks.workunit.client.1.smithi170.stdout:0/892: unlink d8/d14/d1c/d3f/d53/df9/l115 0 2024-02-15T22:51:26.310 INFO:tasks.workunit.client.1.smithi170.stdout:0/893: read d8/d14/d1c/d3f/d53/fb2 [617153,112099] 0 2024-02-15T22:51:26.310 INFO:tasks.workunit.client.1.smithi170.stdout:0/894: write d8/d14/f108 [308528,85070] 0 2024-02-15T22:51:26.311 INFO:tasks.workunit.client.1.smithi170.stdout:0/895: unlink d8/d14/d1c/d3f/dce/ld2 0 2024-02-15T22:51:26.315 INFO:tasks.workunit.client.1.smithi170.stdout:0/896: dread d8/df/d13/d22/d39/d55/f8e [0,4194304] 0 2024-02-15T22:51:26.315 INFO:tasks.workunit.client.1.smithi170.stdout:0/897: read - d8/d14/d70/d93/dd0/fe6 zero size 2024-02-15T22:51:26.321 INFO:tasks.workunit.client.1.smithi170.stdout:0/898: write d8/d14/d44/f79 [4098541,86318] 0 2024-02-15T22:51:26.323 INFO:tasks.workunit.client.1.smithi170.stdout:0/899: unlink d8/d14/d1c/f2b 0 2024-02-15T22:51:26.323 INFO:tasks.workunit.client.1.smithi170.stdout:0/900: write d8/d14/f16 [3198464,6332] 0 2024-02-15T22:51:26.323 INFO:tasks.workunit.client.1.smithi170.stdout:0/901: stat d8/d14/la5 0 2024-02-15T22:51:26.324 INFO:tasks.workunit.client.1.smithi170.stdout:0/902: unlink d8/df/d13/d22/d39/fbb 0 2024-02-15T22:51:26.326 INFO:tasks.workunit.client.1.smithi170.stdout:0/903: link d8/d14/d1c/f24 d8/d6d/dda/f11f 0 2024-02-15T22:51:26.327 INFO:tasks.workunit.client.1.smithi170.stdout:0/904: symlink d8/df/d13/l120 0 2024-02-15T22:51:26.330 INFO:tasks.workunit.client.1.smithi170.stdout:6/963: dwrite d3/d1d/d36/d56/daf/dd5/df0/f111 [0,4194304] 0 2024-02-15T22:51:26.336 INFO:tasks.workunit.client.1.smithi170.stdout:6/964: write d3/d1a/f40 [5321425,6742] 0 2024-02-15T22:51:26.336 INFO:tasks.workunit.client.1.smithi170.stdout:6/965: chown d3/l7c 4452199 1 2024-02-15T22:51:26.337 INFO:tasks.workunit.client.1.smithi170.stdout:6/966: chown d3/d1d/d1b/d3c/fb6 466934031 1 2024-02-15T22:51:26.337 INFO:tasks.workunit.client.1.smithi170.stdout:6/967: rmdir d3/d1d/d1b/d3c 39 2024-02-15T22:51:26.338 INFO:tasks.workunit.client.1.smithi170.stdout:6/968: write d3/d1d/d28/f7d [2496310,77112] 0 2024-02-15T22:51:26.338 INFO:tasks.workunit.client.1.smithi170.stdout:8/787: dwrite d9/d18/d32/f81 [0,4194304] 0 2024-02-15T22:51:26.338 INFO:tasks.workunit.client.1.smithi170.stdout:8/788: chown d9/d18/d26 24 1 2024-02-15T22:51:26.339 INFO:tasks.workunit.client.1.smithi170.stdout:6/969: symlink d3/d1d/d28/d3b/l155 0 2024-02-15T22:51:26.341 INFO:tasks.workunit.client.1.smithi170.stdout:8/789: mkdir d9/d18/d32/d99/db7/de0/d10f 0 2024-02-15T22:51:26.342 INFO:tasks.workunit.client.1.smithi170.stdout:6/970: mkdir d3/db8/d96/d156 0 2024-02-15T22:51:26.342 INFO:tasks.workunit.client.1.smithi170.stdout:6/971: write d3/d1d/d36/d132/f145 [2727418,11175] 0 2024-02-15T22:51:26.342 INFO:tasks.workunit.client.1.smithi170.stdout:6/972: getdents d3/d24/d31/dc6 0 2024-02-15T22:51:26.343 INFO:tasks.workunit.client.1.smithi170.stdout:8/790: symlink d9/d18/d32/d7a/d78/d7f/d98/l110 0 2024-02-15T22:51:26.343 INFO:tasks.workunit.client.1.smithi170.stdout:8/791: creat d9/d18/d32/d99/db7/f111 x:0 0 0 2024-02-15T22:51:26.343 INFO:tasks.workunit.client.1.smithi170.stdout:6/973: creat d3/d1d/d28/d66/dd6/d13d/f157 x:0 0 0 2024-02-15T22:51:26.344 INFO:tasks.workunit.client.1.smithi170.stdout:6/974: fsync d3/d24/ffe 0 2024-02-15T22:51:26.345 INFO:tasks.workunit.client.1.smithi170.stdout:6/975: dread d3/d1d/d28/d66/d114/d11c/f14d [0,4194304] 0 2024-02-15T22:51:26.345 INFO:tasks.workunit.client.1.smithi170.stdout:8/792: truncate d9/d18/d26/fba 1985018 0 2024-02-15T22:51:26.345 INFO:tasks.workunit.client.1.smithi170.stdout:8/793: chown d9/d18/l31 97972889 1 2024-02-15T22:51:26.346 INFO:tasks.workunit.client.1.smithi170.stdout:6/976: mkdir d3/d1d/dd3/d13c/d158 0 2024-02-15T22:51:26.347 INFO:tasks.workunit.client.1.smithi170.stdout:6/977: getdents d3/d1d/d36/d56/daf/dd5 0 2024-02-15T22:51:26.350 INFO:tasks.workunit.client.1.smithi170.stdout:6/978: creat d3/d24/d31/d106/d11e/f159 x:0 0 0 2024-02-15T22:51:26.357 INFO:tasks.workunit.client.1.smithi170.stdout:4/981: dwrite d0/d22/da/d8b/d47/da9/f9b [0,4194304] 0 2024-02-15T22:51:26.359 INFO:tasks.workunit.client.1.smithi170.stdout:4/982: rmdir d0/d22/da/d8b/d47/dbe/d20 39 2024-02-15T22:51:26.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/983: creat d0/f147 x:0 0 0 2024-02-15T22:51:26.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/984: fsync d0/d22/da/d8b/d47/d67/f9e 0 2024-02-15T22:51:26.360 INFO:tasks.workunit.client.1.smithi170.stdout:4/985: mknod d0/d22/da/d8b/d47/da9/de7/c148 0 2024-02-15T22:51:26.361 INFO:tasks.workunit.client.1.smithi170.stdout:4/986: rmdir d0/d22/d10c/d143 39 2024-02-15T22:51:26.365 INFO:tasks.workunit.client.1.smithi170.stdout:6/979: dread d3/d1d/d1b/d9b/f103 [0,4194304] 0 2024-02-15T22:51:26.366 INFO:tasks.workunit.client.1.smithi170.stdout:6/980: creat d3/d1d/d36/d56/daf/f15a x:0 0 0 2024-02-15T22:51:26.366 INFO:tasks.workunit.client.1.smithi170.stdout:9/799: dwrite de/d1b/d1c/d1f/d20/d27/d28/d80/fcf [0,4194304] 0 2024-02-15T22:51:26.366 INFO:tasks.workunit.client.1.smithi170.stdout:0/905: dwrite d8/df/d13/f42 [0,4194304] 0 2024-02-15T22:51:26.366 INFO:tasks.workunit.client.1.smithi170.stdout:0/906: chown d8/df/d13/d22/d39/d55/c83 8622078 1 2024-02-15T22:51:26.367 INFO:tasks.workunit.client.1.smithi170.stdout:8/794: dwrite d9/d18/d26/dd5/f10a [4194304,4194304] 0 2024-02-15T22:51:26.368 INFO:tasks.workunit.client.1.smithi170.stdout:6/981: mknod d3/d1d/d36/d56/d6c/c15b 0 2024-02-15T22:51:26.373 INFO:tasks.workunit.client.1.smithi170.stdout:9/800: creat de/d1b/d1c/d1f/d20/d27/d28/f115 x:0 0 0 2024-02-15T22:51:26.377 INFO:tasks.workunit.client.1.smithi170.stdout:6/982: mkdir d3/d24/d31/d106/d11e/d15c 0 2024-02-15T22:51:26.379 INFO:tasks.workunit.client.1.smithi170.stdout:4/987: dwrite d0/d22/da/d8b/d47/f4b [0,4194304] 0 2024-02-15T22:51:26.381 INFO:tasks.workunit.client.1.smithi170.stdout:8/795: dread d9/d18/d32/d7a/d78/d7f/d98/fad [0,4194304] 0 2024-02-15T22:51:26.386 INFO:tasks.workunit.client.1.smithi170.stdout:8/796: mkdir d9/d18/d32/d3b/dc5/d112 0 2024-02-15T22:51:26.386 INFO:tasks.workunit.client.1.smithi170.stdout:8/797: stat d9/d18/d32/d7a/d78/d7f/fd1 0 2024-02-15T22:51:26.388 INFO:tasks.workunit.client.1.smithi170.stdout:8/798: creat d9/d18/d26/f113 x:0 0 0 2024-02-15T22:51:26.388 INFO:tasks.workunit.client.1.smithi170.stdout:8/799: chown d9/d18/d32/d7a/lf9 541919 1 2024-02-15T22:51:26.398 INFO:tasks.workunit.client.1.smithi170.stdout:9/801: dwrite de/d1b/d1c/d1f/d20/d27/df2/dfa/fee [0,4194304] 0 2024-02-15T22:51:26.400 INFO:tasks.workunit.client.1.smithi170.stdout:0/907: dwrite d8/df/d13/f1f [0,4194304] 0 2024-02-15T22:51:26.400 INFO:tasks.workunit.client.1.smithi170.stdout:0/908: dread - d8/df/f117 zero size 2024-02-15T22:51:26.402 INFO:tasks.workunit.client.1.smithi170.stdout:9/802: mknod de/d1b/d1c/d1f/d20/d27/c116 0 2024-02-15T22:51:26.402 INFO:tasks.workunit.client.1.smithi170.stdout:9/803: creat de/d1b/d37/dab/f117 x:0 0 0 2024-02-15T22:51:26.403 INFO:tasks.workunit.client.1.smithi170.stdout:9/804: stat de/d97/fe2 0 2024-02-15T22:51:26.414 INFO:tasks.workunit.client.1.smithi170.stdout:6/983: dwrite d3/d1d/d36/f58 [4194304,4194304] 0 2024-02-15T22:51:26.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/984: dread d3/d1d/d36/d56/daf/dd5/df0/fca [0,4194304] 0 2024-02-15T22:51:26.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/985: write d3/d1d/d27/f2d [1503262,113591] 0 2024-02-15T22:51:26.420 INFO:tasks.workunit.client.1.smithi170.stdout:6/986: chown d3/d1d/d36/d56/d6c/dc4/f11b 39995723 1 2024-02-15T22:51:26.420 INFO:tasks.workunit.client.1.smithi170.stdout:4/988: dwrite d0/d22/da/d8b/d47/dbe/fac [0,4194304] 0 2024-02-15T22:51:26.422 INFO:tasks.workunit.client.1.smithi170.stdout:4/989: dread d0/d22/da/d8b/d47/dbe/d20/d49/dbc/dd0/f113 [0,4194304] 0 2024-02-15T22:51:26.423 INFO:tasks.workunit.client.1.smithi170.stdout:4/990: mknod d0/d22/da/d8b/c149 0 2024-02-15T22:51:26.424 INFO:tasks.workunit.client.1.smithi170.stdout:4/991: chown d0/d22/c15 0 1 2024-02-15T22:51:26.437 INFO:tasks.workunit.client.1.smithi170.stdout:0/909: dwrite d8/d14/d70/f8a [0,4194304] 0 2024-02-15T22:51:26.437 INFO:tasks.workunit.client.1.smithi170.stdout:6/987: dread d3/db8/d96/fe4 [0,4194304] 0 2024-02-15T22:51:26.438 INFO:tasks.workunit.client.1.smithi170.stdout:6/988: truncate d3/d1d/d27/d70/d82/f138 503052 0 2024-02-15T22:51:26.438 INFO:tasks.workunit.client.1.smithi170.stdout:9/805: dwrite de/f8f [0,4194304] 0 2024-02-15T22:51:26.464 INFO:tasks.workunit.client.1.smithi170.stdout:0/910: dwrite d8/d14/d1c/f24 [0,4194304] 0 2024-02-15T22:51:26.464 INFO:tasks.workunit.client.1.smithi170.stdout:6/989: dwrite d3/d1d/d36/d56/d6c/d10d/f148 [0,4194304] 0 2024-02-15T22:51:26.465 INFO:tasks.workunit.client.1.smithi170.stdout:9/806: dwrite de/d1b/f6a [0,4194304] 0 2024-02-15T22:51:26.467 INFO:tasks.workunit.client.1.smithi170.stdout:6/990: creat d3/d1d/dd3/d13c/f15d x:0 0 0 2024-02-15T22:51:26.476 INFO:tasks.workunit.client.1.smithi170.stdout:9/807: creat de/d1b/d37/f118 x:0 0 0 2024-02-15T22:51:26.477 INFO:tasks.workunit.client.1.smithi170.stdout:6/991: getdents d3/d1d/d28/d66/dd6 0 2024-02-15T22:51:26.477 INFO:tasks.workunit.client.1.smithi170.stdout:6/992: creat d3/d1d/d36/d56/d6c/f15e x:0 0 0 2024-02-15T22:51:26.479 INFO:tasks.workunit.client.1.smithi170.stdout:6/993: truncate d3/d24/d31/f49 5159307 0 2024-02-15T22:51:26.480 INFO:tasks.workunit.client.1.smithi170.stdout:6/994: rmdir d3/db8/d96/d156 0 2024-02-15T22:51:26.480 INFO:tasks.workunit.client.1.smithi170.stdout:6/995: creat d3/d1d/d36/d56/d6c/f15f x:0 0 0 2024-02-15T22:51:26.482 INFO:tasks.workunit.client.1.smithi170.stdout:9/808: dread de/f12 [0,4194304] 0 2024-02-15T22:51:26.500 INFO:tasks.workunit.client.1.smithi170.stdout:9/809: dwrite de/d1b/d37/dab/fe9 [0,4194304] 0 2024-02-15T22:51:26.508 INFO:tasks.workunit.client.1.smithi170.stdout:9/810: rmdir de/d1b/d1c/d1f 39 2024-02-15T22:51:26.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/811: dwrite de/d1b/d1c/d1f/d20/fce [0,4194304] 0 2024-02-15T22:51:26.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/812: chown de/d1b/d37/f110 418237670 1 2024-02-15T22:51:26.529 INFO:tasks.workunit.client.1.smithi170.stdout:9/813: chown de/d1b/d1c/d1f 842 1 2024-02-15T22:51:26.531 INFO:tasks.workunit.client.1.smithi170.stdout:9/814: rename de/d1b/d1c/d1f/d20/c39 to de/d1b/d1c/d1f/d20/d27/df2/dfa/c119 0 2024-02-15T22:51:26.533 INFO:tasks.workunit.client.1.smithi170.stdout:9/815: link de/d1b/d1c/d1f/d20/d27/d2c/f32 de/d1b/d1c/d1f/d20/d78/dfd/f11a 0 2024-02-15T22:51:26.534 INFO:tasks.workunit.client.1.smithi170.stdout:9/816: getdents de/d1b/d1c/d1f/d20/d27/d2c 0 2024-02-15T22:51:26.536 INFO:tasks.workunit.client.1.smithi170.stdout:9/817: rmdir de/d97/ddc 39 2024-02-15T22:51:26.537 INFO:tasks.workunit.client.1.smithi170.stdout:9/818: truncate de/d1b/d1c/d1f/d20/d27/d28/f9a 880747 0 2024-02-15T22:51:26.537 INFO:tasks.workunit.client.1.smithi170.stdout:9/819: chown de/d1b/d37/dab/fe4 0 1 2024-02-15T22:51:26.538 INFO:tasks.workunit.client.1.smithi170.stdout:9/820: mkdir de/d1b/d1c/d11b 0 2024-02-15T22:51:26.538 INFO:tasks.workunit.client.1.smithi170.stdout:9/821: fsync de/d1b/d1c/d1f/d20/f22 0 2024-02-15T22:51:26.540 INFO:tasks.workunit.client.1.smithi170.stdout:9/822: symlink de/d1b/d1c/d1f/d20/d27/d2c/l11c 0 2024-02-15T22:51:26.545 INFO:tasks.workunit.client.1.smithi170.stdout:9/823: write de/d1b/d1c/f5b [202764,100294] 0 2024-02-15T22:51:26.551 INFO:tasks.workunit.client.1.smithi170.stdout:9/824: mknod de/d1b/d1c/d1f/d20/d27/d28/d80/c11d 0 2024-02-15T22:51:26.568 INFO:tasks.workunit.client.1.smithi170.stdout:9/825: dwrite de/d1b/d1c/d1f/d20/d27/d84/f101 [0,4194304] 0 2024-02-15T22:51:26.572 INFO:tasks.workunit.client.1.smithi170.stdout:9/826: mknod de/d1b/d1c/d1f/d20/d27/d28/c11e 0 2024-02-15T22:51:26.584 INFO:tasks.workunit.client.1.smithi170.stdout:9/827: dread de/d1b/d1c/d1f/d20/fce [0,4194304] 0 2024-02-15T22:51:26.586 INFO:tasks.workunit.client.1.smithi170.stdout:9/828: rename de/d1b/d1c/d47/f4d to de/d1b/d1c/d1f/d20/d27/dfc/d109/f11f 0 2024-02-15T22:51:26.586 INFO:tasks.workunit.client.1.smithi170.stdout:9/829: chown de/d1b/cb7 3 1 2024-02-15T22:51:26.588 INFO:tasks.workunit.client.1.smithi170.stdout:9/830: rename de/d1b/d1c/d1f/d20/d27/d28/d7a/cb5 to de/d1b/d37/da5/c120 0 2024-02-15T22:51:26.590 INFO:tasks.workunit.client.1.smithi170.stdout:9/831: truncate f2 1150361 0 2024-02-15T22:51:26.595 INFO:tasks.workunit.client.1.smithi170.stdout:9/832: dread de/d1b/fd5 [0,4194304] 0 2024-02-15T22:51:26.595 INFO:tasks.workunit.client.1.smithi170.stdout:9/833: chown de/d1b/f9f 160338848 1 2024-02-15T22:51:26.595 INFO:tasks.workunit.client.1.smithi170.stdout:9/834: write de/d1b/d37/f118 [349030,73987] 0 2024-02-15T22:51:26.597 INFO:tasks.workunit.client.1.smithi170.stdout:9/835: getdents de/d1b/d37/dab 0 2024-02-15T22:51:26.597 INFO:tasks.workunit.client.1.smithi170.stdout:9/836: truncate de/d1b/d1c/ff4 815813 0 2024-02-15T22:51:26.599 INFO:tasks.workunit.client.1.smithi170.stdout:9/837: truncate de/d1b/d1c/d1f/d20/d27/df2/dfa/f70 2913785 0 2024-02-15T22:51:26.601 INFO:tasks.workunit.client.1.smithi170.stdout:9/838: symlink de/d1b/d1c/d1f/d20/d27/dfc/d109/l121 0 2024-02-15T22:51:26.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/839: dwrite de/d1b/d1c/f46 [0,4194304] 0 2024-02-15T22:51:26.621 INFO:tasks.workunit.client.1.smithi170.stdout:9/840: write de/d1b/d1c/d1f/d20/d27/d28/d7a/fff [573467,97431] 0 2024-02-15T22:51:26.621 INFO:tasks.workunit.client.1.smithi170.stdout:9/841: truncate de/d1b/d1c/d1f/d20/d27/d84/ff3 891377 0 2024-02-15T22:51:26.623 INFO:tasks.workunit.client.1.smithi170.stdout:9/842: creat de/d1b/d1c/d1f/d20/d27/dfc/d109/f122 x:0 0 0 2024-02-15T22:51:26.630 INFO:tasks.workunit.client.1.smithi170.stdout:4/992: sync 2024-02-15T22:51:26.630 INFO:tasks.workunit.client.1.smithi170.stdout:8/800: sync 2024-02-15T22:51:26.630 INFO:tasks.workunit.client.1.smithi170.stdout:0/911: sync 2024-02-15T22:51:26.631 INFO:tasks.workunit.client.1.smithi170.stdout:8/801: creat d9/d18/d32/d99/d103/f114 x:0 0 0 2024-02-15T22:51:26.631 INFO:tasks.workunit.client.1.smithi170.stdout:8/802: readlink d9/d18/d48/l69 0 2024-02-15T22:51:26.631 INFO:tasks.workunit.client.1.smithi170.stdout:4/993: write d0/d22/da/d8b/d47/d67/d77/dc5/d110/f132 [551110,86481] 0 2024-02-15T22:51:26.631 INFO:tasks.workunit.client.1.smithi170.stdout:8/803: dread - d9/d18/d32/dab/fd6 zero size 2024-02-15T22:51:26.633 INFO:tasks.workunit.client.1.smithi170.stdout:0/912: link d8/d14/d1c/d3f/d51/f5a d8/d6d/dda/de5/dfe/f121 0 2024-02-15T22:51:26.634 INFO:tasks.workunit.client.1.smithi170.stdout:8/804: symlink d9/d18/d32/d99/db7/de0/d10f/l115 0 2024-02-15T22:51:26.635 INFO:tasks.workunit.client.1.smithi170.stdout:8/805: chown d9/d18/d32/d99/db7/de0 244 1 2024-02-15T22:51:26.635 INFO:tasks.workunit.client.1.smithi170.stdout:8/806: creat d9/d18/d32/db1/f116 x:0 0 0 2024-02-15T22:51:26.635 INFO:tasks.workunit.client.1.smithi170.stdout:0/913: truncate d8/d14/d1c/d3f/dce/dd5/fd7 5715011 0 2024-02-15T22:51:26.637 INFO:tasks.workunit.client.1.smithi170.stdout:8/807: symlink d9/d18/d32/dab/l117 0 2024-02-15T22:51:26.639 INFO:tasks.workunit.client.1.smithi170.stdout:0/914: unlink d8/df/d13/d22/d39/d55/c83 0 2024-02-15T22:51:26.639 INFO:tasks.workunit.client.1.smithi170.stdout:0/915: write d8/d14/d44/f79 [3821236,35778] 0 2024-02-15T22:51:26.639 INFO:tasks.workunit.client.1.smithi170.stdout:0/916: write d8/d14/d1c/f1e [255709,27607] 0 2024-02-15T22:51:26.640 INFO:tasks.workunit.client.1.smithi170.stdout:8/808: symlink d9/d18/d32/d3b/dc5/d112/l118 0 2024-02-15T22:51:26.642 INFO:tasks.workunit.client.1.smithi170.stdout:0/917: symlink d8/d14/d1c/d3f/d53/l122 0 2024-02-15T22:51:26.646 INFO:tasks.workunit.client.1.smithi170.stdout:9/843: dwrite de/d1b/d1c/d1f/d20/d78/f8b [0,4194304] 0 2024-02-15T22:51:26.646 INFO:tasks.workunit.client.1.smithi170.stdout:8/809: dread d9/d18/d26/ff2 [0,4194304] 0 2024-02-15T22:51:26.653 INFO:tasks.workunit.client.1.smithi170.stdout:9/844: read de/d1b/d1c/d1f/d20/f22 [596578,87777] 0 2024-02-15T22:51:26.654 INFO:tasks.workunit.client.1.smithi170.stdout:9/845: symlink de/d1b/d1c/d11b/l123 0 2024-02-15T22:51:26.655 INFO:tasks.workunit.client.1.smithi170.stdout:9/846: chown de/d8e/ca7 574 1 2024-02-15T22:51:26.660 INFO:tasks.workunit.client.1.smithi170.stdout:6/996: sync 2024-02-15T22:51:26.674 INFO:tasks.workunit.client.1.smithi170.stdout:0/918: dwrite d8/df/d13/d36/d60/f91 [0,4194304] 0 2024-02-15T22:51:26.676 INFO:tasks.workunit.client.1.smithi170.stdout:0/919: creat d8/d14/d1c/d3f/d51/de1/f123 x:0 0 0 2024-02-15T22:51:26.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/920: link d8/df/c67 d8/df/c124 0 2024-02-15T22:51:26.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/921: chown d8/df/d13/le9 32730 1 2024-02-15T22:51:26.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/922: fsync d8/df/d13/d22/d6a/d8f/fed 0 2024-02-15T22:51:26.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/923: creat d8/f125 x:0 0 0 2024-02-15T22:51:26.678 INFO:tasks.workunit.client.1.smithi170.stdout:0/924: write d8/f94 [159837,47908] 0 2024-02-15T22:51:26.680 INFO:tasks.workunit.client.1.smithi170.stdout:0/925: rmdir d8/df/d13/d22/d39/d55 39 2024-02-15T22:51:26.680 INFO:tasks.workunit.client.1.smithi170.stdout:0/926: chown d8/df/d13/c5e 1534 1 2024-02-15T22:51:26.682 INFO:tasks.workunit.client.1.smithi170.stdout:8/810: dwrite d9/d18/d32/db1/f116 [0,4194304] 0 2024-02-15T22:51:26.683 INFO:tasks.workunit.client.1.smithi170.stdout:0/927: dread d8/d14/d1c/d3f/dce/dd5/fd7 [4194304,4194304] 0 2024-02-15T22:51:26.690 INFO:tasks.workunit.client.1.smithi170.stdout:6/997: dwrite d3/f7 [0,4194304] 0 2024-02-15T22:51:26.694 INFO:tasks.workunit.client.1.smithi170.stdout:0/928: dread d8/d14/d1c/d3f/fcf [0,4194304] 0 2024-02-15T22:51:26.694 INFO:tasks.workunit.client.1.smithi170.stdout:0/929: readlink d8/d14/d1c/d3f/dce/lb0 0 2024-02-15T22:51:26.696 INFO:tasks.workunit.client.1.smithi170.stdout:0/930: creat d8/df/d13/d22/d39/dfb/f126 x:0 0 0 2024-02-15T22:51:26.696 INFO:tasks.workunit.client.1.smithi170.stdout:0/931: chown d8/df/d13/d22/d39/d55 225840 1 2024-02-15T22:51:26.702 INFO:tasks.workunit.client.1.smithi170.stdout:8/811: dwrite d9/d18/d32/d99/d103/f114 [0,4194304] 0 2024-02-15T22:51:26.705 INFO:tasks.workunit.client.1.smithi170.stdout:8/812: rename d9/d18/d32/d7a/d78/d7f/d98/l110 to d9/d18/d32/d3b/d4b/l119 0 2024-02-15T22:51:26.707 INFO:tasks.workunit.client.1.smithi170.stdout:8/813: rename d9/d18/fc7 to d9/d18/d32/db1/f11a 0 2024-02-15T22:51:26.707 INFO:tasks.workunit.client.1.smithi170.stdout:8/814: mkdir d9/d18/d26/dd5/d11b 0 2024-02-15T22:51:26.709 INFO:tasks.workunit.client.1.smithi170.stdout:8/815: creat d9/d18/d32/d3b/dc5/df5/f11c x:0 0 0 2024-02-15T22:51:26.711 INFO:tasks.workunit.client.1.smithi170.stdout:0/932: dread d8/df/d13/d22/f7c [0,4194304] 0 2024-02-15T22:51:26.711 INFO:tasks.workunit.client.1.smithi170.stdout:0/933: stat d8/d14/d6f/fca 0 2024-02-15T22:51:26.711 INFO:tasks.workunit.client.1.smithi170.stdout:0/934: chown d8/d6d/dda/de5/dfe/f121 476784 1 2024-02-15T22:51:26.712 INFO:tasks.workunit.client.1.smithi170.stdout:0/935: mkdir d8/d14/d1c/d3f/dce/da0/d127 0 2024-02-15T22:51:26.712 INFO:tasks.workunit.client.1.smithi170.stdout:0/936: write d8/df/d13/d36/d60/da2/fb8 [638687,48104] 0 2024-02-15T22:51:26.715 INFO:tasks.workunit.client.1.smithi170.stdout:0/937: link d8/d14/f16 d8/d14/d1c/d3f/dce/da0/d127/f128 0 2024-02-15T22:51:26.715 INFO:tasks.workunit.client.1.smithi170.stdout:0/938: chown d8/d14/d1c/d3f/d51/de1 18 1 2024-02-15T22:51:26.715 INFO:tasks.workunit.client.1.smithi170.stdout:0/939: fsync d8/df/d13/d36/fec 0 2024-02-15T22:51:26.716 INFO:tasks.workunit.client.1.smithi170.stdout:0/940: write d8/d14/d1c/d3f/dce/dd5/fd7 [4735318,87447] 0 2024-02-15T22:51:26.717 INFO:tasks.workunit.client.1.smithi170.stdout:0/941: symlink d8/d14/d1c/d3f/dce/da0/l129 0 2024-02-15T22:51:26.718 INFO:tasks.workunit.client.1.smithi170.stdout:0/942: truncate d8/df/d13/f30 1143830 0 2024-02-15T22:51:26.718 INFO:tasks.workunit.client.1.smithi170.stdout:0/943: chown d8/d14/d6f/f88 0 1 2024-02-15T22:51:26.738 INFO:tasks.workunit.client.1.smithi170.stdout:8/816: dwrite d9/dd0/fda [0,4194304] 0 2024-02-15T22:51:26.738 INFO:tasks.workunit.client.1.smithi170.stdout:8/817: dread - d9/d18/d32/d99/d103/f10c zero size 2024-02-15T22:51:26.742 INFO:tasks.workunit.client.1.smithi170.stdout:0/944: dwrite d8/d14/f63 [4194304,4194304] 0 2024-02-15T22:51:26.744 INFO:tasks.workunit.client.1.smithi170.stdout:0/945: symlink d8/df/d13/l12a 0 2024-02-15T22:51:26.746 INFO:tasks.workunit.client.1.smithi170.stdout:0/946: rename d8/df/d13/d22/f6b to d8/d14/d44/de3/dfd/f12b 0 2024-02-15T22:51:26.747 INFO:tasks.workunit.client.1.smithi170.stdout:0/947: truncate d8/df/d13/d36/d60/da2/fd1 149263 0 2024-02-15T22:51:26.748 INFO:tasks.workunit.client.1.smithi170.stdout:8/818: rmdir d9/d18/d32/d7a/d78/d7f/d98 39 2024-02-15T22:51:26.751 INFO:tasks.workunit.client.1.smithi170.stdout:0/948: mknod d8/d6d/dda/de5/dfe/c12c 0 2024-02-15T22:51:26.752 INFO:tasks.workunit.client.1.smithi170.stdout:8/819: mknod d9/d18/d32/d99/d103/c11d 0 2024-02-15T22:51:26.753 INFO:tasks.workunit.client.1.smithi170.stdout:8/820: write d9/d18/d26/fb5 [475704,30088] 0 2024-02-15T22:51:26.753 INFO:tasks.workunit.client.1.smithi170.stdout:8/821: chown d9/d18/d32/dab/ld4 397 1 2024-02-15T22:51:26.753 INFO:tasks.workunit.client.1.smithi170.stdout:8/822: write d9/f82 [166212,57291] 0 2024-02-15T22:51:26.755 INFO:tasks.workunit.client.1.smithi170.stdout:0/949: rmdir d8/d14/d6f 39 2024-02-15T22:51:26.756 INFO:tasks.workunit.client.1.smithi170.stdout:0/950: chown d8/d14/d1c/d3f/lea 474200 1 2024-02-15T22:51:26.756 INFO:tasks.workunit.client.1.smithi170.stdout:0/951: chown d8/df/d13/d36/d60/f91 748635123 1 2024-02-15T22:51:26.761 INFO:tasks.workunit.client.1.smithi170.stdout:8/823: write d9/d18/d32/db1/f11a [309452,48022] 0 2024-02-15T22:51:26.761 INFO:tasks.workunit.client.1.smithi170.stdout:8/824: chown d9/d18/d32/d7a/d78/d7f/c84 2 1 2024-02-15T22:51:26.785 INFO:tasks.workunit.client.1.smithi170.stdout:0/952: dwrite d8/df/d13/f11b [0,4194304] 0 2024-02-15T22:51:26.787 INFO:tasks.workunit.client.1.smithi170.stdout:8/825: dwrite d9/d18/d32/db1/f11a [0,4194304] 0 2024-02-15T22:51:26.787 INFO:tasks.workunit.client.1.smithi170.stdout:8/826: write d9/d18/f106 [745398,99628] 0 2024-02-15T22:51:26.787 INFO:tasks.workunit.client.1.smithi170.stdout:0/953: unlink d8/df/d13/d22/d39/cbf 0 2024-02-15T22:51:26.790 INFO:tasks.workunit.client.1.smithi170.stdout:8/827: rename d9/d18/f7e to d9/d18/d32/dab/f11e 0 2024-02-15T22:51:26.794 INFO:tasks.workunit.client.1.smithi170.stdout:0/954: truncate d8/df/d13/d22/fcc 1385966 0 2024-02-15T22:51:26.795 INFO:tasks.workunit.client.1.smithi170.stdout:0/955: mknod d8/d6d/dda/de5/dfe/c12d 0 2024-02-15T22:51:26.797 INFO:tasks.workunit.client.1.smithi170.stdout:8/828: rename d9/d18/d32/d99/db7/de0/dfd to d9/d11f 0 2024-02-15T22:51:26.797 INFO:tasks.workunit.client.1.smithi170.stdout:8/829: creat d9/dd0/f120 x:0 0 0 2024-02-15T22:51:26.797 INFO:tasks.workunit.client.1.smithi170.stdout:8/830: stat d9/d18/d26 0 2024-02-15T22:51:26.797 INFO:tasks.workunit.client.1.smithi170.stdout:8/831: stat d9/d18/d32/d7a/ce9 0 2024-02-15T22:51:26.800 INFO:tasks.workunit.client.1.smithi170.stdout:0/956: link d8/df/d13/d22/f4b d8/df/d13/d36/f12e 0 2024-02-15T22:51:26.800 INFO:tasks.workunit.client.1.smithi170.stdout:0/957: truncate d8/d14/d1c/d3f/f111 4784543 0 2024-02-15T22:51:26.802 INFO:tasks.workunit.client.1.smithi170.stdout:0/958: symlink d8/d6d/dda/l12f 0 2024-02-15T22:51:26.804 INFO:tasks.workunit.client.1.smithi170.stdout:8/832: read d9/f97 [5481822,56945] 0 2024-02-15T22:51:26.807 INFO:tasks.workunit.client.1.smithi170.stdout:8/833: mknod d9/d18/d32/d7a/d78/d95/c121 0 2024-02-15T22:51:26.808 INFO:tasks.workunit.client.1.smithi170.stdout:0/959: symlink d8/d14/d1c/d3f/dce/da0/d127/l130 0 2024-02-15T22:51:26.809 INFO:tasks.workunit.client.1.smithi170.stdout:0/960: symlink d8/d14/d70/d93/l131 0 2024-02-15T22:51:26.810 INFO:tasks.workunit.client.1.smithi170.stdout:0/961: symlink d8/df/d13/d36/d60/l132 0 2024-02-15T22:51:26.810 INFO:tasks.workunit.client.1.smithi170.stdout:0/962: chown d8/d6d/d96 14647 1 2024-02-15T22:51:26.813 INFO:tasks.workunit.client.1.smithi170.stdout:0/963: symlink d8/df/d13/d36/d60/l133 0 2024-02-15T22:51:26.824 INFO:tasks.workunit.client.1.smithi170.stdout:8/834: dwrite d9/d18/d32/d3b/d4b/f5f [0,4194304] 0 2024-02-15T22:51:26.824 INFO:tasks.workunit.client.1.smithi170.stdout:8/835: readlink d9/d18/l1f 0 2024-02-15T22:51:26.824 INFO:tasks.workunit.client.1.smithi170.stdout:0/964: dread d8/d14/d1c/d3f/dce/dd5/fd7 [0,4194304] 0 2024-02-15T22:51:26.826 INFO:tasks.workunit.client.1.smithi170.stdout:8/836: rename d9/d18/d32/db1/f11a to d9/d18/d32/d99/d103/f122 0 2024-02-15T22:51:26.827 INFO:tasks.workunit.client.1.smithi170.stdout:8/837: mkdir d9/d18/d32/d7a/d123 0 2024-02-15T22:51:26.827 INFO:tasks.workunit.client.1.smithi170.stdout:8/838: fsync d9/d18/d32/d3b/dfe/f74 0 2024-02-15T22:51:26.827 INFO:tasks.workunit.client.1.smithi170.stdout:8/839: chown d9/d18/d32/d7a/d78/d7f/d98/fad 850897997 1 2024-02-15T22:51:26.828 INFO:tasks.workunit.client.1.smithi170.stdout:0/965: dread f1 [0,4194304] 0 2024-02-15T22:51:26.828 INFO:tasks.workunit.client.1.smithi170.stdout:0/966: chown d8/d14/d1c/d3f/d53/df9 15 1 2024-02-15T22:51:26.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/840: write d9/d18/d26/f55 [421999,128705] 0 2024-02-15T22:51:26.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/841: read d9/d18/d32/f4c [129771,81968] 0 2024-02-15T22:51:26.831 INFO:tasks.workunit.client.1.smithi170.stdout:8/842: chown d9/d18/l87 2012 1 2024-02-15T22:51:26.832 INFO:tasks.workunit.client.1.smithi170.stdout:8/843: fsync d9/f1d 0 2024-02-15T22:51:26.833 INFO:tasks.workunit.client.1.smithi170.stdout:8/844: unlink d9/d18/d26/d4f/f80 0 2024-02-15T22:51:26.836 INFO:tasks.workunit.client.1.smithi170.stdout:0/967: write d8/df/d13/d36/d60/da2/dcb/fdb [3829880,79615] 0 2024-02-15T22:51:26.837 INFO:tasks.workunit.client.1.smithi170.stdout:0/968: truncate d8/df/d13/d22/d71/fa9 762373 0 2024-02-15T22:51:26.838 INFO:tasks.workunit.client.1.smithi170.stdout:0/969: chown d8/d14/d1c/c92 10957 1 2024-02-15T22:51:26.840 INFO:tasks.workunit.client.1.smithi170.stdout:0/970: rename d8/d14/la5 to d8/df/d13/d36/l134 0 2024-02-15T22:51:26.840 INFO:tasks.workunit.client.1.smithi170.stdout:0/971: truncate d8/d14/d1c/d3f/d53/fc5 661701 0 2024-02-15T22:51:26.840 INFO:tasks.workunit.client.1.smithi170.stdout:0/972: truncate d8/df/d13/d22/d6a/d8f/fed 43463 0 2024-02-15T22:51:26.851 INFO:tasks.workunit.client.1.smithi170.stdout:8/845: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:26.863 INFO:tasks.workunit.client.1.smithi170.stdout:0/973: dwrite d8/df/d13/d22/d6a/d8f/f9b [4194304,4194304] 0 2024-02-15T22:51:26.863 INFO:tasks.workunit.client.1.smithi170.stdout:0/974: truncate d8/df/f117 934816 0 2024-02-15T22:51:26.864 INFO:tasks.workunit.client.1.smithi170.stdout:0/975: truncate d8/df/d13/d36/d60/da2/fb8 663189 0 2024-02-15T22:51:26.865 INFO:tasks.workunit.client.1.smithi170.stdout:0/976: symlink d8/df/d13/d22/d39/l135 0 2024-02-15T22:51:26.866 INFO:tasks.workunit.client.1.smithi170.stdout:0/977: symlink d8/df/d13/d36/l136 0 2024-02-15T22:51:26.867 INFO:tasks.workunit.client.1.smithi170.stdout:8/846: dwrite d9/d18/d32/d99/db7/f105 [0,4194304] 0 2024-02-15T22:51:26.867 INFO:tasks.workunit.client.1.smithi170.stdout:8/847: chown d9/d18/d26/d4f/fce 0 1 2024-02-15T22:51:26.867 INFO:tasks.workunit.client.1.smithi170.stdout:4/994: sync 2024-02-15T22:51:26.867 INFO:tasks.workunit.client.1.smithi170.stdout:4/995: readlink d0/d22/da/d8b/d47/d5e/d7d/l121 0 2024-02-15T22:51:26.868 INFO:tasks.workunit.client.1.smithi170.stdout:0/978: mkdir d8/df/d13/d36/d60/da2/dcb/d137 0 2024-02-15T22:51:26.873 INFO:tasks.workunit.client.1.smithi170.stdout:8/848: creat d9/d18/d26/dd5/f124 x:0 0 0 2024-02-15T22:51:26.873 INFO:tasks.workunit.client.1.smithi170.stdout:8/849: truncate d9/d18/d26/d4f/fbd 461234 0 2024-02-15T22:51:26.873 INFO:tasks.workunit.client.1.smithi170.stdout:8/850: chown d9/db2/fc8 2529 1 2024-02-15T22:51:26.875 INFO:tasks.workunit.client.1.smithi170.stdout:4/996: rename d0/d22/da/d8b/d47/d67/d77/dc5/dea/f13f to d0/d22/da/d8b/d47/dbe/da2/f14a 0 2024-02-15T22:51:26.875 INFO:tasks.workunit.client.1.smithi170.stdout:4/997: chown d0/d22/da/d8b/d47/d2b/c5d 12 1 2024-02-15T22:51:26.876 INFO:tasks.workunit.client.1.smithi170.stdout:8/851: unlink d9/d18/d32/db1/f109 0 2024-02-15T22:51:26.877 INFO:tasks.workunit.client.1.smithi170.stdout:8/852: truncate d9/d18/d32/d99/fb6 355260 0 2024-02-15T22:51:26.878 INFO:tasks.workunit.client.1.smithi170.stdout:8/853: creat d9/d18/d26/dd5/f125 x:0 0 0 2024-02-15T22:51:26.880 INFO:tasks.workunit.client.1.smithi170.stdout:8/854: symlink d9/d18/d32/d99/db7/de0/d10f/l126 0 2024-02-15T22:51:26.880 INFO:tasks.workunit.client.1.smithi170.stdout:0/979: dwrite d8/d14/d70/d93/ff6 [0,4194304] 0 2024-02-15T22:51:26.882 INFO:tasks.workunit.client.1.smithi170.stdout:8/855: truncate d9/f82 3217685 0 2024-02-15T22:51:26.882 INFO:tasks.workunit.client.1.smithi170.stdout:8/856: write d9/d18/d32/d3b/d4b/fca [243653,16935] 0 2024-02-15T22:51:26.884 INFO:tasks.workunit.client.1.smithi170.stdout:6/998: sync 2024-02-15T22:51:26.884 INFO:tasks.workunit.client.1.smithi170.stdout:6/999: chown d3/d1d/d36/d56/daf/dd5/df0/fca 866 1 2024-02-15T22:51:26.884 INFO:tasks.workunit.client.1.smithi170.stdout:9/847: sync 2024-02-15T22:51:26.884 INFO:tasks.workunit.client.1.smithi170.stdout:4/998: read d0/d22/da/d8b/d47/dbe/d20/f3d [420879,69579] 0 2024-02-15T22:51:26.886 INFO:tasks.workunit.client.1.smithi170.stdout:0/980: creat d8/d14/d1c/d3f/d53/df9/f138 x:0 0 0 2024-02-15T22:51:26.888 INFO:tasks.workunit.client.1.smithi170.stdout:0/981: creat d8/d14/d1c/d3f/d53/f139 x:0 0 0 2024-02-15T22:51:26.911 INFO:tasks.workunit.client.1.smithi170.stdout:0/982: dread d8/d14/d6f/f88 [0,4194304] 0 2024-02-15T22:51:26.913 INFO:tasks.workunit.client.1.smithi170.stdout:0/983: rename d8/df/f49 to d8/d14/d1c/d3f/d53/df9/f13a 0 2024-02-15T22:51:26.928 INFO:tasks.workunit.client.1.smithi170.stdout:8/857: dwrite d9/d18/d48/f5b [0,4194304] 0 2024-02-15T22:51:26.928 INFO:tasks.workunit.client.1.smithi170.stdout:8/858: fsync d9/d18/d26/fb5 0 2024-02-15T22:51:26.930 INFO:tasks.workunit.client.1.smithi170.stdout:0/984: dwrite d8/d14/d6f/fca [4194304,4194304] 0 2024-02-15T22:51:26.931 INFO:tasks.workunit.client.1.smithi170.stdout:9/848: dwrite de/d1b/d1c/d1f/d20/d27/d28/f98 [0,4194304] 0 2024-02-15T22:51:26.931 INFO:tasks.workunit.client.1.smithi170.stdout:4/999: dwrite d0/d22/da/d8b/d47/dbe/d89/de8/fdd [0,4194304] 0 2024-02-15T22:51:26.936 INFO:tasks.workunit.client.1.smithi170.stdout:9/849: truncate de/d1b/d37/dab/fdf 289666 0 2024-02-15T22:51:26.944 INFO:tasks.workunit.client.1.smithi170.stdout:8/859: read d9/d18/d32/d7a/d78/d7f/d98/f102 [3224034,29553] 0 2024-02-15T22:51:26.946 INFO:tasks.workunit.client.1.smithi170.stdout:8/860: chown d9/l21 29632707 1 2024-02-15T22:51:26.946 INFO:tasks.workunit.client.1.smithi170.stdout:8/861: fsync d9/d18/d32/f81 0 2024-02-15T22:51:26.954 INFO:tasks.workunit.client.1.smithi170.stdout:0/985: dwrite d8/d14/d1c/d3f/dce/da0/d127/f128 [0,4194304] 0 2024-02-15T22:51:26.966 INFO:tasks.workunit.client.1.smithi170.stdout:8/862: dwrite d9/d18/d32/d7a/d78/d7f/ff8 [0,4194304] 0 2024-02-15T22:51:26.989 INFO:tasks.workunit.client.1.smithi170.stdout:8/863: dwrite d9/d18/d32/dab/fd6 [0,4194304] 0 2024-02-15T22:51:26.989 INFO:tasks.workunit.client.1.smithi170.stdout:0/986: dwrite d8/d14/d1c/d3f/d53/fc5 [0,4194304] 0 2024-02-15T22:51:26.990 INFO:tasks.workunit.client.1.smithi170.stdout:8/864: dread d9/d18/d26/ff2 [0,4194304] 0 2024-02-15T22:51:26.992 INFO:tasks.workunit.client.1.smithi170.stdout:8/865: mkdir d9/db2/dd7/da5/d127 0 2024-02-15T22:51:26.993 INFO:tasks.workunit.client.1.smithi170.stdout:8/866: mknod d9/d11f/c128 0 2024-02-15T22:51:26.994 INFO:tasks.workunit.client.1.smithi170.stdout:8/867: creat d9/db2/dd7/f129 x:0 0 0 2024-02-15T22:51:26.994 INFO:tasks.workunit.client.1.smithi170.stdout:8/868: mkdir d9/db2/d12a 0 2024-02-15T22:51:27.001 INFO:tasks.workunit.client.1.smithi170.stdout:0/987: write d8/df/d13/f42 [3670002,122236] 0 2024-02-15T22:51:27.002 INFO:tasks.workunit.client.1.smithi170.stdout:8/869: dread d9/d18/d48/f76 [0,4194304] 0 2024-02-15T22:51:27.002 INFO:tasks.workunit.client.1.smithi170.stdout:8/870: creat d9/d18/f12b x:0 0 0 2024-02-15T22:51:27.004 INFO:tasks.workunit.client.1.smithi170.stdout:8/871: rmdir d9/d18/d26 39 2024-02-15T22:51:27.005 INFO:tasks.workunit.client.1.smithi170.stdout:8/872: mkdir d9/d18/d32/db1/d12c 0 2024-02-15T22:51:27.007 INFO:tasks.workunit.client.1.smithi170.stdout:8/873: dread d9/d18/d26/fb5 [0,4194304] 0 2024-02-15T22:51:27.007 INFO:tasks.workunit.client.1.smithi170.stdout:0/988: dread d8/d14/d1c/d3f/d53/df9/f13a [0,4194304] 0 2024-02-15T22:51:27.008 INFO:tasks.workunit.client.1.smithi170.stdout:8/874: link d9/d11f/c128 d9/d18/d26/c12d 0 2024-02-15T22:51:27.008 INFO:tasks.workunit.client.1.smithi170.stdout:8/875: fsync d9/d18/d32/f4c 0 2024-02-15T22:51:27.008 INFO:tasks.workunit.client.1.smithi170.stdout:8/876: fsync d9/d18/d32/d3b/f40 0 2024-02-15T22:51:27.008 INFO:tasks.workunit.client.1.smithi170.stdout:8/877: dread - d9/d18/d26/dd5/f124 zero size 2024-02-15T22:51:27.009 INFO:tasks.workunit.client.1.smithi170.stdout:0/989: symlink d8/d14/d44/df5/l13b 0 2024-02-15T22:51:27.010 INFO:tasks.workunit.client.1.smithi170.stdout:0/990: creat d8/df/d13/d22/d39/f13c x:0 0 0 2024-02-15T22:51:27.010 INFO:tasks.workunit.client.1.smithi170.stdout:8/878: rmdir d9/d18/d32/d7a/d78/d7f 39 2024-02-15T22:51:27.011 INFO:tasks.workunit.client.1.smithi170.stdout:8/879: mkdir d9/d18/d32/d7a/d78/d7f/d98/d12e 0 2024-02-15T22:51:27.037 INFO:tasks.workunit.client.1.smithi170.stdout:0/991: dwrite d8/f1b [0,4194304] 0 2024-02-15T22:51:27.037 INFO:tasks.workunit.client.1.smithi170.stdout:8/880: dwrite d9/d18/d26/dd5/f124 [0,4194304] 0 2024-02-15T22:51:27.044 INFO:tasks.workunit.client.1.smithi170.stdout:0/992: truncate d8/d14/d44/f4c 318774 0 2024-02-15T22:51:27.046 INFO:tasks.workunit.client.1.smithi170.stdout:0/993: rename d8/df/d13/d22/d71/f7b to d8/d14/d44/de3/dfd/f13d 0 2024-02-15T22:51:27.047 INFO:tasks.workunit.client.1.smithi170.stdout:0/994: symlink d8/d6d/l13e 0 2024-02-15T22:51:27.054 INFO:tasks.workunit.client.1.smithi170.stdout:0/995: dread d8/df/d13/d22/d6a/fab [0,4194304] 0 2024-02-15T22:51:27.056 INFO:tasks.workunit.client.1.smithi170.stdout:0/996: rename d8/d14/d70/d93/dd0/cfc to d8/df/d13/d36/d60/da2/d11e/c13f 0 2024-02-15T22:51:27.057 INFO:tasks.workunit.client.1.smithi170.stdout:8/881: dwrite d9/d18/d26/dd5/f10a [0,4194304] 0 2024-02-15T22:51:27.064 INFO:tasks.workunit.client.1.smithi170.stdout:8/882: dread d9/d18/d32/d7a/d78/d7f/d98/f9f [0,4194304] 0 2024-02-15T22:51:27.067 INFO:tasks.workunit.client.1.smithi170.stdout:0/997: dread d8/d14/d1c/d3f/f48 [0,4194304] 0 2024-02-15T22:51:27.068 INFO:tasks.workunit.client.1.smithi170.stdout:0/998: creat d8/d14/d1c/d3f/d51/f140 x:0 0 0 2024-02-15T22:51:27.070 INFO:tasks.workunit.client.1.smithi170.stdout:0/999: rename d8/d14/d1c/d3f/d51/f5a to d8/d14/d70/d93/ddc/f141 0 2024-02-15T22:51:27.078 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:26 smithi138 ceph-mon[29229]: pgmap v26: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 194 MiB/s rd, 246 MiB/s wr, 496 op/s 2024-02-15T22:51:27.084 INFO:tasks.workunit.client.1.smithi170.stdout:8/883: dwrite d9/d18/d32/d3b/f6c [0,4194304] 0 2024-02-15T22:51:27.084 INFO:tasks.workunit.client.1.smithi170.stdout:8/884: truncate d9/d18/d26/fba 2393828 0 2024-02-15T22:51:27.084 INFO:tasks.workunit.client.1.smithi170.stdout:8/885: fdatasync d9/d18/d32/d7a/d78/d7f/d98/f9f 0 2024-02-15T22:51:27.085 INFO:tasks.workunit.client.1.smithi170.stdout:8/886: rename d9/d18/d32/c7c to d9/d18/d32/d99/d103/c12f 0 2024-02-15T22:51:27.087 INFO:tasks.workunit.client.1.smithi170.stdout:8/887: write d9/d18/f106 [420376,52196] 0 2024-02-15T22:51:27.087 INFO:tasks.workunit.client.1.smithi170.stdout:8/888: creat d9/d18/d32/d3b/dc5/df5/f130 x:0 0 0 2024-02-15T22:51:27.088 INFO:tasks.workunit.client.1.smithi170.stdout:8/889: mkdir d9/d18/d26/d131 0 2024-02-15T22:51:27.089 INFO:tasks.workunit.client.1.smithi170.stdout:8/890: getdents d9/d18/d32/d7a/d78 0 2024-02-15T22:51:27.091 INFO:tasks.workunit.client.1.smithi170.stdout:8/891: link d9/dd0/fda d9/d18/d32/d99/db7/de0/d10f/f132 0 2024-02-15T22:51:27.091 INFO:tasks.workunit.client.1.smithi170.stdout:8/892: rmdir d9/d18/d26/d4f 39 2024-02-15T22:51:27.091 INFO:tasks.workunit.client.1.smithi170.stdout:8/893: chown d9/d18/d32/d3b/d4b/l6a 10984 1 2024-02-15T22:51:27.093 INFO:tasks.workunit.client.1.smithi170.stdout:8/894: unlink d9/l36 0 2024-02-15T22:51:27.094 INFO:tasks.workunit.client.1.smithi170.stdout:8/895: mknod d9/d18/d32/d99/c133 0 2024-02-15T22:51:27.096 INFO:tasks.workunit.client.1.smithi170.stdout:8/896: creat d9/d18/d32/d3b/f134 x:0 0 0 2024-02-15T22:51:27.096 INFO:tasks.workunit.client.1.smithi170.stdout:8/897: write d9/d18/d26/fba [2986877,39332] 0 2024-02-15T22:51:27.096 INFO:tasks.workunit.client.1.smithi170.stdout:8/898: creat d9/d18/d32/d3b/dc5/f135 x:0 0 0 2024-02-15T22:51:27.096 INFO:tasks.workunit.client.1.smithi170.stdout:8/899: fsync d9/d18/d32/d99/db7/fe5 0 2024-02-15T22:51:27.096 INFO:tasks.workunit.client.1.smithi170.stdout:8/900: readlink d9/d18/d32/d7a/d78/l89 0 2024-02-15T22:51:27.099 INFO:tasks.workunit.client.1.smithi170.stdout:8/901: mkdir d9/d11f/d136 0 2024-02-15T22:51:27.102 INFO:tasks.workunit.client.1.smithi170.stdout:8/902: dread d9/d18/d32/d3b/d68/f8e [0,4194304] 0 2024-02-15T22:51:27.102 INFO:tasks.workunit.client.1.smithi170.stdout:8/903: readlink d9/d18/d32/dab/ld4 0 2024-02-15T22:51:27.103 INFO:tasks.workunit.client.1.smithi170.stdout:8/904: unlink d9/d18/d32/d3b/dc5/d112/l118 0 2024-02-15T22:51:27.112 INFO:tasks.workunit.client.1.smithi170.stdout:8/905: dread d9/d18/d26/f45 [0,4194304] 0 2024-02-15T22:51:27.115 INFO:tasks.workunit.client.1.smithi170.stdout:8/906: rename d9/db2/dd7/da5 to d9/d18/d32/d7a/d78/d95/d137 0 2024-02-15T22:51:27.115 INFO:tasks.workunit.client.1.smithi170.stdout:8/907: dread - d9/d18/d32/d99/db7/f111 zero size 2024-02-15T22:51:27.116 INFO:tasks.workunit.client.1.smithi170.stdout:8/908: symlink d9/d18/d32/db1/l138 0 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 -- 172.21.15.138:0/2129248188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30200fe9d0 msgr2=0x7f3020100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 --2- 172.21.15.138:0/2129248188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30200fe9d0 0x7f3020100df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f301800b0a0 tx=0x7f301800b3b0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 -- 172.21.15.138:0/2129248188 shutdown_connections 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 --2- 172.21.15.138:0/2129248188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3020101330 0x7f30201037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 --2- 172.21.15.138:0/2129248188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30200fe9d0 0x7f3020100df0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 -- 172.21.15.138:0/2129248188 >> 172.21.15.138:0/2129248188 conn(0x7f30200fa600 msgr2=0x7f30200fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 -- 172.21.15.138:0/2129248188 shutdown_connections 2024-02-15T22:51:27.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.118+0000 7f3024f5f700 1 -- 172.21.15.138:0/2129248188 wait complete. 2024-02-15T22:51:27.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 Processor -- start 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 -- start start 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3020101330 0x7f302019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302019c910 con 0x7f30200fe9d0 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f3024f5f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302019ca50 con 0x7f3020101330 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f301e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f301e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60248/0 (socket says 172.21.15.138:60248) 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.119+0000 7f301e59c700 1 -- 172.21.15.138:0/1750783594 learned_addr learned my addr 172.21.15.138:0/1750783594 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:27.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.120+0000 7f301dd9b700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3020101330 0x7f302019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.124 INFO:tasks.workunit.client.1.smithi170.stdout:8/909: rmdir d9/d18/d32/d7a 39 2024-02-15T22:51:27.124 INFO:tasks.workunit.client.1.smithi170.stdout:9/850: sync 2024-02-15T22:51:27.124 INFO:tasks.workunit.client.1.smithi170.stdout:9/851: chown de/d1b/d1c/d1f/d20/l6c 3579254 1 2024-02-15T22:51:27.124 INFO:tasks.workunit.client.1.smithi170.stdout:9/852: mkdir de/d1b/d1c/d1f/d20/d27/d2c/d124 0 2024-02-15T22:51:27.124 INFO:tasks.workunit.client.1.smithi170.stdout:9/853: getdents de/d1b/d1c/d1f/d20/d27/df2/dfa 0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.120+0000 7f301e59c700 1 -- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3020101330 msgr2=0x7f302019c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.120+0000 7f301e59c700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3020101330 0x7f302019c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.120+0000 7f301e59c700 1 -- 172.21.15.138:0/1750783594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009d00 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.120+0000 7f301e59c700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3018006070 tx=0x7f3018003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.121+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301800e040 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.121+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f301800ce60 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.121+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30201a14a0 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.121+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30201a1a10 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.121+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301801dae0 con 0x7f30200fe9d0 2024-02-15T22:51:27.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.122+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3020196170 con 0x7f30200fe9d0 2024-02-15T22:51:27.126 INFO:tasks.workunit.client.1.smithi170.stdout:9/854: unlink de/d1b/d1c/d1f/d20/d78/fe1 0 2024-02-15T22:51:27.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.123+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f3018004250 con 0x7f30200fe9d0 2024-02-15T22:51:27.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.124+0000 7f300f7fe700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 0x7f300806f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.124+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f301808e250 con 0x7f30200fe9d0 2024-02-15T22:51:27.127 INFO:tasks.workunit.client.1.smithi170.stdout:8/910: dread d9/d18/d32/d7a/d78/d7f/d98/f102 [0,4194304] 0 2024-02-15T22:51:27.127 INFO:tasks.workunit.client.1.smithi170.stdout:8/911: write d9/d18/d32/d3b/d68/f8e [300966,39069] 0 2024-02-15T22:51:27.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.125+0000 7f301dd9b700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 0x7f300806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.125+0000 7f301dd9b700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 0x7f300806f400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3010005950 tx=0x7f301000b410 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.128 INFO:tasks.workunit.client.1.smithi170.stdout:8/912: creat d9/d18/d32/d7a/d78/d7f/d98/d12e/f139 x:0 0 0 2024-02-15T22:51:27.130 INFO:tasks.workunit.client.1.smithi170.stdout:8/913: getdents d9/d18/d32/d3b/d68 0 2024-02-15T22:51:27.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.129+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f301805b990 con 0x7f30200fe9d0 2024-02-15T22:51:27.132 INFO:tasks.workunit.client.1.smithi170.stdout:8/914: mkdir d9/d18/d32/dab/d13a 0 2024-02-15T22:51:27.132 INFO:tasks.workunit.client.1.smithi170.stdout:9/855: dread de/d1b/d1c/d1f/d20/d27/d84/f101 [0,4194304] 0 2024-02-15T22:51:27.133 INFO:tasks.workunit.client.1.smithi170.stdout:8/915: creat d9/d18/d32/d7a/d123/f13b x:0 0 0 2024-02-15T22:51:27.134 INFO:tasks.workunit.client.1.smithi170.stdout:8/916: mknod d9/db2/d12a/c13c 0 2024-02-15T22:51:27.136 INFO:tasks.workunit.client.1.smithi170.stdout:8/917: creat d9/d18/d32/d7a/d78/d95/f13d x:0 0 0 2024-02-15T22:51:27.142 INFO:tasks.workunit.client.1.smithi170.stdout:9/856: write de/d8e/fad [6413783,30993] 0 2024-02-15T22:51:27.144 INFO:tasks.workunit.client.1.smithi170.stdout:9/857: mkdir de/d1b/d1c/d125 0 2024-02-15T22:51:27.144 INFO:tasks.workunit.client.1.smithi170.stdout:9/858: read - de/d1b/d1c/d1f/d20/d27/d28/f115 zero size 2024-02-15T22:51:27.145 INFO:tasks.workunit.client.1.smithi170.stdout:9/859: mkdir de/d1b/d1c/d1f/d20/d27/dfc/d109/d126 0 2024-02-15T22:51:27.146 INFO:tasks.workunit.client.1.smithi170.stdout:9/860: mknod de/d1b/d1c/d1f/c127 0 2024-02-15T22:51:27.146 INFO:tasks.workunit.client.1.smithi170.stdout:9/861: mknod de/d1b/d1c/d1f/d20/d27/df2/c128 0 2024-02-15T22:51:27.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/862: symlink de/d1b/d1c/d1f/d20/d27/df2/l129 0 2024-02-15T22:51:27.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/863: truncate de/f1e 960114 0 2024-02-15T22:51:27.147 INFO:tasks.workunit.client.1.smithi170.stdout:9/864: readlink de/d1b/d1c/d1f/d20/d27/d2c/l11c 0 2024-02-15T22:51:27.150 INFO:tasks.workunit.client.1.smithi170.stdout:8/918: dwrite d9/d18/d32/d99/db7/f105 [0,4194304] 0 2024-02-15T22:51:27.150 INFO:tasks.workunit.client.1.smithi170.stdout:8/919: read - d9/db2/dd7/f129 zero size 2024-02-15T22:51:27.169 INFO:tasks.workunit.client.1.smithi170.stdout:9/865: dwrite de/d8e/fbd [0,4194304] 0 2024-02-15T22:51:27.169 INFO:tasks.workunit.client.1.smithi170.stdout:9/866: write de/d1b/d1c/d1f/d20/d78/dfd/f11a [633383,57320] 0 2024-02-15T22:51:27.169 INFO:tasks.workunit.client.1.smithi170.stdout:9/867: write de/d1b/d1c/d1f/d20/d27/d84/fdb [476609,16292] 0 2024-02-15T22:51:27.169 INFO:tasks.workunit.client.1.smithi170.stdout:8/920: dwrite d9/d18/d32/d7a/d78/fe4 [0,4194304] 0 2024-02-15T22:51:27.174 INFO:tasks.workunit.client.1.smithi170.stdout:8/921: rename d9/d18/d32/d7a/d78/lff to d9/l13e 0 2024-02-15T22:51:27.176 INFO:tasks.workunit.client.1.smithi170.stdout:9/868: write de/d8e/fcc [23305,57483] 0 2024-02-15T22:51:27.187 INFO:tasks.workunit.client.1.smithi170.stdout:9/869: dread de/d1b/d1c/d1f/d20/d27/d28/f98 [0,4194304] 0 2024-02-15T22:51:27.187 INFO:tasks.workunit.client.1.smithi170.stdout:9/870: stat de/d1b/d1c/c68 0 2024-02-15T22:51:27.189 INFO:tasks.workunit.client.1.smithi170.stdout:9/871: link de/d1b/d1c/d1f/d20/l6c de/l12a 0 2024-02-15T22:51:27.195 INFO:tasks.workunit.client.1.smithi170.stdout:9/872: rmdir de/d1b 39 2024-02-15T22:51:27.217 INFO:tasks.workunit.client.1.smithi170.stdout:9/873: dwrite de/d1b/d1c/d1f/d20/ff6 [0,4194304] 0 2024-02-15T22:51:27.218 INFO:tasks.workunit.client.1.smithi170.stdout:9/874: creat de/d1b/d1c/f12b x:0 0 0 2024-02-15T22:51:27.221 INFO:tasks.workunit.client.1.smithi170.stdout:9/875: creat de/d1b/d1c/d1f/d20/d27/df2/f12c x:0 0 0 2024-02-15T22:51:27.222 INFO:tasks.workunit.client.1.smithi170.stdout:9/876: symlink de/d1b/d1c/d1f/d20/d27/d28/d7a/l12d 0 2024-02-15T22:51:27.225 INFO:tasks.workunit.client.1.smithi170.stdout:9/877: rename de/d1b/l55 to de/d1b/d1c/l12e 0 2024-02-15T22:51:27.227 INFO:tasks.workunit.client.1.smithi170.stdout:9/878: link de/d1b/d1c/f62 de/d1b/d1c/f12f 0 2024-02-15T22:51:27.228 INFO:tasks.workunit.client.1.smithi170.stdout:9/879: truncate de/d1b/d1c/d1f/d20/d27/d28/f98 598830 0 2024-02-15T22:51:27.229 INFO:tasks.workunit.client.1.smithi170.stdout:9/880: symlink de/d1b/d1c/d1f/d20/d27/d28/d80/l130 0 2024-02-15T22:51:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:26 smithi170 ceph-mon[35248]: pgmap v26: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 194 MiB/s rd, 246 MiB/s wr, 496 op/s 2024-02-15T22:51:27.315 INFO:tasks.workunit.client.1.smithi170.stdout:8/922: sync 2024-02-15T22:51:27.315 INFO:tasks.workunit.client.1.smithi170.stdout:8/923: truncate d9/d18/d32/d3b/dfe/fe6 660406 0 2024-02-15T22:51:27.316 INFO:tasks.workunit.client.1.smithi170.stdout:8/924: symlink d9/d18/d32/d3b/dc5/d112/l13f 0 2024-02-15T22:51:27.319 INFO:tasks.workunit.client.1.smithi170.stdout:8/925: dread d9/d18/d32/d7a/d78/d7f/d98/f9f [0,4194304] 0 2024-02-15T22:51:27.320 INFO:tasks.workunit.client.1.smithi170.stdout:8/926: mkdir d9/d18/d32/db1/d12c/d140 0 2024-02-15T22:51:27.321 INFO:tasks.workunit.client.1.smithi170.stdout:8/927: mknod d9/d18/d32/d3b/dfe/c141 0 2024-02-15T22:51:27.322 INFO:tasks.workunit.client.1.smithi170.stdout:8/928: unlink d9/d18/d32/f81 0 2024-02-15T22:51:27.343 INFO:tasks.workunit.client.1.smithi170.stdout:8/929: dwrite d9/d18/d32/d3b/d4b/f8f [0,4194304] 0 2024-02-15T22:51:27.354 INFO:tasks.workunit.client.1.smithi170.stdout:9/881: sync 2024-02-15T22:51:27.355 INFO:tasks.workunit.client.1.smithi170.stdout:9/882: read de/d1b/f25 [276687,90577] 0 2024-02-15T22:51:27.355 INFO:tasks.workunit.client.1.smithi170.stdout:9/883: readlink de/d1b/d1c/d1f/d20/l5c 0 2024-02-15T22:51:27.356 INFO:tasks.workunit.client.1.smithi170.stdout:9/884: getdents de/da6 0 2024-02-15T22:51:27.357 INFO:tasks.workunit.client.1.smithi170.stdout:8/930: dread d9/d18/d32/d7a/d78/d7f/ff8 [0,4194304] 0 2024-02-15T22:51:27.357 INFO:tasks.workunit.client.1.smithi170.stdout:8/931: write d9/d18/d26/d4f/fce [5210840,79420] 0 2024-02-15T22:51:27.357 INFO:tasks.workunit.client.1.smithi170.stdout:9/885: stat de/da6/ca9 0 2024-02-15T22:51:27.359 INFO:tasks.workunit.client.1.smithi170.stdout:8/932: creat d9/db2/d12a/f142 x:0 0 0 2024-02-15T22:51:27.361 INFO:tasks.workunit.client.1.smithi170.stdout:8/933: link d9/d18/d32/d99/db7/de0/d10f/f132 d9/d18/d26/d131/f143 0 2024-02-15T22:51:27.362 INFO:tasks.workunit.client.1.smithi170.stdout:8/934: stat d9/d18/d26/dd5 0 2024-02-15T22:51:27.362 INFO:tasks.workunit.client.1.smithi170.stdout:8/935: getdents d9/d18/d32/db1 0 2024-02-15T22:51:27.375 INFO:tasks.workunit.client.1.smithi170.stdout:9/886: dwrite de/d1b/d1c/d47/f48 [0,4194304] 0 2024-02-15T22:51:27.383 INFO:tasks.workunit.client.1.smithi170.stdout:8/936: dwrite d9/ff [0,4194304] 0 2024-02-15T22:51:27.383 INFO:tasks.workunit.client.1.smithi170.stdout:8/937: read - d9/db2/dd7/f129 zero size 2024-02-15T22:51:27.409 INFO:tasks.workunit.client.1.smithi170.stdout:8/938: dwrite d9/d18/d32/f4c [0,4194304] 0 2024-02-15T22:51:27.409 INFO:tasks.workunit.client.1.smithi170.stdout:9/887: dwrite de/d1b/d1c/d1f/f36 [0,4194304] 0 2024-02-15T22:51:27.409 INFO:tasks.workunit.client.1.smithi170.stdout:8/939: chown d9/db2/fac 0 1 2024-02-15T22:51:27.412 INFO:tasks.workunit.client.1.smithi170.stdout:8/940: dread d9/f82 [0,4194304] 0 2024-02-15T22:51:27.415 INFO:tasks.workunit.client.1.smithi170.stdout:8/941: fsync d9/d18/d26/d4f/fce 0 2024-02-15T22:51:27.415 INFO:tasks.workunit.client.1.smithi170.stdout:8/942: truncate d9/d18/d26/dd5/f125 1027891 0 2024-02-15T22:51:27.416 INFO:tasks.workunit.client.1.smithi170.stdout:9/888: dread de/d1b/d1c/d1f/f36 [0,4194304] 0 2024-02-15T22:51:27.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/889: mkdir de/d1b/d1c/d47/d131 0 2024-02-15T22:51:27.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/890: truncate de/d1b/d1c/d1f/d20/d27/fae 76782 0 2024-02-15T22:51:27.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/891: dread - de/d1b/d37/dab/fe4 zero size 2024-02-15T22:51:27.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/892: readlink de/d1b/d1c/d1f/d20/d27/d2c/l11c 0 2024-02-15T22:51:27.418 INFO:tasks.workunit.client.1.smithi170.stdout:9/893: dread - de/d1b/d1c/d1f/d20/d27/d28/d80/f107 zero size 2024-02-15T22:51:27.420 INFO:tasks.workunit.client.1.smithi170.stdout:9/894: rename de/d1b/d1c/d1f/d20/d27/d2c/f32 to de/d1b/d37/dab/f132 0 2024-02-15T22:51:27.421 INFO:tasks.workunit.client.1.smithi170.stdout:9/895: unlink de/d1b/d1c/cbf 0 2024-02-15T22:51:27.422 INFO:tasks.workunit.client.1.smithi170.stdout:9/896: rmdir de/d1b/d1c/d1f/d20/d27/df2/dfa 39 2024-02-15T22:51:27.422 INFO:tasks.workunit.client.1.smithi170.stdout:9/897: stat de/d1b/d1c/d1f/f9b 0 2024-02-15T22:51:27.422 INFO:tasks.workunit.client.1.smithi170.stdout:9/898: write de/d1b/d1c/ff9 [997134,122444] 0 2024-02-15T22:51:27.423 INFO:tasks.workunit.client.1.smithi170.stdout:9/899: creat de/d1b/d1c/d1f/d20/d27/d2c/d124/f133 x:0 0 0 2024-02-15T22:51:27.424 INFO:tasks.workunit.client.1.smithi170.stdout:9/900: symlink de/d1b/d1c/d1f/d20/d27/d28/d80/l134 0 2024-02-15T22:51:27.431 INFO:tasks.workunit.client.1.smithi170.stdout:8/943: dwrite d9/d18/d32/d7a/d78/d7f/f94 [0,4194304] 0 2024-02-15T22:51:27.431 INFO:tasks.workunit.client.1.smithi170.stdout:8/944: fdatasync d9/d18/d32/d7a/d78/d7f/d98/d12e/f139 0 2024-02-15T22:51:27.432 INFO:tasks.workunit.client.1.smithi170.stdout:8/945: unlink d9/d18/d32/caa 0 2024-02-15T22:51:27.439 INFO:tasks.workunit.client.1.smithi170.stdout:9/901: dwrite de/d1b/d1c/d47/fc8 [0,4194304] 0 2024-02-15T22:51:27.441 INFO:tasks.workunit.client.1.smithi170.stdout:9/902: truncate de/d1b/d1c/f5b 873524 0 2024-02-15T22:51:27.461 INFO:tasks.workunit.client.1.smithi170.stdout:8/946: dwrite d9/fd [0,4194304] 0 2024-02-15T22:51:27.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.460+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3020061190 con 0x7f300806cf50 2024-02-15T22:51:27.463 INFO:tasks.workunit.client.1.smithi170.stdout:8/947: creat d9/d18/d32/dab/d13a/f144 x:0 0 0 2024-02-15T22:51:27.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.462+0000 7f300f7fe700 1 -- 172.21.15.138:0/1750783594 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f3020061190 con 0x7f300806cf50 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 msgr2=0x7f300806f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 0x7f300806f400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3010005950 tx=0x7f301000b410 comp rx=0 tx=0).stop 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 msgr2=0x7f302019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3018006070 tx=0x7f3018003c30 comp rx=0 tx=0).stop 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 shutdown_connections 2024-02-15T22:51:27.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f300806cf50 0x7f300806f400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30200fe9d0 0x7f302019bdb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 --2- 172.21.15.138:0/1750783594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3020101330 0x7f302019c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.466+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 >> 172.21.15.138:0/1750783594 conn(0x7f30200fa600 msgr2=0x7f30200fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.467+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 shutdown_connections 2024-02-15T22:51:27.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.469+0000 7f3024f5f700 1 -- 172.21.15.138:0/1750783594 wait complete. 2024-02-15T22:51:27.471 INFO:tasks.workunit.client.1.smithi170.stdout:8/948: write d9/d18/d26/ff2 [1536077,92085] 0 2024-02-15T22:51:27.491 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:51:27.566 INFO:tasks.workunit.client.1.smithi170.stdout:8/949: sync 2024-02-15T22:51:27.566 INFO:tasks.workunit.client.1.smithi170.stdout:9/903: sync 2024-02-15T22:51:27.566 INFO:tasks.workunit.client.1.smithi170.stdout:9/904: fdatasync de/d1b/d1c/d1f/d20/d27/df2/dfa/fee 0 2024-02-15T22:51:27.567 INFO:tasks.workunit.client.1.smithi170.stdout:9/905: mkdir de/d1b/d1c/d1f/d135 0 2024-02-15T22:51:27.596 INFO:tasks.workunit.client.1.smithi170.stdout:8/950: dwrite d9/d18/d32/d7a/d78/d7f/d98/fad [4194304,4194304] 0 2024-02-15T22:51:27.596 INFO:tasks.workunit.client.1.smithi170.stdout:8/951: chown d9/d18/d32/dab/f11e 407 1 2024-02-15T22:51:27.596 INFO:tasks.workunit.client.1.smithi170.stdout:9/906: dwrite de/da6/ff0 [0,4194304] 0 2024-02-15T22:51:27.597 INFO:tasks.workunit.client.1.smithi170.stdout:9/907: stat de/d1b/d1c/d1f/d20/d27/d2c/d124 0 2024-02-15T22:51:27.598 INFO:tasks.workunit.client.1.smithi170.stdout:8/952: rename d9/ff to d9/d11f/f145 0 2024-02-15T22:51:27.602 INFO:tasks.workunit.client.1.smithi170.stdout:8/953: rename d9/d18/d32/d3b/d68/f8e to d9/d18/d32/d99/db7/de0/f146 0 2024-02-15T22:51:27.602 INFO:tasks.workunit.client.1.smithi170.stdout:8/954: dread - d9/d18/d32/d7a/d78/d95/fc6 zero size 2024-02-15T22:51:27.602 INFO:tasks.workunit.client.1.smithi170.stdout:8/955: chown l3 94881356 1 2024-02-15T22:51:27.613 INFO:tasks.workunit.client.1.smithi170.stdout:9/908: dwrite de/d1b/faf [0,4194304] 0 2024-02-15T22:51:27.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/909: dread de/fd7 [0,4194304] 0 2024-02-15T22:51:27.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/910: dread - de/d1b/d1c/d1f/d20/d27/d84/f94 zero size 2024-02-15T22:51:27.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/911: fsync de/d1b/d37/f110 0 2024-02-15T22:51:27.620 INFO:tasks.workunit.client.1.smithi170.stdout:9/912: chown de/d1b/d1c/d1f/d20/d27/d28/d7a/c93 100960969 1 2024-02-15T22:51:27.621 INFO:tasks.workunit.client.1.smithi170.stdout:9/913: mkdir de/da6/d136 0 2024-02-15T22:51:27.621 INFO:tasks.workunit.client.1.smithi170.stdout:9/914: mknod de/d97/ddc/c137 0 2024-02-15T22:51:27.622 INFO:tasks.workunit.client.1.smithi170.stdout:9/915: stat de/d8e/cdd 0 2024-02-15T22:51:27.622 INFO:tasks.workunit.client.1.smithi170.stdout:9/916: chown de/d1b/d37/dab/fdf 68019 1 2024-02-15T22:51:27.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 -- 172.21.15.138:0/2108197503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 msgr2=0x7fa5400ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 --2- 172.21.15.138:0/2108197503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa5400ff460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009870 tx=0x7fa53c009b80 comp rx=0 tx=0).stop 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 -- 172.21.15.138:0/2108197503 shutdown_connections 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 --2- 172.21.15.138:0/2108197503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa5401006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 --2- 172.21.15.138:0/2108197503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa5400ff460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 -- 172.21.15.138:0/2108197503 >> 172.21.15.138:0/2108197503 conn(0x7fa5400fa5e0 msgr2=0x7fa5400fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 -- 172.21.15.138:0/2108197503 shutdown_connections 2024-02-15T22:51:27.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.622+0000 7fa547541700 1 -- 172.21.15.138:0/2108197503 wait complete. 2024-02-15T22:51:27.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 Processor -- start 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 -- start start 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa54019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54019df00 con 0x7fa540100250 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.623+0000 7fa547541700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54019e040 con 0x7fa5400ff050 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60260/0 (socket says 172.21.15.138:60260) 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 -- 172.21.15.138:0/4233651479 learned_addr learned my addr 172.21.15.138:0/4233651479 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa5452dd700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa54019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 -- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 msgr2=0x7fa54019d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa54019d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 -- 172.21.15.138:0/4233651479 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009520 con 0x7fa540100250 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.624+0000 7fa544adc700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e970 tx=0x7fa53000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.625+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa530004a00 con 0x7fa540100250 2024-02-15T22:51:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.625+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540068570 con 0x7fa540100250 2024-02-15T22:51:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.625+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa53000cc70 con 0x7fa540100250 2024-02-15T22:51:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.625+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540068b40 con 0x7fa540100250 2024-02-15T22:51:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.625+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5300055f0 con 0x7fa540100250 2024-02-15T22:51:27.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.626+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54006aec0 con 0x7fa540100250 2024-02-15T22:51:27.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.627+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7fa53000c7c0 con 0x7fa540100250 2024-02-15T22:51:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.627+0000 7fa5367fc700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 0x7fa52c06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.628+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa530014070 con 0x7fa540100250 2024-02-15T22:51:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.628+0000 7fa5452dd700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 0x7fa52c06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:27.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.628+0000 7fa5452dd700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 0x7fa52c06f3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009840 tx=0x7fa53c019040 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:27.634 INFO:tasks.workunit.client.1.smithi170.stdout:9/917: dwrite de/d1b/d1c/ff9 [0,4194304] 0 2024-02-15T22:51:27.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.633+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fa53005a200 con 0x7fa540100250 2024-02-15T22:51:27.655 INFO:tasks.workunit.client.1.smithi170.stdout:9/918: dwrite de/d1b/d1c/d1f/d20/ff6 [4194304,4194304] 0 2024-02-15T22:51:27.656 INFO:tasks.workunit.client.1.smithi170.stdout:9/919: symlink de/d1b/d1c/d1f/d20/d78/dfd/l138 0 2024-02-15T22:51:27.657 INFO:tasks.workunit.client.1.smithi170.stdout:9/920: symlink de/d1b/d1c/d1f/d20/d27/d28/d80/l139 0 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/921: getdents de 0 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/922: write de/d97/ddc/ff8 [855164,122931] 0 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/923: write de/d8e/fad [4471173,7373] 0 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/924: readlink de/d1b/d1c/d1f/d20/d27/d28/d80/l139 0 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/925: dread - de/d1b/d1c/d1f/d20/d78/dfd/f108 zero size 2024-02-15T22:51:27.659 INFO:tasks.workunit.client.1.smithi170.stdout:9/926: rmdir de/d1b/d1c/d1f/d20/d27 39 2024-02-15T22:51:27.674 INFO:tasks.workunit.client.1.smithi170.stdout:9/927: dwrite de/da6/ff0 [0,4194304] 0 2024-02-15T22:51:27.674 INFO:tasks.workunit.client.1.smithi170.stdout:9/928: write de/d1b/d1c/d47/f10a [180963,13089] 0 2024-02-15T22:51:27.675 INFO:tasks.workunit.client.1.smithi170.stdout:9/929: dread de/d1b/d1c/d1f/f9b [0,4194304] 0 2024-02-15T22:51:27.681 INFO:tasks.workunit.client.1.smithi170.stdout:8/956: sync 2024-02-15T22:51:27.682 INFO:tasks.workunit.client.1.smithi170.stdout:9/930: dread de/d1b/d1c/f46 [0,4194304] 0 2024-02-15T22:51:27.682 INFO:tasks.workunit.client.1.smithi170.stdout:9/931: write de/f75 [662511,130237] 0 2024-02-15T22:51:27.683 INFO:tasks.workunit.client.1.smithi170.stdout:8/957: unlink d9/db2/d12a/c13c 0 2024-02-15T22:51:27.686 INFO:tasks.workunit.client.1.smithi170.stdout:9/932: rename de/d1b/d1c/d1f/d20/f42 to de/d1b/d1c/d1f/d20/d27/d2c/d124/f13a 0 2024-02-15T22:51:27.690 INFO:tasks.workunit.client.1.smithi170.stdout:8/958: dread d9/d18/d32/d3b/dc5/fe2 [0,4194304] 0 2024-02-15T22:51:27.691 INFO:tasks.workunit.client.1.smithi170.stdout:8/959: mkdir d9/d18/d32/d7a/d78/d7f/d98/d12e/d147 0 2024-02-15T22:51:27.692 INFO:tasks.workunit.client.1.smithi170.stdout:8/960: write d9/d18/d32/d99/db7/f111 [754088,120286] 0 2024-02-15T22:51:27.698 INFO:tasks.workunit.client.1.smithi170.stdout:8/961: dread d9/d18/d32/d7a/d78/fe4 [0,4194304] 0 2024-02-15T22:51:27.699 INFO:tasks.workunit.client.1.smithi170.stdout:8/962: fsync d9/d18/d32/d7a/d78/d7f/ff8 0 2024-02-15T22:51:27.700 INFO:tasks.workunit.client.1.smithi170.stdout:8/963: creat d9/d18/d32/d3b/d68/f148 x:0 0 0 2024-02-15T22:51:27.702 INFO:tasks.workunit.client.1.smithi170.stdout:8/964: mkdir d9/d18/d32/d3b/dc5/d149 0 2024-02-15T22:51:27.702 INFO:tasks.workunit.client.1.smithi170.stdout:8/965: dread - d9/dd0/f120 zero size 2024-02-15T22:51:27.703 INFO:tasks.workunit.client.1.smithi170.stdout:8/966: mknod d9/d18/d32/d3b/c14a 0 2024-02-15T22:51:27.703 INFO:tasks.workunit.client.1.smithi170.stdout:8/967: creat d9/db2/f14b x:0 0 0 2024-02-15T22:51:27.703 INFO:tasks.workunit.client.1.smithi170.stdout:8/968: chown d9/d18/d32/d3b/dfe 3201 1 2024-02-15T22:51:27.704 INFO:tasks.workunit.client.1.smithi170.stdout:9/933: dwrite de/d1b/d1c/d1f/d20/d27/d84/fb2 [0,4194304] 0 2024-02-15T22:51:27.704 INFO:tasks.workunit.client.1.smithi170.stdout:8/969: link d9/d18/d26/dd5/ced d9/db2/dd7/c14c 0 2024-02-15T22:51:27.705 INFO:tasks.workunit.client.1.smithi170.stdout:9/934: creat de/d97/f13b x:0 0 0 2024-02-15T22:51:27.707 INFO:tasks.workunit.client.1.smithi170.stdout:9/935: rename de/d1b/d1c/d1f/d20/d27/f29 to de/d1b/d1c/d1f/d20/f13c 0 2024-02-15T22:51:27.708 INFO:tasks.workunit.client.1.smithi170.stdout:9/936: creat de/d1b/d1c/d1f/d20/d78/f13d x:0 0 0 2024-02-15T22:51:27.708 INFO:tasks.workunit.client.1.smithi170.stdout:9/937: creat de/da6/d136/f13e x:0 0 0 2024-02-15T22:51:27.709 INFO:tasks.workunit.client.1.smithi170.stdout:9/938: mknod de/d1b/d1c/d1f/d20/d27/d28/d7a/c13f 0 2024-02-15T22:51:27.710 INFO:tasks.workunit.client.1.smithi170.stdout:9/939: creat de/d1b/d1c/d1f/d20/d27/dfc/d109/f140 x:0 0 0 2024-02-15T22:51:27.712 INFO:tasks.workunit.client.1.smithi170.stdout:9/940: rename de/d1b/d1c/d1f/d20/d27/d2c/c86 to de/d1b/d1c/d125/c141 0 2024-02-15T22:51:27.715 INFO:tasks.workunit.client.1.smithi170.stdout:9/941: creat de/d1b/d37/da5/f142 x:0 0 0 2024-02-15T22:51:27.717 INFO:tasks.workunit.client.1.smithi170.stdout:8/970: write d9/d18/d32/db1/f116 [3944431,14183] 0 2024-02-15T22:51:27.718 INFO:tasks.workunit.client.1.smithi170.stdout:8/971: mknod d9/d18/d32/d7a/d78/d7f/d98/c14d 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:9/942: dread de/d1b/d1c/d1f/f79 [0,4194304] 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/972: creat d9/d18/d26/d4f/f14e x:0 0 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/973: creat d9/d18/f14f x:0 0 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/974: fdatasync d9/d18/d32/d7a/d78/d7f/d98/f102 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:8/975: write d9/d18/d32/d99/db7/f105 [4752157,48756] 0 2024-02-15T22:51:27.720 INFO:tasks.workunit.client.1.smithi170.stdout:9/943: creat de/d1b/d1c/d1f/d20/d27/d28/d7a/f143 x:0 0 0 2024-02-15T22:51:27.721 INFO:tasks.workunit.client.1.smithi170.stdout:9/944: getdents de/d1b/d1c/d1f/d135 0 2024-02-15T22:51:27.722 INFO:tasks.workunit.client.1.smithi170.stdout:8/976: truncate d9/d18/d32/d3b/f10d 135386 0 2024-02-15T22:51:27.724 INFO:tasks.workunit.client.1.smithi170.stdout:8/977: rmdir d9/db2/dd7 39 2024-02-15T22:51:27.725 INFO:tasks.workunit.client.1.smithi170.stdout:8/978: rmdir d9/d18/d32/d7a/d78/d95/d137 39 2024-02-15T22:51:27.725 INFO:tasks.workunit.client.1.smithi170.stdout:8/979: getdents d9/d18/d32/d7a/d78 0 2024-02-15T22:51:27.727 INFO:tasks.workunit.client.1.smithi170.stdout:8/980: mknod d9/d18/d26/d4f/c150 0 2024-02-15T22:51:27.727 INFO:tasks.workunit.client.1.smithi170.stdout:8/981: fdatasync d9/d18/d32/d3b/dc5/f135 0 2024-02-15T22:51:27.727 INFO:tasks.workunit.client.1.smithi170.stdout:8/982: read d9/f6d [182944,61404] 0 2024-02-15T22:51:27.728 INFO:tasks.workunit.client.1.smithi170.stdout:8/983: dread - d9/db2/fc8 zero size 2024-02-15T22:51:27.728 INFO:tasks.workunit.client.1.smithi170.stdout:8/984: write d9/d18/d32/d3b/f134 [846662,73559] 0 2024-02-15T22:51:27.730 INFO:tasks.workunit.client.1.smithi170.stdout:8/985: unlink d9/d18/d26/c12d 0 2024-02-15T22:51:27.731 INFO:tasks.workunit.client.1.smithi170.stdout:8/986: dread d9/d18/d26/d4f/fbd [0,4194304] 0 2024-02-15T22:51:27.733 INFO:tasks.workunit.client.1.smithi170.stdout:8/987: rename d9/f82 to d9/d18/f151 0 2024-02-15T22:51:27.734 INFO:tasks.workunit.client.1.smithi170.stdout:8/988: read d9/d18/d32/dab/f11e [42624,50011] 0 2024-02-15T22:51:27.750 INFO:tasks.workunit.client.1.smithi170.stdout:8/989: dwrite d9/d18/d32/d99/d103/f114 [0,4194304] 0 2024-02-15T22:51:27.751 INFO:tasks.workunit.client.1.smithi170.stdout:8/990: rmdir d9/d18/d26/d4f 39 2024-02-15T22:51:27.764 INFO:tasks.workunit.client.1.smithi170.stdout:8/991: dwrite d9/d18/d32/d3b/f90 [0,4194304] 0 2024-02-15T22:51:27.766 INFO:tasks.workunit.client.1.smithi170.stdout:8/992: creat d9/d18/d32/d7a/d78/d95/d137/f152 x:0 0 0 2024-02-15T22:51:27.768 INFO:tasks.workunit.client.1.smithi170.stdout:8/993: rename d9/d18/d32/d3b/dc5/f135 to d9/d18/d32/d7a/d78/d95/d137/f153 0 2024-02-15T22:51:27.768 INFO:tasks.workunit.client.1.smithi170.stdout:8/994: chown d9/d18/d32/d7a/d78/d7f/d98/d12e 1 1 2024-02-15T22:51:27.774 INFO:tasks.workunit.client.1.smithi170.stdout:8/995: read d9/d18/f10e [5307247,18075] 0 2024-02-15T22:51:27.775 INFO:tasks.workunit.client.1.smithi170.stdout:8/996: dread d9/f6d [0,4194304] 0 2024-02-15T22:51:27.775 INFO:tasks.workunit.client.1.smithi170.stdout:8/997: chown d9/d18/c25 0 1 2024-02-15T22:51:27.775 INFO:tasks.workunit.client.1.smithi170.stdout:8/998: truncate d9/d18/d32/dab/d13a/f144 696157 0 2024-02-15T22:51:27.791 INFO:tasks.workunit.client.1.smithi170.stdout:8/999: dwrite d9/d18/d32/d7a/d78/d95/f13d [0,4194304] 0 2024-02-15T22:51:27.827 INFO:tasks.workunit.client.1.smithi170.stdout:9/945: sync 2024-02-15T22:51:27.827 INFO:tasks.workunit.client.1.smithi170.stdout:9/946: truncate de/da6/ff0 1946011 0 2024-02-15T22:51:27.828 INFO:tasks.workunit.client.1.smithi170.stdout:9/947: mknod de/d97/ddc/c144 0 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/948: dwrite f2 [0,4194304] 0 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/949: fsync fc 0 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/950: write de/d1b/d1c/d1f/d20/d27/d28/d7a/fe8 [1000706,92200] 0 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/951: chown de/d1b/d1c/d1f/d20/d27/d28/d80/f107 1863 1 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/952: read fc [2640311,46303] 0 2024-02-15T22:51:27.844 INFO:tasks.workunit.client.1.smithi170.stdout:9/953: write de/d1b/d1c/d1f/d20/d27/d2c/d124/f133 [670925,81185] 0 2024-02-15T22:51:27.845 INFO:tasks.workunit.client.1.smithi170.stdout:9/954: mkdir de/d97/d145 0 2024-02-15T22:51:27.845 INFO:tasks.workunit.client.1.smithi170.stdout:9/955: rmdir de/d1b 39 2024-02-15T22:51:27.845 INFO:tasks.workunit.client.1.smithi170.stdout:9/956: chown de/d1b/d1c/d1f/d20/d27/dfc/d109/f11f 23 1 2024-02-15T22:51:27.941 INFO:tasks.workunit.client.1.smithi170.stdout:9/957: sync 2024-02-15T22:51:27.941 INFO:tasks.workunit.client.1.smithi170.stdout:9/958: write de/d1b/d1c/d1f/d20/d78/dfd/f113 [113158,122639] 0 2024-02-15T22:51:27.942 INFO:tasks.workunit.client.1.smithi170.stdout:9/959: rename de/d1b/d1c/d1f/d20/d27/df2/f12c to de/d1b/d1c/f146 0 2024-02-15T22:51:27.943 INFO:tasks.workunit.client.1.smithi170.stdout:9/960: mknod de/d1b/d1c/d1f/d20/d78/c147 0 2024-02-15T22:51:27.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.943+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa540104ba0 con 0x7fa52c06cf10 2024-02-15T22:51:27.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.945+0000 7fa5367fc700 1 -- 172.21.15.138:0/4233651479 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fa540104ba0 con 0x7fa52c06cf10 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 msgr2=0x7fa52c06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 0x7fa52c06f3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009840 tx=0x7fa53c019040 comp rx=0 tx=0).stop 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 msgr2=0x7fa54019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e970 tx=0x7fa53000ec80 comp rx=0 tx=0).stop 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 shutdown_connections 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7fa52c06cf10 0x7fa52c06f3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5400ff050 0x7fa54019d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 --2- 172.21.15.138:0/4233651479 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa540100250 0x7fa54019d8e0 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e970 tx=0x7fa53000ec80 comp rx=0 tx=0).stop 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.949+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 >> 172.21.15.138:0/4233651479 conn(0x7fa5400fa5e0 msgr2=0x7fa540103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:27.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.950+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 shutdown_connections 2024-02-15T22:51:27.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:27.950+0000 7fa547541700 1 -- 172.21.15.138:0/4233651479 wait complete. 2024-02-15T22:51:27.961 INFO:tasks.workunit.client.1.smithi170.stdout:9/961: dwrite de/d1b/d1c/d1f/d20/d78/f102 [4194304,4194304] 0 2024-02-15T22:51:27.980 INFO:tasks.workunit.client.1.smithi170.stdout:9/962: dwrite de/d1b/d37/dab/f132 [4194304,4194304] 0 2024-02-15T22:51:27.980 INFO:tasks.workunit.client.1.smithi170.stdout:9/963: chown de/d1b/d1c/d1f/d20/d27/d84/lc7 355210500 1 2024-02-15T22:51:27.981 INFO:tasks.workunit.client.1.smithi170.stdout:9/964: rmdir de/d1b/d1c/d1f/d20/d27/d28 39 2024-02-15T22:51:27.982 INFO:tasks.workunit.client.1.smithi170.stdout:9/965: creat de/d1b/d1c/d1f/d20/d27/d28/d80/f148 x:0 0 0 2024-02-15T22:51:27.984 INFO:tasks.workunit.client.1.smithi170.stdout:9/966: mkdir de/d1b/d1c/d1f/d20/d78/dfd/d149 0 2024-02-15T22:51:27.985 INFO:tasks.workunit.client.1.smithi170.stdout:9/967: creat de/d1b/d1c/d125/f14a x:0 0 0 2024-02-15T22:51:27.985 INFO:tasks.workunit.client.1.smithi170.stdout:9/968: stat de/d1b/d1c/f62 0 2024-02-15T22:51:27.987 INFO:tasks.workunit.client.1.smithi170.stdout:9/969: mkdir de/d1b/d1c/d1f/d20/d27/d14b 0 2024-02-15T22:51:27.988 INFO:tasks.workunit.client.1.smithi170.stdout:9/970: symlink de/d1b/d1c/d1f/d20/d27/d84/l14c 0 2024-02-15T22:51:27.988 INFO:tasks.workunit.client.1.smithi170.stdout:9/971: chown de/d1b/d1c/d1f/d20/d27/df2/dfa/c119 336412217 1 2024-02-15T22:51:27.988 INFO:tasks.workunit.client.1.smithi170.stdout:9/972: fdatasync de/d1b/d1c/d1f/d20/d78/f13d 0 2024-02-15T22:51:28.041 INFO:tasks.workunit.client.1.smithi170.stdout:9/973: sync 2024-02-15T22:51:28.042 INFO:tasks.workunit.client.1.smithi170.stdout:9/974: mknod de/da6/d136/c14d 0 2024-02-15T22:51:28.042 INFO:tasks.workunit.client.1.smithi170.stdout:9/975: chown de/d1b/d1c/d1f/d20/d27/d28/f115 47342 1 2024-02-15T22:51:28.043 INFO:tasks.workunit.client.1.smithi170.stdout:9/976: creat de/d1b/d1c/d1f/d20/d27/d28/f14e x:0 0 0 2024-02-15T22:51:28.043 INFO:tasks.workunit.client.1.smithi170.stdout:9/977: fdatasync fc 0 2024-02-15T22:51:28.044 INFO:tasks.workunit.client.1.smithi170.stdout:9/978: mknod de/da6/c14f 0 2024-02-15T22:51:28.044 INFO:tasks.workunit.client.1.smithi170.stdout:9/979: mknod de/d1b/d1c/d1f/d20/d78/dfd/c150 0 2024-02-15T22:51:28.045 INFO:tasks.workunit.client.1.smithi170.stdout:9/980: creat de/d1b/d1c/d1f/d135/f151 x:0 0 0 2024-02-15T22:51:28.047 INFO:tasks.workunit.client.1.smithi170.stdout:9/981: rename de/d1b/d1c/d1f/d20/d27/df2/dfa to de/d1b/d1c/d1f/d152 0 2024-02-15T22:51:28.047 INFO:tasks.workunit.client.1.smithi170.stdout:9/982: read - de/da6/d136/f13e zero size 2024-02-15T22:51:28.047 INFO:tasks.workunit.client.1.smithi170.stdout:9/983: getdents de/d1b/d1c/d47 0 2024-02-15T22:51:28.048 INFO:tasks.workunit.client.1.smithi170.stdout:9/984: mknod de/d8e/c153 0 2024-02-15T22:51:28.049 INFO:tasks.workunit.client.1.smithi170.stdout:9/985: truncate de/d1b/d1c/d1f/d20/d78/f8b 907603 0 2024-02-15T22:51:28.068 INFO:tasks.workunit.client.1.smithi170.stdout:9/986: dwrite de/d1b/d1c/f2d [0,4194304] 0 2024-02-15T22:51:28.069 INFO:tasks.workunit.client.1.smithi170.stdout:9/987: mkdir de/d1b/d1c/d47/d154 0 2024-02-15T22:51:28.075 INFO:tasks.workunit.client.1.smithi170.stdout:9/988: read de/d1b/d1c/d1f/d20/fb0 [3251927,1712] 0 2024-02-15T22:51:28.076 INFO:tasks.workunit.client.1.smithi170.stdout:9/989: symlink de/d1b/d37/da5/l155 0 2024-02-15T22:51:28.076 INFO:tasks.workunit.client.1.smithi170.stdout:9/990: stat de/d1b/d1c/c82 0 2024-02-15T22:51:28.077 INFO:tasks.workunit.client.1.smithi170.stdout:9/991: mkdir de/d1b/d1c/d156 0 2024-02-15T22:51:28.077 INFO:tasks.workunit.client.1.smithi170.stdout:9/992: readlink de/d1b/d1c/d1f/d20/d27/d2c/l11c 0 2024-02-15T22:51:28.078 INFO:tasks.workunit.client.1.smithi170.stdout:9/993: rename de/d1b/d1c/d1f/d20/c10e to de/d8e/c157 0 2024-02-15T22:51:28.079 INFO:tasks.workunit.client.1.smithi170.stdout:9/994: mknod de/d97/ddc/c158 0 2024-02-15T22:51:28.079 INFO:tasks.workunit.client.1.smithi170.stdout:9/995: creat de/d1b/d1c/d125/f159 x:0 0 0 2024-02-15T22:51:28.088 INFO:tasks.workunit.client.1.smithi170.stdout:9/996: dread de/d1b/d1c/f2d [0,4194304] 0 2024-02-15T22:51:28.088 INFO:tasks.workunit.client.1.smithi170.stdout:9/997: rmdir de/d1b/d1c/d11b 39 2024-02-15T22:51:28.089 INFO:tasks.workunit.client.1.smithi170.stdout:9/998: creat de/d1b/d1c/d1f/d20/d27/dfc/d109/d126/f15a x:0 0 0 2024-02-15T22:51:28.090 INFO:tasks.workunit.client.1.smithi170.stdout:9/999: mknod de/d1b/d1c/d1f/d20/d27/df2/c15b 0 2024-02-15T22:51:28.092 INFO:tasks.workunit.client.1.smithi170.stderr:+ rm -rf -- ./tmp.oISZ7cLITq 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.100+0000 7f0a74ebc700 1 -- 172.21.15.138:0/2442229227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 msgr2=0x7f0a70100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.100+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/2442229227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70100ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009910 tx=0x7f0a60009c20 comp rx=0 tx=0).stop 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 -- 172.21.15.138:0/2442229227 shutdown_connections 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/2442229227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 0x7f0a700ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/2442229227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70100ae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 -- 172.21.15.138:0/2442229227 >> 172.21.15.138:0/2442229227 conn(0x7f0a700f9d80 msgr2=0x7f0a700fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 -- 172.21.15.138:0/2442229227 shutdown_connections 2024-02-15T22:51:28.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.101+0000 7f0a74ebc700 1 -- 172.21.15.138:0/2442229227 wait complete. 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 Processor -- start 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 -- start start 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 0x7f0a70193770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701942d0 con 0x7f0a701006d0 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a74ebc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70194410 con 0x7f0a700ff2a0 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a6dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a6dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60282/0 (socket says 172.21.15.138:60282) 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.102+0000 7f0a6dd9b700 1 -- 172.21.15.138:0/1448791201 learned_addr learned my addr 172.21.15.138:0/1448791201 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a6e59c700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 0x7f0a70193770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a6dd9b700 1 -- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 msgr2=0x7f0a70193770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a6dd9b700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 0x7f0a70193770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a6dd9b700 1 -- 172.21.15.138:0/1448791201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600095f0 con 0x7f0a701006d0 2024-02-15T22:51:28.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a6dd9b700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400e920 tx=0x7f0a6400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:28.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a6400c9d0 con 0x7f0a701006d0 2024-02-15T22:51:28.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a64010430 con 0x7f0a701006d0 2024-02-15T22:51:28.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.103+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a70198ec0 con 0x7f0a701006d0 2024-02-15T22:51:28.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.104+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a640185f0 con 0x7f0a701006d0 2024-02-15T22:51:28.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.104+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7019d7f0 con 0x7f0a701006d0 2024-02-15T22:51:28.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.105+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f0a640105a0 con 0x7f0a701006d0 2024-02-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.106+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70106b40 con 0x7f0a701006d0 2024-02-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.106+0000 7f0a5f7fe700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 0x7f0a5806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.106+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0a6408e020 con 0x7f0a701006d0 2024-02-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.106+0000 7f0a6e59c700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 0x7f0a5806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.107+0000 7f0a6e59c700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 0x7f0a5806f3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4b0 tx=0x7f0a60009f70 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:28.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.112+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f0a6405a060 con 0x7f0a701006d0 2024-02-15T22:51:28.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.429+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a70104c00 con 0x7f0a5806cf10 2024-02-15T22:51:28.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.445+0000 7f0a5f7fe700 1 -- 172.21.15.138:0/1448791201 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0a70104c00 con 0x7f0a5806cf10 2024-02-15T22:51:28.447 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:51:28.447 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (7m) 25s ago 8m 26.9M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (8m) 25s ago 8m 7700k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (7m) 39s ago 7m 7658k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (8m) 25s ago 8m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (7m) 39s ago 7m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (6m) 25s ago 8m 84.1M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (2m) 25s ago 2m 81.8M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (2m) 25s ago 2m 149M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (2m) 39s ago 2m 98.4M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (2m) 39s ago 2m 41.7M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 starting - - - - 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (66s) 39s ago 7m 488M - 19.0.0-1450-gf78a58c0 f081f847070a 3b76cab03601 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (10m) 25s ago 10m 54.4M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (7m) 39s ago 7m 41.6M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:51:28.448 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 25s ago 8m 14.6M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 39s ago 7m 15.8M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (6m) 25s ago 6m 135M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (6m) 25s ago 6m 136M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (5m) 25s ago 5m 105M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (5m) 39s ago 5m 145M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (4m) 39s ago 4m 128M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (4m) 39s ago 4m 123M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:51:28.449 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 starting - - - - 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 msgr2=0x7f0a5806f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 0x7f0a5806f3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4b0 tx=0x7f0a60009f70 comp rx=0 tx=0).stop 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 msgr2=0x7f0a70193cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400e920 tx=0x7f0a6400ec30 comp rx=0 tx=0).stop 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 shutdown_connections 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f0a5806cf10 0x7f0a5806f3c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a700ff2a0 0x7f0a70193770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 --2- 172.21.15.138:0/1448791201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a701006d0 0x7f0a70193cb0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400e920 tx=0x7f0a6400ec30 comp rx=0 tx=0).stop 2024-02-15T22:51:28.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.448+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 >> 172.21.15.138:0/1448791201 conn(0x7f0a700f9d80 msgr2=0x7f0a701034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:28.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.449+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 shutdown_connections 2024-02-15T22:51:28.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.449+0000 7f0a74ebc700 1 -- 172.21.15.138:0/1448791201 wait complete. 2024-02-15T22:51:28.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 -- 172.21.15.138:0/289603067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e781079b0 msgr2=0x7f4e78107e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 --2- 172.21.15.138:0/289603067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e781079b0 0x7f4e78107e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009910 tx=0x7f4e68009c20 comp rx=0 tx=0).stop 2024-02-15T22:51:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 -- 172.21.15.138:0/289603067 shutdown_connections 2024-02-15T22:51:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 --2- 172.21.15.138:0/289603067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e781079b0 0x7f4e78107e00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 --2- 172.21.15.138:0/289603067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e78106800 0x7f4e78106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.626+0000 7f4e7e755700 1 -- 172.21.15.138:0/289603067 >> 172.21.15.138:0/289603067 conn(0x7f4e78075940 msgr2=0x7f4e78077d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:28.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.627+0000 7f4e7e755700 1 -- 172.21.15.138:0/289603067 shutdown_connections 2024-02-15T22:51:28.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.627+0000 7f4e7e755700 1 -- 172.21.15.138:0/289603067 wait complete. 2024-02-15T22:51:28.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 Processor -- start 2024-02-15T22:51:28.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 -- start start 2024-02-15T22:51:28.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 0x7f4e78080ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 0x7f4e78081020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e78081640 con 0x7f4e78106800 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e7e755700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e78081780 con 0x7f4e781079b0 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.628+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 0x7f4e78080ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 0x7f4e78080ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60290/0 (socket says 172.21.15.138:60290) 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e777fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 0x7f4e78081020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e77fff700 1 -- 172.21.15.138:0/2562273502 learned_addr learned my addr 172.21.15.138:0/2562273502 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e777fe700 1 -- 172.21.15.138:0/2562273502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 msgr2=0x7f4e78080ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e777fe700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 0x7f4e78080ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:28.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e777fe700 1 -- 172.21.15.138:0/2562273502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680095f0 con 0x7f4e781079b0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.629+0000 7f4e777fe700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 0x7f4e78081020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e680098e0 tx=0x7f4e6800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.630+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e6801d070 con 0x7f4e781079b0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.630+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e781a9e70 con 0x7f4e781079b0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.630+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e6800f460 con 0x7f4e781079b0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.630+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e68021640 con 0x7f4e781079b0 2024-02-15T22:51:28.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.630+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e781aa330 con 0x7f4e781079b0 2024-02-15T22:51:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.632+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f4e68003a60 con 0x7f4e781079b0 2024-02-15T22:51:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.632+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64005320 con 0x7f4e781079b0 2024-02-15T22:51:28.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.633+0000 7f4e757fa700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 0x7f4e6006f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.633+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4e6808d700 con 0x7f4e781079b0 2024-02-15T22:51:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.633+0000 7f4e77fff700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 0x7f4e6006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:28.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.634+0000 7f4e77fff700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 0x7f4e6006f510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00bd70 tx=0x7f4e6c00b4a0 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:28.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:28.640+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4e6805af60 con 0x7f4e781079b0 2024-02-15T22:51:28.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:28 smithi138 ceph-mon[29229]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 200 MiB/s rd, 260 MiB/s wr, 553 op/s 2024-02-15T22:51:28.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:28 smithi138 ceph-mon[29229]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:29.076 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:28 smithi170 ceph-mon[35248]: pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 200 MiB/s rd, 260 MiB/s wr, 553 op/s 2024-02-15T22:51:29.076 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:28 smithi170 ceph-mon[35248]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:29.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.105+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e64005cc0 con 0x7f4e781079b0 2024-02-15T22:51:29.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.105+0000 7f4e757fa700 1 -- 172.21.15.138:0/2562273502 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f4e68026070 con 0x7f4e781079b0 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:51:29.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:51:29.109 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:51:29.109 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 13, 2024-02-15T22:51:29.109 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:51:29.109 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:51:29.109 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 msgr2=0x7f4e6006f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 0x7f4e6006f510 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00bd70 tx=0x7f4e6c00b4a0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 msgr2=0x7f4e78081020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 0x7f4e78081020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e680098e0 tx=0x7f4e6800bd70 comp rx=0 tx=0).stop 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 shutdown_connections 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f4e6006d060 0x7f4e6006f510 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e78106800 0x7f4e78080ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 --2- 172.21.15.138:0/2562273502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e781079b0 0x7f4e78081020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.108+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 >> 172.21.15.138:0/2562273502 conn(0x7f4e78075940 msgr2=0x7f4e7810abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.109+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 shutdown_connections 2024-02-15T22:51:29.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.109+0000 7f4e7e755700 1 -- 172.21.15.138:0/2562273502 wait complete. 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 -- 172.21.15.138:0/443961197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0100be0 msgr2=0x7f55c0102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 --2- 172.21.15.138:0/443961197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0100be0 0x7f55c0102fc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009910 tx=0x7f55b0009c20 comp rx=0 tx=0).stop 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 -- 172.21.15.138:0/443961197 shutdown_connections 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 --2- 172.21.15.138:0/443961197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0103500 0x7f55c01058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 --2- 172.21.15.138:0/443961197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0100be0 0x7f55c0102fc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 -- 172.21.15.138:0/443961197 >> 172.21.15.138:0/443961197 conn(0x7f55c00fa600 msgr2=0x7f55c00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 -- 172.21.15.138:0/443961197 shutdown_connections 2024-02-15T22:51:29.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.246+0000 7f55c558e700 1 -- 172.21.15.138:0/443961197 wait complete. 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.247+0000 7f55c558e700 1 Processor -- start 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.247+0000 7f55c558e700 1 -- start start 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55c558e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55c558e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0103500 0x7f55c0195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55c558e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c01964e0 con 0x7f55c0103500 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55c558e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0196620 con 0x7f55c0100be0 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:40560/0 (socket says 172.21.15.138:40560) 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 -- 172.21.15.138:0/1600357209 learned_addr learned my addr 172.21.15.138:0/1600357209 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55be7fc700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0103500 0x7f55c0195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:29.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 -- 172.21.15.138:0/1600357209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0103500 msgr2=0x7f55c0195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0103500 0x7f55c0195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 -- 172.21.15.138:0/1600357209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00095f0 con 0x7f55c0100be0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.248+0000 7f55beffd700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000c00 tx=0x7f55b000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.249+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b001d070 con 0x7f55c0100be0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.249+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55b0005dc0 con 0x7f55c0100be0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.249+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b00226a0 con 0x7f55c0100be0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.249+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c019b020 con 0x7f55c0100be0 2024-02-15T22:51:29.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.249+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c019b510 con 0x7f55c0100be0 2024-02-15T22:51:29.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.250+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c018fb70 con 0x7f55c0100be0 2024-02-15T22:51:29.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.251+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 24) v1 ==== 90734+0+0 (secure 0 0 0) 0x7f55b0003680 con 0x7f55c0100be0 2024-02-15T22:51:29.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.251+0000 7f55a7fff700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 0x7f55a806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:29.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.251+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f55b008dbb0 con 0x7f55c0100be0 2024-02-15T22:51:29.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.251+0000 7f55be7fc700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 0x7f55a806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:29.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.252+0000 7f55be7fc700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 0x7f55a806f3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009bf0 tx=0x7f55b4009260 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:29.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.260+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f55b0094080 con 0x7f55c0100be0 2024-02-15T22:51:29.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.704+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 --> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55c0061190 con 0x7f55a806cf10 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.707+0000 7f55a7fff700 1 -- 172.21.15.138:0/1600357209 <== mgr.24347 v2:172.21.15.170:6828/2668591850 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f55c0061190 con 0x7f55a806cf10 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [], 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "", 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mgr daemons", 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:51:29.710 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:51:29.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.713+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 msgr2=0x7f55a806f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.713+0000 7f55c558e700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 0x7f55a806f3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009bf0 tx=0x7f55b4009260 comp rx=0 tx=0).stop 2024-02-15T22:51:29.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.713+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 msgr2=0x7f55c0195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:29.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.714+0000 7f55c558e700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f55b0000c00 tx=0x7f55b000f740 comp rx=0 tx=0).stop 2024-02-15T22:51:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 shutdown_connections 2024-02-15T22:51:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:6828/2668591850,v1:172.21.15.170:6829/2668591850] conn(0x7f55a806cf10 0x7f55a806f3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55c0100be0 0x7f55c0195980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 --2- 172.21.15.138:0/1600357209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55c0103500 0x7f55c0195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 >> 172.21.15.138:0/1600357209 conn(0x7f55c00fa600 msgr2=0x7f55c00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:29.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 shutdown_connections 2024-02-15T22:51:29.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:29.715+0000 7f55c558e700 1 -- 172.21.15.138:0/1600357209 wait complete. 2024-02-15T22:51:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:29 smithi138 ceph-mon[29229]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:29 smithi138 ceph-mon[29229]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:29 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2562273502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:29 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:29 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:29 smithi170 ceph-mon[35248]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:30.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:29 smithi170 ceph-mon[35248]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:30.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:29 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2562273502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:51:30.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:29 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:30.264 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:29 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:31.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:30 smithi138 ceph-mon[29229]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 166 MiB/s rd, 211 MiB/s wr, 438 op/s 2024-02-15T22:51:31.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:30 smithi138 ceph-mon[29229]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:31.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:30 smithi170 ceph-mon[35248]: pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 166 MiB/s rd, 211 MiB/s wr, 438 op/s 2024-02-15T22:51:31.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:30 smithi170 ceph-mon[35248]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:51:32.505 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:32 smithi138 ceph-mon[29229]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 198 MiB/s rd, 255 MiB/s wr, 627 op/s 2024-02-15T22:51:32.505 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:32 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:32.505 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:32 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:32 smithi170 ceph-mon[35248]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 198 MiB/s rd, 255 MiB/s wr, 627 op/s 2024-02-15T22:51:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:32 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:32 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:33.571 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: Standby manager daemon smithi138.jqscxs restarted 2024-02-15T22:51:33.571 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: Standby manager daemon smithi138.jqscxs started 2024-02-15T22:51:33.571 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/crt"}]: dispatch 2024-02-15T22:51:33.571 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:51:33.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/key"}]: dispatch 2024-02-15T22:51:33.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:33 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: Standby manager daemon smithi138.jqscxs restarted 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: Standby manager daemon smithi138.jqscxs started 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/crt"}]: dispatch 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi138.jqscxs/key"}]: dispatch 2024-02-15T22:51:33.662 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:33 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:51:34.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:34 smithi170 ceph-mon[35248]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 116 MiB/s rd, 153 MiB/s wr, 426 op/s 2024-02-15T22:51:34.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:34 smithi170 ceph-mon[35248]: mgrmap e25: smithi170.gczrzt(active, since 54s), standbys: smithi138.jqscxs 2024-02-15T22:51:34.578 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:34 smithi138 ceph-mon[29229]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 116 MiB/s rd, 153 MiB/s wr, 426 op/s 2024-02-15T22:51:34.578 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:34 smithi138 ceph-mon[29229]: mgrmap e25: smithi170.gczrzt(active, since 54s), standbys: smithi138.jqscxs 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd='[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]': finished 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: mgrmap e26: smithi138.jqscxs(active, starting, since 0.00609351s) 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:51:36.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:51:36.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 172.21.15.170:0/2808024916' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.24347 ' entity='mgr.smithi170.gczrzt' cmd='[{"prefix": "mgr fail", "who": "smithi170.gczrzt"}]': finished 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: mgrmap e26: smithi138.jqscxs(active, starting, since 0.00609351s) 2024-02-15T22:51:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:51:36.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:51:36.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: [15/Feb/2024:22:51:36] ENGINE Bus STARTING 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: [15/Feb/2024:22:51:36] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: mgrmap e27: smithi138.jqscxs(active, since 1.0126s) 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: pgmap v3: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: [15/Feb/2024:22:51:36] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:51:37.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:37 smithi170 ceph-mon[35248]: [15/Feb/2024:22:51:36] ENGINE Bus STARTED 2024-02-15T22:51:37.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: [15/Feb/2024:22:51:36] ENGINE Bus STARTING 2024-02-15T22:51:37.527 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: [15/Feb/2024:22:51:36] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:51:37.528 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: mgrmap e27: smithi138.jqscxs(active, since 1.0126s) 2024-02-15T22:51:37.528 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: pgmap v3: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:37.528 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: [15/Feb/2024:22:51:36] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:51:37.528 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:37 smithi138 ceph-mon[29229]: [15/Feb/2024:22:51:36] ENGINE Bus STARTED 2024-02-15T22:51:38.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:38 smithi170 ceph-mon[35248]: pgmap v4: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:38.431 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:38 smithi170 ceph-mon[35248]: mgrmap e28: smithi138.jqscxs(active, since 2s) 2024-02-15T22:51:38.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:38 smithi138 ceph-mon[29229]: pgmap v4: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:38.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:38 smithi138 ceph-mon[29229]: mgrmap e28: smithi138.jqscxs(active, since 2s) 2024-02-15T22:51:39.327 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T22:51:39.328 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-15T22:51:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:40 smithi170 ceph-mon[35248]: pgmap v5: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:40 smithi170 ceph-mon[35248]: mgrmap e29: smithi138.jqscxs(active, since 4s) 2024-02-15T22:51:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:40 smithi138 ceph-mon[29229]: pgmap v5: 65 pgs: 65 active+clean; 956 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail 2024-02-15T22:51:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:40 smithi138 ceph-mon[29229]: mgrmap e29: smithi138.jqscxs(active, since 4s) 2024-02-15T22:51:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:41 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:41.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:41 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:41 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:42.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:41 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:42 smithi138 ceph-mon[29229]: pgmap v6: 65 pgs: 65 active+clean; 851 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 406 KiB/s rd, 454 KiB/s wr, 44 op/s 2024-02-15T22:51:43.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:42 smithi170 ceph-mon[35248]: pgmap v6: 65 pgs: 65 active+clean; 851 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 406 KiB/s rd, 454 KiB/s wr, 44 op/s 2024-02-15T22:51:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:43 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:51:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:43 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:51:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:43 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:51:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:43 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:51:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:43 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:51:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:43 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:51:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:43 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:51:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:43 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:51:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:43 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:51:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:43 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/3957762453' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:51:45.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:44 smithi138 ceph-mon[29229]: pgmap v7: 65 pgs: 65 active+clean; 436 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 234 op/s 2024-02-15T22:51:45.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:44 smithi138 ceph-mon[29229]: mgrmap e30: smithi138.jqscxs(active, since 8s), standbys: smithi170.gczrzt 2024-02-15T22:51:45.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:44 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:45.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:44 smithi170 ceph-mon[35248]: pgmap v7: 65 pgs: 65 active+clean; 436 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 234 op/s 2024-02-15T22:51:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:44 smithi170 ceph-mon[35248]: mgrmap e30: smithi138.jqscxs(active, since 8s), standbys: smithi170.gczrzt 2024-02-15T22:51:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:44 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:51:47.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:46 smithi138 ceph-mon[29229]: pgmap v8: 65 pgs: 65 active+clean; 436 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-02-15T22:51:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:46 smithi170 ceph-mon[35248]: pgmap v8: 65 pgs: 65 active+clean; 436 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-02-15T22:51:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:48 smithi138 ceph-mon[29229]: pgmap v9: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 269 op/s 2024-02-15T22:51:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:48 smithi170 ceph-mon[35248]: pgmap v9: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 269 op/s 2024-02-15T22:51:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:50 smithi138 ceph-mon[29229]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 247 op/s 2024-02-15T22:51:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:50 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:50 smithi170 ceph-mon[35248]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 247 op/s 2024-02-15T22:51:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:50 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:51:53.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:52 smithi138 ceph-mon[29229]: pgmap v11: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 247 op/s 2024-02-15T22:51:53.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:52 smithi170 ceph-mon[35248]: pgmap v11: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 247 op/s 2024-02-15T22:51:54.870 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:54 smithi138 ceph-mon[29229]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 341 op/s 2024-02-15T22:51:55.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:54 smithi170 ceph-mon[35248]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 341 op/s 2024-02-15T22:51:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:56 smithi138 ceph-mon[29229]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-02-15T22:51:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:56 smithi170 ceph-mon[35248]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2024-02-15T22:51:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:58 smithi138 ceph-mon[29229]: pgmap v14: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 378 op/s 2024-02-15T22:51:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:58 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:58 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:58 smithi170 ceph-mon[35248]: pgmap v14: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 378 op/s 2024-02-15T22:51:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:58 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:58 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:59 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:51:59 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:59 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:51:59 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 -- 172.21.15.138:0/728573628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 msgr2=0x7f55880ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 --2- 172.21.15.138:0/728573628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f55880ff460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f558000b0a0 tx=0x7f558000b3b0 comp rx=0 tx=0).stop 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 -- 172.21.15.138:0/728573628 shutdown_connections 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 --2- 172.21.15.138:0/728573628 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 0x7f55881006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 --2- 172.21.15.138:0/728573628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f55880ff460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 -- 172.21.15.138:0/728573628 >> 172.21.15.138:0/728573628 conn(0x7f55880fa5e0 msgr2=0x7f55880fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 -- 172.21.15.138:0/728573628 shutdown_connections 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.887+0000 7f558f0c0700 1 -- 172.21.15.138:0/728573628 wait complete. 2024-02-15T22:51:59.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 Processor -- start 2024-02-15T22:51:59.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 -- start start 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 0x7f558810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558810dab0 con 0x7f5588100250 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558f0c0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55881a9d40 con 0x7f55880ff050 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f5587fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 0x7f558810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558ce5c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558ce5c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:51424/0 (socket says 172.21.15.138:51424) 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.888+0000 7f558ce5c700 1 -- 172.21.15.138:0/3518667051 learned_addr learned my addr 172.21.15.138:0/3518667051 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.889+0000 7f558ce5c700 1 -- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 msgr2=0x7f558810d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.889+0000 7f558ce5c700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 0x7f558810d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.889+0000 7f558ce5c700 1 -- 172.21.15.138:0/3518667051 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009d00 con 0x7f55880ff050 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.889+0000 7f558ce5c700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5580006070 tx=0x7f5580008cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.890+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5580010070 con 0x7f55880ff050 2024-02-15T22:51:59.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.890+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5580003c10 con 0x7f55880ff050 2024-02-15T22:51:59.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.890+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558806a7d0 con 0x7f55880ff050 2024-02-15T22:51:59.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.891+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5580021680 con 0x7f55880ff050 2024-02-15T22:51:59.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.891+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558806ad50 con 0x7f55880ff050 2024-02-15T22:51:59.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.892+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558810f2a0 con 0x7f55880ff050 2024-02-15T22:51:59.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.893+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f55800045f0 con 0x7f55880ff050 2024-02-15T22:51:59.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.894+0000 7f5585ffb700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 0x7f557006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:51:59.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.894+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f558008e270 con 0x7f55880ff050 2024-02-15T22:51:59.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.894+0000 7f5587fff700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 0x7f557006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:51:59.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.895+0000 7f5587fff700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 0x7f557006fc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f558810e040 tx=0x7f557c00f040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:51:59.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:51:59.902+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f5580057ea0 con 0x7f55880ff050 2024-02-15T22:52:00.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.235+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5588104ba0 con 0x7f557006d7b0 2024-02-15T22:52:00.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.237+0000 7f5585ffb700 1 -- 172.21.15.138:0/3518667051 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5588104ba0 con 0x7f557006d7b0 2024-02-15T22:52:00.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 msgr2=0x7f557006fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 0x7f557006fc60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f558810e040 tx=0x7f557c00f040 comp rx=0 tx=0).stop 2024-02-15T22:52:00.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 msgr2=0x7f558810cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5580006070 tx=0x7f5580008cb0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 shutdown_connections 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f557006d7b0 0x7f557006fc60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55880ff050 0x7f558810cf50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 --2- 172.21.15.138:0/3518667051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5588100250 0x7f558810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 >> 172.21.15.138:0/3518667051 conn(0x7f55880fa5e0 msgr2=0x7f5588103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 shutdown_connections 2024-02-15T22:52:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.239+0000 7f558f0c0700 1 -- 172.21.15.138:0/3518667051 wait complete. 2024-02-15T22:52:00.255 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:52:00.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 -- 172.21.15.138:0/2567815141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda80737b0 msgr2=0x7fdda8073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 --2- 172.21.15.138:0/2567815141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda80737b0 0x7fdda8073c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009940 tx=0x7fdd9c009c50 comp rx=0 tx=0).stop 2024-02-15T22:52:00.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 -- 172.21.15.138:0/2567815141 shutdown_connections 2024-02-15T22:52:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 --2- 172.21.15.138:0/2567815141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda80737b0 0x7fdda8073c20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 --2- 172.21.15.138:0/2567815141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda8074d80 0x7fdda80731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 -- 172.21.15.138:0/2567815141 >> 172.21.15.138:0/2567815141 conn(0x7fdda80fb6f0 msgr2=0x7fdda80fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 -- 172.21.15.138:0/2567815141 shutdown_connections 2024-02-15T22:52:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.387+0000 7fddad723700 1 -- 172.21.15.138:0/2567815141 wait complete. 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 Processor -- start 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 -- start start 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 0x7fdda8197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda81986c0 con 0x7fdda8074d80 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fddad723700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8198800 con 0x7fdda80737b0 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fdda67fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fdda67fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47326/0 (socket says 172.21.15.138:47326) 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fdda67fc700 1 -- 172.21.15.138:0/3572022125 learned_addr learned my addr 172.21.15.138:0/3572022125 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.388+0000 7fdda6ffd700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 0x7fdda8197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdda67fc700 1 -- 172.21.15.138:0/3572022125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 msgr2=0x7fdda8197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdda67fc700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 0x7fdda8197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdda67fc700 1 -- 172.21.15.138:0/3572022125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0095f0 con 0x7fdda8074d80 2024-02-15T22:52:00.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdda6ffd700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 0x7fdda8197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:52:00.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdda67fc700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00be80 tx=0x7fdd9c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:00.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c01d070 con 0x7fdda8074d80 2024-02-15T22:52:00.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda819d250 con 0x7fdda8074d80 2024-02-15T22:52:00.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd9c00f460 con 0x7fdda8074d80 2024-02-15T22:52:00.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9c017630 con 0x7fdda8074d80 2024-02-15T22:52:00.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.389+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda819d6e0 con 0x7fdda8074d80 2024-02-15T22:52:00.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.390+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda810af10 con 0x7fdda8074d80 2024-02-15T22:52:00.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.391+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fdd9c00fa40 con 0x7fdda8074d80 2024-02-15T22:52:00.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.391+0000 7fdd8ffff700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 0x7fdd9006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.392+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdd9c08e550 con 0x7fdda8074d80 2024-02-15T22:52:00.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.392+0000 7fdda6ffd700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 0x7fdd9006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.392+0000 7fdda6ffd700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 0x7fdd9006fb60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009cb0 tx=0x7fdd98009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:00.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.400+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fdd9c05bb20 con 0x7fdda8074d80 2024-02-15T22:52:00.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.691+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdda8107660 con 0x7fdd9006d6b0 2024-02-15T22:52:00.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.692+0000 7fdd8ffff700 1 -- 172.21.15.138:0/3572022125 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fdda8107660 con 0x7fdd9006d6b0 2024-02-15T22:52:00.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.695+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 msgr2=0x7fdd9006fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.695+0000 7fddad723700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 0x7fdd9006fb60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009cb0 tx=0x7fdd98009260 comp rx=0 tx=0).stop 2024-02-15T22:52:00.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.695+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 msgr2=0x7fdda81980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.695+0000 7fddad723700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00be80 tx=0x7fdd9c00bf60 comp rx=0 tx=0).stop 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 shutdown_connections 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fdd9006d6b0 0x7fdd9006fb60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdda80737b0 0x7fdda8197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 --2- 172.21.15.138:0/3572022125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdda8074d80 0x7fdda81980a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 >> 172.21.15.138:0/3572022125 conn(0x7fdda80fb6f0 msgr2=0x7fdda8105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 shutdown_connections 2024-02-15T22:52:00.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.696+0000 7fddad723700 1 -- 172.21.15.138:0/3572022125 wait complete. 2024-02-15T22:52:00.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1897370223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 msgr2=0x7ffa481006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1897370223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa481006a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009910 tx=0x7ffa3c009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:00.818 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:00 smithi138 ceph-mon[29229]: pgmap v15: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 267 op/s 2024-02-15T22:52:00.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1897370223 shutdown_connections 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1897370223 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa481006a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1897370223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 0x7ffa480ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1897370223 >> 172.21.15.138:0/1897370223 conn(0x7ffa480fa5e0 msgr2=0x7ffa480fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1897370223 shutdown_connections 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.815+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1897370223 wait complete. 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 Processor -- start 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 -- start start 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 0x7ffa48068f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48196540 con 0x7ffa48100250 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4cb06700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4819d010 con 0x7ffa480ff050 2024-02-15T22:52:00.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa45d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47346/0 (socket says 172.21.15.138:47346) 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa45d9b700 1 -- 172.21.15.138:0/1450756768 learned_addr learned my addr 172.21.15.138:0/1450756768 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.816+0000 7ffa4659c700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 0x7ffa48068f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa45d9b700 1 -- 172.21.15.138:0/1450756768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 msgr2=0x7ffa48068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa45d9b700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 0x7ffa48068f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa45d9b700 1 -- 172.21.15.138:0/1450756768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0095f0 con 0x7ffa48100250 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa45d9b700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00f690 tx=0x7ffa3c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c01d070 con 0x7ffa48100250 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4819d260 con 0x7ffa48100250 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffa3c005dc0 con 0x7ffa48100250 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa3c0226a0 con 0x7ffa48100250 2024-02-15T22:52:00.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.817+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4819d750 con 0x7ffa48100250 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.818+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa48107ba0 con 0x7ffa48100250 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.818+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7ffa3c0038f0 con 0x7ffa48100250 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.819+0000 7ffa377fe700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 0x7ffa3006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.819+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffa3c08e6f0 con 0x7ffa48100250 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.819+0000 7ffa4659c700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 0x7ffa3006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:00.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.819+0000 7ffa4659c700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 0x7ffa3006fb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa481000b0 tx=0x7ffa38009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:00.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:00.824+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7ffa3c05bce0 con 0x7ffa48100250 2024-02-15T22:52:01.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:00 smithi170 ceph-mon[35248]: pgmap v15: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 267 op/s 2024-02-15T22:52:01.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.169+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa48104ba0 con 0x7ffa3006d660 2024-02-15T22:52:01.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.189+0000 7ffa377fe700 1 -- 172.21.15.138:0/1450756768 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ffa48104ba0 con 0x7ffa3006d660 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (7m) 3s ago 9m 26.9M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (9m) 3s ago 9m 7768k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (8m) 21s ago 8m 7726k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (9m) 3s ago 9m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (8m) 21s ago 8m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (7m) 3s ago 8m 86.0M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (3m) 3s ago 3m 102M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (3m) 3s ago 3m 186M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (3m) 21s ago 3m 153M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (3m) 21s ago 3m 92.0M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:52:01.192 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (39s) 3s ago 10m 475M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (99s) 21s ago 8m 74.5M - 19.0.0-1450-gf78a58c0 f081f847070a 3b76cab03601 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (10m) 3s ago 10m 58.6M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (7m) 21s ago 7m 45.0M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (9m) 3s ago 9m 14.5M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 21s ago 8m 15.3M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (7m) 3s ago 7m 221M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (6m) 3s ago 6m 226M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (6m) 3s ago 6m 192M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (5m) 21s ago 5m 255M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (5m) 21s ago 5m 224M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:52:01.193 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (5m) 21s ago 5m 230M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:52:01.194 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (48s) 3s ago 8m 49.2M - 2.43.0 a07b618ecd1d f6befe3831bd 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 msgr2=0x7ffa3006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 0x7ffa3006fb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa481000b0 tx=0x7ffa38009260 comp rx=0 tx=0).stop 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 msgr2=0x7ffa4819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00f690 tx=0x7ffa3c00f6c0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 shutdown_connections 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ffa3006d660 0x7ffa3006fb10 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ffa481000b0 tx=0x7ffa38009260 comp rx=0 tx=0).stop 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.193+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa480ff050 0x7ffa48068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.194+0000 7ffa4cb06700 1 --2- 172.21.15.138:0/1450756768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa48100250 0x7ffa4819cad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.194+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 >> 172.21.15.138:0/1450756768 conn(0x7ffa480fa5e0 msgr2=0x7ffa48103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:01.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.197+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 shutdown_connections 2024-02-15T22:52:01.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.198+0000 7ffa4cb06700 1 -- 172.21.15.138:0/1450756768 wait complete. 2024-02-15T22:52:01.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/807098486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 msgr2=0x7fe2dc0fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/807098486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc0fee40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009910 tx=0x7fe2d0009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/807098486 shutdown_connections 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/807098486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc0ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/807098486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc0fee40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/807098486 >> 172.21.15.138:0/807098486 conn(0x7fe2dc0fa5e0 msgr2=0x7fe2dc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/807098486 shutdown_connections 2024-02-15T22:52:01.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.356+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/807098486 wait complete. 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 Processor -- start 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 -- start start 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc198670 con 0x7fe2dc0fea30 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e2b3e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc1987b0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e08da700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e08da700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47366/0 (socket says 172.21.15.138:47366) 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.357+0000 7fe2e08da700 1 -- 172.21.15.138:0/1625012946 learned_addr learned my addr 172.21.15.138:0/1625012946 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2dbfff700 1 -- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 msgr2=0x7fe2dc197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2dbfff700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2dbfff700 1 -- 172.21.15.138:0/1625012946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00095f0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2dbfff700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc198050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e970 tx=0x7fe2c800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c800c9d0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.358+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2c8010430 con 0x7fe2dc0ff380 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.359+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c8018650 con 0x7fe2dc0ff380 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.359+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc19d260 con 0x7fe2dc0ff380 2024-02-15T22:52:01.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.359+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc19d6f0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.360+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc10ae80 con 0x7fe2dc0ff380 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.360+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fe2c80105a0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.360+0000 7fe2d9ffb700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 0x7fe2cc06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.361+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe2c8014070 con 0x7fe2dc0ff380 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.361+0000 7fe2e08da700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 0x7fe2cc06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.361+0000 7fe2e08da700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 0x7fe2cc06fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009fd0 tx=0x7fe2d0005a90 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:01.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.364+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fe2c805ab30 con 0x7fe2dc0ff380 2024-02-15T22:52:01.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.722+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2dc19dd50 con 0x7fe2dc0ff380 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.723+0000 7fe2d9ffb700 1 -- 172.21.15.138:0/1625012946 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fe2c805a6c0 con 0x7fe2dc0ff380 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:01.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:52:01.727 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.731+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 msgr2=0x7fe2cc06fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.731+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 0x7fe2cc06fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009fd0 tx=0x7fe2d0005a90 comp rx=0 tx=0).stop 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.731+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 msgr2=0x7fe2dc198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.731+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc198050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e970 tx=0x7fe2c800ec80 comp rx=0 tx=0).stop 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 shutdown_connections 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe2cc06d6a0 0x7fe2cc06fb50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc0fea30 0x7fe2dc197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 --2- 172.21.15.138:0/1625012946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2dc0ff380 0x7fe2dc198050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 >> 172.21.15.138:0/1625012946 conn(0x7fe2dc0fa5e0 msgr2=0x7fe2dc107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 shutdown_connections 2024-02-15T22:52:01.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.732+0000 7fe2e2b3e700 1 -- 172.21.15.138:0/1625012946 wait complete. 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 -- 172.21.15.138:0/3887074971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 msgr2=0x7fd3fc101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 --2- 172.21.15.138:0/3887074971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc101840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009910 tx=0x7fd3ec009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 -- 172.21.15.138:0/3887074971 shutdown_connections 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 --2- 172.21.15.138:0/3887074971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc101840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 --2- 172.21.15.138:0/3887074971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 -- 172.21.15.138:0/3887074971 >> 172.21.15.138:0/3887074971 conn(0x7fd3fc0f9d80 msgr2=0x7fd3fc0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:01.928 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:01 smithi138 ceph-mon[29229]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:01.928 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:01 smithi138 ceph-mon[29229]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 -- 172.21.15.138:0/3887074971 shutdown_connections 2024-02-15T22:52:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.925+0000 7fd403745700 1 -- 172.21.15.138:0/3887074971 wait complete. 2024-02-15T22:52:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.926+0000 7fd403745700 1 Processor -- start 2024-02-15T22:52:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.926+0000 7fd403745700 1 -- start start 2024-02-15T22:52:01.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.926+0000 7fd403745700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd403745700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd403745700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1964b0 con 0x7fd3fc1013f0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd4014e1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:47392/0 (socket says 172.21.15.138:47392) 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd4014e1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:51490/0 (socket says 172.21.15.138:51490) 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 -- 172.21.15.138:0/698087897 learned_addr learned my addr 172.21.15.138:0/698087897 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1965f0 con 0x7fd3fc0fe410 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 -- 172.21.15.138:0/698087897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 msgr2=0x7fd3fc195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0095f0 con 0x7fd3fc1013f0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.927+0000 7fd400ce0700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000c00 tx=0x7fd3ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.928+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec01d070 con 0x7fd3fc1013f0 2024-02-15T22:52:01.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.928+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc19b040 con 0x7fd3fc1013f0 2024-02-15T22:52:01.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.928+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc19b530 con 0x7fd3fc1013f0 2024-02-15T22:52:01.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.928+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd3ec005dc0 con 0x7fd3fc1013f0 2024-02-15T22:52:01.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.928+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec0226a0 con 0x7fd3fc1013f0 2024-02-15T22:52:01.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.929+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e0005320 con 0x7fd3fc1013f0 2024-02-15T22:52:01.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.930+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fd3ec00faf0 con 0x7fd3fc1013f0 2024-02-15T22:52:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.930+0000 7fd3f27fc700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 0x7fd3e806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.931+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd3ec08ea20 con 0x7fd3fc1013f0 2024-02-15T22:52:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.931+0000 7fd4014e1700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 0x7fd3e806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:01.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.931+0000 7fd4014e1700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 0x7fd3e806fb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0681d0 tx=0x7fd3f8009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:01.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:01.935+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fd3ec05c070 con 0x7fd3fc1013f0 2024-02-15T22:52:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:01 smithi170 ceph-mon[35248]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:01 smithi170 ceph-mon[35248]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:02.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.322+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3e0000bf0 con 0x7fd3e806d6a0 2024-02-15T22:52:02.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.324+0000 7fd3f27fc700 1 -- 172.21.15.138:0/698087897 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fd3e0000bf0 con 0x7fd3e806d6a0 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "", 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:52:02.327 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:52:02.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.327+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 msgr2=0x7fd3e806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:02.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.327+0000 7fd403745700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 0x7fd3e806fb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0681d0 tx=0x7fd3f8009260 comp rx=0 tx=0).stop 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.327+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 msgr2=0x7fd3fc195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.327+0000 7fd403745700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000c00 tx=0x7fd3ec00f690 comp rx=0 tx=0).stop 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 shutdown_connections 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e806d6a0 0x7fd3e806fb50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3fc0fe410 0x7fd3fc195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:02.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 --2- 172.21.15.138:0/698087897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3fc1013f0 0x7fd3fc195e90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:02.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 >> 172.21.15.138:0/698087897 conn(0x7fd3fc0f9d80 msgr2=0x7fd3fc104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:02.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 shutdown_connections 2024-02-15T22:52:02.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:02.328+0000 7fd403745700 1 -- 172.21.15.138:0/698087897 wait complete. 2024-02-15T22:52:02.941 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:02 smithi138 ceph-mon[29229]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:02.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:02 smithi138 ceph-mon[29229]: pgmap v16: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 267 op/s 2024-02-15T22:52:02.942 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:02 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1625012946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:03.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:02 smithi170 ceph-mon[35248]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:03.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:02 smithi170 ceph-mon[35248]: pgmap v16: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 267 op/s 2024-02-15T22:52:03.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:02 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1625012946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:04.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:03 smithi138 ceph-mon[29229]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:04.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:03 smithi170 ceph-mon[35248]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:05.166 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:04 smithi138 ceph-mon[29229]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 410 op/s 2024-02-15T22:52:05.236 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:04 smithi170 ceph-mon[35248]: pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 410 op/s 2024-02-15T22:52:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 298 op/s 2024-02-15T22:52:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:52:06.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:06 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: pgmap v18: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 298 op/s 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:52:06.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:52:06.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:06.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:52:06.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:52:06.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:52:06.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:06 smithi138 ceph-mon[29229]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:52:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:07 smithi138 ceph-mon[29229]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:07.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: Reconfiguring prometheus.smithi138 (dependencies changed)... 2024-02-15T22:52:07.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:07 smithi170 ceph-mon[35248]: Reconfiguring daemon prometheus.smithi138 on smithi138 2024-02-15T22:52:09.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:08 smithi138 ceph-mon[29229]: pgmap v19: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 555 op/s 2024-02-15T22:52:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:08 smithi170 ceph-mon[35248]: pgmap v19: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 555 op/s 2024-02-15T22:52:11.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:10 smithi138 ceph-mon[29229]: pgmap v20: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 399 op/s 2024-02-15T22:52:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:10 smithi170 ceph-mon[35248]: pgmap v20: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 399 op/s 2024-02-15T22:52:13.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:12 smithi138 ceph-mon[29229]: pgmap v21: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 399 op/s 2024-02-15T22:52:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:12 smithi170 ceph-mon[35248]: pgmap v21: 65 pgs: 65 active+clean; 324 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 399 op/s 2024-02-15T22:52:14.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:14 smithi138 ceph-mon[29229]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 697 op/s 2024-02-15T22:52:15.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:14 smithi170 ceph-mon[35248]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 697 op/s 2024-02-15T22:52:15.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:15 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:15.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:15 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:15.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:15 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:52:15.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:15 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:52:15.854 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:15 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:16.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:15 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:16.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:15 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:16.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:15 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:52:16.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:15 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:52:16.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:15 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:17.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:16 smithi170 ceph-mon[35248]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 553 op/s 2024-02-15T22:52:17.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:16 smithi138 ceph-mon[29229]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 553 op/s 2024-02-15T22:52:18.304 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-15T22:52:18.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-15T22:52:18.621 DEBUG:teuthology.parallel:result is None 2024-02-15T22:52:18.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:18 smithi138 ceph-mon[29229]: pgmap v24: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 774 op/s 2024-02-15T22:52:19.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:18 smithi170 ceph-mon[35248]: pgmap v24: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 774 op/s 2024-02-15T22:52:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:20 smithi138 ceph-mon[29229]: pgmap v25: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 517 op/s 2024-02-15T22:52:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:20 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:20 smithi170 ceph-mon[35248]: pgmap v25: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 517 op/s 2024-02-15T22:52:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:20 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:22 smithi138 ceph-mon[29229]: pgmap v26: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 517 op/s 2024-02-15T22:52:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:22 smithi170 ceph-mon[35248]: pgmap v26: 65 pgs: 65 active+clean; 315 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 517 op/s 2024-02-15T22:52:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:24 smithi138 ceph-mon[29229]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 651 op/s 2024-02-15T22:52:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:24 smithi170 ceph-mon[35248]: pgmap v27: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 651 op/s 2024-02-15T22:52:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:26 smithi138 ceph-mon[29229]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-02-15T22:52:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:26 smithi170 ceph-mon[35248]: pgmap v28: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 353 op/s 2024-02-15T22:52:29.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:28 smithi138 ceph-mon[29229]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 466 op/s 2024-02-15T22:52:29.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:28 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:52:29.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:28 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:52:29.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:28 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:29.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:28 smithi170 ceph-mon[35248]: pgmap v29: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 466 op/s 2024-02-15T22:52:29.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:28 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:52:29.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:28 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:52:29.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:28 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:29 smithi138 ceph-mon[29229]: Upgrade: Updating mgr.smithi170.gczrzt 2024-02-15T22:52:30.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:29 smithi138 ceph-mon[29229]: Deploying daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:52:30.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:29 smithi170 ceph-mon[35248]: Upgrade: Updating mgr.smithi170.gczrzt 2024-02-15T22:52:30.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:29 smithi170 ceph-mon[35248]: Deploying daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:52:31.124 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:30 smithi170 ceph-mon[35248]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 245 op/s 2024-02-15T22:52:31.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:30 smithi138 ceph-mon[29229]: pgmap v30: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 245 op/s 2024-02-15T22:52:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 -- 172.21.15.138:0/4099424943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 msgr2=0x7fcdfc103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 --2- 172.21.15.138:0/4099424943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc103a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009910 tx=0x7fcdec009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 -- 172.21.15.138:0/4099424943 shutdown_connections 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 --2- 172.21.15.138:0/4099424943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc103a00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 --2- 172.21.15.138:0/4099424943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc1027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 -- 172.21.15.138:0/4099424943 >> 172.21.15.138:0/4099424943 conn(0x7fcdfc0fd960 msgr2=0x7fcdfc0ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 -- 172.21.15.138:0/4099424943 shutdown_connections 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.493+0000 7fce044b3700 1 -- 172.21.15.138:0/4099424943 wait complete. 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 Processor -- start 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 -- start start 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1986e0 con 0x7fcdfc1035b0 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce044b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc198820 con 0x7fcdfc1023b0 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce01a4e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce01a4e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36674/0 (socket says 172.21.15.138:36674) 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce01a4e700 1 -- 172.21.15.138:0/3442533876 learned_addr learned my addr 172.21.15.138:0/3442533876 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.494+0000 7fce0224f700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce0224f700 1 -- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 msgr2=0x7fcdfc1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce0224f700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce0224f700 1 -- 172.21.15.138:0/3442533876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0095f0 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce0224f700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc197b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800e940 tx=0x7fcdf800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdf80041f0 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc19d2d0 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcdf8004350 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdf8003c80 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.495+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc19d820 con 0x7fcdfc1023b0 2024-02-15T22:52:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.496+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc10af00 con 0x7fcdfc1023b0 2024-02-15T22:52:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.497+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fcdf800c7c0 con 0x7fcdfc1023b0 2024-02-15T22:52:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.497+0000 7fcdf37fe700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 0x7fcde806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.497+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcdf8014070 con 0x7fcdfc1023b0 2024-02-15T22:52:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.497+0000 7fce01a4e700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 0x7fcde806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.498+0000 7fce01a4e700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 0x7fcde806fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006010 tx=0x7fcdec005940 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.502+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fcdf805ab60 con 0x7fcdfc1023b0 2024-02-15T22:52:32.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.723+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdfc107f00 con 0x7fcde806d660 2024-02-15T22:52:32.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.724+0000 7fcdf37fe700 1 -- 172.21.15.138:0/3442533876 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fcdfc107f00 con 0x7fcde806d660 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 msgr2=0x7fcde806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 0x7fcde806fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdec006010 tx=0x7fcdec005940 comp rx=0 tx=0).stop 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 msgr2=0x7fcdfc197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc197b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800e940 tx=0x7fcdf800ec50 comp rx=0 tx=0).stop 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 shutdown_connections 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcde806d660 0x7fcde806fb10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdfc1023b0 0x7fcdfc197b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 --2- 172.21.15.138:0/3442533876 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdfc1035b0 0x7fcdfc1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 >> 172.21.15.138:0/3442533876 conn(0x7fcdfc0fd960 msgr2=0x7fcdfc1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:32.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 shutdown_connections 2024-02-15T22:52:32.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.726+0000 7fce044b3700 1 -- 172.21.15.138:0/3442533876 wait complete. 2024-02-15T22:52:32.739 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:52:32.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 -- 172.21.15.138:0/213026677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 msgr2=0x7f19741058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 --2- 172.21.15.138:0/213026677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f19741058e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1964009910 tx=0x7f1964009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:32.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 -- 172.21.15.138:0/213026677 shutdown_connections 2024-02-15T22:52:32.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 --2- 172.21.15.138:0/213026677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f19741058e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 --2- 172.21.15.138:0/213026677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 0x7f1974102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 -- 172.21.15.138:0/213026677 >> 172.21.15.138:0/213026677 conn(0x7f19740fa5e0 msgr2=0x7f19740fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:32.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 -- 172.21.15.138:0/213026677 shutdown_connections 2024-02-15T22:52:32.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.834+0000 7f197b6b1700 1 -- 172.21.15.138:0/213026677 wait complete. 2024-02-15T22:52:32.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 Processor -- start 2024-02-15T22:52:32.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 -- start start 2024-02-15T22:52:32.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 0x7f1974195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974196490 con 0x7f1974103500 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197b6b1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741965d0 con 0x7f1974100be0 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36700/0 (socket says 172.21.15.138:36700) 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 -- 172.21.15.138:0/188663074 learned_addr learned my addr 172.21.15.138:0/188663074 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f197944d700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 0x7f1974195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 -- 172.21.15.138:0/188663074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 msgr2=0x7f1974195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 0x7f1974195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 -- 172.21.15.138:0/188663074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640095f0 con 0x7f1974103500 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.835+0000 7f1978c4c700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1964000c00 tx=0x7f196400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.836+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196401d070 con 0x7f1974103500 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.836+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1964005dc0 con 0x7f1974103500 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.836+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197419b020 con 0x7f1974103500 2024-02-15T22:52:32.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.836+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19640226a0 con 0x7f1974103500 2024-02-15T22:52:32.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.836+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197419b510 con 0x7f1974103500 2024-02-15T22:52:32.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.837+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197418fb70 con 0x7f1974103500 2024-02-15T22:52:32.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.837+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f19640038f0 con 0x7f1974103500 2024-02-15T22:52:32.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.838+0000 7f196a7fc700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 0x7f196006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:32.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.838+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f196408e660 con 0x7f1974103500 2024-02-15T22:52:32.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.838+0000 7f197944d700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 0x7f196006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:32.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.838+0000 7f197944d700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 0x7f196006fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1970009c60 tx=0x7f1970009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:32.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:32.843+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f196405bcd0 con 0x7f1974103500 2024-02-15T22:52:33.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:32 smithi170 ceph-mon[35248]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 245 op/s 2024-02-15T22:52:33.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.068+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19740612a0 con 0x7f196006d660 2024-02-15T22:52:33.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.070+0000 7f196a7fc700 1 -- 172.21.15.138:0/188663074 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f19740612a0 con 0x7f196006d660 2024-02-15T22:52:33.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 msgr2=0x7f196006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 0x7f196006fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1970009c60 tx=0x7f1970009260 comp rx=0 tx=0).stop 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 msgr2=0x7f1974195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1964000c00 tx=0x7f196400f690 comp rx=0 tx=0).stop 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 shutdown_connections 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f196006d660 0x7f196006fb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1974100be0 0x7f1974195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 --2- 172.21.15.138:0/188663074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1974103500 0x7f1974195e70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 >> 172.21.15.138:0/188663074 conn(0x7f19740fa5e0 msgr2=0x7f19740fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 shutdown_connections 2024-02-15T22:52:33.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.072+0000 7f197b6b1700 1 -- 172.21.15.138:0/188663074 wait complete. 2024-02-15T22:52:33.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 -- 172.21.15.138:0/1926542855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4101730 msgr2=0x7fd5b4101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 --2- 172.21.15.138:0/1926542855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4101730 0x7fd5b4101b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009910 tx=0x7fd5a8009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:33.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 -- 172.21.15.138:0/1926542855 shutdown_connections 2024-02-15T22:52:33.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 --2- 172.21.15.138:0/1926542855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4102110 0x7fd5b40fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 --2- 172.21.15.138:0/1926542855 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4101730 0x7fd5b4101b40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 -- 172.21.15.138:0/1926542855 >> 172.21.15.138:0/1926542855 conn(0x7fd5b40f9d80 msgr2=0x7fd5b40fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.181 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:32 smithi138 ceph-mon[29229]: pgmap v31: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1023 KiB/s wr, 245 op/s 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 -- 172.21.15.138:0/1926542855 shutdown_connections 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.178+0000 7fd5babd9700 1 -- 172.21.15.138:0/1926542855 wait complete. 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 Processor -- start 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 -- start start 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 0x7fd5b4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40ff9c0 con 0x7fd5b4102110 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5babd9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40ffb00 con 0x7fd5b4101730 2024-02-15T22:52:33.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b8975700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 0x7fd5b4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36720/0 (socket says 172.21.15.138:36720) 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 -- 172.21.15.138:0/255037226 learned_addr learned my addr 172.21.15.138:0/255037226 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 -- 172.21.15.138:0/255037226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 msgr2=0x7fd5b4100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 0x7fd5b4100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 -- 172.21.15.138:0/255037226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a80095f0 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b8975700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 0x7fd5b4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b3fff700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000e8f0 tx=0x7fd5a000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.179+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a0009790 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.180+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd5a000c810 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.180+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b40ffde0 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.180+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a00055b0 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.180+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b419da10 con 0x7fd5b4102110 2024-02-15T22:52:33.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.181+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b4108cc0 con 0x7fd5b4102110 2024-02-15T22:52:33.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.181+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fd5a000c980 con 0x7fd5b4102110 2024-02-15T22:52:33.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.181+0000 7fd5b1ffb700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 0x7fd5a406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.182+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd5a0014070 con 0x7fd5b4102110 2024-02-15T22:52:33.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.182+0000 7fd5b8975700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 0x7fd5a406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.182+0000 7fd5b8975700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 0x7fd5a406fb10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b6f0 tx=0x7fd5a8005940 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.186+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fd5a005aa70 con 0x7fd5b4102110 2024-02-15T22:52:33.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.450+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5b419dfc0 con 0x7fd5a406d660 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.468+0000 7fd5b1ffb700 1 -- 172.21.15.138:0/255037226 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd5b419dfc0 con 0x7fd5a406d660 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (8m) 36s ago 9m 26.9M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (9m) 36s ago 9m 7768k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (8m) 54s ago 8m 7726k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (9m) 36s ago 9m 6656k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:52:33.471 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (8m) 54s ago 8m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (7m) 36s ago 9m 86.0M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (4m) 36s ago 4m 102M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (3m) 36s ago 3m 186M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (4m) 54s ago 4m 153M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (3m) 54s ago 3m 92.0M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (71s) 36s ago 11m 475M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (2m) 54s ago 8m 74.5M - 19.0.0-1450-gf78a58c0 f081f847070a 3b76cab03601 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (11m) 36s ago 11m 58.6M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (8m) 54s ago 8m 45.0M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (9m) 36s ago 9m 14.5M - 1.5.0 0da6a335fe13 a15264178acc 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 54s ago 8m 15.3M - 1.5.0 0da6a335fe13 f78327baab30 2024-02-15T22:52:33.472 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (7m) 36s ago 7m 221M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (7m) 36s ago 7m 226M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (6m) 36s ago 6m 192M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (6m) 54s ago 6m 255M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (5m) 54s ago 5m 224M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (5m) 54s ago 5m 230M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:52:33.473 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 starting - - - - 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 msgr2=0x7fd5a406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 0x7fd5a406fb10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b6f0 tx=0x7fd5a8005940 comp rx=0 tx=0).stop 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 msgr2=0x7fd5b40ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000e8f0 tx=0x7fd5a000ec00 comp rx=0 tx=0).stop 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 shutdown_connections 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd5a406d660 0x7fd5a406fb10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b4101730 0x7fd5b4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 --2- 172.21.15.138:0/255037226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b4102110 0x7fd5b40ff480 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.471+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 >> 172.21.15.138:0/255037226 conn(0x7fd5b40f9d80 msgr2=0x7fd5b4104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.472+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 shutdown_connections 2024-02-15T22:52:33.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.472+0000 7fd5babd9700 1 -- 172.21.15.138:0/255037226 wait complete. 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 -- 172.21.15.138:0/322626269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c0fe480 msgr2=0x7f5d6c0fe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 --2- 172.21.15.138:0/322626269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c0fe890 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009910 tx=0x7f5d68009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 -- 172.21.15.138:0/322626269 shutdown_connections 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 --2- 172.21.15.138:0/322626269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c101460 0x7f5d6c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 --2- 172.21.15.138:0/322626269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c0fe890 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.586+0000 7f5d73514700 1 -- 172.21.15.138:0/322626269 >> 172.21.15.138:0/322626269 conn(0x7f5d6c0f9dd0 msgr2=0x7f5d6c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 -- 172.21.15.138:0/322626269 shutdown_connections 2024-02-15T22:52:33.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 -- 172.21.15.138:0/322626269 wait complete. 2024-02-15T22:52:33.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 Processor -- start 2024-02-15T22:52:33.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 -- start start 2024-02-15T22:52:33.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1965a0 con 0x7f5d6c101460 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.587+0000 7f5d73514700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1966e0 con 0x7f5d6c0fe480 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35268/0 (socket says 172.21.15.138:35268) 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 -- 172.21.15.138:0/3060412924 learned_addr learned my addr 172.21.15.138:0/3060412924 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d712b0700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 -- 172.21.15.138:0/3060412924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c0fe480 msgr2=0x7f5d6c195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 -- 172.21.15.138:0/3060412924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680095f0 con 0x7f5d6c101460 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d70aaf700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00d8d0 tx=0x7f5d5c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d5c0098a0 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c19b190 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5d5c010460 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d5c00f5f0 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.588+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c19b6e0 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.589+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c108d00 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.590+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f5d5c009a00 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.590+0000 7f5d627fc700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 0x7f5d5806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.590+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5d5c08d0c0 con 0x7f5d6c101460 2024-02-15T22:52:33.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.590+0000 7f5d712b0700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 0x7f5d5806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.591+0000 7f5d712b0700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 0x7f5d5806fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005090 tx=0x7f5d6801a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.595+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f5d5c05a6b0 con 0x7f5d6c101460 2024-02-15T22:52:33.749 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-15T22:52:33.750 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-15T22:52:33.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.880+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d6c108ef0 con 0x7f5d6c101460 2024-02-15T22:52:33.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.881+0000 7f5d627fc700 1 -- 172.21.15.138:0/3060412924 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f5d5c05a240 con 0x7f5d6c101460 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:52:33.884 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:52:33.885 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 msgr2=0x7f5d5806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 0x7f5d5806fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005090 tx=0x7f5d6801a040 comp rx=0 tx=0).stop 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 msgr2=0x7f5d6c195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00d8d0 tx=0x7f5d5c00dbe0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 shutdown_connections 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f5d5806d660 0x7f5d5806fb10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6c0fe480 0x7f5d6c195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 --2- 172.21.15.138:0/3060412924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d6c101460 0x7f5d6c195f80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 >> 172.21.15.138:0/3060412924 conn(0x7f5d6c0f9dd0 msgr2=0x7f5d6c104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 shutdown_connections 2024-02-15T22:52:33.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.883+0000 7f5d73514700 1 -- 172.21.15.138:0/3060412924 wait complete. 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.989+0000 7f7e884f6700 1 -- 172.21.15.138:0/64163258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e800ff050 msgr2=0x7f7e800ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 --2- 172.21.15.138:0/64163258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e800ff050 0x7f7e800ff460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009910 tx=0x7f7e7c009c20 comp rx=0 tx=0).stop 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- 172.21.15.138:0/64163258 shutdown_connections 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 --2- 172.21.15.138:0/64163258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80100250 0x7f7e801006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 --2- 172.21.15.138:0/64163258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e800ff050 0x7f7e800ff460 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- 172.21.15.138:0/64163258 >> 172.21.15.138:0/64163258 conn(0x7f7e800fa5e0 msgr2=0x7f7e800fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- 172.21.15.138:0/64163258 shutdown_connections 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- 172.21.15.138:0/64163258 wait complete. 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 Processor -- start 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- start start 2024-02-15T22:52:33.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e800ff050 0x7f7e80195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801964f0 con 0x7f7e80100250 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.990+0000 7f7e884f6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80196630 con 0x7f7e800ff050 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35284/0 (socket says 172.21.15.138:35284) 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 -- 172.21.15.138:0/3175200004 learned_addr learned my addr 172.21.15.138:0/3175200004 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e86292700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e800ff050 0x7f7e80195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 -- 172.21.15.138:0/3175200004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e800ff050 msgr2=0x7f7e80195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e800ff050 0x7f7e80195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 -- 172.21.15.138:0/3175200004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0095f0 con 0x7f7e80100250 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e85a91700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000e920 tx=0x7f7e7000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7000c9d0 con 0x7f7e80100250 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8019b0e0 con 0x7f7e80100250 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e70010430 con 0x7f7e80100250 2024-02-15T22:52:33.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e70018650 con 0x7f7e80100250 2024-02-15T22:52:33.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.991+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8019b630 con 0x7f7e80100250 2024-02-15T22:52:33.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.992+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e80108ca0 con 0x7f7e80100250 2024-02-15T22:52:33.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.993+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 30) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f7e700105a0 con 0x7f7e80100250 2024-02-15T22:52:33.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.993+0000 7f7e777fe700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 0x7f7e6c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:52:33.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.993+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e70014070 con 0x7f7e80100250 2024-02-15T22:52:33.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.993+0000 7f7e86292700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 0x7f7e6c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:52:33.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.994+0000 7f7e86292700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 0x7f7e6c06fb10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b6f0 tx=0x7f7e7c005940 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:52:33.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:33.997+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7e70052a50 con 0x7f7e80100250 2024-02-15T22:52:34.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:33 smithi170 ceph-mon[35248]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:34.072 DEBUG:teuthology.parallel:result is None 2024-02-15T22:52:34.072 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T22:52:34.098 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:33 smithi138 ceph-mon[29229]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:34.107 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T22:52:34.108 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T22:52:34.165 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T22:52:34.165 DEBUG:teuthology.parallel:result is None 2024-02-15T22:52:34.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.217+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e80104ba0 con 0x7f7e6c06d660 2024-02-15T22:52:34.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.218+0000 7f7e777fe700 1 -- 172.21.15.138:0/3175200004 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f7e80104ba0 con 0x7f7e6c06d660 2024-02-15T22:52:34.220 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mgr daemons", 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:52:34.221 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:52:34.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 msgr2=0x7f7e6c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 0x7f7e6c06fb10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b6f0 tx=0x7f7e7c005940 comp rx=0 tx=0).stop 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 msgr2=0x7f7e80195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000e920 tx=0x7f7e7000ec30 comp rx=0 tx=0).stop 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 shutdown_connections 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e6c06d660 0x7f7e6c06fb10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e800ff050 0x7f7e80195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 --2- 172.21.15.138:0/3175200004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e80100250 0x7f7e80195ed0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 >> 172.21.15.138:0/3175200004 conn(0x7f7e800fa5e0 msgr2=0x7f7e80103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.220+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 shutdown_connections 2024-02-15T22:52:34.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:52:34.221+0000 7f7e884f6700 1 -- 172.21.15.138:0/3175200004 wait complete. 2024-02-15T22:52:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:34 smithi170 ceph-mon[35248]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:34 smithi170 ceph-mon[35248]: pgmap v32: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 355 op/s 2024-02-15T22:52:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:34 smithi170 ceph-mon[35248]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:34 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3060412924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:34 smithi138 ceph-mon[29229]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:34 smithi138 ceph-mon[29229]: pgmap v32: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 355 op/s 2024-02-15T22:52:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:34 smithi138 ceph-mon[29229]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:34 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3060412924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.135 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:36.960 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:36 smithi170 ceph-mon[35248]: pgmap v33: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 951 KiB/s rd, 951 KiB/s wr, 221 op/s 2024-02-15T22:52:37.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:36 smithi138 ceph-mon[29229]: pgmap v33: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 951 KiB/s rd, 951 KiB/s wr, 221 op/s 2024-02-15T22:52:39.185 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:38 smithi138 ceph-mon[29229]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 325 op/s 2024-02-15T22:52:39.186 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:38 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:39.186 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:38 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:39.212 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:38 smithi170 ceph-mon[35248]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 325 op/s 2024-02-15T22:52:39.213 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:38 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:39.213 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:38 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:40.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:40.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:40.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:40 smithi138 ceph-mon[29229]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 772 KiB/s wr, 213 op/s 2024-02-15T22:52:40.237 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:40.237 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:40.237 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:40 smithi170 ceph-mon[35248]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 772 KiB/s wr, 213 op/s 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 772 KiB/s wr, 213 op/s 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:52:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:42 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:52:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 772 KiB/s wr, 213 op/s 2024-02-15T22:52:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:52:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:52:42.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:52:42.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:52:42.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:52:42.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:42 smithi138 ceph-mon[29229]: from='mgr.? 172.21.15.170:0/623278144' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: mgrmap e31: smithi138.jqscxs(active, since 67s), standbys: smithi170.gczrzt 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.353 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all mgr 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.jqscxs"}]: dispatch 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.jqscxs"}]': finished 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.gczrzt"}]: dispatch 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.gczrzt"}]': finished 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all rgw 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-15T22:52:43.354 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all nfs 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:52:43.355 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: mgrmap e31: smithi138.jqscxs(active, since 67s), standbys: smithi170.gczrzt 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all mgr 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.jqscxs"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi138.jqscxs"}]': finished 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.gczrzt"}]: dispatch 2024-02-15T22:52:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi170.gczrzt"}]': finished 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all rgw 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all iscsi 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all nfs 2024-02-15T22:52:43.764 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:43.764 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:52:43.764 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all nvmeof 2024-02-15T22:52:43.764 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:44.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:44 smithi138 ceph-mon[29229]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 774 KiB/s wr, 216 op/s 2024-02-15T22:52:45.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:44 smithi170 ceph-mon[35248]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 774 KiB/s wr, 216 op/s 2024-02-15T22:52:46.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:45 smithi138 ceph-mon[29229]: Upgrade: Updating node-exporter.smithi138 (1/2) 2024-02-15T22:52:46.042 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:45 smithi138 ceph-mon[29229]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-15T22:52:46.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:45 smithi170 ceph-mon[35248]: Upgrade: Updating node-exporter.smithi138 (1/2) 2024-02-15T22:52:46.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:45 smithi170 ceph-mon[35248]: Deploying daemon node-exporter.smithi138 on smithi138 2024-02-15T22:52:47.067 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:46 smithi170 ceph-mon[35248]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 355 KiB/s rd, 298 KiB/s wr, 107 op/s 2024-02-15T22:52:47.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:46 smithi138 ceph-mon[29229]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 355 KiB/s rd, 298 KiB/s wr, 107 op/s 2024-02-15T22:52:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:47 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:47 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:48.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:47 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:48.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:47 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:48 smithi138 ceph-mon[29229]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 356 KiB/s rd, 298 KiB/s wr, 109 op/s 2024-02-15T22:52:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:48 smithi170 ceph-mon[35248]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 356 KiB/s rd, 298 KiB/s wr, 109 op/s 2024-02-15T22:52:50.077 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:49 smithi170 ceph-mon[35248]: Upgrade: Updating node-exporter.smithi170 (2/2) 2024-02-15T22:52:50.078 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:49 smithi170 ceph-mon[35248]: Deploying daemon node-exporter.smithi170 on smithi170 2024-02-15T22:52:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:49 smithi138 ceph-mon[29229]: Upgrade: Updating node-exporter.smithi170 (2/2) 2024-02-15T22:52:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:49 smithi138 ceph-mon[29229]: Deploying daemon node-exporter.smithi170 on smithi170 2024-02-15T22:52:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:50 smithi138 ceph-mon[29229]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-15T22:52:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:50 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:50 smithi170 ceph-mon[35248]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-15T22:52:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:50 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:52:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:52 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:52 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:52.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:52 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:52 smithi138 ceph-mon[29229]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-15T22:52:52.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:52 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:52.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:52 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:52.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:52 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:52:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:52 smithi170 ceph-mon[35248]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-15T22:52:55.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:55 smithi138 ceph-mon[29229]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-02-15T22:52:55.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:55 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:55.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:55 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:55 smithi170 ceph-mon[35248]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 4.4 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-02-15T22:52:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:55 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:55 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:56.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:56 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:56.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:56 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:56.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:56 smithi170 ceph-mon[35248]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:52:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:56 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:56 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:56 smithi138 ceph-mon[29229]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-15T22:52:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:57 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:57.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:57 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:57 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:57 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:58 smithi138 ceph-mon[29229]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T22:52:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:58 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:58 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:58 smithi170 ceph-mon[35248]: pgmap v44: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T22:52:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:58 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:58 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:59.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:59 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:59.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:52:59 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:59 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:52:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:52:59 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:00.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:00 smithi170 ceph-mon[35248]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:00.642 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:00 smithi138 ceph-mon[29229]: pgmap v45: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:01.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:01.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:01.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:01.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:01 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:02.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:01 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:02.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:02 smithi138 ceph-mon[29229]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:03.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:02 smithi170 ceph-mon[35248]: pgmap v46: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:04.153 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:03 smithi138 ceph-mon[29229]: Upgrade: Updating prometheus.smithi138 2024-02-15T22:53:04.153 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:03 smithi138 ceph-mon[29229]: Deploying daemon prometheus.smithi138 on smithi138 2024-02-15T22:53:04.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:03 smithi170 ceph-mon[35248]: Upgrade: Updating prometheus.smithi138 2024-02-15T22:53:04.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:03 smithi170 ceph-mon[35248]: Deploying daemon prometheus.smithi138 on smithi138 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/2933395464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24100170 msgr2=0x7f6c24100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/2933395464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24100170 0x7f6c24100580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009910 tx=0x7f6c20009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/2933395464 shutdown_connections 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/2933395464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24101370 0x7f6c241017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/2933395464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24100170 0x7f6c24100580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.329+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/2933395464 >> 172.21.15.138:0/2933395464 conn(0x7f6c240fb6e0 msgr2=0x7f6c240fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/2933395464 shutdown_connections 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/2933395464 wait complete. 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 Processor -- start 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 -- start start 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 0x7f6c24195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c24196590 con 0x7f6c24101370 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c2b6fa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241966d0 con 0x7f6c24100170 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.330+0000 7f6c28c95700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35348/0 (socket says 172.21.15.138:35348) 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 -- 172.21.15.138:0/428340194 learned_addr learned my addr 172.21.15.138:0/428340194 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:04.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c29496700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 0x7f6c24195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 -- 172.21.15.138:0/428340194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 msgr2=0x7f6c24195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 0x7f6c24195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 -- 172.21.15.138:0/428340194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200095f0 con 0x7f6c24101370 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c29496700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 0x7f6c24195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c28c95700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400b4b0 tx=0x7f6c1400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c14011800 con 0x7f6c24101370 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c14011e10 con 0x7f6c24101370 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2419b180 con 0x7f6c24101370 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c1400f2e0 con 0x7f6c24101370 2024-02-15T22:53:04.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.331+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2419b750 con 0x7f6c24101370 2024-02-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.332+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24108d40 con 0x7f6c24101370 2024-02-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.333+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 31) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f6c14010380 con 0x7f6c24101370 2024-02-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.333+0000 7f6c1a7fc700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 0x7f6c1006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.333+0000 7f6c29496700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 0x7f6c1006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.333+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6c1408ccf0 con 0x7f6c24101370 2024-02-15T22:53:04.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.334+0000 7f6c29496700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 0x7f6c1006fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6c20006010 tx=0x7f6c20005960 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:04.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.338+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f6c1405a3f0 con 0x7f6c24101370 2024-02-15T22:53:04.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.559+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c24105cc0 con 0x7f6c1006d660 2024-02-15T22:53:04.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.560+0000 7f6c1a7fc700 1 -- 172.21.15.138:0/428340194 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f6c24105cc0 con 0x7f6c1006d660 2024-02-15T22:53:04.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 msgr2=0x7f6c1006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 0x7f6c1006fb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6c20006010 tx=0x7f6c20005960 comp rx=0 tx=0).stop 2024-02-15T22:53:04.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 msgr2=0x7f6c24195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400b4b0 tx=0x7f6c1400b870 comp rx=0 tx=0).stop 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 shutdown_connections 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6c1006d660 0x7f6c1006fb10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c24100170 0x7f6c24195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 --2- 172.21.15.138:0/428340194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c24101370 0x7f6c24195f70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.562+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 >> 172.21.15.138:0/428340194 conn(0x7f6c240fb6e0 msgr2=0x7f6c241045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.563+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 shutdown_connections 2024-02-15T22:53:04.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.563+0000 7f6c2b6fa700 1 -- 172.21.15.138:0/428340194 wait complete. 2024-02-15T22:53:04.575 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1275318098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 msgr2=0x7f4c501058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1275318098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c501058e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009910 tx=0x7f4c40009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1275318098 shutdown_connections 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1275318098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c501058e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1275318098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 0x7f4c50102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1275318098 >> 172.21.15.138:0/1275318098 conn(0x7f4c500fa5e0 msgr2=0x7f4c500fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1275318098 shutdown_connections 2024-02-15T22:53:04.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.671+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1275318098 wait complete. 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 Processor -- start 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 -- start start 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 0x7f4c5019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5019cb00 con 0x7f4c50103500 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c57a9f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5019cc40 con 0x7f4c50100be0 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35370/0 (socket says 172.21.15.138:35370) 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 -- 172.21.15.138:0/1214465829 learned_addr learned my addr 172.21.15.138:0/1214465829 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5583b700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 0x7f4c5019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 -- 172.21.15.138:0/1214465829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 msgr2=0x7f4c5019bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 0x7f4c5019bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.672+0000 7f4c5503a700 1 -- 172.21.15.138:0/1214465829 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400095f0 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c5503a700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006010 tx=0x7f4c4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4001d070 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c4000f460 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c501a1690 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c40021640 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.673+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c501a1c00 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.674+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500ffc80 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.674+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 31) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f4c4000fab0 con 0x7f4c50103500 2024-02-15T22:53:04.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.675+0000 7f4c46ffd700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 0x7f4c3c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:04.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.675+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4c4008e640 con 0x7f4c50103500 2024-02-15T22:53:04.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.675+0000 7f4c5583b700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 0x7f4c3c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:04.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.675+0000 7f4c5583b700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 0x7f4c3c06fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:04.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.679+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4c4005bcb0 con 0x7f4c50103500 2024-02-15T22:53:04.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.899+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c501a2300 con 0x7f4c3c06d660 2024-02-15T22:53:04.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.901+0000 7f4c46ffd700 1 -- 172.21.15.138:0/1214465829 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f4c501a2300 con 0x7f4c3c06d660 2024-02-15T22:53:04.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 msgr2=0x7f4c3c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 0x7f4c3c06fb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c006fd0 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2024-02-15T22:53:04.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 msgr2=0x7f4c5019c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:04.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006010 tx=0x7f4c4000be20 comp rx=0 tx=0).stop 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 shutdown_connections 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c3c06d660 0x7f4c3c06fb10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c50100be0 0x7f4c5019bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 --2- 172.21.15.138:0/1214465829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c50103500 0x7f4c5019c4e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 >> 172.21.15.138:0/1214465829 conn(0x7f4c500fa5e0 msgr2=0x7f4c500fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 shutdown_connections 2024-02-15T22:53:04.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:04.903+0000 7f4c57a9f700 1 -- 172.21.15.138:0/1214465829 wait complete. 2024-02-15T22:53:05.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- 172.21.15.138:0/1527795406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 msgr2=0x7fa6581006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 --2- 172.21.15.138:0/1527795406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa6581006a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa648009910 tx=0x7fa648009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:05.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- 172.21.15.138:0/1527795406 shutdown_connections 2024-02-15T22:53:05.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 --2- 172.21.15.138:0/1527795406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa6581006a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 --2- 172.21.15.138:0/1527795406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 0x7fa6580ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- 172.21.15.138:0/1527795406 >> 172.21.15.138:0/1527795406 conn(0x7fa6580fa600 msgr2=0x7fa6580fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- 172.21.15.138:0/1527795406 shutdown_connections 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- 172.21.15.138:0/1527795406 wait complete. 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 Processor -- start 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.008+0000 7fa65f482700 1 -- start start 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65f482700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 0x7fa658195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65f482700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65f482700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581964b0 con 0x7fa658100250 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65f482700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581965f0 con 0x7fa6580ff050 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35378/0 (socket says 172.21.15.138:35378) 2024-02-15T22:53:05.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 -- 172.21.15.138:0/2525123838 learned_addr learned my addr 172.21.15.138:0/2525123838 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65d21e700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 0x7fa658195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 -- 172.21.15.138:0/2525123838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 msgr2=0x7fa658195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 0x7fa658195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 -- 172.21.15.138:0/2525123838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6480095f0 con 0x7fa658100250 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65ca1d700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa64800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64801d070 con 0x7fa658100250 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa64800f460 con 0x7fa658100250 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa648021640 con 0x7fa658100250 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.009+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65819b040 con 0x7fa658100250 2024-02-15T22:53:05.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.010+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65819b530 con 0x7fa658100250 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.010+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa658107ba0 con 0x7fa658100250 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.011+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 31) v1 ==== 91450+0+0 (secure 0 0 0) 0x7fa64800fab0 con 0x7fa658100250 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.011+0000 7fa64e7fc700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 0x7fa64406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.011+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa64808e400 con 0x7fa658100250 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.011+0000 7fa65d21e700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 0x7fa64406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.012+0000 7fa65d21e700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 0x7fa64406fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa6581000b0 tx=0x7fa65400b410 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.016+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fa64805ba70 con 0x7fa658100250 2024-02-15T22:53:05.138 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:04 smithi138 ceph-mon[29229]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:53:05.182 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:04 smithi170 ceph-mon[35248]: pgmap v47: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-02-15T22:53:05.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.230+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa65819bc80 con 0x7fa64406d660 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.240+0000 7fa64e7fc700 1 -- 172.21.15.138:0/2525123838 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa65819bc80 con 0x7fa64406d660 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (8m) 9s ago 10m 26.9M - 0.25.0 c8568f914cd2 d660413a51fb 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (10m) 9s ago 10m 7868k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (9m) 11s ago 9m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (10m) 9s ago 10m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (9m) 11s ago 9m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (8m) 9s ago 9m 82.5M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (4m) 9s ago 4m 72.8M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:53:05.243 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (4m) 9s ago 4m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (4m) 11s ago 4m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (4m) 11s ago 4m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (103s) 9s ago 11m 496M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (30s) 11s ago 9m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (11m) 9s ago 11m 60.0M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (9m) 11s ago 9m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (18s) 9s ago 10m 5469k - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (14s) 11s ago 9m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (8m) 9s ago 8m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (7m) 9s ago 7m 239M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (7m) 9s ago 7m 194M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (6m) 11s ago 6m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:53:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (6m) 11s ago 6m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:53:05.245 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (6m) 11s ago 6m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:53:05.245 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (50s) 9s ago 9m 54.1M - 2.43.0 a07b618ecd1d 92cf4499c1f5 2024-02-15T22:53:05.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 msgr2=0x7fa64406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 0x7fa64406fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa6581000b0 tx=0x7fa65400b410 comp rx=0 tx=0).stop 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 msgr2=0x7fa658195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa64800bd70 comp rx=0 tx=0).stop 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 shutdown_connections 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fa64406d660 0x7fa64406fb10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6580ff050 0x7fa658195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 --2- 172.21.15.138:0/2525123838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa658100250 0x7fa658195e90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 >> 172.21.15.138:0/2525123838 conn(0x7fa6580fa600 msgr2=0x7fa658068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 shutdown_connections 2024-02-15T22:53:05.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.243+0000 7fa65f482700 1 -- 172.21.15.138:0/2525123838 wait complete. 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 -- 172.21.15.138:0/237903684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd00ff050 msgr2=0x7efcd00ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 --2- 172.21.15.138:0/237903684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd00ff050 0x7efcd00ff460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009910 tx=0x7efcc8009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 -- 172.21.15.138:0/237903684 shutdown_connections 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 --2- 172.21.15.138:0/237903684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd0100250 0x7efcd01006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 --2- 172.21.15.138:0/237903684 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd00ff050 0x7efcd00ff460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 -- 172.21.15.138:0/237903684 >> 172.21.15.138:0/237903684 conn(0x7efcd00fa5e0 msgr2=0x7efcd00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 -- 172.21.15.138:0/237903684 shutdown_connections 2024-02-15T22:53:05.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 -- 172.21.15.138:0/237903684 wait complete. 2024-02-15T22:53:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.351+0000 7efcd52c0700 1 Processor -- start 2024-02-15T22:53:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcd52c0700 1 -- start start 2024-02-15T22:53:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcd52c0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd00ff050 0x7efcd0194890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcd52c0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcd52c0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01953f0 con 0x7efcd0100250 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcd52c0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0195530 con 0x7efcd00ff050 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35398/0 (socket says 172.21.15.138:35398) 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 -- 172.21.15.138:0/2195112183 learned_addr learned my addr 172.21.15.138:0/2195112183 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcceffd700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd00ff050 0x7efcd0194890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 -- 172.21.15.138:0/2195112183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd00ff050 msgr2=0x7efcd0194890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd00ff050 0x7efcd0194890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 -- 172.21.15.138:0/2195112183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc80095f0 con 0x7efcd0100250 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.352+0000 7efcce7fc700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efcc4007ed0 tx=0x7efcc400f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.353+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc4012630 con 0x7efcd0100250 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.353+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd0068430 con 0x7efcd0100250 2024-02-15T22:53:05.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.353+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efcc4009950 con 0x7efcd0100250 2024-02-15T22:53:05.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.353+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc4011b10 con 0x7efcd0100250 2024-02-15T22:53:05.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.353+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd0068980 con 0x7efcd0100250 2024-02-15T22:53:05.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.354+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd0107ba0 con 0x7efcd0100250 2024-02-15T22:53:05.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.354+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 31) v1 ==== 91450+0+0 (secure 0 0 0) 0x7efcc401b360 con 0x7efcd0100250 2024-02-15T22:53:05.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.354+0000 7efcb7fff700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 0x7efcb806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.355+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efcc408f890 con 0x7efcd0100250 2024-02-15T22:53:05.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.355+0000 7efcceffd700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 0x7efcb806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.355+0000 7efcceffd700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 0x7efcb806fb10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcc8006010 tx=0x7efcc800b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.359+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7efcc405ce80 con 0x7efcd0100250 2024-02-15T22:53:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.643+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efcd0199f80 con 0x7efcd0100250 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.643+0000 7efcb7fff700 1 -- 172.21.15.138:0/2195112183 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7efcc405ca10 con 0x7efcd0100250 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:53:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:53:05.647 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:53:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 msgr2=0x7efcb806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 0x7efcb806fb10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efcc8006010 tx=0x7efcc800b540 comp rx=0 tx=0).stop 2024-02-15T22:53:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 msgr2=0x7efcd0194dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efcc4007ed0 tx=0x7efcc400f5c0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 shutdown_connections 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7efcb806d660 0x7efcb806fb10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd00ff050 0x7efcd0194890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 --2- 172.21.15.138:0/2195112183 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd0100250 0x7efcd0194dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 >> 172.21.15.138:0/2195112183 conn(0x7efcd00fa5e0 msgr2=0x7efcd0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 shutdown_connections 2024-02-15T22:53:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.646+0000 7efcd52c0700 1 -- 172.21.15.138:0/2195112183 wait complete. 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 -- 172.21.15.138:0/1481474661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908100170 msgr2=0x7f2908100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 --2- 172.21.15.138:0/1481474661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908100170 0x7f2908100580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009910 tx=0x7f28f8009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 -- 172.21.15.138:0/1481474661 shutdown_connections 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 --2- 172.21.15.138:0/1481474661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908101370 0x7f29081017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 --2- 172.21.15.138:0/1481474661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908100170 0x7f2908100580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 -- 172.21.15.138:0/1481474661 >> 172.21.15.138:0/1481474661 conn(0x7f29080fb6e0 msgr2=0x7f29080fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 -- 172.21.15.138:0/1481474661 shutdown_connections 2024-02-15T22:53:05.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.755+0000 7f290e0ee700 1 -- 172.21.15.138:0/1481474661 wait complete. 2024-02-15T22:53:05.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.756+0000 7f290e0ee700 1 Processor -- start 2024-02-15T22:53:05.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.756+0000 7f290e0ee700 1 -- start start 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908100170 0x7f2908195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081964f0 con 0x7f2908101370 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2908196630 con 0x7f2908100170 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35426/0 (socket says 172.21.15.138:35426) 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 -- 172.21.15.138:0/2656488991 learned_addr learned my addr 172.21.15.138:0/2656488991 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f29077fe700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908100170 0x7f2908195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 -- 172.21.15.138:0/2656488991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908100170 msgr2=0x7f2908195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908100170 0x7f2908195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 -- 172.21.15.138:0/2656488991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80095f0 con 0x7f2908101370 2024-02-15T22:53:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2906ffd700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e920 tx=0x7f28fc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28fc00c9d0 con 0x7f2908101370 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f28fc010430 con 0x7f2908101370 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290819b0e0 con 0x7f2908101370 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28fc018650 con 0x7f2908101370 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.757+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290819b630 con 0x7f2908101370 2024-02-15T22:53:05.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.758+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2908108cc0 con 0x7f2908101370 2024-02-15T22:53:05.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.759+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 31) v1 ==== 91450+0+0 (secure 0 0 0) 0x7f28fc0105a0 con 0x7f2908101370 2024-02-15T22:53:05.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.759+0000 7f2904ff9700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 0x7f28f006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:05.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.760+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f28fc014070 con 0x7f2908101370 2024-02-15T22:53:05.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.760+0000 7f29077fe700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 0x7f28f006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:05.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.760+0000 7f29077fe700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 0x7f28f006fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28f800b6f0 tx=0x7f28f8005940 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:05.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.765+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f28fc052a50 con 0x7f2908101370 2024-02-15T22:53:05.918 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:05 smithi138 ceph-mon[29229]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:05.918 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:05 smithi138 ceph-mon[29229]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:05.918 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:05 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:05.918 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:05 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2195112183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.983+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2908105cc0 con 0x7f28f006d660 2024-02-15T22:53:05.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.984+0000 7f2904ff9700 1 -- 172.21.15.138:0/2656488991 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f2908105cc0 con 0x7f28f006d660 2024-02-15T22:53:05.986 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:53:05.986 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:53:05.986 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:53:05.987 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 msgr2=0x7f28f006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 0x7f28f006fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28f800b6f0 tx=0x7f28f8005940 comp rx=0 tx=0).stop 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 msgr2=0x7f2908195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00e920 tx=0x7f28fc00ec30 comp rx=0 tx=0).stop 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 shutdown_connections 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f28f006d660 0x7f28f006fb10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2908100170 0x7f2908195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 --2- 172.21.15.138:0/2656488991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2908101370 0x7f2908195ed0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 >> 172.21.15.138:0/2656488991 conn(0x7f29080fb6e0 msgr2=0x7f29081045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 shutdown_connections 2024-02-15T22:53:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:05.986+0000 7f290e0ee700 1 -- 172.21.15.138:0/2656488991 wait complete. 2024-02-15T22:53:06.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:05 smithi170 ceph-mon[35248]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:06.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:05 smithi170 ceph-mon[35248]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:06.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:05 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:06.114 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:05 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2195112183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:07.208 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:06 smithi138 ceph-mon[29229]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:07.208 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:06 smithi138 ceph-mon[29229]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:07.208 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:06 smithi138 ceph-mon[29229]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:06 smithi170 ceph-mon[35248]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:06 smithi170 ceph-mon[35248]: pgmap v48: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-02-15T22:53:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:06 smithi170 ceph-mon[35248]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:08 smithi138 ceph-mon[29229]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-02-15T22:53:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:08 smithi138 ceph-mon[29229]: mgrmap e32: smithi138.jqscxs(active, since 92s), standbys: smithi170.gczrzt 2024-02-15T22:53:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:08 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:08 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:08 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:08 smithi170 ceph-mon[35248]: pgmap v49: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-02-15T22:53:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:08 smithi170 ceph-mon[35248]: mgrmap e32: smithi138.jqscxs(active, since 92s), standbys: smithi170.gczrzt 2024-02-15T22:53:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:08 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:08 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:08 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:11.126 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:10 smithi138 ceph-mon[29229]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:53:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:10 smithi170 ceph-mon[35248]: pgmap v50: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:53:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:12 smithi138 ceph-mon[29229]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:53:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:12 smithi170 ceph-mon[35248]: pgmap v51: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-15T22:53:15.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:14 smithi138 ceph-mon[29229]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-02-15T22:53:15.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:14 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:15.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:14 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:14 smithi170 ceph-mon[35248]: pgmap v52: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-02-15T22:53:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:14 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:14 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:16 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:16 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:16 smithi138 ceph-mon[29229]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-15T22:53:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:16 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:16 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:16 smithi170 ceph-mon[35248]: pgmap v53: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-15T22:53:19.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-02-15T22:53:19.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.216 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:18 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: pgmap v54: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-02-15T22:53:19.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:19.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:18 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:20.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:19 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:53:20.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:19 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T22:53:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:20 smithi138 ceph-mon[29229]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:53:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:20 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:20 smithi170 ceph-mon[35248]: pgmap v55: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-15T22:53:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:20 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:22.190 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:21 smithi138 ceph-mon[29229]: Upgrade: Updating alertmanager.smithi138 2024-02-15T22:53:22.190 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:21 smithi138 ceph-mon[29229]: Deploying daemon alertmanager.smithi138 on smithi138 2024-02-15T22:53:22.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:21 smithi170 ceph-mon[35248]: Upgrade: Updating alertmanager.smithi138 2024-02-15T22:53:22.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:21 smithi170 ceph-mon[35248]: Deploying daemon alertmanager.smithi138 on smithi138 2024-02-15T22:53:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:22 smithi138 ceph-mon[29229]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:53:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:22 smithi170 ceph-mon[35248]: pgmap v56: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-15T22:53:25.084 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:24 smithi138 ceph-mon[29229]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-02-15T22:53:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:24 smithi170 ceph-mon[35248]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-02-15T22:53:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:26 smithi138 ceph-mon[29229]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:26 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:26 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:26 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:26 smithi170 ceph-mon[35248]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:26 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:26 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:26 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:28.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:28 smithi138 ceph-mon[29229]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:29.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:28 smithi170 ceph-mon[35248]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:30.858 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:30 smithi138 ceph-mon[29229]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:31.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:30 smithi170 ceph-mon[35248]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:32.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:32 smithi138 ceph-mon[29229]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:32.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:32.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:32 smithi170 ceph-mon[35248]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:33.663 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:33 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:33.663 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:33 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:33 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:33 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:35.161 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:34 smithi138 ceph-mon[29229]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:35.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:34 smithi170 ceph-mon[35248]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:35.937 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 -- 172.21.15.138:0/2544851379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 msgr2=0x7f95d4101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 --2- 172.21.15.138:0/2544851379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4101800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009910 tx=0x7f95c4009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 -- 172.21.15.138:0/2544851379 shutdown_connections 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 --2- 172.21.15.138:0/2544851379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4101800 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 --2- 172.21.15.138:0/2544851379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 0x7f95d41005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 -- 172.21.15.138:0/2544851379 >> 172.21.15.138:0/2544851379 conn(0x7f95d40fb780 msgr2=0x7f95d40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 -- 172.21.15.138:0/2544851379 shutdown_connections 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.116+0000 7f95d9459700 1 -- 172.21.15.138:0/2544851379 wait complete. 2024-02-15T22:53:36.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 Processor -- start 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 -- start start 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 0x7f95d41959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4196480 con 0x7f95d41013b0 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d9459700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41965c0 con 0x7f95d41001b0 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60770/0 (socket says 172.21.15.138:60770) 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 -- 172.21.15.138:0/167685103 learned_addr learned my addr 172.21.15.138:0/167685103 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d2ffd700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 0x7f95d41959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 -- 172.21.15.138:0/167685103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 msgr2=0x7f95d41959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 0x7f95d41959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.117+0000 7f95d27fc700 1 -- 172.21.15.138:0/167685103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40095f0 con 0x7f95d41013b0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95d27fc700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95c400bd70 tx=0x7f95c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c401d070 con 0x7f95d41013b0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d419b020 con 0x7f95d41013b0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f95c4022470 con 0x7f95d41013b0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c400f670 con 0x7f95d41013b0 2024-02-15T22:53:36.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.118+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d419b4e0 con 0x7f95d41013b0 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.119+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d4108d00 con 0x7f95d41013b0 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.120+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f95c4004b70 con 0x7f95d41013b0 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.120+0000 7f95bbfff700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 0x7f95bc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.120+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f95c408e790 con 0x7f95d41013b0 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.120+0000 7f95d2ffd700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 0x7f95bc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.121+0000 7f95d2ffd700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 0x7f95bc06f9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f95c8005fd0 tx=0x7f95c8005e50 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.125+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f95c405c170 con 0x7f95d41013b0 2024-02-15T22:53:36.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:36.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:36.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:36.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:53:36.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:53:36.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:53:36.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.363+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95d4105d00 con 0x7f95bc06d520 2024-02-15T22:53:36.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.365+0000 7f95bbfff700 1 -- 172.21.15.138:0/167685103 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f95d4105d00 con 0x7f95bc06d520 2024-02-15T22:53:36.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 msgr2=0x7f95bc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 0x7f95bc06f9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f95c8005fd0 tx=0x7f95c8005e50 comp rx=0 tx=0).stop 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 msgr2=0x7f95d4195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95c400bd70 tx=0x7f95c400be50 comp rx=0 tx=0).stop 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 shutdown_connections 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f95bc06d520 0x7f95bc06f9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95d41001b0 0x7f95d41959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 --2- 172.21.15.138:0/167685103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f95d41013b0 0x7f95d4195ef0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 >> 172.21.15.138:0/167685103 conn(0x7f95d40fb780 msgr2=0x7f95d41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 shutdown_connections 2024-02-15T22:53:36.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.367+0000 7f95d9459700 1 -- 172.21.15.138:0/167685103 wait complete. 2024-02-15T22:53:36.380 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 -- 172.21.15.138:0/1663471331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 msgr2=0x7f299c1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 --2- 172.21.15.138:0/1663471331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c1017a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2990009910 tx=0x7f2990009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 -- 172.21.15.138:0/1663471331 shutdown_connections 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 --2- 172.21.15.138:0/1663471331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c1017a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 --2- 172.21.15.138:0/1663471331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 0x7f299c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 -- 172.21.15.138:0/1663471331 >> 172.21.15.138:0/1663471331 conn(0x7f299c0fb6e0 msgr2=0x7f299c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.473+0000 7f29a3519700 1 -- 172.21.15.138:0/1663471331 shutdown_connections 2024-02-15T22:53:36.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 -- 172.21.15.138:0/1663471331 wait complete. 2024-02-15T22:53:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 Processor -- start 2024-02-15T22:53:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 -- start start 2024-02-15T22:53:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 0x7f299c195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1964c0 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a3519700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c196600 con 0x7f299c100150 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a0ab4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a0ab4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60792/0 (socket says 172.21.15.138:60792) 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.474+0000 7f29a0ab4700 1 -- 172.21.15.138:0/3197224833 learned_addr learned my addr 172.21.15.138:0/3197224833 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a12b5700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 0x7f299c195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a0ab4700 1 -- 172.21.15.138:0/3197224833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 msgr2=0x7f299c195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a0ab4700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 0x7f299c195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a0ab4700 1 -- 172.21.15.138:0/3197224833 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900095f0 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a0ab4700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2990006010 tx=0x7f299000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299001d070 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c19b050 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f299000f460 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2990021640 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.475+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c19b540 con 0x7f299c101350 2024-02-15T22:53:36.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.476+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c108ca0 con 0x7f299c101350 2024-02-15T22:53:36.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.477+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f299000fab0 con 0x7f299c101350 2024-02-15T22:53:36.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.477+0000 7f299a7fc700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 0x7f298406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.477+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f299008e2a0 con 0x7f299c101350 2024-02-15T22:53:36.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.477+0000 7f29a12b5700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 0x7f298406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.477+0000 7f29a12b5700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 0x7f298406f9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2994009550 tx=0x7f29940091b0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.482+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f299005bab0 con 0x7f299c101350 2024-02-15T22:53:36.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.701+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f299c105ca0 con 0x7f298406d520 2024-02-15T22:53:36.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.702+0000 7f299a7fc700 1 -- 172.21.15.138:0/3197224833 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f299c105ca0 con 0x7f298406d520 2024-02-15T22:53:36.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 msgr2=0x7f298406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 0x7f298406f9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2994009550 tx=0x7f29940091b0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 msgr2=0x7f299c195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2990006010 tx=0x7f299000bd70 comp rx=0 tx=0).stop 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 shutdown_connections 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f298406d520 0x7f298406f9d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f299c100150 0x7f299c195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 --2- 172.21.15.138:0/3197224833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c101350 0x7f299c195ea0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.704+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 >> 172.21.15.138:0/3197224833 conn(0x7f299c0fb6e0 msgr2=0x7f299c104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.705+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 shutdown_connections 2024-02-15T22:53:36.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.705+0000 7f29a3519700 1 -- 172.21.15.138:0/3197224833 wait complete. 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 -- 172.21.15.138:0/2620846951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 msgr2=0x7f7e94105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 --2- 172.21.15.138:0/2620846951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94105940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009910 tx=0x7f7e88009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 -- 172.21.15.138:0/2620846951 shutdown_connections 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 --2- 172.21.15.138:0/2620846951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94105940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 --2- 172.21.15.138:0/2620846951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 -- 172.21.15.138:0/2620846951 >> 172.21.15.138:0/2620846951 conn(0x7f7e940fa600 msgr2=0x7f7e940fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 -- 172.21.15.138:0/2620846951 shutdown_connections 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 -- 172.21.15.138:0/2620846951 wait complete. 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.814+0000 7f7e99a28700 1 Processor -- start 2024-02-15T22:53:36.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e99a28700 1 -- start start 2024-02-15T22:53:36.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e99a28700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e99a28700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e99a28700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e941964b0 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e99a28700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e941965f0 con 0x7f7e94100c40 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60824/0 (socket says 172.21.15.138:60824) 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 -- 172.21.15.138:0/549220989 learned_addr learned my addr 172.21.15.138:0/549220989 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e92ffd700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 -- 172.21.15.138:0/549220989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 msgr2=0x7f7e94195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 -- 172.21.15.138:0/549220989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880095f0 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e92ffd700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.815+0000 7f7e927fc700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000c00 tx=0x7f7e8800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.816+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8801d070 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.816+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9419b040 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.816+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e88005dc0 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.816+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e880226a0 con 0x7f7e94103560 2024-02-15T22:53:36.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.816+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940fea30 con 0x7f7e94103560 2024-02-15T22:53:36.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.817+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9418fb70 con 0x7f7e94103560 2024-02-15T22:53:36.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.817+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f7e88022800 con 0x7f7e94103560 2024-02-15T22:53:36.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.818+0000 7f7e98a26700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 0x7f7e7c073de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:36.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.818+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e8808e520 con 0x7f7e94103560 2024-02-15T22:53:36.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.818+0000 7f7e92ffd700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 0x7f7e7c073de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:36.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.818+0000 7f7e92ffd700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 0x7f7e7c073de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009be0 tx=0x7f7e84009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:36.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:36.823+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7e8805bd30 con 0x7f7e94103560 2024-02-15T22:53:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:53:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.041+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e94061190 con 0x7f7e7c071930 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.052+0000 7f7e98a26700 1 -- 172.21.15.138:0/549220989 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7e94061190 con 0x7f7e7c071930 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (11s) 5s ago 10m 15.4M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (10m) 5s ago 10m 7914k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (9m) 43s ago 9m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (10m) 5s ago 10m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:53:37.054 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (9m) 43s ago 9m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (9m) 5s ago 10m 84.4M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (5m) 5s ago 5m 72.9M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (5m) 5s ago 5m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (5m) 43s ago 5m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (4m) 43s ago 4m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (2m) 5s ago 12m 499M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (62s) 43s ago 9m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (12m) 5s ago 12m 61.4M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (9m) 43s ago 9m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (50s) 5s ago 10m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (46s) 43s ago 9m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (8m) 5s ago 8m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (8m) 5s ago 8m 240M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:53:37.055 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (7m) 5s ago 7m 195M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:53:37.056 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (7m) 43s ago 7m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:53:37.056 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (7m) 43s ago 7m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:53:37.056 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (6m) 43s ago 6m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:53:37.056 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (28s) 5s ago 10m 53.2M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 msgr2=0x7f7e7c073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 0x7f7e7c073de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009be0 tx=0x7f7e84009260 comp rx=0 tx=0).stop 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 msgr2=0x7f7e94195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000c00 tx=0x7f7e8800f740 comp rx=0 tx=0).stop 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 shutdown_connections 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7e7c071930 0x7f7e7c073de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e94100c40 0x7f7e94195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 --2- 172.21.15.138:0/549220989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e94103560 0x7f7e94195e90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.054+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 >> 172.21.15.138:0/549220989 conn(0x7f7e940fa600 msgr2=0x7f7e940fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:37.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.055+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 shutdown_connections 2024-02-15T22:53:37.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.055+0000 7f7e99a28700 1 -- 172.21.15.138:0/549220989 wait complete. 2024-02-15T22:53:37.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 -- 172.21.15.138:0/3281225533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54100170 msgr2=0x7f6e54100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3281225533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54100170 0x7f6e54100580 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009910 tx=0x7f6e50009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 -- 172.21.15.138:0/3281225533 shutdown_connections 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3281225533 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54101370 0x7f6e541017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3281225533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54100170 0x7f6e54100580 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 -- 172.21.15.138:0/3281225533 >> 172.21.15.138:0/3281225533 conn(0x7f6e540fb6e0 msgr2=0x7f6e540fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 -- 172.21.15.138:0/3281225533 shutdown_connections 2024-02-15T22:53:37.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.162+0000 7f6e5b827700 1 -- 172.21.15.138:0/3281225533 wait complete. 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 Processor -- start 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 -- start start 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54196190 0x7f6e5419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54196600 con 0x7f6e54101370 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e5b827700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54196770 con 0x7f6e54196190 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60842/0 (socket says 172.21.15.138:60842) 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 -- 172.21.15.138:0/3175183694 learned_addr learned my addr 172.21.15.138:0/3175183694 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:37.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e58dc2700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54196190 0x7f6e5419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 -- 172.21.15.138:0/3175183694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54196190 msgr2=0x7f6e5419b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54196190 0x7f6e5419b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 -- 172.21.15.138:0/3175183694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500095f0 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.163+0000 7f6e595c3700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e541011d0 tx=0x7f6e5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.164+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5001d070 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.164+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5419b700 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.164+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e5000f460 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.164+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e50021640 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.164+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5419bbc0 con 0x7f6e54101370 2024-02-15T22:53:37.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.165+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54108cc0 con 0x7f6e54101370 2024-02-15T22:53:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.165+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f6e5000fa40 con 0x7f6e54101370 2024-02-15T22:53:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.165+0000 7f6e4a7fc700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 0x7f6e4006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.166+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6e5008e080 con 0x7f6e54101370 2024-02-15T22:53:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.166+0000 7f6e58dc2700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 0x7f6e4006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:37.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.166+0000 7f6e58dc2700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 0x7f6e4006f9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400bbd0 tx=0x7f6e4400b5b0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:37.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.170+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f6e50057d60 con 0x7f6e54101370 2024-02-15T22:53:37.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:37.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.454+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6e5419c200 con 0x7f6e54101370 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.454+0000 7f6e4a7fc700 1 -- 172.21.15.138:0/3175183694 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f6e5005b420 con 0x7f6e54101370 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:53:37.457 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:53:37.458 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 msgr2=0x7f6e4006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 0x7f6e4006f9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400bbd0 tx=0x7f6e4400b5b0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 msgr2=0x7f6e54195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6e541011d0 tx=0x7f6e5000be20 comp rx=0 tx=0).stop 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 shutdown_connections 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f6e4006d520 0x7f6e4006f9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e54101370 0x7f6e54195c50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 --2- 172.21.15.138:0/3175183694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e54196190 0x7f6e5419b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.456+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 >> 172.21.15.138:0/3175183694 conn(0x7f6e540fb6e0 msgr2=0x7f6e541045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.457+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 shutdown_connections 2024-02-15T22:53:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.457+0000 7f6e5b827700 1 -- 172.21.15.138:0/3175183694 wait complete. 2024-02-15T22:53:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 -- 172.21.15.138:0/4069419339 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d940ff050 msgr2=0x7f0d940ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 --2- 172.21.15.138:0/4069419339 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d940ff050 0x7f0d940ff460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009910 tx=0x7f0d90009c20 comp rx=0 tx=0).stop 2024-02-15T22:53:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 -- 172.21.15.138:0/4069419339 shutdown_connections 2024-02-15T22:53:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 --2- 172.21.15.138:0/4069419339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d94100250 0x7f0d941006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 --2- 172.21.15.138:0/4069419339 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d940ff050 0x7f0d940ff460 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 -- 172.21.15.138:0/4069419339 >> 172.21.15.138:0/4069419339 conn(0x7f0d940fa600 msgr2=0x7f0d940fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 -- 172.21.15.138:0/4069419339 shutdown_connections 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 -- 172.21.15.138:0/4069419339 wait complete. 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.564+0000 7f0d9be50700 1 Processor -- start 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 -- start start 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d940ff050 0x7f0d941948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94195400 con 0x7f0d94100250 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94195540 con 0x7f0d940ff050 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60860/0 (socket says 172.21.15.138:60860) 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 -- 172.21.15.138:0/2966351558 learned_addr learned my addr 172.21.15.138:0/2966351558 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 -- 172.21.15.138:0/2966351558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d940ff050 msgr2=0x7f0d941948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d940ff050 0x7f0d941948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 -- 172.21.15.138:0/2966351558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900095f0 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d993eb700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0d84007910 tx=0x7f0d84007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d84012070 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d8400d810 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d94068df0 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.565+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d840054c0 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.566+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d94069340 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.567+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94107ba0 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.567+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f0d84016070 con 0x7f0d94100250 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.567+0000 7f0d8affd700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 0x7f0d8006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.568+0000 7f0d99bec700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 0x7f0d8006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:53:37.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.568+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0d8408e250 con 0x7f0d94100250 2024-02-15T22:53:37.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.568+0000 7f0d99bec700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 0x7f0d8006f9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000b5c0 tx=0x7f0d90005fd0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:53:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.572+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f0d8405b7d0 con 0x7f0d94100250 2024-02-15T22:53:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.807+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d94104ba0 con 0x7f0d8006d520 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.808+0000 7f0d8affd700 1 -- 172.21.15.138:0/2966351558 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0d94104ba0 con 0x7f0d8006d520 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:53:37.811 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 msgr2=0x7f0d8006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 0x7f0d8006f9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000b5c0 tx=0x7f0d90005fd0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 msgr2=0x7f0d94194de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0d84007910 tx=0x7f0d84007cd0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 shutdown_connections 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0d8006d520 0x7f0d8006f9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d940ff050 0x7f0d941948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 --2- 172.21.15.138:0/2966351558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d94100250 0x7f0d94194de0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.811+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 >> 172.21.15.138:0/2966351558 conn(0x7f0d940fa600 msgr2=0x7f0d94103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.812+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 shutdown_connections 2024-02-15T22:53:37.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:53:37.812+0000 7f0d9be50700 1 -- 172.21.15.138:0/2966351558 wait complete. 2024-02-15T22:53:38.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:37 smithi138 ceph-mon[29229]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:37 smithi138 ceph-mon[29229]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:37 smithi138 ceph-mon[29229]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:37 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3175183694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:38.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:37 smithi170 ceph-mon[35248]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:37 smithi170 ceph-mon[35248]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:37 smithi170 ceph-mon[35248]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:38.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:37 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3175183694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:53:39.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:38 smithi138 ceph-mon[29229]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:39.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:38 smithi138 ceph-mon[29229]: Upgrade: Updating grafana.smithi138 2024-02-15T22:53:39.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:38 smithi138 ceph-mon[29229]: Deploying daemon grafana.smithi138 on smithi138 2024-02-15T22:53:39.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:38 smithi138 ceph-mon[29229]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:39.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:38 smithi170 ceph-mon[35248]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:39.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:38 smithi170 ceph-mon[35248]: Upgrade: Updating grafana.smithi138 2024-02-15T22:53:39.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:38 smithi170 ceph-mon[35248]: Deploying daemon grafana.smithi138 on smithi138 2024-02-15T22:53:39.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:38 smithi170 ceph-mon[35248]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:53:41.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:40 smithi170 ceph-mon[35248]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:41.096 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:40 smithi138 ceph-mon[29229]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:42 smithi138 ceph-mon[29229]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:43.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:42 smithi170 ceph-mon[35248]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:45.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:44 smithi138 ceph-mon[29229]: pgmap v67: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:45.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:44 smithi170 ceph-mon[35248]: pgmap v67: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:47.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:46 smithi138 ceph-mon[29229]: pgmap v68: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:46 smithi170 ceph-mon[35248]: pgmap v68: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:49.204 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:48 smithi170 ceph-mon[35248]: pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:48 smithi138 ceph-mon[29229]: pgmap v69: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:51.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:50 smithi170 ceph-mon[35248]: pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:51.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:50 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:51.202 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:50 smithi138 ceph-mon[29229]: pgmap v70: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:51.203 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:50 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:53:53.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:52 smithi138 ceph-mon[29229]: pgmap v71: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:53.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:52 smithi170 ceph-mon[35248]: pgmap v71: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:55.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:54 smithi138 ceph-mon[29229]: pgmap v72: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:55.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:54 smithi170 ceph-mon[35248]: pgmap v72: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:53:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:56 smithi138 ceph-mon[29229]: pgmap v73: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:56 smithi170 ceph-mon[35248]: pgmap v73: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:53:59.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:53:58 smithi138 ceph-mon[29229]: pgmap v74: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:53:59.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:53:58 smithi170 ceph-mon[35248]: pgmap v74: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:01.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:00 smithi138 ceph-mon[29229]: pgmap v75: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:00 smithi170 ceph-mon[35248]: pgmap v75: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:02 smithi138 ceph-mon[29229]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:02 smithi170 ceph-mon[35248]: pgmap v76: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:04 smithi138 ceph-mon[29229]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:05.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:04 smithi170 ceph-mon[35248]: pgmap v77: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:06.187 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:05 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:05 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:06 smithi138 ceph-mon[29229]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:06 smithi170 ceph-mon[35248]: pgmap v78: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/1511034126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 msgr2=0x7f4c78100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/1511034126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78100560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009910 tx=0x7f4c74009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/1511034126 shutdown_connections 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/1511034126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c781017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/1511034126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78100560 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/1511034126 >> 172.21.15.138:0/1511034126 conn(0x7f4c780fb6e0 msgr2=0x7f4c780fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/1511034126 shutdown_connections 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.929+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/1511034126 wait complete. 2024-02-15T22:54:07.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 Processor -- start 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 -- start start 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c78195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78196570 con 0x7f4c78100150 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7f2b5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781966b0 con 0x7f4c78101350 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7d051700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7d051700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37062/0 (socket says 172.21.15.138:37062) 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.930+0000 7f4c7d051700 1 -- 172.21.15.138:0/242042439 learned_addr learned my addr 172.21.15.138:0/242042439 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7c850700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c78195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7d051700 1 -- 172.21.15.138:0/242042439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 msgr2=0x7f4c78195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7d051700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c78195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7d051700 1 -- 172.21.15.138:0/242042439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740095f0 con 0x7f4c78100150 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7c850700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c78195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7d051700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400bda0 tx=0x7f4c7400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7401d070 con 0x7f4c78100150 2024-02-15T22:54:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7819b100 con 0x7f4c78100150 2024-02-15T22:54:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4c74004c50 con 0x7f4c78100150 2024-02-15T22:54:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c7400f690 con 0x7f4c78100150 2024-02-15T22:54:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.931+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7819b670 con 0x7f4c78100150 2024-02-15T22:54:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.932+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c78108d20 con 0x7f4c78100150 2024-02-15T22:54:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.933+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f4c74022a20 con 0x7f4c78100150 2024-02-15T22:54:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.933+0000 7f4c6e7fc700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 0x7f4c6406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.933+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4c7408e6d0 con 0x7f4c78100150 2024-02-15T22:54:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.933+0000 7f4c7c850700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 0x7f4c6406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.933+0000 7f4c7c850700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 0x7f4c6406f9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c68007900 tx=0x7f4c68008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:07.938+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4c7405bf90 con 0x7f4c78100150 2024-02-15T22:54:08.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.161+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c78105ca0 con 0x7f4c6406d520 2024-02-15T22:54:08.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.162+0000 7f4c6e7fc700 1 -- 172.21.15.138:0/242042439 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f4c78105ca0 con 0x7f4c6406d520 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 msgr2=0x7f4c6406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 0x7f4c6406f9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c68007900 tx=0x7f4c68008040 comp rx=0 tx=0).stop 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 msgr2=0x7f4c78195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400bda0 tx=0x7f4c7400be80 comp rx=0 tx=0).stop 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 shutdown_connections 2024-02-15T22:54:08.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4c6406d520 0x7f4c6406f9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c78100150 0x7f4c78195a10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 --2- 172.21.15.138:0/242042439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c78101350 0x7f4c78195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.164+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 >> 172.21.15.138:0/242042439 conn(0x7f4c780fb6e0 msgr2=0x7f4c78104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.165+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 shutdown_connections 2024-02-15T22:54:08.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.165+0000 7f4c7f2b5700 1 -- 172.21.15.138:0/242042439 wait complete. 2024-02-15T22:54:08.178 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:54:08.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 -- 172.21.15.138:0/3069308518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008100c40 msgr2=0x7f5008103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 --2- 172.21.15.138:0/3069308518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008100c40 0x7f5008103020 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009910 tx=0x7f4ff8009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:08.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 -- 172.21.15.138:0/3069308518 shutdown_connections 2024-02-15T22:54:08.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 --2- 172.21.15.138:0/3069308518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008103560 0x7f5008105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 --2- 172.21.15.138:0/3069308518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008100c40 0x7f5008103020 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 -- 172.21.15.138:0/3069308518 >> 172.21.15.138:0/3069308518 conn(0x7f50080fa5e0 msgr2=0x7f50080fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 -- 172.21.15.138:0/3069308518 shutdown_connections 2024-02-15T22:54:08.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.271+0000 7f500e7c6700 1 -- 172.21.15.138:0/3069308518 wait complete. 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 Processor -- start 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 -- start start 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008100c40 0x7f5008195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008196480 con 0x7f5008103560 2024-02-15T22:54:08.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.272+0000 7f500e7c6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50081965c0 con 0x7f5008100c40 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37074/0 (socket says 172.21.15.138:37074) 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 -- 172.21.15.138:0/698512241 learned_addr learned my addr 172.21.15.138:0/698512241 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f5007fff700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008100c40 0x7f5008195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 -- 172.21.15.138:0/698512241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008100c40 msgr2=0x7f5008195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008100c40 0x7f5008195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 -- 172.21.15.138:0/698512241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80095f0 con 0x7f5008103560 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50077fe700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c8a0 tx=0x7f4ffc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc00cea0 con 0x7f5008103560 2024-02-15T22:54:08.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500819b070 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ffc004830 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc0055b0 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.273+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500819b5c0 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.274+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500818fb70 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.275+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f4ffc007ad0 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.275+0000 7f50057fa700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 0x7f4ff006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.275+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4ffc08cc90 con 0x7f5008103560 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.275+0000 7f5007fff700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 0x7f4ff006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.276+0000 7f5007fff700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 0x7f4ff006f9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8006010 tx=0x7f4ff800b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.280+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f4ffc05a4a0 con 0x7f5008103560 2024-02-15T22:54:08.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.503+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5008061190 con 0x7f4ff006d520 2024-02-15T22:54:08.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.504+0000 7f50057fa700 1 -- 172.21.15.138:0/698512241 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f5008061190 con 0x7f4ff006d520 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 msgr2=0x7f4ff006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 0x7f4ff006f9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8006010 tx=0x7f4ff800b540 comp rx=0 tx=0).stop 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 msgr2=0x7f5008195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c8a0 tx=0x7f4ffc00cc60 comp rx=0 tx=0).stop 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 shutdown_connections 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f4ff006d520 0x7f4ff006f9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5008100c40 0x7f5008195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 --2- 172.21.15.138:0/698512241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5008103560 0x7f5008195e60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 >> 172.21.15.138:0/698512241 conn(0x7f50080fa5e0 msgr2=0x7f50080fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 shutdown_connections 2024-02-15T22:54:08.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.506+0000 7f500e7c6700 1 -- 172.21.15.138:0/698512241 wait complete. 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 -- 172.21.15.138:0/4147000547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c0ff050 msgr2=0x7f993c0ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4147000547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c0ff050 0x7f993c0ff460 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f992c009910 tx=0x7f992c009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 -- 172.21.15.138:0/4147000547 shutdown_connections 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4147000547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c100250 0x7f993c1006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4147000547 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c0ff050 0x7f993c0ff460 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 -- 172.21.15.138:0/4147000547 >> 172.21.15.138:0/4147000547 conn(0x7f993c0fa5e0 msgr2=0x7f993c0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.614+0000 7f9940ef5700 1 -- 172.21.15.138:0/4147000547 shutdown_connections 2024-02-15T22:54:08.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 -- 172.21.15.138:0/4147000547 wait complete. 2024-02-15T22:54:08.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 Processor -- start 2024-02-15T22:54:08.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 -- start start 2024-02-15T22:54:08.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c0ff050 0x7f993c102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c101b70 con 0x7f993c100250 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.615+0000 7f9940ef5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c101cb0 con 0x7f993c0ff050 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37094/0 (socket says 172.21.15.138:37094) 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 -- 172.21.15.138:0/4252954058 learned_addr learned my addr 172.21.15.138:0/4252954058 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f993a59c700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c0ff050 0x7f993c102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 -- 172.21.15.138:0/4252954058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c0ff050 msgr2=0x7f993c102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c0ff050 0x7f993c102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 -- 172.21.15.138:0/4252954058 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0095f0 con 0x7f993c100250 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9939d9b700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f993000d900 tx=0x7f993000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9930004a00 con 0x7f993c100250 2024-02-15T22:54:08.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c101f90 con 0x7f993c100250 2024-02-15T22:54:08.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f99300054d0 con 0x7f993c100250 2024-02-15T22:54:08.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9930009d00 con 0x7f993c100250 2024-02-15T22:54:08.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.616+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c19da10 con 0x7f993c100250 2024-02-15T22:54:08.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.617+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c107bc0 con 0x7f993c100250 2024-02-15T22:54:08.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.618+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f9930005020 con 0x7f993c100250 2024-02-15T22:54:08.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.618+0000 7f992b7fe700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 0x7f992406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.619+0000 7f993a59c700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 0x7f992406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.619+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f993008cf70 con 0x7f993c100250 2024-02-15T22:54:08.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.619+0000 7f993a59c700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 0x7f992406f9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f992c006010 tx=0x7f992c00b560 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.623+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f993005a6e0 con 0x7f993c100250 2024-02-15T22:54:08.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.833+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f993c068ae0 con 0x7f992406d520 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.844+0000 7f992b7fe700 1 -- 172.21.15.138:0/4252954058 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f993c068ae0 con 0x7f992406d520 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (43s) 37s ago 11m 15.4M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (11m) 37s ago 11m 7914k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (10m) 74s ago 10m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (11m) 37s ago 11m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (10m) 74s ago 10m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:54:08.847 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (9m) 37s ago 10m 84.4M - 9.4.7 954c08fa6188 0eaf538e1e71 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (5m) 37s ago 5m 72.9M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (5m) 37s ago 5m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (5m) 74s ago 5m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (5m) 74s ago 5m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (2m) 37s ago 12m 499M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (94s) 74s ago 10m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (12m) 37s ago 12m 61.4M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (10m) 74s ago 10m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (82s) 37s ago 11m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (78s) 74s ago 10m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (9m) 37s ago 9m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (8m) 37s ago 8m 240M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (8m) 37s ago 8m 195M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:54:08.848 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (7m) 74s ago 7m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:54:08.849 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (7m) 74s ago 7m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:54:08.849 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (7m) 74s ago 7m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:54:08.849 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (60s) 37s ago 10m 53.2M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:54:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.846+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 msgr2=0x7f992406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.846+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 0x7f992406f9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f992c006010 tx=0x7f992c00b560 comp rx=0 tx=0).stop 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.846+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 msgr2=0x7f993c101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.846+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f993000d900 tx=0x7f993000dc10 comp rx=0 tx=0).stop 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 shutdown_connections 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f992406d520 0x7f992406f9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f993c0ff050 0x7f993c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 --2- 172.21.15.138:0/4252954058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c100250 0x7f993c101630 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 >> 172.21.15.138:0/4252954058 conn(0x7f993c0fa5e0 msgr2=0x7f993c0683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 shutdown_connections 2024-02-15T22:54:08.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.847+0000 7f9940ef5700 1 -- 172.21.15.138:0/4252954058 wait complete. 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- 172.21.15.138:0/2149183197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc740fe9d0 msgr2=0x7fcc74100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 --2- 172.21.15.138:0/2149183197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc740fe9d0 0x7fcc74100df0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009910 tx=0x7fcc64009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- 172.21.15.138:0/2149183197 shutdown_connections 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 --2- 172.21.15.138:0/2149183197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc74101330 0x7fcc741037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 --2- 172.21.15.138:0/2149183197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc740fe9d0 0x7fcc74100df0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- 172.21.15.138:0/2149183197 >> 172.21.15.138:0/2149183197 conn(0x7fcc740fa5e0 msgr2=0x7fcc740fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:08.956 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:08 smithi138 ceph-mon[29229]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- 172.21.15.138:0/2149183197 shutdown_connections 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- 172.21.15.138:0/2149183197 wait complete. 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 Processor -- start 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.952+0000 7fcc7a983700 1 -- start start 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc7a983700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740fe9d0 0x7fcc7419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc7a983700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc7a983700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419ca90 con 0x7fcc74101330 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc7a983700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419cbd0 con 0x7fcc740fe9d0 2024-02-15T22:54:08.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37122/0 (socket says 172.21.15.138:37122) 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 -- 172.21.15.138:0/1484462538 learned_addr learned my addr 172.21.15.138:0/1484462538 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc73fff700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740fe9d0 0x7fcc7419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 -- 172.21.15.138:0/1484462538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740fe9d0 msgr2=0x7fcc7419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740fe9d0 0x7fcc7419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 -- 172.21.15.138:0/1484462538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640095f0 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.953+0000 7fcc737fe700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d8d0 tx=0x7fcc6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.954+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc68009940 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.954+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc68010460 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.954+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc741a1680 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.954+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6800f5f0 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.954+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc741a1bd0 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.955+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc74196170 con 0x7fcc74101330 2024-02-15T22:54:08.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.955+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fcc68009aa0 con 0x7fcc74101330 2024-02-15T22:54:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.956+0000 7fcc717fa700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 0x7fcc5c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.956+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcc6808cf60 con 0x7fcc74101330 2024-02-15T22:54:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.956+0000 7fcc73fff700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 0x7fcc5c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:08.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.956+0000 7fcc73fff700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 0x7fcc5c06f9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b5c0 tx=0x7fcc64005960 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:08.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:08.960+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fcc6805a750 con 0x7fcc74101330 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.252+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc7402cc30 con 0x7fcc74101330 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.252+0000 7fcc717fa700 1 -- 172.21.15.138:0/1484462538 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fcc680202c0 con 0x7fcc74101330 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:54:09.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:54:09.256 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.254+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 msgr2=0x7fcc5c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.254+0000 7fcc7a983700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 0x7fcc5c06f9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b5c0 tx=0x7fcc64005960 comp rx=0 tx=0).stop 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.254+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 msgr2=0x7fcc7419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.254+0000 7fcc7a983700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d8d0 tx=0x7fcc6800dc90 comp rx=0 tx=0).stop 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 shutdown_connections 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcc5c06d520 0x7fcc5c06f9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740fe9d0 0x7fcc7419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 --2- 172.21.15.138:0/1484462538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc74101330 0x7fcc7419c470 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 >> 172.21.15.138:0/1484462538 conn(0x7fcc740fa5e0 msgr2=0x7fcc740fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 shutdown_connections 2024-02-15T22:54:09.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.255+0000 7fcc7a983700 1 -- 172.21.15.138:0/1484462538 wait complete. 2024-02-15T22:54:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:08 smithi170 ceph-mon[35248]: pgmap v79: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 -- 172.21.15.138:0/3975015987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 msgr2=0x7f45a00fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/3975015987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a00fe820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4590009910 tx=0x7f4590009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 -- 172.21.15.138:0/3975015987 shutdown_connections 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/3975015987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 0x7f45a0101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/3975015987 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a00fe820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.362+0000 7f45a4e9b700 1 -- 172.21.15.138:0/3975015987 >> 172.21.15.138:0/3975015987 conn(0x7f45a00f9d80 msgr2=0x7f45a00fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 -- 172.21.15.138:0/3975015987 shutdown_connections 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 -- 172.21.15.138:0/3975015987 wait complete. 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 Processor -- start 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 -- start start 2024-02-15T22:54:09.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 0x7f45a0195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0196560 con 0x7f45a00fe410 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.363+0000 7f45a4e9b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01966a0 con 0x7f45a01013f0 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37146/0 (socket says 172.21.15.138:37146) 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 -- 172.21.15.138:0/2788090389 learned_addr learned my addr 172.21.15.138:0/2788090389 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459dd9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 0x7f45a0195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 -- 172.21.15.138:0/2788090389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 msgr2=0x7f45a0195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 0x7f45a0195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 -- 172.21.15.138:0/2788090389 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900095f0 con 0x7f45a00fe410 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f459e59c700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f459000bda0 tx=0x7f459000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459001d070 con 0x7f45a00fe410 2024-02-15T22:54:09.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4590022470 con 0x7f45a00fe410 2024-02-15T22:54:09.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a019b0f0 con 0x7f45a00fe410 2024-02-15T22:54:09.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459000f650 con 0x7f45a00fe410 2024-02-15T22:54:09.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.364+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a019b660 con 0x7f45a00fe410 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.365+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0108d10 con 0x7f45a00fe410 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.366+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f4590004af0 con 0x7f45a00fe410 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.366+0000 7f458f7fe700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 0x7f458806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.366+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f459008e530 con 0x7f45a00fe410 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.366+0000 7f459dd9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 0x7f458806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:09.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.367+0000 7f459dd9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 0x7f458806f9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4594009a10 tx=0x7f4594009190 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:09.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.371+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f459005be70 con 0x7f45a00fe410 2024-02-15T22:54:09.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.594+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45a019bdb0 con 0x7f458806d520 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.595+0000 7f458f7fe700 1 -- 172.21.15.138:0/2788090389 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f45a019bdb0 con 0x7f458806d520 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:54:09.598 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:54:09.599 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:54:09.599 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T22:54:09.599 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:54:09.599 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:54:09.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 msgr2=0x7f458806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 0x7f458806f9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4594009a10 tx=0x7f4594009190 comp rx=0 tx=0).stop 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 msgr2=0x7f45a0195a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f459000bda0 tx=0x7f459000bdd0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 shutdown_connections 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f458806d520 0x7f458806f9d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45a00fe410 0x7f45a0195a00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 --2- 172.21.15.138:0/2788090389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45a01013f0 0x7f45a0195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 >> 172.21.15.138:0/2788090389 conn(0x7f45a00f9d80 msgr2=0x7f45a0104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 shutdown_connections 2024-02-15T22:54:09.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:09.598+0000 7f45a4e9b700 1 -- 172.21.15.138:0/2788090389 wait complete. 2024-02-15T22:54:10.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:09 smithi138 ceph-mon[29229]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:09 smithi138 ceph-mon[29229]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:09 smithi138 ceph-mon[29229]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:09 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1484462538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:09 smithi170 ceph-mon[35248]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:09 smithi170 ceph-mon[35248]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:09 smithi170 ceph-mon[35248]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:09 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1484462538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:11.135 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:10 smithi138 ceph-mon[29229]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:11.135 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:10 smithi138 ceph-mon[29229]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:10 smithi170 ceph-mon[35248]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:11.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:10 smithi170 ceph-mon[35248]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:13.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:12 smithi138 ceph-mon[29229]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:13.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:12 smithi170 ceph-mon[35248]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:15.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:14 smithi138 ceph-mon[29229]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:14 smithi170 ceph-mon[35248]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:17.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:16 smithi138 ceph-mon[29229]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:16 smithi170 ceph-mon[35248]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:18 smithi138 ceph-mon[29229]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:19.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:18 smithi170 ceph-mon[35248]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:20 smithi138 ceph-mon[29229]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:21.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:20 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:20 smithi170 ceph-mon[35248]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:20 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:22 smithi138 ceph-mon[29229]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:22 smithi170 ceph-mon[35248]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:24 smithi138 ceph-mon[29229]: pgmap v87: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:24 smithi170 ceph-mon[35248]: pgmap v87: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:54:27.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:26 smithi138 ceph-mon[29229]: pgmap v88: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:27.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:26 smithi170 ceph-mon[35248]: pgmap v88: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:29.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:28 smithi138 ceph-mon[29229]: pgmap v89: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:29.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:28 smithi170 ceph-mon[35248]: pgmap v89: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:31.180 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:30 smithi138 ceph-mon[29229]: pgmap v90: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:31.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:30 smithi170 ceph-mon[35248]: pgmap v90: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:33.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:32 smithi138 ceph-mon[29229]: pgmap v91: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:33.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:32 smithi170 ceph-mon[35248]: pgmap v91: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:34 smithi138 ceph-mon[29229]: pgmap v92: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:34 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:34 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:35.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:34 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:35.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:34 smithi170 ceph-mon[35248]: pgmap v92: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:34 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:34 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:34 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:36.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:36.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:36.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:36 smithi138 ceph-mon[29229]: pgmap v93: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:36.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:36 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:36.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:36.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:36 smithi170 ceph-mon[35248]: pgmap v93: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:36 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:39.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:38 smithi138 ceph-mon[29229]: pgmap v94: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:39.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:38 smithi170 ceph-mon[35248]: pgmap v94: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 -- 172.21.15.138:0/4127907617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 msgr2=0x7f32c41017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/4127907617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c41017c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009910 tx=0x7f32b8009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 -- 172.21.15.138:0/4127907617 shutdown_connections 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/4127907617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c41017c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/4127907617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.713+0000 7f32c9ffe700 1 -- 172.21.15.138:0/4127907617 >> 172.21.15.138:0/4127907617 conn(0x7f32c40fb720 msgr2=0x7f32c40fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 -- 172.21.15.138:0/4127907617 shutdown_connections 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 -- 172.21.15.138:0/4127907617 wait complete. 2024-02-15T22:54:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 Processor -- start 2024-02-15T22:54:39.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 -- start start 2024-02-15T22:54:39.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:39.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c41964d0 con 0x7f32c4101370 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.714+0000 7f32c9ffe700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4196610 con 0x7f32c4100170 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38006/0 (socket says 172.21.15.138:38006) 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 -- 172.21.15.138:0/880966806 learned_addr learned my addr 172.21.15.138:0/880966806 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c37fe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 -- 172.21.15.138:0/880966806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 msgr2=0x7f32c4195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 -- 172.21.15.138:0/880966806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80095f0 con 0x7f32c4101370 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c37fe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c2ffd700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bd70 tx=0x7f32b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b801d070 con 0x7f32c4101370 2024-02-15T22:54:39.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c419b060 con 0x7f32c4101370 2024-02-15T22:54:39.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f32b8022470 con 0x7f32c4101370 2024-02-15T22:54:39.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b800f670 con 0x7f32c4101370 2024-02-15T22:54:39.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.715+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c419b550 con 0x7f32c4101370 2024-02-15T22:54:39.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.717+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4108cc0 con 0x7f32c4101370 2024-02-15T22:54:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.717+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f32b800f8e0 con 0x7f32c4101370 2024-02-15T22:54:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.717+0000 7f32c0ff9700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 0x7f32ac06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.718+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f32b808e5d0 con 0x7f32c4101370 2024-02-15T22:54:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.718+0000 7f32c37fe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 0x7f32ac06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.718+0000 7f32c37fe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 0x7f32ac06f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f32b4005950 tx=0x7f32b40058e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:39.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.722+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f32b805bf00 con 0x7f32c4101370 2024-02-15T22:54:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.964+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c419bc50 con 0x7f32ac06d520 2024-02-15T22:54:39.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.965+0000 7f32c0ff9700 1 -- 172.21.15.138:0/880966806 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f32c419bc50 con 0x7f32ac06d520 2024-02-15T22:54:39.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.967+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 msgr2=0x7f32ac06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:39.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.967+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 0x7f32ac06f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f32b4005950 tx=0x7f32b40058e0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.967+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 msgr2=0x7f32c4195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:39.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.967+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32b800bd70 tx=0x7f32b800be50 comp rx=0 tx=0).stop 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 shutdown_connections 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f32ac06d520 0x7f32ac06f9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c4100170 0x7f32c4195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 --2- 172.21.15.138:0/880966806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32c4101370 0x7f32c4195eb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 >> 172.21.15.138:0/880966806 conn(0x7f32c40fb720 msgr2=0x7f32c41045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 shutdown_connections 2024-02-15T22:54:39.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:39.968+0000 7f32c9ffe700 1 -- 172.21.15.138:0/880966806 wait complete. 2024-02-15T22:54:39.982 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:54:40.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.077+0000 7ff088699700 1 -- 172.21.15.138:0/1615718823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080100c60 msgr2=0x7ff080103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.077+0000 7ff088699700 1 --2- 172.21.15.138:0/1615718823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080100c60 0x7ff080103040 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009910 tx=0x7ff07c009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 -- 172.21.15.138:0/1615718823 shutdown_connections 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 --2- 172.21.15.138:0/1615718823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080103580 0x7ff080105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 --2- 172.21.15.138:0/1615718823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080100c60 0x7ff080103040 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 -- 172.21.15.138:0/1615718823 >> 172.21.15.138:0/1615718823 conn(0x7ff0800fa600 msgr2=0x7ff0800fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 -- 172.21.15.138:0/1615718823 shutdown_connections 2024-02-15T22:54:40.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 -- 172.21.15.138:0/1615718823 wait complete. 2024-02-15T22:54:40.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.078+0000 7ff088699700 1 Processor -- start 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff088699700 1 -- start start 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff088699700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080100c60 0x7ff080195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff088699700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff088699700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080196400 con 0x7ff080103580 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff088699700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080196540 con 0x7ff080100c60 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38030/0 (socket says 172.21.15.138:38030) 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 -- 172.21.15.138:0/3259528686 learned_addr learned my addr 172.21.15.138:0/3259528686 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff086435700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080100c60 0x7ff080195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 -- 172.21.15.138:0/3259528686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080100c60 msgr2=0x7ff080195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080100c60 0x7ff080195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 -- 172.21.15.138:0/3259528686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0095f0 con 0x7ff080103580 2024-02-15T22:54:40.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.079+0000 7ff085c34700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c930 tx=0x7ff07000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.080+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070007ad0 con 0x7ff080103580 2024-02-15T22:54:40.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.080+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff07000ce80 con 0x7ff080103580 2024-02-15T22:54:40.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.080+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08019b000 con 0x7ff080103580 2024-02-15T22:54:40.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.080+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070018630 con 0x7ff080103580 2024-02-15T22:54:40.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.080+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08019b520 con 0x7ff080103580 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.081+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08018fb70 con 0x7ff080103580 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.081+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7ff070007c30 con 0x7ff080103580 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.082+0000 7ff0777fe700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 0x7ff06c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.082+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff07008cf30 con 0x7ff080103580 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.082+0000 7ff086435700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 0x7ff06c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.082+0000 7ff086435700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 0x7ff06c06f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b5c0 tx=0x7ff07c0052a0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.086+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7ff0700c0a50 con 0x7ff080103580 2024-02-15T22:54:40.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.307+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff080061190 con 0x7ff06c06d520 2024-02-15T22:54:40.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.308+0000 7ff0777fe700 1 -- 172.21.15.138:0/3259528686 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff080061190 con 0x7ff06c06d520 2024-02-15T22:54:40.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 msgr2=0x7ff06c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 0x7ff06c06f9d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b5c0 tx=0x7ff07c0052a0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 msgr2=0x7ff080195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c930 tx=0x7ff07000cc40 comp rx=0 tx=0).stop 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 shutdown_connections 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff06c06d520 0x7ff06c06f9d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff080100c60 0x7ff080195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 --2- 172.21.15.138:0/3259528686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff080103580 0x7ff080195e70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 >> 172.21.15.138:0/3259528686 conn(0x7ff0800fa600 msgr2=0x7ff0800fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 shutdown_connections 2024-02-15T22:54:40.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.310+0000 7ff088699700 1 -- 172.21.15.138:0/3259528686 wait complete. 2024-02-15T22:54:40.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 -- 172.21.15.138:0/624296944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee41005e0 msgr2=0x7f1ee41009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 --2- 172.21.15.138:0/624296944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee41005e0 0x7f1ee41009f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009910 tx=0x7f1ed4009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 -- 172.21.15.138:0/624296944 shutdown_connections 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 --2- 172.21.15.138:0/624296944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee40ff320 0x7f1ee40ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 --2- 172.21.15.138:0/624296944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee41005e0 0x7f1ee41009f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 -- 172.21.15.138:0/624296944 >> 172.21.15.138:0/624296944 conn(0x7f1ee40f9d80 msgr2=0x7f1ee40fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 -- 172.21.15.138:0/624296944 shutdown_connections 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.420+0000 7f1eec45a700 1 -- 172.21.15.138:0/624296944 wait complete. 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 Processor -- start 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 -- start start 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 0x7f1ee4101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4101c50 con 0x7f1ee40ff320 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eec45a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4101d90 con 0x7f1ee41005e0 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eea1f6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eea1f6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38038/0 (socket says 172.21.15.138:38038) 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1eea1f6700 1 -- 172.21.15.138:0/2110681553 learned_addr learned my addr 172.21.15.138:0/2110681553 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.421+0000 7f1ee99f5700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 0x7f1ee4101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eea1f6700 1 -- 172.21.15.138:0/2110681553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 msgr2=0x7f1ee4101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eea1f6700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 0x7f1ee4101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eea1f6700 1 -- 172.21.15.138:0/2110681553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed40095f0 con 0x7f1ee40ff320 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1ee99f5700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 0x7f1ee4101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eea1f6700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400bda0 tx=0x7f1ed400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed401d070 con 0x7f1ee40ff320 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4004c50 con 0x7f1ee40ff320 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee4102010 con 0x7f1ee40ff320 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ed400f690 con 0x7f1ee40ff320 2024-02-15T22:54:40.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.422+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee4102500 con 0x7f1ee40ff320 2024-02-15T22:54:40.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.423+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee4107b90 con 0x7f1ee40ff320 2024-02-15T22:54:40.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.423+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f1ed4022a20 con 0x7f1ee40ff320 2024-02-15T22:54:40.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.424+0000 7f1edb7fe700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 0x7f1ed006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.424+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ed408e7d0 con 0x7f1ee40ff320 2024-02-15T22:54:40.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.424+0000 7f1ee99f5700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 0x7f1ed006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.424+0000 7f1ee99f5700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 0x7f1ed006f9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0005fd0 tx=0x7f1ee0005e20 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.429+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f1ed405bfe0 con 0x7f1ee40ff320 2024-02-15T22:54:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.646+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ee419ddf0 con 0x7f1ed006d520 2024-02-15T22:54:40.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.659+0000 7f1edb7fe700 1 -- 172.21.15.138:0/2110681553 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1ee419ddf0 con 0x7f1ed006d520 2024-02-15T22:54:40.661 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (75s) 0s ago 11m 15.7M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (12m) 0s ago 12m 7998k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (10m) 106s ago 10m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (11m) 0s ago 11m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (10m) 106s ago 10m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (6s) 0s ago 11m 57.4M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (6m) 0s ago 6m 72.8M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (6m) 0s ago 6m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (6m) 106s ago 6m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (6m) 106s ago 6m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (3m) 0s ago 13m 504M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (2m) 106s ago 10m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (13m) 0s ago 13m 62.8M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (10m) 106s ago 10m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:54:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (114s) 0s ago 11m 15.9M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (110s) 106s ago 10m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (9m) 0s ago 9m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (9m) 0s ago 9m 240M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (8m) 0s ago 8m 195M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (8m) 106s ago 8m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (8m) 106s ago 8m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (7m) 106s ago 7m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:54:40.663 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (92s) 0s ago 11m 62.8M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 msgr2=0x7f1ed006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 0x7f1ed006f9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0005fd0 tx=0x7f1ee0005e20 comp rx=0 tx=0).stop 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 msgr2=0x7f1ee41030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400bda0 tx=0x7f1ed400be80 comp rx=0 tx=0).stop 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 shutdown_connections 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f1ed006d520 0x7f1ed006f9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ee40ff320 0x7f1ee41030c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 --2- 172.21.15.138:0/2110681553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ee41005e0 0x7f1ee4101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 >> 172.21.15.138:0/2110681553 conn(0x7f1ee40f9d80 msgr2=0x7f1ee40fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:40.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 shutdown_connections 2024-02-15T22:54:40.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.661+0000 7f1eec45a700 1 -- 172.21.15.138:0/2110681553 wait complete. 2024-02-15T22:54:40.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- 172.21.15.138:0/2975379502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf80ff050 msgr2=0x7fadf80ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 --2- 172.21.15.138:0/2975379502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf80ff050 0x7fadf80ff460 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fadec009910 tx=0x7fadec009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- 172.21.15.138:0/2975379502 shutdown_connections 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 --2- 172.21.15.138:0/2975379502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf8100250 0x7fadf81006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 --2- 172.21.15.138:0/2975379502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf80ff050 0x7fadf80ff460 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- 172.21.15.138:0/2975379502 >> 172.21.15.138:0/2975379502 conn(0x7fadf80fa5e0 msgr2=0x7fadf80fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- 172.21.15.138:0/2975379502 shutdown_connections 2024-02-15T22:54:40.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- 172.21.15.138:0/2975379502 wait complete. 2024-02-15T22:54:40.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 Processor -- start 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.768+0000 7fadfeb96700 1 -- start start 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadfeb96700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf80ff050 0x7fadf8068f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadfeb96700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadfeb96700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf819aca0 con 0x7fadf8100250 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadfeb96700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf819ae10 con 0x7fadf80ff050 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38046/0 (socket says 172.21.15.138:38046) 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 -- 172.21.15.138:0/1610606010 learned_addr learned my addr 172.21.15.138:0/1610606010 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 -- 172.21.15.138:0/1610606010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf80ff050 msgr2=0x7fadf8068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadfc932700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf80ff050 0x7fadf8068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf80ff050 0x7fadf8068f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 -- 172.21.15.138:0/1610606010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0095f0 con 0x7fadf8100250 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf7fff700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fade400d8d0 tx=0x7fade400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.769+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade4009940 con 0x7fadf8100250 2024-02-15T22:54:40.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.770+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fade4010460 con 0x7fadf8100250 2024-02-15T22:54:40.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.770+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf819b0f0 con 0x7fadf8100250 2024-02-15T22:54:40.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.770+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fade400f5f0 con 0x7fadf8100250 2024-02-15T22:54:40.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.770+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf819b640 con 0x7fadf8100250 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.771+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8107ba0 con 0x7fadf8100250 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.771+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fade40105d0 con 0x7fadf8100250 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.771+0000 7fadf5ffb700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 0x7fade806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.772+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fade408cf60 con 0x7fadf8100250 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.772+0000 7fadfc932700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 0x7fade806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:40.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.772+0000 7fadfc932700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 0x7fade806f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadec006010 tx=0x7fadec00b540 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:40.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:40.776+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fade40c0a50 con 0x7fadf8100250 2024-02-15T22:54:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:40 smithi138 ceph-mon[29229]: pgmap v95: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:40 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:40 smithi138 ceph-mon[29229]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:41.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.074+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fadf819bc80 con 0x7fadf8100250 2024-02-15T22:54:41.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.075+0000 7fadf5ffb700 1 -- 172.21.15.138:0/1610606010 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fade405a770 con 0x7fadf8100250 2024-02-15T22:54:41.077 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:54:41.077 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:54:41.077 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:54:41.078 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:54:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 msgr2=0x7fade806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 0x7fade806f9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadec006010 tx=0x7fadec00b540 comp rx=0 tx=0).stop 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 msgr2=0x7fadf819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fade400d8d0 tx=0x7fade400dc90 comp rx=0 tx=0).stop 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 shutdown_connections 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fade806d520 0x7fade806f9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadf80ff050 0x7fadf8068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 --2- 172.21.15.138:0/1610606010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadf8100250 0x7fadf819a6d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 >> 172.21.15.138:0/1610606010 conn(0x7fadf80fa5e0 msgr2=0x7fadf8103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 shutdown_connections 2024-02-15T22:54:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.078+0000 7fadfeb96700 1 -- 172.21.15.138:0/1610606010 wait complete. 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 -- 172.21.15.138:0/1256884791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0100c80 msgr2=0x7fcbe0103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/1256884791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0100c80 0x7fcbe0103060 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009910 tx=0x7fcbd4009c20 comp rx=0 tx=0).stop 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 -- 172.21.15.138:0/1256884791 shutdown_connections 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/1256884791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe01035a0 0x7fcbe0105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/1256884791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0100c80 0x7fcbe0103060 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 -- 172.21.15.138:0/1256884791 >> 172.21.15.138:0/1256884791 conn(0x7fcbe00fa600 msgr2=0x7fcbe00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 -- 172.21.15.138:0/1256884791 shutdown_connections 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.190+0000 7fcbe70b3700 1 -- 172.21.15.138:0/1256884791 wait complete. 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 Processor -- start 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 -- start start 2024-02-15T22:54:41.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe0100c80 0x7fcbe0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0196490 con 0x7fcbe01035a0 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe70b3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01965d0 con 0x7fcbe0100c80 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbdffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbdffff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38078/0 (socket says 172.21.15.138:38078) 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbdffff700 1 -- 172.21.15.138:0/4052553954 learned_addr learned my addr 172.21.15.138:0/4052553954 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.191+0000 7fcbe4e4f700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe0100c80 0x7fcbe0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbdffff700 1 -- 172.21.15.138:0/4052553954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe0100c80 msgr2=0x7fcbe0195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbdffff700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe0100c80 0x7fcbe0195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbdffff700 1 -- 172.21.15.138:0/4052553954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40095f0 con 0x7fcbe01035a0 2024-02-15T22:54:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbdffff700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d900 tx=0x7fcbcc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc0041f0 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe019b080 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcbcc004ce0 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbcc00b750 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.192+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe019b5d0 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.193+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe018fb80 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.194+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fcbcc004e50 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.194+0000 7fcbddffb700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 0x7fcbd006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.194+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcbcc08ce90 con 0x7fcbe01035a0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.194+0000 7fcbe4e4f700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 0x7fcbd006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:54:41.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.195+0000 7fcbe4e4f700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 0x7fcbd006f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b5c0 tx=0x7fcbd4005ee0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:54:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.203+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fcbcc05a6a0 con 0x7fcbe01035a0 2024-02-15T22:54:41.233 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:40 smithi170 ceph-mon[35248]: pgmap v95: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:41.234 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:41.234 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:40 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:41.234 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:40 smithi170 ceph-mon[35248]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:41.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.427+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbe0061190 con 0x7fcbd006d520 2024-02-15T22:54:41.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.428+0000 7fcbddffb700 1 -- 172.21.15.138:0/4052553954 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fcbe0061190 con 0x7fcbd006d520 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/2 daemons upgraded", 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:54:41.431 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.430+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 msgr2=0x7fcbd006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.430+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 0x7fcbd006f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b5c0 tx=0x7fcbd4005ee0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.430+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 msgr2=0x7fcbe0195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.430+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00d900 tx=0x7fcbcc00dc10 comp rx=0 tx=0).stop 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 shutdown_connections 2024-02-15T22:54:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcbd006d520 0x7fcbd006f9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe0100c80 0x7fcbe0195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 --2- 172.21.15.138:0/4052553954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe01035a0 0x7fcbe0195e70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:54:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 >> 172.21.15.138:0/4052553954 conn(0x7fcbe00fa600 msgr2=0x7fcbe00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:54:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 shutdown_connections 2024-02-15T22:54:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:54:41.431+0000 7fcbe70b3700 1 -- 172.21.15.138:0/4052553954 wait complete. 2024-02-15T22:54:42.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:42 smithi138 ceph-mon[29229]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:42.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:42 smithi138 ceph-mon[29229]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:42.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:42.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:42.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:42 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1610606010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:42.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:42 smithi170 ceph-mon[35248]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:42 smithi170 ceph-mon[35248]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:42.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:42 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1610606010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:43 smithi138 ceph-mon[29229]: pgmap v96: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:43 smithi138 ceph-mon[29229]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:43.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:43 smithi170 ceph-mon[35248]: pgmap v96: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:43.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:43 smithi170 ceph-mon[35248]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: pgmap v97: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:54:45.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:54:45.488 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.489 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:45 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: pgmap v97: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:54:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T22:54:45.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:45.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:54:45.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:54:45.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:54:45.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:45 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:46.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:46 smithi138 ceph-mon[29229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:54:46.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:46 smithi138 ceph-mon[29229]: Upgrade: Finalizing container_image settings 2024-02-15T22:54:46.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:46 smithi138 ceph-mon[29229]: Upgrade: Complete! 2024-02-15T22:54:46.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:46 smithi170 ceph-mon[35248]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T22:54:46.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:46 smithi170 ceph-mon[35248]: Upgrade: Finalizing container_image settings 2024-02-15T22:54:46.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:46 smithi170 ceph-mon[35248]: Upgrade: Complete! 2024-02-15T22:54:46.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:54:47.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:47 smithi138 ceph-mon[29229]: pgmap v98: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:47.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:47 smithi170 ceph-mon[35248]: pgmap v98: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:48 smithi138 ceph-mon[29229]: pgmap v99: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:49.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:48 smithi170 ceph-mon[35248]: pgmap v99: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:50 smithi138 ceph-mon[29229]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:50 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:50 smithi170 ceph-mon[35248]: pgmap v100: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:51.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:50 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:54:53.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:52 smithi138 ceph-mon[29229]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:53.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:52 smithi170 ceph-mon[35248]: pgmap v101: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:55.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:54 smithi138 ceph-mon[29229]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:55.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:54 smithi170 ceph-mon[35248]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:56 smithi138 ceph-mon[29229]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:57.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:56 smithi170 ceph-mon[35248]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:54:59.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:54:58 smithi138 ceph-mon[29229]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:54:59.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:54:58 smithi170 ceph-mon[35248]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:01.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:00 smithi138 ceph-mon[29229]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:01.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:00 smithi170 ceph-mon[35248]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:02 smithi138 ceph-mon[29229]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:02 smithi170 ceph-mon[35248]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:05.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:04 smithi138 ceph-mon[29229]: pgmap v107: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:05.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:04 smithi170 ceph-mon[35248]: pgmap v107: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:06.188 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:05 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:06.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:05 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:07.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:06 smithi138 ceph-mon[29229]: pgmap v108: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:07.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:06 smithi170 ceph-mon[35248]: pgmap v108: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:09.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:08 smithi138 ceph-mon[29229]: pgmap v109: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:09.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:08 smithi170 ceph-mon[35248]: pgmap v109: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:11.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:10 smithi138 ceph-mon[29229]: pgmap v110: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:10 smithi170 ceph-mon[35248]: pgmap v110: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1564441076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0103340 msgr2=0x7fcad0105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1564441076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0103340 0x7fcad0105720 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009910 tx=0x7fcacc009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1564441076 shutdown_connections 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1564441076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0103340 0x7fcad0105720 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1564441076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0100a20 0x7fcad0102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1564441076 >> 172.21.15.138:0/1564441076 conn(0x7fcad00fa440 msgr2=0x7fcad00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1564441076 shutdown_connections 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.545+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1564441076 wait complete. 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 Processor -- start 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 -- start start 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0103340 0x7fcad0195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0196240 con 0x7fcad0100a20 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad6f9f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0196380 con 0x7fcad0103340 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad5f9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad5f9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52958/0 (socket says 172.21.15.138:52958) 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.546+0000 7fcad5f9d700 1 -- 172.21.15.138:0/1091131844 learned_addr learned my addr 172.21.15.138:0/1091131844 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad579c700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0103340 0x7fcad0195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad5f9d700 1 -- 172.21.15.138:0/1091131844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0103340 msgr2=0x7fcad0195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:11.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad5f9d700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0103340 0x7fcad0195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad5f9d700 1 -- 172.21.15.138:0/1091131844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0095f0 con 0x7fcad0100a20 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad5f9d700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c930 tx=0x7fcac000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac0007ad0 con 0x7fcad0100a20 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad019ae40 con 0x7fcad0100a20 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcac000ce80 con 0x7fcad0100a20 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac0018630 con 0x7fcad0100a20 2024-02-15T22:55:11.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.547+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad019b380 con 0x7fcad0100a20 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.548+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad018f9b0 con 0x7fcad0100a20 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.549+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fcac0007c30 con 0x7fcad0100a20 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.549+0000 7fcac6ffd700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 0x7fcabc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.549+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcac008cf70 con 0x7fcad0100a20 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.549+0000 7fcad579c700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 0x7fcabc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:11.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.550+0000 7fcad579c700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 0x7fcabc06f9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00b5c0 tx=0x7fcacc0052e0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:11.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.554+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fcac00c0a50 con 0x7fcad0100a20 2024-02-15T22:55:11.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.776+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcad0061190 con 0x7fcabc06d520 2024-02-15T22:55:11.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.778+0000 7fcac6ffd700 1 -- 172.21.15.138:0/1091131844 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fcad0061190 con 0x7fcabc06d520 2024-02-15T22:55:11.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 msgr2=0x7fcabc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:11.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 0x7fcabc06f9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00b5c0 tx=0x7fcacc0052e0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 msgr2=0x7fcad0195770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c930 tx=0x7fcac000cc40 comp rx=0 tx=0).stop 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 shutdown_connections 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fcabc06d520 0x7fcabc06f9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcad0100a20 0x7fcad0195770 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 --2- 172.21.15.138:0/1091131844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcad0103340 0x7fcad0195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 >> 172.21.15.138:0/1091131844 conn(0x7fcad00fa440 msgr2=0x7fcad00fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 shutdown_connections 2024-02-15T22:55:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:11.780+0000 7fcad6f9f700 1 -- 172.21.15.138:0/1091131844 wait complete. 2024-02-15T22:55:12.524 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-15T22:55:12.774 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:13.154 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:12 smithi138 ceph-mon[29229]: pgmap v111: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:13.154 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:12 smithi138 ceph-mon[29229]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:13.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:12 smithi170 ceph-mon[35248]: pgmap v111: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:13.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:12 smithi170 ceph-mon[35248]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 -- 172.21.15.138:0/649802284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 msgr2=0x7fbe800ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/649802284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe800ff6a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b0a0 tx=0x7fbe7800b3b0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 -- 172.21.15.138:0/649802284 shutdown_connections 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/649802284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/649802284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe800ff6a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 -- 172.21.15.138:0/649802284 >> 172.21.15.138:0/649802284 conn(0x7fbe800fabb0 msgr2=0x7fbe800fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:14.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 -- 172.21.15.138:0/649802284 shutdown_connections 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.441+0000 7fbe84b6e700 1 -- 172.21.15.138:0/649802284 wait complete. 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 Processor -- start 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 -- start start 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80101760 con 0x7fbe800ff2d0 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe84b6e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801018a0 con 0x7fbe800ffc70 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe7e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe7e59c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39822/0 (socket says 172.21.15.138:39822) 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.442+0000 7fbe7e59c700 1 -- 172.21.15.138:0/3551246126 learned_addr learned my addr 172.21.15.138:0/3551246126 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7dd9b700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7e59c700 1 -- 172.21.15.138:0/3551246126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 msgr2=0x7fbe80101220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:14.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7e59c700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80101220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7e59c700 1 -- 172.21.15.138:0/3551246126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009d00 con 0x7fbe800ff2d0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7dd9b700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe7e59c700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f80 tx=0x7fbe7800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe7800e040 con 0x7fbe800ff2d0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe80101b20 con 0x7fbe800ff2d0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe78003e60 con 0x7fbe800ff2d0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe7801d910 con 0x7fbe800ff2d0 2024-02-15T22:55:14.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.443+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe801a2260 con 0x7fbe800ff2d0 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.444+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8004ea50 con 0x7fbe800ff2d0 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.445+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fbe78004820 con 0x7fbe800ff2d0 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.445+0000 7fbe6f7fe700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 0x7fbe6806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.445+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbe7808e830 con 0x7fbe800ff2d0 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.445+0000 7fbe7dd9b700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 0x7fbe6806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:14.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.445+0000 7fbe7dd9b700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 0x7fbe6806f9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe801024d0 tx=0x7fbe74005f50 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:14.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.451+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fbe78058530 con 0x7fbe800ff2d0 2024-02-15T22:55:14.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.731+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe80102210 con 0x7fbe800ff2d0 2024-02-15T22:55:14.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.732+0000 7fbe6f7fe700 1 -- 172.21.15.138:0/3551246126 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fbe7805bbf0 con 0x7fbe800ff2d0 2024-02-15T22:55:14.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 msgr2=0x7fbe6806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 0x7fbe6806f9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe801024d0 tx=0x7fbe74005f50 comp rx=0 tx=0).stop 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 msgr2=0x7fbe80100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f80 tx=0x7fbe7800cdd0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 shutdown_connections 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fbe6806d520 0x7fbe6806f9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe800ff2d0 0x7fbe80100ce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 --2- 172.21.15.138:0/3551246126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe800ffc70 0x7fbe80101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 >> 172.21.15.138:0/3551246126 conn(0x7fbe800fabb0 msgr2=0x7fbe80103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 shutdown_connections 2024-02-15T22:55:14.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:14.734+0000 7fbe84b6e700 1 -- 172.21.15.138:0/3551246126 wait complete. 2024-02-15T22:55:14.747 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:55:15.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:14 smithi138 ceph-mon[29229]: pgmap v112: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:15.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:14 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:15.115 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:14 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3551246126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:15.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:14 smithi170 ceph-mon[35248]: pgmap v112: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:15.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:14 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:15.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:14 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3551246126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:15.413 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-15T22:55:15.620 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:17.068 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:16 smithi138 ceph-mon[29229]: pgmap v113: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:17.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:16 smithi170 ceph-mon[35248]: pgmap v113: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:17.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.318+0000 7fe981ed2700 1 -- 172.21.15.138:0/440646591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c1003d0 msgr2=0x7fe97c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:17.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.318+0000 7fe981ed2700 1 --2- 172.21.15.138:0/440646591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c1003d0 0x7fe97c1007a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009910 tx=0x7fe96c009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:17.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 -- 172.21.15.138:0/440646591 shutdown_connections 2024-02-15T22:55:17.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 --2- 172.21.15.138:0/440646591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c100d70 0x7fe97c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 --2- 172.21.15.138:0/440646591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c1003d0 0x7fe97c1007a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 -- 172.21.15.138:0/440646591 >> 172.21.15.138:0/440646591 conn(0x7fe97c0fbc90 msgr2=0x7fe97c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:17.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 -- 172.21.15.138:0/440646591 shutdown_connections 2024-02-15T22:55:17.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 -- 172.21.15.138:0/440646591 wait complete. 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 Processor -- start 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.319+0000 7fe981ed2700 1 -- start start 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c1003d0 0x7fe97c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c073ad0 con 0x7fe97c100d70 2024-02-15T22:55:17.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c073c10 con 0x7fe97c1003d0 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39846/0 (socket says 172.21.15.138:39846) 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 -- 172.21.15.138:0/1837145179 learned_addr learned my addr 172.21.15.138:0/1837145179 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97b7fe700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c1003d0 0x7fe97c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 -- 172.21.15.138:0/1837145179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c1003d0 msgr2=0x7fe97c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c1003d0 0x7fe97c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 -- 172.21.15.138:0/1837145179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0095f0 con 0x7fe97c100d70 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe97affd700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b480 tx=0x7fe97000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe970011800 con 0x7fe97c100d70 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c1a20f0 con 0x7fe97c100d70 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe970011e20 con 0x7fe97c100d70 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe970010ea0 con 0x7fe97c100d70 2024-02-15T22:55:17.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.320+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c1a2450 con 0x7fe97c100d70 2024-02-15T22:55:17.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.322+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c1086e0 con 0x7fe97c100d70 2024-02-15T22:55:17.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.322+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fe970010380 con 0x7fe97c100d70 2024-02-15T22:55:17.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.322+0000 7fe978ff9700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 0x7fe96406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:17.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.322+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe97008ca20 con 0x7fe97c100d70 2024-02-15T22:55:17.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.323+0000 7fe97b7fe700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 0x7fe96406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:17.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.323+0000 7fe97b7fe700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 0x7fe96406f9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe96c006010 tx=0x7fe96c01a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:17.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.327+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fe970056700 con 0x7fe97c100d70 2024-02-15T22:55:17.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.612+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe97c04ea50 con 0x7fe97c100d70 2024-02-15T22:55:17.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.612+0000 7fe978ff9700 1 -- 172.21.15.138:0/1837145179 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fe970059dc0 con 0x7fe97c100d70 2024-02-15T22:55:17.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 msgr2=0x7fe96406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:17.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 0x7fe96406f9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe96c006010 tx=0x7fe96c01a040 comp rx=0 tx=0).stop 2024-02-15T22:55:17.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 msgr2=0x7fe97c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b480 tx=0x7fe97000b790 comp rx=0 tx=0).stop 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 shutdown_connections 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fe96406d520 0x7fe96406f9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe97c1003d0 0x7fe97c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 --2- 172.21.15.138:0/1837145179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe97c100d70 0x7fe97c073590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 >> 172.21.15.138:0/1837145179 conn(0x7fe97c0fbc90 msgr2=0x7fe97c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 shutdown_connections 2024-02-15T22:55:17.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:17.615+0000 7fe981ed2700 1 -- 172.21.15.138:0/1837145179 wait complete. 2024-02-15T22:55:17.628 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-15T22:55:18.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:17 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/1837145179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:18.262 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-15T22:55:18.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:17 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/1837145179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:18.471 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:19.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:18 smithi138 ceph-mon[29229]: pgmap v114: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:19.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:18 smithi170 ceph-mon[35248]: pgmap v114: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/2635270771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f4100d80 msgr2=0x7fd3f4104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/2635270771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f4100d80 0x7fd3f4104d50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009910 tx=0x7fd3e4009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/2635270771 shutdown_connections 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/2635270771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f4100d80 0x7fd3f4104d50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/2635270771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f41003e0 0x7fd3f41007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.080+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/2635270771 >> 172.21.15.138:0/2635270771 conn(0x7fd3f40fbca0 msgr2=0x7fd3f40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/2635270771 shutdown_connections 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/2635270771 wait complete. 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 Processor -- start 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 -- start start 2024-02-15T22:55:20.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f4100d80 0x7fd3f4196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4196970 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fc2dc700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419a700 con 0x7fd3f4100d80 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.081+0000 7fd3fa078700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39864/0 (socket says 172.21.15.138:39864) 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 -- 172.21.15.138:0/937495595 learned_addr learned my addr 172.21.15.138:0/937495595 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3f9877700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f4100d80 0x7fd3f4196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 -- 172.21.15.138:0/937495595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f4100d80 msgr2=0x7fd3f4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f4100d80 0x7fd3f4196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 -- 172.21.15.138:0/937495595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40095f0 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fa078700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000ada0 tx=0x7fd3f000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f000f070 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3f000ae90 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f419a9e0 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f00056d0 con 0x7fd3f41003e0 2024-02-15T22:55:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.082+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f419af30 con 0x7fd3f41003e0 2024-02-15T22:55:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.083+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f4108660 con 0x7fd3f41003e0 2024-02-15T22:55:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.084+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fd3f0005830 con 0x7fd3f41003e0 2024-02-15T22:55:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.084+0000 7fd3eb7fe700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 0x7fd3e006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:20.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.084+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd3f008c790 con 0x7fd3f41003e0 2024-02-15T22:55:20.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.084+0000 7fd3f9877700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 0x7fd3e006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:20.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.085+0000 7fd3f9877700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 0x7fd3e006f9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4197370 tx=0x7fd3e401a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:20.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.089+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fd3f00564f0 con 0x7fd3f41003e0 2024-02-15T22:55:20.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.373+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3f419b260 con 0x7fd3f41003e0 2024-02-15T22:55:20.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.374+0000 7fd3eb7fe700 1 -- 172.21.15.138:0/937495595 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fd3f0059bb0 con 0x7fd3f41003e0 2024-02-15T22:55:20.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 msgr2=0x7fd3e006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 0x7fd3e006f9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4197370 tx=0x7fd3e401a040 comp rx=0 tx=0).stop 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 msgr2=0x7fd3f4195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000ada0 tx=0x7fd3f000c330 comp rx=0 tx=0).stop 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 shutdown_connections 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fd3e006d520 0x7fd3e006f9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3f41003e0 0x7fd3f4195d50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 --2- 172.21.15.138:0/937495595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3f4100d80 0x7fd3f4196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 >> 172.21.15.138:0/937495595 conn(0x7fd3f40fbca0 msgr2=0x7fd3f41045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 shutdown_connections 2024-02-15T22:55:20.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:20.376+0000 7fd3fc2dc700 1 -- 172.21.15.138:0/937495595 wait complete. 2024-02-15T22:55:20.389 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:55:21.069 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:20 smithi138 ceph-mon[29229]: pgmap v115: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:21.070 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:20 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:21.070 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:20 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/937495595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:21.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-15T22:55:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:20 smithi170 ceph-mon[35248]: pgmap v115: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:21.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:20 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:21.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:20 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/937495595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:21.312 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 -- 172.21.15.138:0/2812517835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ff2d0 msgr2=0x7f256c0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 --2- 172.21.15.138:0/2812517835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ff2d0 0x7f256c0ff6a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f255c009910 tx=0x7f255c009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 -- 172.21.15.138:0/2812517835 shutdown_connections 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 --2- 172.21.15.138:0/2812517835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ffc70 0x7f256c103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 --2- 172.21.15.138:0/2812517835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ff2d0 0x7f256c0ff6a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.022+0000 7f25722aa700 1 -- 172.21.15.138:0/2812517835 >> 172.21.15.138:0/2812517835 conn(0x7f256c0fabb0 msgr2=0x7f256c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 -- 172.21.15.138:0/2812517835 shutdown_connections 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 -- 172.21.15.138:0/2812517835 wait complete. 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 Processor -- start 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 -- start start 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ff2d0 0x7f256c100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c101760 con 0x7f256c0ffc70 2024-02-15T22:55:23.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.023+0000 7f25722aa700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c1018a0 con 0x7f256c0ff2d0 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39880/0 (socket says 172.21.15.138:39880) 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 -- 172.21.15.138:0/823005201 learned_addr learned my addr 172.21.15.138:0/823005201 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256bfff700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ff2d0 0x7f256c100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 -- 172.21.15.138:0/823005201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ff2d0 msgr2=0x7f256c100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ff2d0 0x7f256c100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 -- 172.21.15.138:0/823005201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0095f0 con 0x7f256c0ffc70 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f256b7fe700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f256000c960 tx=0x7f256000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:23.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2560007a70 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2560007bd0 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c1a1f80 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25600186c0 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.024+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c1a22e0 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.025+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c1085f0 con 0x7f256c0ffc70 2024-02-15T22:55:23.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.026+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f256000faa0 con 0x7f256c0ffc70 2024-02-15T22:55:23.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.026+0000 7f25697fa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 0x7f255406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:23.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.026+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f256008cfa0 con 0x7f256c0ffc70 2024-02-15T22:55:23.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.026+0000 7f256bfff700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 0x7f255406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:23.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.026+0000 7f256bfff700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 0x7f255406f9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f255c00b5c0 tx=0x7f255c01a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:23.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.031+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f256005a7b0 con 0x7f256c0ffc70 2024-02-15T22:55:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:22 smithi138 ceph-mon[29229]: pgmap v116: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:23.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:23.246+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f256c061190 con 0x7f255406d520 2024-02-15T22:55:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:22 smithi170 ceph-mon[35248]: pgmap v116: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:24 smithi138 ceph-mon[29229]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:25.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:24 smithi138 ceph-mon[29229]: pgmap v117: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:24 smithi170 ceph-mon[35248]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:25.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:24 smithi170 ceph-mon[35248]: pgmap v117: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:25.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.416+0000 7f25697fa700 1 -- 172.21.15.138:0/823005201 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5391 (secure 0 0 0) 0x7f256c061190 con 0x7f255406d520 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 msgr2=0x7f255406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 0x7f255406f9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f255c00b5c0 tx=0x7f255c01a040 comp rx=0 tx=0).stop 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 msgr2=0x7f256c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f256000c960 tx=0x7f256000cd20 comp rx=0 tx=0).stop 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 shutdown_connections 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f255406d520 0x7f255406f9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f256c0ff2d0 0x7f256c100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 --2- 172.21.15.138:0/823005201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f256c0ffc70 0x7f256c101220 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 >> 172.21.15.138:0/823005201 conn(0x7f256c0fabb0 msgr2=0x7f256c069090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 shutdown_connections 2024-02-15T22:55:25.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:25.420+0000 7f25722aa700 1 -- 172.21.15.138:0/823005201 wait complete. 2024-02-15T22:55:25.442 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:55:26.141 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T22:55:26.351 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:26.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:26 smithi138 ceph-mon[29229]: pgmap v118: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:27.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:26 smithi170 ceph-mon[35248]: pgmap v118: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:28.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- 172.21.15.138:0/3848733626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 msgr2=0x7f8cec103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/3848733626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec103c30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009910 tx=0x7f8cdc009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- 172.21.15.138:0/3848733626 shutdown_connections 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/3848733626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec103c30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/3848733626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 0x7f8cec0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- 172.21.15.138:0/3848733626 >> 172.21.15.138:0/3848733626 conn(0x7f8cec0fab80 msgr2=0x7f8cec0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- 172.21.15.138:0/3848733626 shutdown_connections 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- 172.21.15.138:0/3848733626 wait complete. 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 Processor -- start 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- start start 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 0x7f8cec195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:28.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec196b10 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.080+0000 7f8cf3aac700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec19a8a0 con 0x7f8cec0ff2c0 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33974/0 (socket says 172.21.15.138:33974) 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 -- 172.21.15.138:0/2683866110 learned_addr learned my addr 172.21.15.138:0/2683866110 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1848700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 0x7f8cec195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 -- 172.21.15.138:0/2683866110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 msgr2=0x7f8cec195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 0x7f8cec195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 -- 172.21.15.138:0/2683866110 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0095f0 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf1047700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0092e0 tx=0x7f8cdc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cdc01d070 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cdc00f460 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec19ab20 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cdc0175f0 con 0x7f8cec0ffc60 2024-02-15T22:55:28.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.081+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec19b010 con 0x7f8cec0ffc60 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.082+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec04ea50 con 0x7f8cec0ffc60 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.083+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f8cdc00f5d0 con 0x7f8cec0ffc60 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.083+0000 7f8ce2ffd700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 0x7f8cd806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.083+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8cdc08e4f0 con 0x7f8cec0ffc60 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.083+0000 7f8cf1848700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 0x7f8cd806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.084+0000 7f8cf1848700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 0x7f8cd806f9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8006fd0 tx=0x7f8ce8008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:28.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.088+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8cdc0581d0 con 0x7f8cec0ffc60 2024-02-15T22:55:28.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.296+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cec19b570 con 0x7f8cd806d520 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.306+0000 7f8ce2ffd700 1 -- 172.21.15.138:0/2683866110 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8cec19b570 con 0x7f8cd806d520 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (2m) 48s ago 12m 15.7M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (12m) 48s ago 12m 7998k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (11m) 2m ago 11m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (12m) 48s ago 12m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (11m) 2m ago 11m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (54s) 48s ago 12m 57.4M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (6m) 48s ago 6m 72.8M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:55:28.309 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (6m) 48s ago 6m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (6m) 2m ago 6m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (6m) 2m ago 6m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (4m) 48s ago 14m 504M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (2m) 2m ago 11m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (14m) 48s ago 14m 62.8M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (11m) 2m ago 11m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (2m) 48s ago 12m 15.9M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (2m) 2m ago 11m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (10m) 48s ago 10m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (10m) 48s ago 10m 240M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (9m) 48s ago 9m 195M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (9m) 2m ago 9m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (8m) 2m ago 8m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:55:28.310 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (8m) 2m ago 8m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:55:28.311 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (2m) 48s ago 12m 62.8M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:55:28.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 msgr2=0x7f8cd806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:28.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 0x7f8cd806f9d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8006fd0 tx=0x7f8ce8008040 comp rx=0 tx=0).stop 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 msgr2=0x7f8cec196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0092e0 tx=0x7f8cdc00be20 comp rx=0 tx=0).stop 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 shutdown_connections 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8cd806d520 0x7f8cd806f9d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cec0ff2c0 0x7f8cec195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 --2- 172.21.15.138:0/2683866110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cec0ffc60 0x7f8cec196430 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.308+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 >> 172.21.15.138:0/2683866110 conn(0x7f8cec0fab80 msgr2=0x7f8cec103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.309+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 shutdown_connections 2024-02-15T22:55:28.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:28.309+0000 7f8cf3aac700 1 -- 172.21.15.138:0/2683866110 wait complete. 2024-02-15T22:55:28.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:28 smithi138 ceph-mon[29229]: pgmap v119: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:28.983 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:28 smithi138 ceph-mon[29229]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:28.984 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:55:28.985 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:55:28.985 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-15T22:55:29.201 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:29.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:28 smithi170 ceph-mon[35248]: pgmap v119: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:29.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:28 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:29.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:29 smithi138 ceph-mon[29229]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:30.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:29 smithi170 ceph-mon[35248]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:30.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 -- 172.21.15.138:0/793901262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 msgr2=0x7fc6a4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:30.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/793901262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4100780 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc698009910 tx=0x7fc698009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 -- 172.21.15.138:0/793901262 shutdown_connections 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/793901262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6a4100d50 0x7fc6a4104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/793901262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4100780 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 -- 172.21.15.138:0/793901262 >> 172.21.15.138:0/793901262 conn(0x7fc6a40fbc30 msgr2=0x7fc6a40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 -- 172.21.15.138:0/793901262 shutdown_connections 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 -- 172.21.15.138:0/793901262 wait complete. 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.855+0000 7fc6ab22f700 1 Processor -- start 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 -- start start 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6a4100d50 0x7fc6a4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41968a0 con 0x7fc6a41003b0 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41969e0 con 0x7fc6a4100d50 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:30.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:33986/0 (socket says 172.21.15.138:33986) 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 -- 172.21.15.138:0/2237000008 learned_addr learned my addr 172.21.15.138:0/2237000008 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 -- 172.21.15.138:0/2237000008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6a4100d50 msgr2=0x7fc6a4196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6a4100d50 0x7fc6a4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 -- 172.21.15.138:0/2237000008 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980095f0 con 0x7fc6a41003b0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a8fcb700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc69800bda0 tx=0x7fc69800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69801d070 con 0x7fc6a41003b0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc698004fb0 con 0x7fc6a41003b0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.856+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a419a7d0 con 0x7fc6a41003b0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.857+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69800f690 con 0x7fc6a41003b0 2024-02-15T22:55:30.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.857+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a419acc0 con 0x7fc6a41003b0 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.858+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a41086c0 con 0x7fc6a41003b0 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.858+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fc698022470 con 0x7fc6a41003b0 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.858+0000 7fc6a1ffb700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 0x7fc69406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.859+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc69808e780 con 0x7fc6a41003b0 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.859+0000 7fc6a3fff700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 0x7fc69406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:30.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.859+0000 7fc6a3fff700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 0x7fc69406f9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc690005fd0 tx=0x7fc690005d00 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:30.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:30.863+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fc698058460 con 0x7fc6a41003b0 2024-02-15T22:55:30.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:30 smithi138 ceph-mon[29229]: pgmap v120: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:31.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.062+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fc6a404ea50 con 0x7fc6a41003b0 2024-02-15T22:55:31.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.069+0000 7fc6a1ffb700 1 -- 172.21.15.138:0/2237000008 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v44)=0 v44) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc69805bb20 con 0x7fc6a41003b0 2024-02-15T22:55:31.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 msgr2=0x7fc69406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:31.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 0x7fc69406f9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc690005fd0 tx=0x7fc690005d00 comp rx=0 tx=0).stop 2024-02-15T22:55:31.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 msgr2=0x7fc6a4195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc69800bda0 tx=0x7fc69800be80 comp rx=0 tx=0).stop 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 shutdown_connections 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fc69406d520 0x7fc69406f9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6a41003b0 0x7fc6a4195d10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.071+0000 7fc6ab22f700 1 --2- 172.21.15.138:0/2237000008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6a4100d50 0x7fc6a4196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.072+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 >> 172.21.15.138:0/2237000008 conn(0x7fc6a40fbc30 msgr2=0x7fc6a40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.072+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 shutdown_connections 2024-02-15T22:55:31.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:31.072+0000 7fc6ab22f700 1 -- 172.21.15.138:0/2237000008 wait complete. 2024-02-15T22:55:31.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:30 smithi170 ceph-mon[35248]: pgmap v120: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:31.953 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:55:31.954 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:55:31.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T22:55:32.163 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:32.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/2237000008' entity='client.admin' 2024-02-15T22:55:32.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:32.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:32.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:55:32.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:32.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:32 smithi138 ceph-mon[29229]: pgmap v121: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:32.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/2237000008' entity='client.admin' 2024-02-15T22:55:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:55:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:32 smithi170 ceph-mon[35248]: pgmap v121: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:33.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1697703884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068fd0 msgr2=0x7ff4a0104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1697703884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068fd0 0x7ff4a0104df0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff494009910 tx=0x7ff494009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1697703884 shutdown_connections 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1697703884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068fd0 0x7ff4a0104df0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1697703884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068630 0x7ff4a0068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1697703884 >> 172.21.15.138:0/1697703884 conn(0x7ff4a0074f50 msgr2=0x7ff4a0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1697703884 shutdown_connections 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1697703884 wait complete. 2024-02-15T22:55:33.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 Processor -- start 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.848+0000 7ff4a60c6700 1 -- start start 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068fd0 0x7ff4a00ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00ffc80 con 0x7ff4a0068630 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00ffdc0 con 0x7ff4a0068fd0 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55126/0 (socket says 172.21.15.138:55126) 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 -- 172.21.15.138:0/1340648462 learned_addr learned my addr 172.21.15.138:0/1340648462 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49effd700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068fd0 0x7ff4a00ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 -- 172.21.15.138:0/1340648462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068fd0 msgr2=0x7ff4a00ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068fd0 0x7ff4a00ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 -- 172.21.15.138:0/1340648462 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940095f0 con 0x7ff4a0068630 2024-02-15T22:55:33.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49f7fe700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff49000ada0 tx=0x7ff49000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:33.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49000f070 con 0x7ff4a0068630 2024-02-15T22:55:33.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a01a1ff0 con 0x7ff4a0068630 2024-02-15T22:55:33.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff490007bf0 con 0x7ff4a0068630 2024-02-15T22:55:33.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff490005690 con 0x7ff4a0068630 2024-02-15T22:55:33.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.849+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a01a2400 con 0x7ff4a0068630 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.851+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a01086d0 con 0x7ff4a0068630 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.851+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7ff490005870 con 0x7ff4a0068630 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.851+0000 7ff49cff9700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 0x7ff48806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.851+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff49008c8a0 con 0x7ff4a0068630 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.851+0000 7ff49effd700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 0x7ff48806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:33.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.852+0000 7ff49effd700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 0x7ff48806f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4a01009f0 tx=0x7ff49401a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:33.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:33.856+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7ff490056600 con 0x7ff4a0068630 2024-02-15T22:55:34.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.050+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7ff4a00fff80 con 0x7ff4a0068630 2024-02-15T22:55:34.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.051+0000 7ff49cff9700 1 -- 172.21.15.138:0/1340648462 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v44)=0 v44) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff490059cc0 con 0x7ff4a0068630 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 msgr2=0x7ff48806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 0x7ff48806f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4a01009f0 tx=0x7ff49401a040 comp rx=0 tx=0).stop 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 msgr2=0x7ff4a00ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff49000ada0 tx=0x7ff49000c330 comp rx=0 tx=0).stop 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 shutdown_connections 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7ff48806d520 0x7ff48806f9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a0068630 0x7ff4a00ff200 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 --2- 172.21.15.138:0/1340648462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4a0068fd0 0x7ff4a00ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 >> 172.21.15.138:0/1340648462 conn(0x7ff4a0074f50 msgr2=0x7ff4a00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 shutdown_connections 2024-02-15T22:55:34.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:34.053+0000 7ff4a60c6700 1 -- 172.21.15.138:0/1340648462 wait complete. 2024-02-15T22:55:34.643 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T22:55:34.854 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:34.976 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:34 smithi138 ceph-mon[29229]: pgmap v122: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:35.215 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:34 smithi170 ceph-mon[35248]: pgmap v122: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:36.078 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:35 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:36.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:35 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/2589175500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf01003e0 msgr2=0x7f8bf01007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/2589175500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf01003e0 0x7f8bf01007b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009910 tx=0x7f8be0009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/2589175500 shutdown_connections 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/2589175500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf0100d80 0x7f8bf0104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/2589175500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf01003e0 0x7f8bf01007b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/2589175500 >> 172.21.15.138:0/2589175500 conn(0x7f8bf00fbca0 msgr2=0x7f8bf00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/2589175500 shutdown_connections 2024-02-15T22:55:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/2589175500 wait complete. 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.592+0000 7f8bf4cd4700 1 Processor -- start 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bf4cd4700 1 -- start start 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bf4cd4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 0x7f8bf0195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bf4cd4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bf4cd4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0196a50 con 0x7f8bf0100d80 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bf4cd4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf019a7e0 con 0x7f8bf01003e0 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55156/0 (socket says 172.21.15.138:55156) 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 -- 172.21.15.138:0/683998764 learned_addr learned my addr 172.21.15.138:0/683998764 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bee59c700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 0x7f8bf0195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:36.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 -- 172.21.15.138:0/683998764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 msgr2=0x7f8bf0195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 0x7f8bf0195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8be5d9b700 1 -- 172.21.15.138:0/683998764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00095f0 con 0x7f8bf0100d80 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.593+0000 7f8bee59c700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 0x7f8bf0195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8be5d9b700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800b480 tx=0x7f8bd800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd80118c0 con 0x7f8bf0100d80 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf019aac0 con 0x7f8bf0100d80 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bd8010380 con 0x7f8bf0100d80 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd800f4f0 con 0x7f8bf0100d80 2024-02-15T22:55:36.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.594+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf019b010 con 0x7f8bf0100d80 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.595+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf01086f0 con 0x7f8bf0100d80 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.595+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f8bd80104f0 con 0x7f8bf0100d80 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.596+0000 7f8be7fff700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 0x7f8bdc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.596+0000 7f8bee59c700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 0x7f8bdc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.596+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8bd808cbc0 con 0x7f8bf0100d80 2024-02-15T22:55:36.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.596+0000 7f8bee59c700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 0x7f8bdc06f9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b5c0 tx=0x7f8be0005960 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:36.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.600+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f8bd80568a0 con 0x7f8bf0100d80 2024-02-15T22:55:36.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.797+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f8bf004ea50 con 0x7f8bf0100d80 2024-02-15T22:55:36.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.797+0000 7f8be7fff700 1 -- 172.21.15.138:0/683998764 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v44)=0 v44) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8bd8056030 con 0x7f8bf0100d80 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 msgr2=0x7f8bdc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 0x7f8bdc06f9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b5c0 tx=0x7f8be0005960 comp rx=0 tx=0).stop 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 msgr2=0x7f8bf0196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800b480 tx=0x7f8bd800b840 comp rx=0 tx=0).stop 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 shutdown_connections 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f8bdc06d520 0x7f8bdc06f9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bf01003e0 0x7f8bf0195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 --2- 172.21.15.138:0/683998764 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf0100d80 0x7f8bf0196370 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:36.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 >> 172.21.15.138:0/683998764 conn(0x7f8bf00fbca0 msgr2=0x7f8bf00fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 shutdown_connections 2024-02-15T22:55:36.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:36.799+0000 7f8bf4cd4700 1 -- 172.21.15.138:0/683998764 wait complete. 2024-02-15T22:55:37.094 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:36 smithi138 ceph-mon[29229]: pgmap v123: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:37.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:36 smithi170 ceph-mon[35248]: pgmap v123: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:37.416 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T22:55:37.624 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:38.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:38 smithi138 ceph-mon[29229]: pgmap v124: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:39.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:38 smithi170 ceph-mon[35248]: pgmap v124: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 -- 172.21.15.138:0/837363502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 msgr2=0x7f0f7c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 --2- 172.21.15.138:0/837363502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c0ff690 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009910 tx=0x7f0f6c009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 -- 172.21.15.138:0/837363502 shutdown_connections 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 --2- 172.21.15.138:0/837363502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 0x7f0f7c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 --2- 172.21.15.138:0/837363502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c0ff690 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 -- 172.21.15.138:0/837363502 >> 172.21.15.138:0/837363502 conn(0x7f0f7c0fab80 msgr2=0x7f0f7c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 -- 172.21.15.138:0/837363502 shutdown_connections 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 -- 172.21.15.138:0/837363502 wait complete. 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.302+0000 7f0f8318a700 1 Processor -- start 2024-02-15T22:55:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f8318a700 1 -- start start 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f8318a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f8318a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 0x7f0f7c196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f8318a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c196a40 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f8318a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c19a7d0 con 0x7f0f7c0ffc60 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55174/0 (socket says 172.21.15.138:55174) 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 -- 172.21.15.138:0/310519349 learned_addr learned my addr 172.21.15.138:0/310519349 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f7bfff700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 0x7f0f7c196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 -- 172.21.15.138:0/310519349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 msgr2=0x7f0f7c196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 0x7f0f7c196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 -- 172.21.15.138:0/310519349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0095f0 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f80f26700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006010 tx=0x7f0f6c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.303+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6c01d070 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.304+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f6c004fb0 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.304+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c19aa50 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.304+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f6c022ea0 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.304+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c19af40 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.305+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c04ea50 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.305+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f0f6c022470 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.306+0000 7f0f79ffb700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 0x7f0f6806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.306+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0f6c08e460 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.306+0000 7f0f7bfff700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 0x7f0f6806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.306+0000 7f0f7bfff700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 0x7f0f6806f9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006fd0 tx=0x7f0f64008040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.311+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f0f6c058390 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.506+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f0f7c197180 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.506+0000 7f0f79ffb700 1 -- 172.21.15.138:0/310519349 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v44)=0 v44) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0f7c197180 con 0x7f0f7c0ff2c0 2024-02-15T22:55:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 msgr2=0x7f0f6806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 0x7f0f6806f9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006fd0 tx=0x7f0f64008040 comp rx=0 tx=0).stop 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 msgr2=0x7f0f7c195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006010 tx=0x7f0f6c00be20 comp rx=0 tx=0).stop 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 shutdown_connections 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0f6806d520 0x7f0f6806f9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f7c0ff2c0 0x7f0f7c195e20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 --2- 172.21.15.138:0/310519349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c0ffc60 0x7f0f7c196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 >> 172.21.15.138:0/310519349 conn(0x7f0f7c0fab80 msgr2=0x7f0f7c103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 shutdown_connections 2024-02-15T22:55:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:39.509+0000 7f0f8318a700 1 -- 172.21.15.138:0/310519349 wait complete. 2024-02-15T22:55:40.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-15T22:55:40.357 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:41.178 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:40 smithi138 ceph-mon[29229]: pgmap v125: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:41.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:40 smithi170 ceph-mon[35248]: pgmap v125: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 -- 172.21.15.138:0/1607343936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ff2c0 msgr2=0x7f56540ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 --2- 172.21.15.138:0/1607343936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ff2c0 0x7f56540ff690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b0a0 tx=0x7f564c00b3b0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 -- 172.21.15.138:0/1607343936 shutdown_connections 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 --2- 172.21.15.138:0/1607343936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ffc60 0x7f5654103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 --2- 172.21.15.138:0/1607343936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ff2c0 0x7f56540ff690 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 -- 172.21.15.138:0/1607343936 >> 172.21.15.138:0/1607343936 conn(0x7f56540fab80 msgr2=0x7f56540fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 -- 172.21.15.138:0/1607343936 shutdown_connections 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 -- 172.21.15.138:0/1607343936 wait complete. 2024-02-15T22:55:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.042+0000 7f5659ffe700 1 Processor -- start 2024-02-15T22:55:42.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5659ffe700 1 -- start start 2024-02-15T22:55:42.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5659ffe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ff2c0 0x7f5654195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:42.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5659ffe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:42.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5659ffe700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5654196a80 con 0x7f56540ffc60 2024-02-15T22:55:42.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5659ffe700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565419a7c0 con 0x7f56540ff2c0 2024-02-15T22:55:42.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:55190/0 (socket says 172.21.15.138:55190) 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 -- 172.21.15.138:0/56371789 learned_addr learned my addr 172.21.15.138:0/56371789 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f56537fe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ff2c0 0x7f5654195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 -- 172.21.15.138:0/56371789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ff2c0 msgr2=0x7f5654195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ff2c0 0x7f5654195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 -- 172.21.15.138:0/56371789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009d00 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5652ffd700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563c00b480 tx=0x7f563c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.043+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563c0118c0 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.044+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565419aaa0 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.044+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f563c010380 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.044+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565419aff0 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.044+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563c00f4f0 con 0x7f56540ffc60 2024-02-15T22:55:42.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.044+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56541085e0 con 0x7f56540ffc60 2024-02-15T22:55:42.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.045+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f563c0104f0 con 0x7f56540ffc60 2024-02-15T22:55:42.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.046+0000 7f5650ff9700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 0x7f564006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:42.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.046+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f563c08cbc0 con 0x7f56540ffc60 2024-02-15T22:55:42.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.046+0000 7f56537fe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 0x7f564006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:42.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.046+0000 7f56537fe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 0x7f564006f9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b830 tx=0x7f564c0097c0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:42.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.050+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f563c0568a0 con 0x7f56540ffc60 2024-02-15T22:55:42.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.266+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f565419b430 con 0x7f564006d520 2024-02-15T22:55:42.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.272+0000 7f5650ff9700 1 -- 172.21.15.138:0/56371789 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f565419b430 con 0x7f564006d520 2024-02-15T22:55:42.274 INFO:teuthology.orchestra.run.smithi138.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 msgr2=0x7f564006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 0x7f564006f9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b830 tx=0x7f564c0097c0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 msgr2=0x7f56541963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f563c00b480 tx=0x7f563c00b840 comp rx=0 tx=0).stop 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 shutdown_connections 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f564006d520 0x7f564006f9d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56540ff2c0 0x7f5654195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 --2- 172.21.15.138:0/56371789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56540ffc60 0x7f56541963a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 >> 172.21.15.138:0/56371789 conn(0x7f56540fab80 msgr2=0x7f5654068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:42.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 shutdown_connections 2024-02-15T22:55:42.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:42.274+0000 7f5659ffe700 1 -- 172.21.15.138:0/56371789 wait complete. 2024-02-15T22:55:43.028 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T22:55:43.029 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T22:55:43.029 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-15T22:55:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:42 smithi138 ceph-mon[29229]: pgmap v126: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:42 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:43.259 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T22:55:43.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:42 smithi170 ceph-mon[35248]: pgmap v126: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:43.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:43.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:42 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:43 smithi138 ceph-mon[29229]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:43.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:43 smithi138 ceph-mon[29229]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:55:43.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:43.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:55:43.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:43 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:44.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:43 smithi170 ceph-mon[35248]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:44.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:43 smithi170 ceph-mon[35248]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:55:44.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:44.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:55:44.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:43 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:45.051 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:44 smithi138 ceph-mon[29229]: pgmap v127: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:45.051 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:44 smithi138 ceph-mon[29229]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:55:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 -- 172.21.15.138:0/791012904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ffd30 msgr2=0x7f03ec103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 --2- 172.21.15.138:0/791012904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ffd30 0x7f03ec103ce0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009910 tx=0x7f03e0009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 -- 172.21.15.138:0/791012904 shutdown_connections 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 --2- 172.21.15.138:0/791012904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ffd30 0x7f03ec103ce0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 --2- 172.21.15.138:0/791012904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ff390 0x7f03ec0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 -- 172.21.15.138:0/791012904 >> 172.21.15.138:0/791012904 conn(0x7f03ec074f50 msgr2=0x7f03ec075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 -- 172.21.15.138:0/791012904 shutdown_connections 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.159+0000 7f03f1286700 1 -- 172.21.15.138:0/791012904 wait complete. 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 Processor -- start 2024-02-15T22:55:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 -- start start 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ffd30 0x7f03ec1012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec101800 con 0x7f03ec0ff390 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03f1286700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec101940 con 0x7f03ec0ffd30 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03eaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38798/0 (socket says 172.21.15.138:38798) 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03eaffd700 1 -- 172.21.15.138:0/3341319093 learned_addr learned my addr 172.21.15.138:0/3341319093 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.160+0000 7f03ea7fc700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ffd30 0x7f03ec1012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03eaffd700 1 -- 172.21.15.138:0/3341319093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ffd30 msgr2=0x7f03ec1012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03eaffd700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ffd30 0x7f03ec1012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03eaffd700 1 -- 172.21.15.138:0/3341319093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00095f0 con 0x7f03ec0ff390 2024-02-15T22:55:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03eaffd700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c930 tx=0x7f03dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc007ad0 con 0x7f03ec0ff390 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec1a1f60 con 0x7f03ec0ff390 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03dc00ce80 con 0x7f03ec0ff390 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc018630 con 0x7f03ec0ff390 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.161+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1a22c0 con 0x7f03ec0ff390 2024-02-15T22:55:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.162+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec04ea50 con 0x7f03ec0ff390 2024-02-15T22:55:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.163+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f03dc007c30 con 0x7f03ec0ff390 2024-02-15T22:55:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.163+0000 7f03d3fff700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 0x7f03d406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.163+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f03dc08ce60 con 0x7f03ec0ff390 2024-02-15T22:55:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.163+0000 7f03ea7fc700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 0x7f03d406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.164+0000 7f03ea7fc700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 0x7f03d406f9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03ec102570 tx=0x7f03e001a040 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.168+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f03dc056bc0 con 0x7f03ec0ff390 2024-02-15T22:55:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:44 smithi170 ceph-mon[35248]: pgmap v127: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:44 smithi170 ceph-mon[35248]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-15T22:55:45.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.390+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec0fcc20 con 0x7f03d406d520 2024-02-15T22:55:45.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.391+0000 7f03d3fff700 1 -- 172.21.15.138:0/3341319093 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f03ec0fcc20 con 0x7f03d406d520 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 msgr2=0x7f03d406f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 0x7f03d406f9d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03ec102570 tx=0x7f03e001a040 comp rx=0 tx=0).stop 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 msgr2=0x7f03ec100d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00c930 tx=0x7f03dc00cc40 comp rx=0 tx=0).stop 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 shutdown_connections 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f03d406d520 0x7f03d406f9d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03ec0ff390 0x7f03ec100d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 --2- 172.21.15.138:0/3341319093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03ec0ffd30 0x7f03ec1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 >> 172.21.15.138:0/3341319093 conn(0x7f03ec074f50 msgr2=0x7f03ec103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:45.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 shutdown_connections 2024-02-15T22:55:45.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.393+0000 7f03f1286700 1 -- 172.21.15.138:0/3341319093 wait complete. 2024-02-15T22:55:45.406 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:55:45.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3320158313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b80ffbb0 msgr2=0x7fb0b80fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3320158313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b80fff80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009940 tx=0x7fb0a8009c50 comp rx=0 tx=0).stop 2024-02-15T22:55:45.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3320158313 shutdown_connections 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3320158313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b81004c0 0x7fb0b810c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3320158313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b80fff80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.501+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3320158313 >> 172.21.15.138:0/3320158313 conn(0x7fb0b8074f50 msgr2=0x7fb0b8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3320158313 shutdown_connections 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3320158313 wait complete. 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 Processor -- start 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 -- start start 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b8198b80 con 0x7fb0b81004c0 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.502+0000 7fb0bdb96700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b819c910 con 0x7fb0b80ffbb0 2024-02-15T22:55:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38818/0 (socket says 172.21.15.138:38818) 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 -- 172.21.15.138:0/3743488830 learned_addr learned my addr 172.21.15.138:0/3743488830 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b77fe700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 -- 172.21.15.138:0/3743488830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b80ffbb0 msgr2=0x7fb0b8197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b8197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 -- 172.21.15.138:0/3743488830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80095f0 con 0x7fb0b81004c0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b6ffd700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00b4b0 tx=0x7fb0ac00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ac011800 con 0x7fb0b81004c0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0ac011e20 con 0x7fb0b81004c0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b819cbf0 con 0x7fb0b81004c0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ac00f2e0 con 0x7fb0b81004c0 2024-02-15T22:55:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.503+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b819d140 con 0x7fb0b81004c0 2024-02-15T22:55:45.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.504+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8109f10 con 0x7fb0b81004c0 2024-02-15T22:55:45.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.505+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7fb0ac010380 con 0x7fb0b81004c0 2024-02-15T22:55:45.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.505+0000 7fb0b4ff9700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 0x7fb0a006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.505+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb0ac08c9e0 con 0x7fb0b81004c0 2024-02-15T22:55:45.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.505+0000 7fb0b77fe700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 0x7fb0a006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.506+0000 7fb0b77fe700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 0x7fb0a006f9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8006010 tx=0x7fb0a800b790 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.510+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7fb0ac056740 con 0x7fb0b81004c0 2024-02-15T22:55:45.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.736+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b819d4d0 con 0x7fb0a006d520 2024-02-15T22:55:45.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.737+0000 7fb0b4ff9700 1 -- 172.21.15.138:0/3743488830 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb0b819d4d0 con 0x7fb0a006d520 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 msgr2=0x7fb0a006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 0x7fb0a006f9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8006010 tx=0x7fb0a800b790 comp rx=0 tx=0).stop 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 msgr2=0x7fb0b81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00b4b0 tx=0x7fb0ac00b7c0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 shutdown_connections 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7fb0a006d520 0x7fb0a006f9d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0b80ffbb0 0x7fb0b8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 --2- 172.21.15.138:0/3743488830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0b81004c0 0x7fb0b81984a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.739+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 >> 172.21.15.138:0/3743488830 conn(0x7fb0b8074f50 msgr2=0x7fb0b80fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:45.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.740+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 shutdown_connections 2024-02-15T22:55:45.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.740+0000 7fb0bdb96700 1 -- 172.21.15.138:0/3743488830 wait complete. 2024-02-15T22:55:45.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 -- 172.21.15.138:0/2361676455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97240ff320 msgr2=0x7f97240ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2361676455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97240ff320 0x7f97240ff790 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9714009910 tx=0x7f9714009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:45.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 -- 172.21.15.138:0/2361676455 shutdown_connections 2024-02-15T22:55:45.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2361676455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97240ff320 0x7f97240ff790 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2361676455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9724103860 0x7f9724103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 -- 172.21.15.138:0/2361676455 >> 172.21.15.138:0/2361676455 conn(0x7f97240748b0 msgr2=0x7f9724074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 -- 172.21.15.138:0/2361676455 shutdown_connections 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.845+0000 7f972c4a5700 1 -- 172.21.15.138:0/2361676455 wait complete. 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 Processor -- start 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 -- start start 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97240ff320 0x7f9724196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724197640 con 0x7f9724103860 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972c4a5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9724197780 con 0x7f97240ff320 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f9729a40700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f9729a40700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38834/0 (socket says 172.21.15.138:38834) 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f9729a40700 1 -- 172.21.15.138:0/2982941435 learned_addr learned my addr 172.21.15.138:0/2982941435 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.846+0000 7f972a241700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97240ff320 0x7f9724196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f9729a40700 1 -- 172.21.15.138:0/2982941435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97240ff320 msgr2=0x7f9724196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f9729a40700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97240ff320 0x7f9724196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f9729a40700 1 -- 172.21.15.138:0/2982941435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97140095f0 con 0x7f9724103860 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f9729a40700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9714005f50 tx=0x7f971400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f971401d070 con 0x7f9724103860 2024-02-15T22:55:45.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f971400b610 con 0x7f9724103860 2024-02-15T22:55:45.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972419fb50 con 0x7f9724103860 2024-02-15T22:55:45.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9714022470 con 0x7f9724103860 2024-02-15T22:55:45.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.847+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972419ffe0 con 0x7f9724103860 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.848+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972404ea50 con 0x7f9724103860 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.849+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f9714003780 con 0x7f9724103860 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.849+0000 7f971b7fe700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 0x7f971006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.849+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f971408e2e0 con 0x7f9724103860 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.849+0000 7f972a241700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 0x7f971006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:45.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.849+0000 7f972a241700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 0x7f971006f9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9720009c60 tx=0x7f9720009260 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:45.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:45.854+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f9714057fa0 con 0x7f9724103860 2024-02-15T22:55:46.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.064+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9724102b60 con 0x7f971006d520 2024-02-15T22:55:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.075+0000 7f971b7fe700 1 -- 172.21.15.138:0/2982941435 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9724102b60 con 0x7f971006d520 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (2m) 66s ago 12m 15.7M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (13m) 66s ago 13m 7998k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (12m) 2m ago 12m 7826k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (13m) 66s ago 13m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (11m) 2m ago 11m 6665k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (71s) 66s ago 12m 57.4M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (7m) 66s ago 7m 72.8M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (7m) 66s ago 7m 136M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (7m) 2m ago 7m 122M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (7m) 2m ago 7m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:55:46.078 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (4m) 66s ago 14m 504M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (3m) 2m ago 11m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (14m) 66s ago 14m 62.8M 2048M 18.2.0 dc2bc1663786 6f1148e5ee6d 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (11m) 2m ago 11m 45.5M 2048M 18.2.0 dc2bc1663786 048fb6f13e25 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (2m) 66s ago 12m 15.9M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (2m) 2m ago 11m 3435k - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (10m) 66s ago 10m 222M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (10m) 66s ago 10m 240M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (10m) 66s ago 10m 195M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (9m) 2m ago 9m 268M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (9m) 2m ago 9m 251M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (8m) 2m ago 8m 224M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:55:46.079 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (2m) 66s ago 12m 62.8M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:55:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 msgr2=0x7f971006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 0x7f971006f9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9720009c60 tx=0x7f9720009260 comp rx=0 tx=0).stop 2024-02-15T22:55:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 msgr2=0x7f9724197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9714005f50 tx=0x7f971400f690 comp rx=0 tx=0).stop 2024-02-15T22:55:46.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 shutdown_connections 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f971006d520 0x7f971006f9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97240ff320 0x7f9724196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 --2- 172.21.15.138:0/2982941435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9724103860 0x7f9724197020 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 >> 172.21.15.138:0/2982941435 conn(0x7f97240748b0 msgr2=0x7f9724102450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 shutdown_connections 2024-02-15T22:55:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.077+0000 7f972c4a5700 1 -- 172.21.15.138:0/2982941435 wait complete. 2024-02-15T22:55:46.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 -- 172.21.15.138:0/1310694568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e481050c0 msgr2=0x7f0e480683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/1310694568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e481050c0 0x7f0e480683d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b0a0 tx=0x7f0e4000b3b0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 -- 172.21.15.138:0/1310694568 shutdown_connections 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/1310694568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e48068910 0x7f0e48068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/1310694568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e481050c0 0x7f0e480683d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 -- 172.21.15.138:0/1310694568 >> 172.21.15.138:0/1310694568 conn(0x7f0e48074f50 msgr2=0x7f0e48075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 -- 172.21.15.138:0/1310694568 shutdown_connections 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.180+0000 7f0e4fee0700 1 -- 172.21.15.138:0/1310694568 wait complete. 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 Processor -- start 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 -- start start 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 0x7f0e4819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4819ce90 con 0x7f0e48068910 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4fee0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4819cfd0 con 0x7f0e481050c0 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4dc7c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4dc7c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38858/0 (socket says 172.21.15.138:38858) 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4dc7c700 1 -- 172.21.15.138:0/3858741783 learned_addr learned my addr 172.21.15.138:0/3858741783 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4d47b700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 0x7f0e4819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.181+0000 7f0e4dc7c700 1 -- 172.21.15.138:0/3858741783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 msgr2=0x7f0e4819c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4dc7c700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 0x7f0e4819c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4dc7c700 1 -- 172.21.15.138:0/3858741783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009d00 con 0x7f0e48068910 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4d47b700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 0x7f0e4819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4dc7c700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000f80 tx=0x7f0e4000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4000e040 con 0x7f0e48068910 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e481a0dc0 con 0x7f0e48068910 2024-02-15T22:55:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e40003e60 con 0x7f0e48068910 2024-02-15T22:55:46.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4001d910 con 0x7f0e48068910 2024-02-15T22:55:46.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.182+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e481a12b0 con 0x7f0e48068910 2024-02-15T22:55:46.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.183+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4810f700 con 0x7f0e48068910 2024-02-15T22:55:46.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.183+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f0e40004820 con 0x7f0e48068910 2024-02-15T22:55:46.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.184+0000 7f0e46ffd700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 0x7f0e3006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.184+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0e4008e850 con 0x7f0e48068910 2024-02-15T22:55:46.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.184+0000 7f0e4d47b700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 0x7f0e3006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.184+0000 7f0e4d47b700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 0x7f0e3006f9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c005fd0 tx=0x7f0e3c005e20 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.188+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f0e40058530 con 0x7f0e48068910 2024-02-15T22:55:46.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.484+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e4810f0e0 con 0x7f0e48068910 2024-02-15T22:55:46.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.485+0000 7f0e46ffd700 1 -- 172.21.15.138:0/3858741783 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f0e4005bbf0 con 0x7f0e48068910 2024-02-15T22:55:46.487 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:55:46.487 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:55:46.487 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:55:46.488 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:55:46.489 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:55:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 msgr2=0x7f0e3006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 0x7f0e3006f9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c005fd0 tx=0x7f0e3c005e20 comp rx=0 tx=0).stop 2024-02-15T22:55:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 msgr2=0x7f0e4819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000f80 tx=0x7f0e4000cdd0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 shutdown_connections 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f0e3006d520 0x7f0e3006f9d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e48068910 0x7f0e4819c300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 --2- 172.21.15.138:0/3858741783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e481050c0 0x7f0e4819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 >> 172.21.15.138:0/3858741783 conn(0x7f0e48074f50 msgr2=0x7f0e480fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 shutdown_connections 2024-02-15T22:55:46.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.487+0000 7f0e4fee0700 1 -- 172.21.15.138:0/3858741783 wait complete. 2024-02-15T22:55:46.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- 172.21.15.138:0/1756407085 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 msgr2=0x7f49d0103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 --2- 172.21.15.138:0/1756407085 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d0103ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009910 tx=0x7f49c0009c20 comp rx=0 tx=0).stop 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- 172.21.15.138:0/1756407085 shutdown_connections 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 --2- 172.21.15.138:0/1756407085 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d0103ce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 --2- 172.21.15.138:0/1756407085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 0x7f49d00ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- 172.21.15.138:0/1756407085 >> 172.21.15.138:0/1756407085 conn(0x7f49d0074f50 msgr2=0x7f49d0075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- 172.21.15.138:0/1756407085 shutdown_connections 2024-02-15T22:55:46.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- 172.21.15.138:0/1756407085 wait complete. 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 Processor -- start 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.595+0000 7f49d74d7700 1 -- start start 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d74d7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 0x7f49d0195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d74d7700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d74d7700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01969b0 con 0x7f49d00ffd30 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d74d7700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d019a740 con 0x7f49d00ff390 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38870/0 (socket says 172.21.15.138:38870) 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 -- 172.21.15.138:0/3889116278 learned_addr learned my addr 172.21.15.138:0/3889116278 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d5273700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 0x7f49d0195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 -- 172.21.15.138:0/3889116278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 msgr2=0x7f49d0195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 0x7f49d0195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 -- 172.21.15.138:0/3889116278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c00095f0 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d4a72700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f49c00092e0 tx=0x7f49c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c001d070 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d019a9c0 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49c0005dc0 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.596+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c0017400 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.597+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d019aeb0 con 0x7f49d00ffd30 2024-02-15T22:55:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.597+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d004ea50 con 0x7f49d00ffd30 2024-02-15T22:55:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.598+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f49c000f6f0 con 0x7f49d00ffd30 2024-02-15T22:55:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.599+0000 7f49c67fc700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 0x7f49bc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.599+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f49c008e520 con 0x7f49d00ffd30 2024-02-15T22:55:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.599+0000 7f49d5273700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 0x7f49bc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.599+0000 7f49d5273700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 0x7f49bc06f9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005950 tx=0x7f49cc00b410 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.607+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f49c0058280 con 0x7f49d00ffd30 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.862+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f49d01970f0 con 0x7f49d00ffd30 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.862+0000 7f49c67fc700 1 -- 172.21.15.138:0/3889116278 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f49c005b940 con 0x7f49d00ffd30 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:55:46.865 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:55:46.866 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:46.867 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:46.868 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:46.868 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:46.868 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:55:46.868 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 msgr2=0x7f49bc06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 0x7f49bc06f9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005950 tx=0x7f49cc00b410 comp rx=0 tx=0).stop 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 msgr2=0x7f49d01962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f49c00092e0 tx=0x7f49c000bd70 comp rx=0 tx=0).stop 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 shutdown_connections 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f49bc06d520 0x7f49bc06f9d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49d00ff390 0x7f49d0195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 --2- 172.21.15.138:0/3889116278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49d00ffd30 0x7f49d01962d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 >> 172.21.15.138:0/3889116278 conn(0x7f49d0074f50 msgr2=0x7f49d0103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 shutdown_connections 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.864+0000 7f49d74d7700 1 -- 172.21.15.138:0/3889116278 wait complete. 2024-02-15T22:55:46.869 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:55:46.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- 172.21.15.138:0/601563567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c101cb0 msgr2=0x7f339c10a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 --2- 172.21.15.138:0/601563567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c101cb0 0x7f339c10a1b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3384009940 tx=0x7f3384009c50 comp rx=0 tx=0).stop 2024-02-15T22:55:46.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- 172.21.15.138:0/601563567 shutdown_connections 2024-02-15T22:55:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 --2- 172.21.15.138:0/601563567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c101cb0 0x7f339c10a1b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 --2- 172.21.15.138:0/601563567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c1013a0 0x7f339c101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- 172.21.15.138:0/601563567 >> 172.21.15.138:0/601563567 conn(0x7f339c0fabe0 msgr2=0x7f339c0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- 172.21.15.138:0/601563567 shutdown_connections 2024-02-15T22:55:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- 172.21.15.138:0/601563567 wait complete. 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 Processor -- start 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.970+0000 7f33a2332700 1 -- start start 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33a2332700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33a2332700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c101cb0 0x7f339c0ff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33a2332700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0ffa80 con 0x7f339c1013a0 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33a2332700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0ffbc0 con 0x7f339c101cb0 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38880/0 (socket says 172.21.15.138:38880) 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 -- 172.21.15.138:0/2331741725 learned_addr learned my addr 172.21.15.138:0/2331741725 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339b7fe700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c101cb0 0x7f339c0ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 -- 172.21.15.138:0/2331741725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c101cb0 msgr2=0x7f339c0ff540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c101cb0 0x7f339c0ff540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 -- 172.21.15.138:0/2331741725 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840095f0 con 0x7f339c1013a0 2024-02-15T22:55:46.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f339bfff700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f338c00d900 tx=0x7f338c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c0041f0 con 0x7f339c1013a0 2024-02-15T22:55:46.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c1a1ee0 con 0x7f339c1013a0 2024-02-15T22:55:46.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f338c004cf0 con 0x7f339c1013a0 2024-02-15T22:55:46.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.971+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c00b750 con 0x7f339c1013a0 2024-02-15T22:55:46.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.972+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c1a2290 con 0x7f339c1013a0 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.972+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c107820 con 0x7f339c1013a0 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.973+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f338c004750 con 0x7f339c1013a0 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.973+0000 7f33997fa700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 0x7f338806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.973+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f338c08cdd0 con 0x7f339c1013a0 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.973+0000 7f339b7fe700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 0x7f338806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.974+0000 7f339b7fe700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 0x7f338806f9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f338400b870 tx=0x7f3384005ea0 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:46.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:46.978+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f338c056ab0 con 0x7f339c1013a0 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: pgmap v128: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:55:47.155 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:46 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3858741783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:47.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.206+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 --> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f339c02cd20 con 0x7f338806d520 2024-02-15T22:55:47.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.207+0000 7f33997fa700 1 -- 172.21.15.138:0/2331741725 <== mgr.14638 v2:172.21.15.138:6800/299484414 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f339c02cd20 con 0x7f338806d520 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "2/23 daemons upgraded", 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:55:47.210 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:55:47.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 msgr2=0x7f338806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 0x7f338806f9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f338400b870 tx=0x7f3384005ea0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 msgr2=0x7f339c0ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f338c00d900 tx=0x7f338c00dc10 comp rx=0 tx=0).stop 2024-02-15T22:55:47.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 shutdown_connections 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f338806d520 0x7f338806f9d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f339c1013a0 0x7f339c0ff000 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.209+0000 7f33a2332700 1 --2- 172.21.15.138:0/2331741725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c101cb0 0x7f339c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.210+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 >> 172.21.15.138:0/2331741725 conn(0x7f339c0fabe0 msgr2=0x7f339c104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.210+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 shutdown_connections 2024-02-15T22:55:47.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.210+0000 7f33a2332700 1 -- 172.21.15.138:0/2331741725 wait complete. 2024-02-15T22:55:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: pgmap v128: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:55:47.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:46 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3858741783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:55:47.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3472764847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100370 msgr2=0x7f7ff8100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3472764847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100370 0x7f7ff8100740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000b0a0 tx=0x7f7ff000b3b0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3472764847 shutdown_connections 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3472764847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100c80 0x7f7ff81093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3472764847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100370 0x7f7ff8100740 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3472764847 >> 172.21.15.138:0/3472764847 conn(0x7f7ff80747e0 msgr2=0x7f7ff8074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3472764847 shutdown_connections 2024-02-15T22:55:47.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.319+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3472764847 wait complete. 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 Processor -- start 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 -- start start 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100370 0x7f7ff8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8102760 con 0x7f7ff8100c80 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ffd41a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff81028a0 con 0x7f7ff8100370 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38890/0 (socket says 172.21.15.138:38890) 2024-02-15T22:55:47.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3894164667 learned_addr learned my addr 172.21.15.138:0/3894164667 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff6ffd700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100370 0x7f7ff8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3894164667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100370 msgr2=0x7f7ff8101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100370 0x7f7ff8101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.320+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3894164667 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009d00 con 0x7f7ff8100c80 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7ff67fc700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b4b0 tx=0x7f7fec00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec011800 con 0x7f7ff8100c80 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fec011e20 con 0x7f7ff8100c80 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec00f2e0 con 0x7f7ff8100c80 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff81a1fc0 con 0x7f7ff8100c80 2024-02-15T22:55:47.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.321+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff81a2370 con 0x7f7ff8100c80 2024-02-15T22:55:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.322+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff804ea50 con 0x7f7ff8100c80 2024-02-15T22:55:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.322+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 32) v1 ==== 91348+0+0 (secure 0 0 0) 0x7f7fec010380 con 0x7f7ff8100c80 2024-02-15T22:55:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.323+0000 7f7fdffff700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 0x7f7fe006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:55:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.323+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7fec08c940 con 0x7f7ff8100c80 2024-02-15T22:55:47.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.323+0000 7f7ff6ffd700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 0x7f7fe006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:55:47.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.323+0000 7f7ff6ffd700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 0x7f7fe006f9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0006090 tx=0x7f7ff0006000 comp rx=0 tx=0).ready entity=mgr.14638 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:55:47.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.327+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182845 (secure 0 0 0) 0x7f7fec0566a0 con 0x7f7ff8100c80 2024-02-15T22:55:47.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.618+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ff81031c0 con 0x7f7ff8100c80 2024-02-15T22:55:47.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.619+0000 7f7fdffff700 1 -- 172.21.15.138:0/3894164667 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7fec059d60 con 0x7f7ff8100c80 2024-02-15T22:55:47.622 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 msgr2=0x7f7fe006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 0x7f7fe006f9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0006090 tx=0x7f7ff0006000 comp rx=0 tx=0).stop 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 msgr2=0x7f7ff8102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b4b0 tx=0x7f7fec00b7c0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 shutdown_connections 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:6800/299484414,v1:172.21.15.138:6801/299484414] conn(0x7f7fe006d520 0x7f7fe006f9d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ff8100370 0x7f7ff8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 --2- 172.21.15.138:0/3894164667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ff8100c80 0x7f7ff8102220 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:55:47.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 >> 172.21.15.138:0/3894164667 conn(0x7f7ff80747e0 msgr2=0x7f7ff80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:55:47.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 shutdown_connections 2024-02-15T22:55:47.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:55:47.621+0000 7f7ffd41a700 1 -- 172.21.15.138:0/3894164667 wait complete. 2024-02-15T22:55:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:47 smithi138 ceph-mon[29229]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-15T22:55:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:47 smithi138 ceph-mon[29229]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:55:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:47 smithi138 ceph-mon[29229]: Upgrade: Setting container_image for all mgr 2024-02-15T22:55:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:47 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3889116278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:55:48.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:47 smithi138 ceph-mon[29229]: from='client.? 172.21.15.138:0/3894164667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:55:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:47 smithi170 ceph-mon[35248]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-15T22:55:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:47 smithi170 ceph-mon[35248]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-15T22:55:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:47 smithi170 ceph-mon[35248]: Upgrade: Setting container_image for all mgr 2024-02-15T22:55:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:47 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3889116278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:55:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:47 smithi170 ceph-mon[35248]: from='client.? 172.21.15.138:0/3894164667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:55:49.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: pgmap v129: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: Upgrade: Updating mon.smithi138 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:48 smithi138 ceph-mon[29229]: Deploying daemon mon.smithi138 on smithi138 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: pgmap v129: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: Upgrade: Updating mon.smithi138 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:55:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:48 smithi170 ceph-mon[35248]: Deploying daemon mon.smithi138 on smithi138 2024-02-15T22:55:50.047 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:49 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:55:50.406 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[29225]: 2024-02-15T22:55:50.044+0000 7ffbc45de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:55:50.406 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[29225]: 2024-02-15T22:55:50.044+0000 7ffbc45de700 -1 mon.smithi138@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T22:55:50.406 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 podman[89351]: 2024-02-15 22:55:50.116203849 +0000 UTC m=+0.207902787 container died 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD) 2024-02-15T22:55:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 podman[89351]: 2024-02-15 22:55:50.536600146 +0000 UTC m=+0.628299090 container cleanup 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-15T22:55:50.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 bash[89351]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138 2024-02-15T22:55:51.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 podman[89376]: 2024-02-15 22:55:50.771610131 +0000 UTC m=+0.653911335 container remove 6f1148e5ee6db04053debba58ff82d1eab01f7818674158f0ce1065840bc77a7 (image=quay.io/ceph/ceph:v18.2.0, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-15T22:55:51.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service: Deactivated successfully. 2024-02-15T22:55:51.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 systemd[1]: Stopped Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:55:51.215 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:50 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service: Consumed 14.198s CPU time. 2024-02-15T22:55:51.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 systemd[1]: Starting Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:55:51.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 podman[89508]: 2024-02-15 22:55:51.414685822 +0000 UTC m=+0.099982500 container create 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-02-15T22:55:51.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 podman[89508]: 2024-02-15 22:55:51.332912906 +0000 UTC m=+0.018209542 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:55:51.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 podman[89508]: 2024-02-15 22:55:51.759255444 +0000 UTC m=+0.444552083 container init 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-15T22:55:51.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 podman[89508]: 2024-02-15 22:55:51.76253518 +0000 UTC m=+0.447831819 container start 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-02-15T22:55:51.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:55:51.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-15T22:55:51.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: pidfile_write: ignore empty --pid-file 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: load: jerasure load: lrc 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: RocksDB version: 7.9.2 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Git sha 0 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: DB SUMMARY 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: DB Session ID: 2O5VN2CQDV6XTXCG7UO0 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:55:51.795 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1502 Bytes 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi138/store.db dir, Total Num: 1, files: 000032.sst 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi138/store.db: 000030.log size: 3916806 ; 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.env: 0x55b1e6e26ae0 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.fs: PosixFileSystem 2024-02-15T22:55:51.796 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.info_log: 0x55b1e8fcb760 2024-02-15T22:55:51.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:55:51.797 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.statistics: (nil) 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.use_fsync: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:55:51.798 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.db_log_dir: 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.wal_dir: 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.write_buffer_manager: 0x55b1e8f9f400 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:55:51.799 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.unordered_write: 0 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.row_cache: None 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.wal_filter: None 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:55:51.800 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.wal_compression: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-15T22:55:51.801 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_open_files: -1 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:55:51.802 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Compression algorithms supported: 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kZSTD supported: 0 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:55:51.803 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000015 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:55:51.804 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.merge_operator: 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_filter: None 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b1e8fcb880) 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_type: 0 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_index_type: 0 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_shortening: 1 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:55:51.805 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: checksum: 4 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: no_block_cache: 0 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache: 0x55b1e8fcf090 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_options: 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: capacity : 536870912 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_shard_bits : 4 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: strict_capacity_limit : 0 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_cache_compressed: (nil) 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: persistent_cache: (nil) 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size: 4096 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_size_deviation: 10 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_restart_interval: 16 2024-02-15T22:55:51.806 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: index_block_restart_interval: 1 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: metadata_block_size: 4096 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: partition_filters: 0 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: use_delta_encoding: 1 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: filter_policy: bloomfilter 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: whole_key_filtering: 1 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: verify_compression: 0 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: format_version: 5 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_index_compression: 1 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: block_align: 0 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_auto_readahead_size: 262144 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: prepopulate_block_cache: 0 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: initial_auto_readahead_size: 8192 2024-02-15T22:55:51.807 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: num_file_reads_for_auto_readahead: 2 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression: NoCompression 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.num_levels: 7 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:55:51.808 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:55:51.809 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:55:51.810 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.arena_block_size: 1048576 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:55:51.811 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:55:51.812 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.ttl: 2592000 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-15T22:55:51.813 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.blob_file_starting_level: 0 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi138/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12099, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-02-15T22:55:51.814 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a8152ccf-1195-4574-a017-cbda5479be72 2024-02-15T22:55:51.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037751791883, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-02-15T22:55:51.815 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037751803706, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3428843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12100, "largest_seqno": 15657, "table_properties": {"data_size": 3415369, "index_size": 8549, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3909, "raw_key_size": 33504, "raw_average_key_size": 21, "raw_value_size": 3385026, "raw_average_value_size": 2202, "num_data_blocks": 388, "num_entries": 1537, "num_filter_entries": 1537, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708037751, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a8152ccf-1195-4574-a017-cbda5479be72", "db_session_id": "2O5VN2CQDV6XTXCG7UO0", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037751803829, "job": 1, "event": "recovery_finished"} 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi138/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:55:52.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b1e90be000 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: DB pointer 0x55b1e90aa000 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** DB Stats ** 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.236 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: L0 1/0 3.27 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: L6 1/0 5.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Sum 2/0 9.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** Compaction Stats [default] ** 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 653.3 0.01 0.00 1 0.005 0 0 0.0 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.237 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Cumulative compaction: 0.00 GB write, 174.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Interval compaction: 0.00 GB write, 174.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache BinnedLRUCache@0x55b1e8fcf090#2 capacity: 512.00 MB usage: 13.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: starting mon.smithi138 rank 0 at public addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] at bind addrs [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi138 fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:55:52.238 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???) e2 preinit fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).mds e23 new map 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).mds e23 print_map 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: e23 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: legacy client fscid: 1 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: Filesystem 'cephfs' (1) 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: fs_name cephfs 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: epoch 23 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:55:52.239 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: tableserver 0 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: root 0 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: session_timeout 60 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: session_autoclose 300 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_file_size 1099511627776 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_xattr_size 65536 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: required_client_features {} 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: last_failure 0 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: last_failure_osd_epoch 46 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: max_mds 2 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: in 0,1 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: up {0=14476,1=24273} 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: failed 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: damaged 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: stopped 2024-02-15T22:55:52.240 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: data_pools [3] 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: metadata_pool 2 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: inline_data disabled 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: balancer 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: bal_rank_mask -1 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: standby_count_wanted 1 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: [mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout: 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:55:52.241 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:55:52.242 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 ceph-mon[89527]: mon.smithi138@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-15T22:55:52.242 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 bash[89508]: 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 2024-02-15T22:55:52.242 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:51 smithi138 systemd[1]: Started Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:55:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: pgmap v131: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: mon.smithi138 calling monitor election 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: monmap e2: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:53.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:55:53.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: mgrmap e32: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:55:53.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: overall HEALTH_OK 2024-02-15T22:55:53.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: from='mgr.14638 ' entity='' 2024-02-15T22:55:53.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:55:53 smithi138 ceph-mon[89527]: mgrmap e33: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: from='mgr.14638 172.21.15.138:0/2108176640' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: pgmap v131: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: mon.smithi138 calling monitor election 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: monmap e2: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: osdmap e48: 6 total, 6 up, 6 in 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: mgrmap e32: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: overall HEALTH_OK 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: from='mgr.14638 ' entity='' 2024-02-15T22:55:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:55:53 smithi170 ceph-mon[35248]: mgrmap e33: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:56:00.376 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:56:00.376 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:56:00.377 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:56:00.377 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:56:00.377 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:56:00.377 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:00 smithi170 ceph-mon[35248]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:56:00.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: Standby manager daemon smithi170.gczrzt restarted 2024-02-15T22:56:00.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: Standby manager daemon smithi170.gczrzt started 2024-02-15T22:56:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/crt"}]: dispatch 2024-02-15T22:56:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T22:56:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi170.gczrzt/key"}]: dispatch 2024-02-15T22:56:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:00 smithi138 ceph-mon[89527]: from='mgr.? 172.21.15.170:0/3588215799' entity='mgr.smithi170.gczrzt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T22:56:01.473 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: mgrmap e34: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: Active manager daemon smithi138.jqscxs restarted 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: mgrmap e35: smithi138.jqscxs(active, starting, since 0.00635072s), standbys: smithi170.gczrzt 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:56:01.474 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:56:01.475 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:01 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:56:01.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: mgrmap e34: smithi138.jqscxs(active, since 4m), standbys: smithi170.gczrzt 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: Active manager daemon smithi138.jqscxs restarted 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: Activating manager daemon smithi138.jqscxs 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: mgrmap e35: smithi138.jqscxs(active, starting, since 0.00635072s), standbys: smithi170.gczrzt 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi138.jqscxs", "id": "smithi138.jqscxs"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr metadata", "who": "smithi170.gczrzt", "id": "smithi170.gczrzt"}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:56:01.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: Manager daemon smithi138.jqscxs is now available 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/mirror_snapshot_schedule"}]: dispatch 2024-02-15T22:56:01.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi138.jqscxs/trash_purge_schedule"}]: dispatch 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: [15/Feb/2024:22:56:00] ENGINE Bus STARTING 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: [15/Feb/2024:22:56:00] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: [15/Feb/2024:22:56:00] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: [15/Feb/2024:22:56:00] ENGINE Bus STARTED 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: mgrmap e36: smithi138.jqscxs(active, since 1.00898s), standbys: smithi170.gczrzt 2024-02-15T22:56:02.391 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:02 smithi138 ceph-mon[89527]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: [15/Feb/2024:22:56:00] ENGINE Bus STARTING 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: [15/Feb/2024:22:56:00] ENGINE Serving on http://172.21.15.138:8765 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: [15/Feb/2024:22:56:00] ENGINE Serving on https://172.21.15.138:7150 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: [15/Feb/2024:22:56:00] ENGINE Bus STARTED 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: mgrmap e36: smithi138.jqscxs(active, since 1.00898s), standbys: smithi170.gczrzt 2024-02-15T22:56:02.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:02 smithi170 ceph-mon[35248]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:03.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:03 smithi138 ceph-mon[89527]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:03.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:03 smithi170 ceph-mon[35248]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:04 smithi138 ceph-mon[89527]: mgrmap e37: smithi138.jqscxs(active, since 3s), standbys: smithi170.gczrzt 2024-02-15T22:56:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:04 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:04.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:04 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:04 smithi170 ceph-mon[35248]: mgrmap e37: smithi138.jqscxs(active, since 3s), standbys: smithi170.gczrzt 2024-02-15T22:56:04.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:04 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:04.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:04 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:05.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:05 smithi138 ceph-mon[89527]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:05.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:05.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:05 smithi170 ceph-mon[35248]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:05 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:05.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:05 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:06.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:06 smithi138 ceph-mon[89527]: mgrmap e38: smithi138.jqscxs(active, since 5s), standbys: smithi170.gczrzt 2024-02-15T22:56:06.529 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:06 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:06.529 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:06 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:06.530 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:06 smithi170 ceph-mon[35248]: mgrmap e38: smithi138.jqscxs(active, since 5s), standbys: smithi170.gczrzt 2024-02-15T22:56:06.530 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:06 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:06.530 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:06 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:07 smithi138 ceph-mon[89527]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:07 smithi170 ceph-mon[35248]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:56:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:07 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:07 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:09.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:09 smithi138 ceph-mon[89527]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-15T22:56:09.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:09 smithi170 ceph-mon[35248]: pgmap v7: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-15T22:56:11.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:11 smithi138 ceph-mon[89527]: pgmap v8: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-15T22:56:11.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:11.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:11.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:11.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:56:11.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:11 smithi170 ceph-mon[35248]: pgmap v8: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-15T22:56:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:11 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:11 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:11 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:11.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:11 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Detected new or changed devices on smithi138 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:56:12.453 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:12.454 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:12 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:56:12.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Detected new or changed devices on smithi138 2024-02-15T22:56:12.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi138:/etc/ceph/ceph.conf 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi170:/etc/ceph/ceph.conf 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.conf 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: Updating smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/config/ceph.client.admin.keyring 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:12.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:12.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T22:56:13.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:13 smithi138 ceph-mon[89527]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:56:13.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:13 smithi170 ceph-mon[35248]: pgmap v9: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:56:14.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:14 smithi138 ceph-mon[89527]: Upgrade: Updating mon.smithi170 2024-02-15T22:56:14.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:14 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:14.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:14 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:14.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:14 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:14.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:14 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:14.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:14 smithi170 ceph-mon[35248]: Upgrade: Updating mon.smithi170 2024-02-15T22:56:14.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:14 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:14.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:14 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:14.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:14 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:14.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:14 smithi170 ceph-mon[35248]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:15.217 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 systemd[1]: Stopping Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:56:15.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:15 smithi138 ceph-mon[89527]: Deploying daemon mon.smithi170 on smithi170 2024-02-15T22:56:15.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:15 smithi138 ceph-mon[89527]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-15T22:56:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 ceph-mon[35248]: Deploying daemon mon.smithi170 on smithi170 2024-02-15T22:56:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 ceph-mon[35248]: pgmap v10: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-15T22:56:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170[35237]: 2024-02-15T22:56:15.299+0000 7f6d885a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi170 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:56:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170[35237]: 2024-02-15T22:56:15.299+0000 7f6d885a1700 -1 mon.smithi170@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T22:56:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 podman[67486]: 2024-02-15 22:56:15.43303649 +0000 UTC m=+0.228870189 container died 048fb6f13e25a93a13c44d6d4d74aa8ecc12dc6f0503bfad9569d0a4aea28a9c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-15T22:56:16.078 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 podman[67486]: 2024-02-15 22:56:15.783203658 +0000 UTC m=+0.579037331 container cleanup 048fb6f13e25a93a13c44d6d4d74aa8ecc12dc6f0503bfad9569d0a4aea28a9c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-15T22:56:16.078 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:15 smithi170 bash[67486]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170 2024-02-15T22:56:16.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 podman[67500]: 2024-02-15 22:56:16.076355122 +0000 UTC m=+0.638426788 container remove 048fb6f13e25a93a13c44d6d4d74aa8ecc12dc6f0503bfad9569d0a4aea28a9c (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-02-15T22:56:16.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi170.service: Deactivated successfully. 2024-02-15T22:56:16.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 systemd[1]: Stopped Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:56:16.419 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi170.service: Consumed 7.972s CPU time. 2024-02-15T22:56:16.669 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 systemd[1]: Starting Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:56:16.669 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 podman[67633]: 2024-02-15 22:56:16.534096534 +0000 UTC m=+0.017622770 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:56:16.669 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 podman[67633]: 2024-02-15 22:56:16.633001612 +0000 UTC m=+0.116527848 container create c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 podman[67633]: 2024-02-15 22:56:16.838420105 +0000 UTC m=+0.321946341 container init c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 podman[67633]: 2024-02-15 22:56:16.841533972 +0000 UTC m=+0.325060217 container start c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: set uid:gid to 167:167 (ceph:ceph) 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: pidfile_write: ignore empty --pid-file 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: load: jerasure load: lrc 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: RocksDB version: 7.9.2 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Git sha 0 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: DB SUMMARY 2024-02-15T22:56:16.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: DB Session ID: GZ9JCAPMEQ2V8ICFYFSI 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: CURRENT file: CURRENT 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: IDENTITY file: IDENTITY 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1396 Bytes 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi170/store.db dir, Total Num: 1, files: 000027.sst 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi170/store.db: 000025.log size: 8761957 ; 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.error_if_exists: 0 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.create_if_missing: 0 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.paranoid_checks: 1 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.env: 0x5624cc049ae0 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.fs: PosixFileSystem 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.info_log: 0x5624ce817760 2024-02-15T22:56:16.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_file_opening_threads: 16 2024-02-15T22:56:16.877 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.statistics: (nil) 2024-02-15T22:56:16.877 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.use_fsync: 0 2024-02-15T22:56:16.877 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_log_file_size: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.keep_log_file_num: 1000 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.recycle_log_file_num: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_fallocate: 1 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_mmap_reads: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_mmap_writes: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.use_direct_reads: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.create_missing_column_families: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.db_log_dir: 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.wal_dir: 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T22:56:16.878 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.advise_random_on_open: 1 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.db_write_buffer_size: 0 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.write_buffer_manager: 0x5624ce7eb400 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.rate_limiter: (nil) 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.wal_recovery_mode: 2 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enable_thread_tracking: 0 2024-02-15T22:56:16.879 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enable_pipelined_write: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.unordered_write: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.row_cache: None 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.wal_filter: None 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_ingest_behind: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.two_write_queues: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.manual_wal_flush: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.wal_compression: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.atomic_flush: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T22:56:16.880 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.log_readahead_size: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.best_efforts_recovery: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.allow_data_in_errors: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.db_host_id: __hostname__ 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_background_jobs: 2 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_background_compactions: -1 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_subcompactions: 1 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T22:56:16.881 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_total_wal_size: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_open_files: -1 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bytes_per_sync: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_readahead_size: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_background_flushes: -1 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Compression algorithms supported: 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T22:56:16.882 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kZSTD supported: 0 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kXpressCompression supported: 0 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kLZ4HCCompression supported: 1 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kZlibCompression supported: 1 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kSnappyCompression supported: 1 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kLZ4Compression supported: 1 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: kBZip2Compression supported: 0 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000010 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.merge_operator: 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_filter: None 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_filter_factory: None 2024-02-15T22:56:16.883 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.sst_partitioner_factory: None 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5624ce817880) 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_type: 0 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_index_type: 0 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_shortening: 1 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: checksum: 4 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: no_block_cache: 0 2024-02-15T22:56:16.884 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache: 0x5624ce81b090 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_options: 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: capacity : 536870912 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_shard_bits : 4 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: strict_capacity_limit : 0 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_cache_compressed: (nil) 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: persistent_cache: (nil) 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size: 4096 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_size_deviation: 10 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_restart_interval: 16 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: index_block_restart_interval: 1 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: metadata_block_size: 4096 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: partition_filters: 0 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: use_delta_encoding: 1 2024-02-15T22:56:16.885 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: filter_policy: bloomfilter 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: whole_key_filtering: 1 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: verify_compression: 0 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: format_version: 5 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_index_compression: 1 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: block_align: 0 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_auto_readahead_size: 262144 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: prepopulate_block_cache: 0 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: initial_auto_readahead_size: 8192 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.write_buffer_size: 33554432 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_write_buffer_number: 2 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression: NoCompression 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression: Disabled 2024-02-15T22:56:16.886 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.prefix_extractor: nullptr 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.num_levels: 7 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:56:16.887 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.level: 32767 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.strategy: 0 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.enabled: false 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.target_file_size_base: 67108864 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T22:56:16.888 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T22:56:16.889 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T22:56:16.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T22:56:16.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T22:56:16.938 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.arena_block_size: 1048576 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.disable_auto_compactions: 0 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.table_properties_collectors: 2024-02-15T22:56:16.939 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.inplace_update_support: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.bloom_locality: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.max_successive_merges: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.paranoid_file_checks: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.force_consistency_checks: 1 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.report_bg_io_stats: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.ttl: 2592000 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-15T22:56:16.940 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enable_blob_files: false 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.min_blob_size: 0 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_file_size: 268435456 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.blob_file_starting_level: 0 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi170/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12121, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4584523c-e57a-4f63-997a-a1ea4c2d7b5a 2024-02-15T22:56:16.941 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037776870441, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037776891529, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 5242547, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12126, "largest_seqno": 16566, "table_properties": {"data_size": 5227056, "index_size": 10054, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4421, "raw_key_size": 38256, "raw_average_key_size": 21, "raw_value_size": 5192357, "raw_average_value_size": 2980, "num_data_blocks": 453, "num_entries": 1742, "num_filter_entries": 1742, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708037776, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4584523c-e57a-4f63-997a-a1ea4c2d7b5a", "db_session_id": "GZ9JCAPMEQ2V8ICFYFSI", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708037776891655, "job": 1, "event": "recovery_finished"} 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi170/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5624ce90a000 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: DB pointer 0x5624ce8f6000 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** DB Stats ** 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:56:16.942 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: L0 1/0 5.00 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 620.0 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: L6 1/0 5.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Sum 2/0 10.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 620.0 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 620.0 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** Compaction Stats [default] ** 2024-02-15T22:56:16.943 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 620.0 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Cumulative compaction: 0.00 GB write, 209.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Interval compaction: 0.00 GB write, 209.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T22:56:16.944 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache BinnedLRUCache@0x5624ce81b090#2 capacity: 512.00 MB usage: 14.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,10.08 KB,0.00192225%) Misc(1,0.00 KB,0%) 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: starting mon.smithi170 rank 1 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi170 fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???) e2 preinit fsid 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).mds e23 new map 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).mds e23 print_map 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: e23 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: legacy client fscid: 1 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: Filesystem 'cephfs' (1) 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: fs_name cephfs 2024-02-15T22:56:16.945 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: epoch 23 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: tableserver 0 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: root 0 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: session_timeout 60 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: session_autoclose 300 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_file_size 1099511627776 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_xattr_size 65536 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: required_client_features {} 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: last_failure 0 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: last_failure_osd_epoch 46 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: max_mds 2 2024-02-15T22:56:16.946 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: in 0,1 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: up {0=14476,1=24273} 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: failed 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: damaged 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: stopped 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: data_pools [3] 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: metadata_pool 2 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: inline_data disabled 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: balancer 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: bal_rank_mask -1 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: standby_count_wanted 1 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: [mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:16.947 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout: 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 ceph-mon[67652]: mon.smithi170@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-02-15T22:56:16.948 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 bash[67633]: c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 2024-02-15T22:56:17.231 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:16 smithi170 systemd[1]: Started Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 -- 172.21.15.138:0/3627369146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d041003d0 msgr2=0x7f3d041007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/3627369146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d041003d0 0x7f3d041007a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009910 tx=0x7f3d00009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 -- 172.21.15.138:0/3627369146 shutdown_connections 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/3627369146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d04100d70 0x7f3d04104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/3627369146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d041003d0 0x7f3d041007a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 -- 172.21.15.138:0/3627369146 >> 172.21.15.138:0/3627369146 conn(0x7f3d040fbc90 msgr2=0x7f3d040fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:17.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 -- 172.21.15.138:0/3627369146 shutdown_connections 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.740+0000 7f3d0c70a700 1 -- 172.21.15.138:0/3627369146 wait complete. 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 Processor -- start 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 -- start start 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04073ad0 con 0x7f3d04100d70 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0c70a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04073c10 con 0x7f3d041003d0 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35894/0 (socket says 172.21.15.138:35894) 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 -- 172.21.15.138:0/2135490527 learned_addr learned my addr 172.21.15.138:0/2135490527 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0a4a6700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0a4a6700 1 -- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 msgr2=0x7f3d04073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0a4a6700 1 -- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 msgr2=0x7f3d04073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:17.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0a4a6700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d0a4a6700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 -- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 msgr2=0x7f3d04073050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.741+0000 7f3d09ca5700 1 -- 172.21.15.138:0/2135490527 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000095f0 con 0x7f3d04100d70 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3d09ca5700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400d900 tx=0x7f3cf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf4004a00 con 0x7f3d04100d70 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cf40054e0 con 0x7f3d04100d70 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d041a1fe0 con 0x7f3d04100d70 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf4009d00 con 0x7f3d04100d70 2024-02-15T22:56:17.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.742+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d041a2390 con 0x7f3d04100d70 2024-02-15T22:56:17.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.743+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d041086e0 con 0x7f3d04100d70 2024-02-15T22:56:17.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.744+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f3cf4005020 con 0x7f3d04100d70 2024-02-15T22:56:17.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.744+0000 7f3cfb7fe700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 0x7f3cf006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:17.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.744+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3cf408d910 con 0x7f3d04100d70 2024-02-15T22:56:17.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.744+0000 7f3d0a4a6700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 0x7f3cf006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:17.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.745+0000 7f3d0a4a6700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 0x7f3cf006fe80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d00006010 tx=0x7f3d0001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:17.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.750+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3cf4056f50 con 0x7f3d04100d70 2024-02-15T22:56:17.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.970+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d0402cca0 con 0x7f3cf006d9d0 2024-02-15T22:56:17.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.971+0000 7f3cfb7fe700 1 -- 172.21.15.138:0/2135490527 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3d0402cca0 con 0x7f3cf006d9d0 2024-02-15T22:56:17.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 msgr2=0x7f3cf006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:17.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 0x7f3cf006fe80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d00006010 tx=0x7f3d0001a040 comp rx=0 tx=0).stop 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 msgr2=0x7f3d04073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400d900 tx=0x7f3cf400dcc0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 shutdown_connections 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3cf006d9d0 0x7f3cf006fe80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d041003d0 0x7f3d04073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 --2- 172.21.15.138:0/2135490527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d04100d70 0x7f3d04073590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 >> 172.21.15.138:0/2135490527 conn(0x7f3d040fbc90 msgr2=0x7f3d040fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 shutdown_connections 2024-02-15T22:56:17.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:17.974+0000 7f3d0c70a700 1 -- 172.21.15.138:0/2135490527 wait complete. 2024-02-15T22:56:17.986 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 -- 172.21.15.138:0/756828205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940ff380 msgr2=0x7fe9940ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 --2- 172.21.15.138:0/756828205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940ff380 0x7fe9940ff750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe990009910 tx=0x7fe990009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 -- 172.21.15.138:0/756828205 shutdown_connections 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 --2- 172.21.15.138:0/756828205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 --2- 172.21.15.138:0/756828205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9940ff380 0x7fe9940ff750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.077+0000 7fe99b417700 1 -- 172.21.15.138:0/756828205 >> 172.21.15.138:0/756828205 conn(0x7fe9940fac20 msgr2=0x7fe9940fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.078+0000 7fe99b417700 1 -- 172.21.15.138:0/756828205 shutdown_connections 2024-02-15T22:56:18.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.078+0000 7fe99b417700 1 -- 172.21.15.138:0/756828205 wait complete. 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.078+0000 7fe99b417700 1 Processor -- start 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.078+0000 7fe99b417700 1 -- start start 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941a2190 con 0x7fe9941012d0 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941a22d0 con 0x7fe9940ffd20 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35914/0 (socket says 172.21.15.138:35914) 2024-02-15T22:56:18.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 -- 172.21.15.138:0/229435334 learned_addr learned my addr 172.21.15.138:0/229435334 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9991b3700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9991b3700 1 -- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 msgr2=0x7fe994100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9991b3700 1 -- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 msgr2=0x7fe994100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9991b3700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9991b3700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 -- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 msgr2=0x7fe994100d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 -- 172.21.15.138:0/229435334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900095f0 con 0x7fe9941012d0 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe9989b2700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe98400d930 tx=0x7fe98400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe984009900 con 0x7fe9941012d0 2024-02-15T22:56:18.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe984010460 con 0x7fe9941012d0 2024-02-15T22:56:18.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9941a2410 con 0x7fe9941012d0 2024-02-15T22:56:18.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98400f5f0 con 0x7fe9941012d0 2024-02-15T22:56:18.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.079+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9941a2960 con 0x7fe9941012d0 2024-02-15T22:56:18.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.080+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99404ea50 con 0x7fe9941012d0 2024-02-15T22:56:18.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.081+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fe9840105d0 con 0x7fe9941012d0 2024-02-15T22:56:18.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.081+0000 7fe98a7fc700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 0x7fe98006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.082+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe98408d340 con 0x7fe9941012d0 2024-02-15T22:56:18.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.082+0000 7fe9991b3700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 0x7fe98006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.082+0000 7fe9991b3700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 0x7fe98006fe80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe990009fd0 tx=0x7fe99001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.086+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe984056980 con 0x7fe9941012d0 2024-02-15T22:56:18.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.306+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9940fba00 con 0x7fe98006d9d0 2024-02-15T22:56:18.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.307+0000 7fe98a7fc700 1 -- 172.21.15.138:0/229435334 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe9940fba00 con 0x7fe98006d9d0 2024-02-15T22:56:18.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.309+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 msgr2=0x7fe98006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.309+0000 7fe99b417700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 0x7fe98006fe80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe990009fd0 tx=0x7fe99001a040 comp rx=0 tx=0).stop 2024-02-15T22:56:18.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 msgr2=0x7fe994101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe98400d930 tx=0x7fe98400dcf0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 shutdown_connections 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe98006d9d0 0x7fe98006fe80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9940ffd20 0x7fe994100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 --2- 172.21.15.138:0/229435334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9941012d0 0x7fe994101740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 >> 172.21.15.138:0/229435334 conn(0x7fe9940fac20 msgr2=0x7fe994103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 shutdown_connections 2024-02-15T22:56:18.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.310+0000 7fe99b417700 1 -- 172.21.15.138:0/229435334 wait complete. 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/121016365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ff2c0 msgr2=0x7f4fa00ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/121016365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa00ff690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009910 tx=0x7f4f94009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/121016365 shutdown_connections 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/121016365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/121016365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa00ff690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/121016365 >> 172.21.15.138:0/121016365 conn(0x7f4fa00fab80 msgr2=0x7f4fa00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:18.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/121016365 shutdown_connections 2024-02-15T22:56:18.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.413+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/121016365 wait complete. 2024-02-15T22:56:18.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 Processor -- start 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 -- start start 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0197770 con 0x7f4fa00ffc60 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.414+0000 7f4fa4f2e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa01978b0 con 0x7f4fa00ff2c0 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35922/0 (socket says 172.21.15.138:35922) 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 -- 172.21.15.138:0/1527057197 learned_addr learned my addr 172.21.15.138:0/1527057197 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9e59c700 1 -- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 msgr2=0x7f4fa0196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9e59c700 1 -- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 msgr2=0x7f4fa0196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9e59c700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:18.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9e59c700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 -- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 msgr2=0x7f4fa0196b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 -- 172.21.15.138:0/1527057197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940095f0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f9dd9b700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d900 tx=0x7f4f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90004a00 con 0x7f4fa00ffc60 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f900054e0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa019fbc0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa01a00e0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.415+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90009d00 con 0x7f4fa00ffc60 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.417+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa01075d0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.417+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f4f90005020 con 0x7f4fa00ffc60 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.417+0000 7f4f8f7fe700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 0x7f4f8806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.417+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4f9008d630 con 0x7f4fa00ffc60 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.417+0000 7f4f9e59c700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 0x7f4f8806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.418+0000 7f4f9e59c700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 0x7f4f8806fe80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006010 tx=0x7f4f9401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.422+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f90056cf0 con 0x7f4fa00ffc60 2024-02-15T22:56:18.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.629+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fa0061190 con 0x7f4f8806d9d0 2024-02-15T22:56:18.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.639+0000 7f4f8f7fe700 1 -- 172.21.15.138:0/1527057197 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f4fa0061190 con 0x7f4f8806d9d0 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (2m) 12s ago 13m 25.6M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (13m) 12s ago 13m 8132k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (12m) 15s ago 12m 8098k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (13m) 12s ago 13m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (12m) 15s ago 12m 6669k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (104s) 12s ago 13m 80.1M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (7m) 12s ago 7m 72.6M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (7m) 12s ago 7m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (7m) 15s ago 7m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:56:18.642 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (7m) 15s ago 7m 60.2M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (4m) 12s ago 14m 473M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (3m) 15s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (27s) 12s ago 15m 29.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 starting - - - 2048M 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (3m) 12s ago 13m 15.8M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (3m) 15s ago 12m 16.3M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (11m) 12s ago 11m 223M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (11m) 12s ago 11m 241M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (10m) 12s ago 10m 196M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (10m) 15s ago 10m 271M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (9m) 15s ago 9m 253M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (9m) 15s ago 9m 226M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:56:18.643 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (3m) 12s ago 12m 62.9M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:56:18.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 msgr2=0x7f4f8806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 0x7f4f8806fe80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006010 tx=0x7f4f9401a040 comp rx=0 tx=0).stop 2024-02-15T22:56:18.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 msgr2=0x7f4fa0197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d900 tx=0x7f4f9000dcc0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 shutdown_connections 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f8806d9d0 0x7f4f8806fe80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fa00ff2c0 0x7f4fa0196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 --2- 172.21.15.138:0/1527057197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4fa00ffc60 0x7f4fa0197090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 >> 172.21.15.138:0/1527057197 conn(0x7f4fa00fab80 msgr2=0x7f4fa00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 shutdown_connections 2024-02-15T22:56:18.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.641+0000 7f4fa4f2e700 1 -- 172.21.15.138:0/1527057197 wait complete. 2024-02-15T22:56:18.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: mon.smithi138 calling monitor election 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: mon.smithi170 calling monitor election 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: monmap e3: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: mgrmap e38: smithi138.jqscxs(active, since 17s), standbys: smithi170.gczrzt 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: overall HEALTH_OK 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:56:18.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:18 smithi138 ceph-mon[89527]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 -- 172.21.15.138:0/2418198979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ffc80 msgr2=0x7f1cfc103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2418198979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc103c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009870 tx=0x7f1ce4009b80 comp rx=0 tx=0).stop 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 -- 172.21.15.138:0/2418198979 shutdown_connections 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2418198979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc103c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2418198979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc0ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 -- 172.21.15.138:0/2418198979 >> 172.21.15.138:0/2418198979 conn(0x7f1cfc0fab80 msgr2=0x7f1cfc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 -- 172.21.15.138:0/2418198979 shutdown_connections 2024-02-15T22:56:18.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.744+0000 7f1d015ed700 1 -- 172.21.15.138:0/2418198979 wait complete. 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 Processor -- start 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 -- start start 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc197700 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1d015ed700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc197840 con 0x7f1cfc0ffc80 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfa7fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35938/0 (socket says 172.21.15.138:35938) 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 -- 172.21.15.138:0/2053974697 learned_addr learned my addr 172.21.15.138:0/2053974697 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:18.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfa7fc700 1 -- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 msgr2=0x7f1cfc1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfa7fc700 1 -- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 msgr2=0x7f1cfc1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfa7fc700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfa7fc700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 -- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 msgr2=0x7f1cfc1970e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.745+0000 7f1cfaffd700 1 -- 172.21.15.138:0/2053974697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009520 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1cfaffd700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4007d20 tx=0x7f1cf400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf400dda0 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cf400f040 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cf40126c0 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc19fc10 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.746+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc1a0080 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.747+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc1075f0 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.747+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f1cf4012980 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.748+0000 7f1cf3fff700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 0x7f1ce806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:18.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.748+0000 7f1cfa7fc700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 0x7f1ce806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:18.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.748+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1cf408d650 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.748+0000 7f1cfa7fc700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 0x7f1ce806fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce4019040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:18.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:18.752+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1cf4056c90 con 0x7f1cfc0ff2e0 2024-02-15T22:56:18.966 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi138"}]: dispatch 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: mon.smithi138 calling monitor election 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: mon.smithi170 calling monitor election 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: mon.smithi138 is new leader, mons smithi138,smithi170 in quorum (ranks 0,1) 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: monmap e3: 2 mons at {smithi138=[v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0],smithi170=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2 up:standby-replay 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: osdmap e49: 6 total, 6 up, 6 in 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: mgrmap e38: smithi138.jqscxs(active, since 17s), standbys: smithi170.gczrzt 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: overall HEALTH_OK 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mon metadata", "id": "smithi170"}]: dispatch 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: pgmap v12: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-15T22:56:18.967 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:18 smithi170 ceph-mon[67652]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:19.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.031+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1cfc02cc60 con 0x7f1cfc0ff2e0 2024-02-15T22:56:19.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.031+0000 7f1cf3fff700 1 -- 172.21.15.138:0/2053974697 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f1cf405a350 con 0x7f1cfc0ff2e0 2024-02-15T22:56:19.034 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:56:19.034 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:56:19.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:56:19.036 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:56:19.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 msgr2=0x7f1ce806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 0x7f1ce806fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce4019040 comp rx=0 tx=0).stop 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 msgr2=0x7f1cfc196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4007d20 tx=0x7f1cf400d3b0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 shutdown_connections 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1ce806d9e0 0x7f1ce806fe90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1cfc0ff2e0 0x7f1cfc196ba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 --2- 172.21.15.138:0/2053974697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cfc0ffc80 0x7f1cfc1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 >> 172.21.15.138:0/2053974697 conn(0x7f1cfc0fab80 msgr2=0x7f1cfc0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 shutdown_connections 2024-02-15T22:56:19.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.034+0000 7f1d015ed700 1 -- 172.21.15.138:0/2053974697 wait complete. 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 -- 172.21.15.138:0/1891393772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 msgr2=0x7f2ef4100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/1891393772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4100770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009910 tx=0x7f2ee8009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 -- 172.21.15.138:0/1891393772 shutdown_connections 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/1891393772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/1891393772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4100770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 -- 172.21.15.138:0/1891393772 >> 172.21.15.138:0/1891393772 conn(0x7f2ef4074850 msgr2=0x7f2ef4074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 -- 172.21.15.138:0/1891393772 shutdown_connections 2024-02-15T22:56:19.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.137+0000 7f2efb1d0700 1 -- 172.21.15.138:0/1891393772 wait complete. 2024-02-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 Processor -- start 2024-02-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 -- start start 2024-02-15T22:56:19.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41975b0 con 0x7f2ef41003a0 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2efb1d0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4197720 con 0x7f2ef4100cb0 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2ef8f6c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2ef8f6c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35950/0 (socket says 172.21.15.138:35950) 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.138+0000 7f2ef8f6c700 1 -- 172.21.15.138:0/2053224768 learned_addr learned my addr 172.21.15.138:0/2053224768 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef3fff700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef3fff700 1 -- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 msgr2=0x7f2ef4197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef3fff700 1 -- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 msgr2=0x7f2ef4197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef3fff700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef3fff700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef8f6c700 1 -- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 msgr2=0x7f2ef4197020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef8f6c700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef8f6c700 1 -- 172.21.15.138:0/2053224768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80095f0 con 0x7f2ef41003a0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef8f6c700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006010 tx=0x7f2ee800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ee801d070 con 0x7f2ef41003a0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ee8004fb0 con 0x7f2ef41003a0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef419fb50 con 0x7f2ef41003a0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ee8022ea0 con 0x7f2ef41003a0 2024-02-15T22:56:19.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.139+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef419ff80 con 0x7f2ef41003a0 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.141+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4106b10 con 0x7f2ef41003a0 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.141+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f2ee8022470 con 0x7f2ef41003a0 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.141+0000 7f2ef1ffb700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 0x7f2ee406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.142+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2ee808ede0 con 0x7f2ef41003a0 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.142+0000 7f2ef3fff700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 0x7f2ee406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.142+0000 7f2ef3fff700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 0x7f2ee406fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005ea0 tx=0x7f2ee0005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.146+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2ee80585f0 con 0x7f2ef41003a0 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.385+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2ef404ea50 con 0x7f2ef41003a0 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.385+0000 7f2ef1ffb700 1 -- 172.21.15.138:0/2053224768 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f2ee8027020 con 0x7f2ef41003a0 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:56:19.388 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:56:19.389 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:19.390 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:19.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:19.391 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 msgr2=0x7f2ee406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 0x7f2ee406fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005ea0 tx=0x7f2ee0005e30 comp rx=0 tx=0).stop 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 msgr2=0x7f2ef4196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006010 tx=0x7f2ee800be20 comp rx=0 tx=0).stop 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 shutdown_connections 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2ee406d9e0 0x7f2ee406fe90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ef41003a0 0x7f2ef4196ae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 --2- 172.21.15.138:0/2053224768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ef4100cb0 0x7f2ef4197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 >> 172.21.15.138:0/2053224768 conn(0x7f2ef4074850 msgr2=0x7f2ef4103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 shutdown_connections 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.388+0000 7f2efb1d0700 1 -- 172.21.15.138:0/2053224768 wait complete. 2024-02-15T22:56:19.392 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 -- 172.21.15.138:0/850454188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 msgr2=0x7fb19c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/850454188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c0ff690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb190009910 tx=0x7fb190009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 -- 172.21.15.138:0/850454188 shutdown_connections 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/850454188 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/850454188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c0ff690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 -- 172.21.15.138:0/850454188 >> 172.21.15.138:0/850454188 conn(0x7fb19c0fab80 msgr2=0x7fb19c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 -- 172.21.15.138:0/850454188 shutdown_connections 2024-02-15T22:56:19.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 -- 172.21.15.138:0/850454188 wait complete. 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.493+0000 7fb1a2f04700 1 Processor -- start 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 -- start start 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1976d0 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c197840 con 0x7fb19c0ffc60 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35968/0 (socket says 172.21.15.138:35968) 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 -- 172.21.15.138:0/3058439385 learned_addr learned my addr 172.21.15.138:0/3058439385 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb19bfff700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb19bfff700 1 -- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 msgr2=0x7fb19c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb19bfff700 1 -- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 msgr2=0x7fb19c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb19bfff700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb19bfff700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 -- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 msgr2=0x7fb19c1970b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 -- 172.21.15.138:0/3058439385 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900095f0 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a0ca0700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1900092e0 tx=0x7fb19000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19001d070 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c19fbe0 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb190005e00 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.494+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb190017400 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.495+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c1a0050 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.496+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c1075d0 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.496+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fb19000f460 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.497+0000 7fb199ffb700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 0x7fb18c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.497+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb19008ec10 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.497+0000 7fb19bfff700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 0x7fb18c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.497+0000 7fb19bfff700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 0x7fb18c06fe80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb188005950 tx=0x7fb1880058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.501+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb190058250 con 0x7fb19c0ff2c0 2024-02-15T22:56:19.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.720+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb19c02ccf0 con 0x7fb18c06d9d0 2024-02-15T22:56:19.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.721+0000 7fb199ffb700 1 -- 172.21.15.138:0/3058439385 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb19c02ccf0 con 0x7fb18c06d9d0 2024-02-15T22:56:19.724 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:56:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:56:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:56:19.724 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "3/23 daemons upgraded", 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:56:19.725 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 msgr2=0x7fb18c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 0x7fb18c06fe80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb188005950 tx=0x7fb1880058e0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 msgr2=0x7fb19c196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1900092e0 tx=0x7fb19000be20 comp rx=0 tx=0).stop 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 shutdown_connections 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb18c06d9d0 0x7fb18c06fe80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c0ff2c0 0x7fb19c196b70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 --2- 172.21.15.138:0/3058439385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb19c0ffc60 0x7fb19c1970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 >> 172.21.15.138:0/3058439385 conn(0x7fb19c0fab80 msgr2=0x7fb19c0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 shutdown_connections 2024-02-15T22:56:19.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.724+0000 7fb1a2f04700 1 -- 172.21.15.138:0/3058439385 wait complete. 2024-02-15T22:56:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 -- 172.21.15.138:0/1478619494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ff160 msgr2=0x7efd1c0ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 --2- 172.21.15.138:0/1478619494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ff160 0x7efd1c0ff530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efd18009910 tx=0x7efd18009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 -- 172.21.15.138:0/1478619494 shutdown_connections 2024-02-15T22:56:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 --2- 172.21.15.138:0/1478619494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ffa70 0x7efd1c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 --2- 172.21.15.138:0/1478619494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ff160 0x7efd1c0ff530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.826+0000 7efd23c31700 1 -- 172.21.15.138:0/1478619494 >> 172.21.15.138:0/1478619494 conn(0x7efd1c0fabb0 msgr2=0x7efd1c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 -- 172.21.15.138:0/1478619494 shutdown_connections 2024-02-15T22:56:19.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 -- 172.21.15.138:0/1478619494 wait complete. 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 Processor -- start 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 -- start start 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c19cf40 con 0x7efd1c0ffa70 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd23c31700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c1a0cd0 con 0x7efd1c0ff160 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd211cc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd211cc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:35990/0 (socket says 172.21.15.138:35990) 2024-02-15T22:56:19.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.827+0000 7efd211cc700 1 -- 172.21.15.138:0/3461043093 learned_addr learned my addr 172.21.15.138:0/3461043093 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd219cd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd219cd700 1 -- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 msgr2=0x7efd1c19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd219cd700 1 -- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 msgr2=0x7efd1c19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd219cd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd219cd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd211cc700 1 -- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 msgr2=0x7efd1c19c320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd211cc700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd211cc700 1 -- 172.21.15.138:0/3461043093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd180095f0 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd211cc700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d8d0 tx=0x7efd0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0c004a00 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd0c0054e0 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c1a0fb0 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd0c009d60 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.828+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c1a1500 con 0x7efd1c0ffa70 2024-02-15T22:56:19.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.829+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1c101600 con 0x7efd1c0ffa70 2024-02-15T22:56:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.830+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7efd0c005020 con 0x7efd1c0ffa70 2024-02-15T22:56:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.830+0000 7efd12ffd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 0x7efd0806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.830+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efd0c08d230 con 0x7efd1c0ffa70 2024-02-15T22:56:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.830+0000 7efd219cd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 0x7efd0806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:19.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.830+0000 7efd219cd700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 0x7efd0806fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd1800b5c0 tx=0x7efd1801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:19.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:19.834+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd0c0568f0 con 0x7efd1c0ffa70 2024-02-15T22:56:19.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:19 smithi138 ceph-mon[89527]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:19.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:19 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2053974697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:19.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:19 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2053224768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:56:20.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:19 smithi170 ceph-mon[67652]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:20.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:19 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2053974697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:20.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:19 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2053224768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:56:20.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.111+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd1c04ea50 con 0x7efd1c0ffa70 2024-02-15T22:56:20.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.111+0000 7efd12ffd700 1 -- 172.21.15.138:0/3461043093 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efd0c01f020 con 0x7efd1c0ffa70 2024-02-15T22:56:20.114 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:56:20.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 msgr2=0x7efd0806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:20.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 0x7efd0806fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd1800b5c0 tx=0x7efd1801a040 comp rx=0 tx=0).stop 2024-02-15T22:56:20.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 msgr2=0x7efd1c19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:20.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d8d0 tx=0x7efd0c00dc90 comp rx=0 tx=0).stop 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 shutdown_connections 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efd0806d9e0 0x7efd0806fe90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd1c0ff160 0x7efd1c19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 --2- 172.21.15.138:0/3461043093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd1c0ffa70 0x7efd1c19c860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 >> 172.21.15.138:0/3461043093 conn(0x7efd1c0fabb0 msgr2=0x7efd1c1105d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.113+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 shutdown_connections 2024-02-15T22:56:20.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:20.114+0000 7efd23c31700 1 -- 172.21.15.138:0/3461043093 wait complete. 2024-02-15T22:56:20.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:20 smithi138 ceph-mon[89527]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:20.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:20 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3461043093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:56:20.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:20 smithi138 ceph-mon[89527]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:20.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:20 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:20.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:20 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:21.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:20 smithi170 ceph-mon[67652]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:21.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:20 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3461043093' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:56:21.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:20 smithi170 ceph-mon[67652]: pgmap v13: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:21.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:20 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:21.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:20 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:22.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:22.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:22.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:22 smithi138 ceph-mon[89527]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:23.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:23.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:23.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:22 smithi170 ceph-mon[67652]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:25.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:25.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:56:25.673 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:25.674 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:25.674 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:25.674 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:26.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:26 smithi170 ceph-mon[67652]: Detected new or changed devices on smithi170 2024-02-15T22:56:26.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:26 smithi170 ceph-mon[67652]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-15T22:56:26.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:26 smithi170 ceph-mon[67652]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-15T22:56:26.698 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:26 smithi138 ceph-mon[89527]: Detected new or changed devices on smithi170 2024-02-15T22:56:26.698 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:26 smithi138 ceph-mon[89527]: Reconfiguring mon.smithi138 (monmap changed)... 2024-02-15T22:56:26.698 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:26 smithi138 ceph-mon[89527]: Reconfiguring daemon mon.smithi138 on smithi138 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:56:27.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: pgmap v16: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi138.jqscxs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:56:27.593 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:28.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:28 smithi170 ceph-mon[67652]: Reconfiguring mgr.smithi138.jqscxs (monmap changed)... 2024-02-15T22:56:28.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:28 smithi170 ceph-mon[67652]: Reconfiguring daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:56:28.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:28 smithi138 ceph-mon[89527]: Reconfiguring mgr.smithi138.jqscxs (monmap changed)... 2024-02-15T22:56:28.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:28 smithi138 ceph-mon[89527]: Reconfiguring daemon mgr.smithi138.jqscxs on smithi138 2024-02-15T22:56:29.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi138"}]: dispatch 2024-02-15T22:56:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi138"}]: dispatch 2024-02-15T22:56:29.621 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:30.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: Reconfiguring ceph-exporter.smithi138 (monmap changed)... 2024-02-15T22:56:30.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: Unable to update caps for client.ceph-exporter.smithi138 2024-02-15T22:56:30.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: Reconfiguring daemon ceph-exporter.smithi138 on smithi138 2024-02-15T22:56:30.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:30.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:30.573 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:30.573 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:30.573 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: Reconfiguring ceph-exporter.smithi138 (monmap changed)... 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: Unable to update caps for client.ceph-exporter.smithi138 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: Reconfiguring daemon ceph-exporter.smithi138 on smithi138 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:31.570 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:31 smithi138 ceph-mon[89527]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-15T22:56:31.570 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:31 smithi138 ceph-mon[89527]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-15T22:56:31.570 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:31 smithi138 ceph-mon[89527]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:31 smithi170 ceph-mon[67652]: Reconfiguring crash.smithi138 (monmap changed)... 2024-02-15T22:56:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:31 smithi170 ceph-mon[67652]: Reconfiguring daemon crash.smithi138 on smithi138 2024-02-15T22:56:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:31 smithi170 ceph-mon[67652]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: Reconfiguring osd.0 (monmap changed)... 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.0 on smithi138 2024-02-15T22:56:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:32 smithi170 ceph-mon[67652]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: Reconfiguring osd.0 (monmap changed)... 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:32.899 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.0 on smithi138 2024-02-15T22:56:32.900 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:32 smithi138 ceph-mon[89527]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: Reconfiguring osd.1 (monmap changed)... 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.1 on smithi138 2024-02-15T22:56:34.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:34 smithi138 ceph-mon[89527]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: Reconfiguring osd.1 (monmap changed)... 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.1 on smithi138 2024-02-15T22:56:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:34 smithi170 ceph-mon[67652]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: Reconfiguring osd.2 (monmap changed)... 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:36.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:36 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.2 on smithi138 2024-02-15T22:56:36.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: Reconfiguring osd.2 (monmap changed)... 2024-02-15T22:56:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:56:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:36.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:36 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.2 on smithi138 2024-02-15T22:56:37.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:37 smithi170 ceph-mon[67652]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:37.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:37 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:37.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:37 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:37.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:37 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:37.436 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:37 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:37.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:37 smithi138 ceph-mon[89527]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:37.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:37 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:37.451 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:37 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:37.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:37 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:37.452 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:37 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:38.142 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:38 smithi170 ceph-mon[67652]: Reconfiguring mds.cephfs.smithi138.bnqzne (monmap changed)... 2024-02-15T22:56:38.142 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:38 smithi170 ceph-mon[67652]: Reconfiguring daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T22:56:38.466 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:38 smithi138 ceph-mon[89527]: Reconfiguring mds.cephfs.smithi138.bnqzne (monmap changed)... 2024-02-15T22:56:38.466 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:38 smithi138 ceph-mon[89527]: Reconfiguring daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T22:56:39.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:39 smithi138 ceph-mon[89527]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:39.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:39.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:39.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:39.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:39 smithi170 ceph-mon[67652]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:40.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:40 smithi138 ceph-mon[89527]: Reconfiguring mds.cephfs.smithi138.fzypgq (monmap changed)... 2024-02-15T22:56:40.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:40 smithi138 ceph-mon[89527]: Reconfiguring daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T22:56:40.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:40 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:40.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:40 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:40 smithi170 ceph-mon[67652]: Reconfiguring mds.cephfs.smithi138.fzypgq (monmap changed)... 2024-02-15T22:56:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:40 smithi170 ceph-mon[67652]: Reconfiguring daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T22:56:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:40 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:40 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: Unable to update caps for client.ceph-exporter.smithi170 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi170"}]: dispatch 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-02-15T22:56:41.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:41 smithi138 ceph-mon[89527]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: Reconfiguring ceph-exporter.smithi170 (monmap changed)... 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: Unable to update caps for client.ceph-exporter.smithi170 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi170"}]: dispatch 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: Reconfiguring daemon ceph-exporter.smithi170 on smithi170 2024-02-15T22:56:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:41 smithi170 ceph-mon[67652]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: Reconfiguring crash.smithi170 (monmap changed)... 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: Reconfiguring daemon crash.smithi170 on smithi170 2024-02-15T22:56:42.923 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:42 smithi170 ceph-mon[67652]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:42.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: Reconfiguring crash.smithi170 (monmap changed)... 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: Reconfiguring daemon crash.smithi170 on smithi170 2024-02-15T22:56:42.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:42 smithi138 ceph-mon[89527]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:44.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: Reconfiguring mgr.smithi170.gczrzt (monmap changed)... 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:44.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:44 smithi138 ceph-mon[89527]: Reconfiguring daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:56:44.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: Reconfiguring mgr.smithi170.gczrzt (monmap changed)... 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi170.gczrzt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:44 smithi170 ceph-mon[67652]: Reconfiguring daemon mgr.smithi170.gczrzt on smithi170 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:45.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T22:56:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T22:56:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:46.306 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:46 smithi170 ceph-mon[67652]: Reconfiguring mon.smithi170 (monmap changed)... 2024-02-15T22:56:46.306 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:46 smithi170 ceph-mon[67652]: Reconfiguring daemon mon.smithi170 on smithi170 2024-02-15T22:56:46.307 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:46 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:46.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:46 smithi138 ceph-mon[89527]: Reconfiguring mon.smithi170 (monmap changed)... 2024-02-15T22:56:46.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:46 smithi138 ceph-mon[89527]: Reconfiguring daemon mon.smithi170 on smithi170 2024-02-15T22:56:46.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:46 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:56:47.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:47 smithi170 ceph-mon[67652]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:47.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:47.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:47.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:56:47.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:47.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:47 smithi138 ceph-mon[89527]: pgmap v26: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:47.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:47.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:47.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:56:47.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: Reconfiguring osd.3 (monmap changed)... 2024-02-15T22:56:48.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.3 on smithi170 2024-02-15T22:56:48.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:48.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:48.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:56:48.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:48.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: Reconfiguring osd.3 (monmap changed)... 2024-02-15T22:56:48.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.3 on smithi170 2024-02-15T22:56:48.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:48.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:48.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:56:48.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:49.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:49 smithi170 ceph-mon[67652]: Reconfiguring osd.4 (monmap changed)... 2024-02-15T22:56:49.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:49 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.4 on smithi170 2024-02-15T22:56:49.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:49 smithi170 ceph-mon[67652]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:49 smithi138 ceph-mon[89527]: Reconfiguring osd.4 (monmap changed)... 2024-02-15T22:56:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:49 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.4 on smithi170 2024-02-15T22:56:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:49 smithi138 ceph-mon[89527]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 -- 172.21.15.138:0/1734425985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 msgr2=0x7f287c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 --2- 172.21.15.138:0/1734425985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c0ff690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f286c009910 tx=0x7f286c009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 -- 172.21.15.138:0/1734425985 shutdown_connections 2024-02-15T22:56:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 --2- 172.21.15.138:0/1734425985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 0x7f287c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 --2- 172.21.15.138:0/1734425985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c0ff690 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 -- 172.21.15.138:0/1734425985 >> 172.21.15.138:0/1734425985 conn(0x7f287c0fab80 msgr2=0x7f287c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 -- 172.21.15.138:0/1734425985 shutdown_connections 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 -- 172.21.15.138:0/1734425985 wait complete. 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.231+0000 7f2881d9e700 1 Processor -- start 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2881d9e700 1 -- start start 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2881d9e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2881d9e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 0x7f287c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2881d9e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c198bb0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2881d9e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c19c940 con 0x7f287c0ffc60 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36358/0 (socket says 172.21.15.138:36358) 2024-02-15T22:56:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 -- 172.21.15.138:0/3523780919 learned_addr learned my addr 172.21.15.138:0/3523780919 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287affd700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 0x7f287c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 -- 172.21.15.138:0/3523780919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 msgr2=0x7f287c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 0x7f287c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 -- 172.21.15.138:0/3523780919 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0095f0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f287b7fe700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f286c006010 tx=0x7f286c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.232+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c01d070 con 0x7f287c0ff2c0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.233+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f286c005dc0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.233+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c19cbc0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.233+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286c017400 con 0x7f287c0ff2c0 2024-02-15T22:56:50.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.233+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c19d0b0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.234+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c04ea50 con 0x7f287c0ff2c0 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.234+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f286c003a60 con 0x7f287c0ff2c0 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.235+0000 7f2878ff9700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 0x7f286406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.235+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f286c08eba0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.235+0000 7f287affd700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 0x7f286406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.235+0000 7f287affd700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 0x7f286406fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287c1995b0 tx=0x7f287000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.239+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f286c0581e0 con 0x7f287c0ff2c0 2024-02-15T22:56:50.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.458+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f287c19d630 con 0x7f286406d9e0 2024-02-15T22:56:50.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.459+0000 7f2878ff9700 1 -- 172.21.15.138:0/3523780919 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f287c19d630 con 0x7f286406d9e0 2024-02-15T22:56:50.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 msgr2=0x7f286406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 0x7f286406fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f287c1995b0 tx=0x7f287000b410 comp rx=0 tx=0).stop 2024-02-15T22:56:50.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 msgr2=0x7f287c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f286c006010 tx=0x7f286c00bd70 comp rx=0 tx=0).stop 2024-02-15T22:56:50.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 shutdown_connections 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f286406d9e0 0x7f286406fe90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f287c0ff2c0 0x7f287c197f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 --2- 172.21.15.138:0/3523780919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f287c0ffc60 0x7f287c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.461+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 >> 172.21.15.138:0/3523780919 conn(0x7f287c0fab80 msgr2=0x7f287c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.462+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 shutdown_connections 2024-02-15T22:56:50.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.462+0000 7f2881d9e700 1 -- 172.21.15.138:0/3523780919 wait complete. 2024-02-15T22:56:50.474 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 -- 172.21.15.138:0/2564796502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ffa20 msgr2=0x7f92b8103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 --2- 172.21.15.138:0/2564796502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ffa20 0x7f92b8103f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009910 tx=0x7f92a8009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 -- 172.21.15.138:0/2564796502 shutdown_connections 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 --2- 172.21.15.138:0/2564796502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ffa20 0x7f92b8103f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 --2- 172.21.15.138:0/2564796502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ff110 0x7f92b80ff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 -- 172.21.15.138:0/2564796502 >> 172.21.15.138:0/2564796502 conn(0x7f92b80fab80 msgr2=0x7f92b80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 -- 172.21.15.138:0/2564796502 shutdown_connections 2024-02-15T22:56:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.568+0000 7f92bfc42700 1 -- 172.21.15.138:0/2564796502 wait complete. 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 Processor -- start 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 -- start start 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ffa20 0x7f92b819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b819cf30 con 0x7f92b80ff110 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bfc42700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81a0cc0 con 0x7f92b80ffa20 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36368/0 (socket says 172.21.15.138:36368) 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 -- 172.21.15.138:0/1460137866 learned_addr learned my addr 172.21.15.138:0/1460137866 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd1dd700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ffa20 0x7f92b819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 -- 172.21.15.138:0/1460137866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ffa20 msgr2=0x7f92b819c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ffa20 0x7f92b819c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.569+0000 7f92bd9de700 1 -- 172.21.15.138:0/1460137866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80095f0 con 0x7f92b80ff110 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92bd9de700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c8a0 tx=0x7f92b400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b40078e0 con 0x7f92b80ff110 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92b400f450 con 0x7f92b80ff110 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b81a0fa0 con 0x7f92b80ff110 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92b400e5e0 con 0x7f92b80ff110 2024-02-15T22:56:50.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.570+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b81a14f0 con 0x7f92b80ff110 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.571+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b8101590 con 0x7f92b80ff110 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.571+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f92b400f5c0 con 0x7f92b80ff110 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.571+0000 7f92aeffd700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 0x7f92a406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.572+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f92b408d6e0 con 0x7f92b80ff110 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.572+0000 7f92bd1dd700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 0x7f92a406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.572+0000 7f92bd1dd700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 0x7f92a406fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f92b819d930 tx=0x7f92a801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.576+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f92b4056d20 con 0x7f92b80ff110 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: Reconfiguring osd.5 (monmap changed)... 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: Reconfiguring daemon osd.5 on smithi170 2024-02-15T22:56:50.736 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:50 smithi170 ceph-mon[67652]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:50.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.791+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92b81a1860 con 0x7f92a406d9d0 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: Reconfiguring osd.5 (monmap changed)... 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: Reconfiguring daemon osd.5 on smithi170 2024-02-15T22:56:50.794 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:50 smithi138 ceph-mon[89527]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:50.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.792+0000 7f92aeffd700 1 -- 172.21.15.138:0/1460137866 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f92b81a1860 con 0x7f92a406d9d0 2024-02-15T22:56:50.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.794+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 msgr2=0x7f92a406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.794+0000 7f92bfc42700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 0x7f92a406fe80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f92b819d930 tx=0x7f92a801a040 comp rx=0 tx=0).stop 2024-02-15T22:56:50.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 msgr2=0x7f92b819c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92b400c8a0 tx=0x7f92b400cbb0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 shutdown_connections 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f92a406d9d0 0x7f92a406fe80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b80ff110 0x7f92b819c310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 --2- 172.21.15.138:0/1460137866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92b80ffa20 0x7f92b819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 >> 172.21.15.138:0/1460137866 conn(0x7f92b80fab80 msgr2=0x7f92b8110580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 shutdown_connections 2024-02-15T22:56:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.795+0000 7f92bfc42700 1 -- 172.21.15.138:0/1460137866 wait complete. 2024-02-15T22:56:50.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 -- 172.21.15.138:0/1854239791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ffba0 msgr2=0x7fb83010a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 --2- 172.21.15.138:0/1854239791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ffba0 0x7fb83010a610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb820009910 tx=0x7fb820009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 -- 172.21.15.138:0/1854239791 shutdown_connections 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 --2- 172.21.15.138:0/1854239791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ffba0 0x7fb83010a610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 --2- 172.21.15.138:0/1854239791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ff290 0x7fb8300ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.897+0000 7fb837ee9700 1 -- 172.21.15.138:0/1854239791 >> 172.21.15.138:0/1854239791 conn(0x7fb830074850 msgr2=0x7fb830074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.898+0000 7fb837ee9700 1 -- 172.21.15.138:0/1854239791 shutdown_connections 2024-02-15T22:56:50.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.898+0000 7fb837ee9700 1 -- 172.21.15.138:0/1854239791 wait complete. 2024-02-15T22:56:50.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.898+0000 7fb837ee9700 1 Processor -- start 2024-02-15T22:56:50.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.898+0000 7fb837ee9700 1 -- start start 2024-02-15T22:56:50.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.898+0000 7fb837ee9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb837ee9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ffba0 0x7fb8301961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb837ee9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830196880 con 0x7fb8300ff290 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb837ee9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301995b0 con 0x7fb8300ffba0 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36390/0 (socket says 172.21.15.138:36390) 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 -- 172.21.15.138:0/3485614357 learned_addr learned my addr 172.21.15.138:0/3485614357 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835484700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ffba0 0x7fb8301961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 -- 172.21.15.138:0/3485614357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ffba0 msgr2=0x7fb8301961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ffba0 0x7fb8301961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 -- 172.21.15.138:0/3485614357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200095f0 con 0x7fb8300ff290 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb835c85700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00d8d0 tx=0x7fb82c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c009940 con 0x7fb8300ff290 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb82c010460 con 0x7fb8300ff290 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb830199890 con 0x7fb8300ff290 2024-02-15T22:56:50.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c00f5f0 con 0x7fb8300ff290 2024-02-15T22:56:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.899+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb830199de0 con 0x7fb8300ff290 2024-02-15T22:56:50.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.900+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb830107d10 con 0x7fb8300ff290 2024-02-15T22:56:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.901+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fb82c0105d0 con 0x7fb8300ff290 2024-02-15T22:56:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.901+0000 7fb826ffd700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 0x7fb81c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.901+0000 7fb835484700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 0x7fb81c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.901+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb82c08d600 con 0x7fb8300ff290 2024-02-15T22:56:50.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.902+0000 7fb835484700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 0x7fb81c06fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb830197290 tx=0x7fb82001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:50.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:50.906+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb82c056cc0 con 0x7fb8300ff290 2024-02-15T22:56:51.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.112+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb83019a050 con 0x7fb81c06d9e0 2024-02-15T22:56:51.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.124+0000 7fb826ffd700 1 -- 172.21.15.138:0/3485614357 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb83019a050 con 0x7fb81c06d9e0 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (3m) 45s ago 13m 25.6M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (14m) 45s ago 14m 8132k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (13m) 30s ago 13m 8124k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (14m) 45s ago 14m 6660k - 18.2.0 dc2bc1663786 762dde00d40d 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (13m) 30s ago 13m 6669k - 18.2.0 dc2bc1663786 1ad74dbee053 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (2m) 45s ago 13m 80.1M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (8m) 45s ago 8m 72.6M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (8m) 45s ago 8m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (8m) 30s ago 8m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (8m) 30s ago 8m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:56:51.127 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (5m) 45s ago 15m 473M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (4m) 30s ago 12m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (59s) 45s ago 15m 29.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (34s) 30s ago 12m 28.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (4m) 45s ago 13m 15.8M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (4m) 30s ago 12m 16.7M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (12m) 45s ago 12m 223M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (11m) 45s ago 11m 241M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (11m) 45s ago 11m 196M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (10m) 30s ago 10m 271M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (10m) 30s ago 10m 254M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (9m) 30s ago 9m 227M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:56:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (3m) 45s ago 13m 62.9M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:56:51.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.126+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 msgr2=0x7fb81c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.126+0000 7fb837ee9700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 0x7fb81c06fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb830197290 tx=0x7fb82001a040 comp rx=0 tx=0).stop 2024-02-15T22:56:51.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.126+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 msgr2=0x7fb830195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.126+0000 7fb837ee9700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00d8d0 tx=0x7fb82c00dc90 comp rx=0 tx=0).stop 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 shutdown_connections 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb81c06d9e0 0x7fb81c06fe90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8300ff290 0x7fb830195cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 --2- 172.21.15.138:0/3485614357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8300ffba0 0x7fb8301961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 >> 172.21.15.138:0/3485614357 conn(0x7fb830074850 msgr2=0x7fb830104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 shutdown_connections 2024-02-15T22:56:51.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.127+0000 7fb837ee9700 1 -- 172.21.15.138:0/3485614357 wait complete. 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 -- 172.21.15.138:0/3427656623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 msgr2=0x7f7aec103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 --2- 172.21.15.138:0/3427656623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec103ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009910 tx=0x7f7ae0009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 -- 172.21.15.138:0/3427656623 shutdown_connections 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 --2- 172.21.15.138:0/3427656623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec103ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 --2- 172.21.15.138:0/3427656623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 0x7f7aec0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 -- 172.21.15.138:0/3427656623 >> 172.21.15.138:0/3427656623 conn(0x7f7aec074f50 msgr2=0x7f7aec075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 -- 172.21.15.138:0/3427656623 shutdown_connections 2024-02-15T22:56:51.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.230+0000 7f7af3c79700 1 -- 172.21.15.138:0/3427656623 wait complete. 2024-02-15T22:56:51.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 Processor -- start 2024-02-15T22:56:51.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 -- start start 2024-02-15T22:56:51.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 0x7f7aec196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec1976e0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af3c79700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec197820 con 0x7f7aec0ff390 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36410/0 (socket says 172.21.15.138:36410) 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 -- 172.21.15.138:0/944466138 learned_addr learned my addr 172.21.15.138:0/944466138 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1a15700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 0x7f7aec196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 -- 172.21.15.138:0/944466138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 msgr2=0x7f7aec196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 0x7f7aec196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 -- 172.21.15.138:0/944466138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00095f0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.231+0000 7f7af1214700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00092e0 tx=0x7f7ae000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.232+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae001d070 con 0x7f7aec0ffd30 2024-02-15T22:56:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.232+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec19fbf0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.232+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ae0005dc0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.232+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae0017400 con 0x7f7aec0ffd30 2024-02-15T22:56:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.232+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec1a0000 con 0x7f7aec0ffd30 2024-02-15T22:56:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.233+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec107600 con 0x7f7aec0ffd30 2024-02-15T22:56:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.233+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f7ae000f6f0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.234+0000 7f7aeaffd700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 0x7f7ad406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.234+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ae008eae0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.234+0000 7f7af1a15700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 0x7f7ad406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.234+0000 7f7af1a15700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 0x7f7ad406fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4005950 tx=0x7f7ae400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.238+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ae0058120 con 0x7f7aec0ffd30 2024-02-15T22:56:51.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.518+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7aec1979e0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.518+0000 7f7aeaffd700 1 -- 172.21.15.138:0/944466138 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f7ae005b7e0 con 0x7f7aec0ffd30 2024-02-15T22:56:51.521 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:56:51.521 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:56:51.521 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:56:51.522 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:56:51.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.520+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 msgr2=0x7f7ad406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.520+0000 7f7af3c79700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 0x7f7ad406fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4005950 tx=0x7f7ae400b410 comp rx=0 tx=0).stop 2024-02-15T22:56:51.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.520+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 msgr2=0x7f7aec1970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.520+0000 7f7af3c79700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00092e0 tx=0x7f7ae000bd70 comp rx=0 tx=0).stop 2024-02-15T22:56:51.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 shutdown_connections 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ad406d9e0 0x7f7ad406fe90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7aec0ff390 0x7f7aec196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 --2- 172.21.15.138:0/944466138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec0ffd30 0x7f7aec1970c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 >> 172.21.15.138:0/944466138 conn(0x7f7aec074f50 msgr2=0x7f7aec0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 shutdown_connections 2024-02-15T22:56:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.521+0000 7f7af3c79700 1 -- 172.21.15.138:0/944466138 wait complete. 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 -- 172.21.15.138:0/657225962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 msgr2=0x7f9bac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 --2- 172.21.15.138:0/657225962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac068a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00b0a0 tx=0x7f9b9c00b3b0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 -- 172.21.15.138:0/657225962 shutdown_connections 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 --2- 172.21.15.138:0/657225962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 0x7f9bac104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 --2- 172.21.15.138:0/657225962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac068a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 -- 172.21.15.138:0/657225962 >> 172.21.15.138:0/657225962 conn(0x7f9bac074f50 msgr2=0x7f9bac075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 -- 172.21.15.138:0/657225962 shutdown_connections 2024-02-15T22:56:51.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.623+0000 7f9bb410d700 1 -- 172.21.15.138:0/657225962 wait complete. 2024-02-15T22:56:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 Processor -- start 2024-02-15T22:56:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 -- start start 2024-02-15T22:56:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 0x7f9bac196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac196950 con 0x7f9bac068630 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb410d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac19a6e0 con 0x7f9bac068fd0 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36436/0 (socket says 172.21.15.138:36436) 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 -- 172.21.15.138:0/2182585004 learned_addr learned my addr 172.21.15.138:0/2182585004 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb16a8700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 0x7f9bac196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 -- 172.21.15.138:0/2182585004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 msgr2=0x7f9bac196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 0x7f9bac196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.624+0000 7f9bb1ea9700 1 -- 172.21.15.138:0/2182585004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c009d00 con 0x7f9bac068630 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9bb1ea9700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000f80 tx=0x7f9b9c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b9c00e040 con 0x7f9bac068630 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b9c003c10 con 0x7f9bac068630 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac19a960 con 0x7f9bac068630 2024-02-15T22:56:51.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b9c01d6b0 con 0x7f9bac068630 2024-02-15T22:56:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.625+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac19ae50 con 0x7f9bac068630 2024-02-15T22:56:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.626+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac1086f0 con 0x7f9bac068630 2024-02-15T22:56:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.626+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f9b9c004040 con 0x7f9bac068630 2024-02-15T22:56:51.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.627+0000 7f9baaffd700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 0x7f9b9406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.627+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9b9c08edd0 con 0x7f9bac068630 2024-02-15T22:56:51.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.627+0000 7f9bb16a8700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 0x7f9b9406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.627+0000 7f9bb16a8700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 0x7f9b9406fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9bac197350 tx=0x7f9ba000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.631+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9b9c058490 con 0x7f9bac068630 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.869+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9bac19b130 con 0x7f9bac068630 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.869+0000 7f9baaffd700 1 -- 172.21.15.138:0/2182585004 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f9b9c017770 con 0x7f9bac068630 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:56:51.872 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:56:51.873 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:51.874 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:51.875 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:56:51.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:51.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.871+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 msgr2=0x7f9b9406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.871+0000 7f9bb410d700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 0x7f9b9406fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9bac197350 tx=0x7f9ba000b410 comp rx=0 tx=0).stop 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.871+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 msgr2=0x7f9bac195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.871+0000 7f9bb410d700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000f80 tx=0x7f9b9c00cd20 comp rx=0 tx=0).stop 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 shutdown_connections 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9b9406d9e0 0x7f9b9406fe90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bac068630 0x7f9bac195d30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 --2- 172.21.15.138:0/2182585004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9bac068fd0 0x7f9bac196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 >> 172.21.15.138:0/2182585004 conn(0x7f9bac074f50 msgr2=0x7f9bac0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 shutdown_connections 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.872+0000 7f9bb410d700 1 -- 172.21.15.138:0/2182585004 wait complete. 2024-02-15T22:56:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 -- 172.21.15.138:0/260198609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ff390 msgr2=0x7fbd380ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 --2- 172.21.15.138:0/260198609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ff390 0x7fbd380ff760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009910 tx=0x7fbd28009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 -- 172.21.15.138:0/260198609 shutdown_connections 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 --2- 172.21.15.138:0/260198609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ffd30 0x7fbd38103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 --2- 172.21.15.138:0/260198609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ff390 0x7fbd380ff760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 -- 172.21.15.138:0/260198609 >> 172.21.15.138:0/260198609 conn(0x7fbd38074f50 msgr2=0x7fbd38075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 -- 172.21.15.138:0/260198609 shutdown_connections 2024-02-15T22:56:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.977+0000 7fbd3f434700 1 -- 172.21.15.138:0/260198609 wait complete. 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 Processor -- start 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 -- start start 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 0x7fbd38195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38196940 con 0x7fbd380ffd30 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3f434700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3819a6d0 con 0x7fbd380ff390 2024-02-15T22:56:51.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36452/0 (socket says 172.21.15.138:36452) 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 -- 172.21.15.138:0/21727943 learned_addr learned my addr 172.21.15.138:0/21727943 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3d1d0700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 0x7fbd38195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 -- 172.21.15.138:0/21727943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 msgr2=0x7fbd38195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 0x7fbd38195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 -- 172.21.15.138:0/21727943 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280095f0 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3d1d0700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 0x7fbd38195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd3c9cf700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400d900 tx=0x7fbd3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.978+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd34009900 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.979+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd34010460 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.979+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3819a9b0 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.979+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd3400f5f0 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.979+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3819af00 con 0x7fbd380ffd30 2024-02-15T22:56:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.980+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3804ea50 con 0x7fbd380ffd30 2024-02-15T22:56:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.980+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fbd340105d0 con 0x7fbd380ffd30 2024-02-15T22:56:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.981+0000 7fbd2e7fc700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 0x7fbd2406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.981+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbd3408d570 con 0x7fbd380ffd30 2024-02-15T22:56:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.981+0000 7fbd3d1d0700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 0x7fbd2406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:51.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.981+0000 7fbd3d1d0700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 0x7fbd2406fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b5c0 tx=0x7fbd280053a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:51.985+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbd34056bb0 con 0x7fbd380ffd30 2024-02-15T22:56:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.203+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd3819b3e0 con 0x7fbd2406d9e0 2024-02-15T22:56:52.206 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: Reconfiguring mds.cephfs.smithi170.banvev (monmap changed)... 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: Reconfiguring daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/944466138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:52.207 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:52 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2182585004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.204+0000 7fbd2e7fc700 1 -- 172.21.15.138:0/21727943 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbd3819b3e0 con 0x7fbd2406d9e0 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "4/23 daemons upgraded", 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:56:52.208 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:56:52.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 msgr2=0x7fbd2406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 0x7fbd2406fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800b5c0 tx=0x7fbd280053a0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 msgr2=0x7fbd38196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400d900 tx=0x7fbd3400dcc0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 shutdown_connections 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fbd2406d9e0 0x7fbd2406fe90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd380ff390 0x7fbd38195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 --2- 172.21.15.138:0/21727943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd380ffd30 0x7fbd38196260 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 >> 172.21.15.138:0/21727943 conn(0x7fbd38074f50 msgr2=0x7fbd38068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 shutdown_connections 2024-02-15T22:56:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.207+0000 7fbd3f434700 1 -- 172.21.15.138:0/21727943 wait complete. 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: Reconfiguring mds.cephfs.smithi170.banvev (monmap changed)... 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: Reconfiguring daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/944466138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:52.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:52 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2182585004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 -- 172.21.15.138:0/820341941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ff2d0 msgr2=0x7fdcf80ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 --2- 172.21.15.138:0/820341941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf80ff6a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009910 tx=0x7fdcf4009c20 comp rx=0 tx=0).stop 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 -- 172.21.15.138:0/820341941 shutdown_connections 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 --2- 172.21.15.138:0/820341941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 --2- 172.21.15.138:0/820341941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf80ff6a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 -- 172.21.15.138:0/820341941 >> 172.21.15.138:0/820341941 conn(0x7fdcf80fabb0 msgr2=0x7fdcf80fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:52.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 -- 172.21.15.138:0/820341941 shutdown_connections 2024-02-15T22:56:52.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.310+0000 7fdcff44d700 1 -- 172.21.15.138:0/820341941 wait complete. 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 Processor -- start 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 -- start start 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf8100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8101760 con 0x7fdcf80ffc70 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcff44d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf81018a0 con 0x7fdcf80ff2d0 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcfc9e8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:52.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcfc9e8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:36468/0 (socket says 172.21.15.138:36468) 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcfc9e8700 1 -- 172.21.15.138:0/4045426730 learned_addr learned my addr 172.21.15.138:0/4045426730 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.311+0000 7fdcfd1e9700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf8100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcfc9e8700 1 -- 172.21.15.138:0/4045426730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ff2d0 msgr2=0x7fdcf8100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcfc9e8700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf8100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcfc9e8700 1 -- 172.21.15.138:0/4045426730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40095f0 con 0x7fdcf80ffc70 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcfc9e8700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c8f0 tx=0x7fdce800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce80078a0 con 0x7fdcf80ffc70 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdce800f450 con 0x7fdcf80ffc70 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf81a1f50 con 0x7fdcf80ffc70 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdce8018610 con 0x7fdcf80ffc70 2024-02-15T22:56:52.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.312+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf81a2360 con 0x7fdcf80ffc70 2024-02-15T22:56:52.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.313+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf804ea50 con 0x7fdcf80ffc70 2024-02-15T22:56:52.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.314+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fdce800f5c0 con 0x7fdcf80ffc70 2024-02-15T22:56:52.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.314+0000 7fdcee7fc700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 0x7fdce406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:56:52.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.314+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdce808d660 con 0x7fdcf80ffc70 2024-02-15T22:56:52.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.314+0000 7fdcfd1e9700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 0x7fdce406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:56:52.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.314+0000 7fdcfd1e9700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 0x7fdce406fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4006010 tx=0x7fdcf401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:56:52.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.318+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdce8056ca0 con 0x7fdcf80ffc70 2024-02-15T22:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.600+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdcf8102210 con 0x7fdcf80ffc70 2024-02-15T22:56:52.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.600+0000 7fdcee7fc700 1 -- 172.21.15.138:0/4045426730 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdce805a360 con 0x7fdcf80ffc70 2024-02-15T22:56:52.603 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 msgr2=0x7fdce406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 0x7fdce406fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4006010 tx=0x7fdcf401a040 comp rx=0 tx=0).stop 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 msgr2=0x7fdcf8101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c8f0 tx=0x7fdce800cc00 comp rx=0 tx=0).stop 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 shutdown_connections 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdce406d9e0 0x7fdce406fe90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf80ff2d0 0x7fdcf8100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 --2- 172.21.15.138:0/4045426730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcf80ffc70 0x7fdcf8101220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 >> 172.21.15.138:0/4045426730 conn(0x7fdcf80fabb0 msgr2=0x7fdcf8068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 shutdown_connections 2024-02-15T22:56:52.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:56:52.603+0000 7fdcff44d700 1 -- 172.21.15.138:0/4045426730 wait complete. 2024-02-15T22:56:53.338 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/4045426730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:53.339 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:56:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/4045426730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:56:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T22:56:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:54.326 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:54 smithi170 ceph-mon[67652]: Reconfiguring mds.cephfs.smithi170.cbefkf (monmap changed)... 2024-02-15T22:56:54.326 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:54 smithi170 ceph-mon[67652]: Reconfiguring daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T22:56:54.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:54 smithi138 ceph-mon[89527]: Reconfiguring mds.cephfs.smithi170.cbefkf (monmap changed)... 2024-02-15T22:56:54.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:54 smithi138 ceph-mon[89527]: Reconfiguring daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T22:56:55.278 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:55.278 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.278 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.278 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:55.278 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]: dispatch 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]': finished 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]: dispatch 2024-02-15T22:56:55.279 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]': finished 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]: dispatch 2024-02-15T22:56:55.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi138"}]': finished 2024-02-15T22:56:55.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]: dispatch 2024-02-15T22:56:55.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi170"}]': finished 2024-02-15T22:56:56.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:56 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all mon 2024-02-15T22:56:56.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:56 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:56.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:56 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:56.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:56 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:56.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:56 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all mon 2024-02-15T22:56:56.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:56 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:56:56.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:56 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi138", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:56:56.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:56 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:56:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:57 smithi138 ceph-mon[89527]: Upgrade: Updating crash.smithi138 (1/2) 2024-02-15T22:56:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:57 smithi138 ceph-mon[89527]: Deploying daemon crash.smithi138 on smithi138 2024-02-15T22:56:57.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:57 smithi138 ceph-mon[89527]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:57.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:57 smithi170 ceph-mon[67652]: Upgrade: Updating crash.smithi138 (1/2) 2024-02-15T22:56:57.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:57 smithi170 ceph-mon[67652]: Deploying daemon crash.smithi138 on smithi138 2024-02-15T22:56:57.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:57 smithi170 ceph-mon[67652]: pgmap v31: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:56:59.275 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:56:59 smithi138 ceph-mon[89527]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:56:59.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:56:59 smithi170 ceph-mon[67652]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:00.892 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:00.892 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:00.892 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:00 smithi138 ceph-mon[89527]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:00.893 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:01.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:01.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:01.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:00 smithi170 ceph-mon[67652]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:01.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:02.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:02 smithi170 ceph-mon[67652]: Upgrade: Updating crash.smithi170 (2/2) 2024-02-15T22:57:02.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:02.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:57:02.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:02.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:02 smithi170 ceph-mon[67652]: Deploying daemon crash.smithi170 on smithi170 2024-02-15T22:57:02.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:02 smithi138 ceph-mon[89527]: Upgrade: Updating crash.smithi170 (2/2) 2024-02-15T22:57:02.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:02.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi170", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T22:57:02.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:02.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:02 smithi138 ceph-mon[89527]: Deploying daemon crash.smithi170 on smithi170 2024-02-15T22:57:03.469 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:03 smithi170 ceph-mon[67652]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:03 smithi138 ceph-mon[89527]: pgmap v34: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:05 smithi170 ceph-mon[67652]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:05.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:05.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:05.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:05.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:05 smithi138 ceph-mon[89527]: pgmap v35: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:05.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:05.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:05.541 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:07 smithi170 ceph-mon[67652]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:07 smithi138 ceph-mon[89527]: pgmap v36: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:08.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:08.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:08 smithi138 ceph-mon[89527]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:09.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:08 smithi170 ceph-mon[67652]: pgmap v37: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:09.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:10.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:10.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:11.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:11.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:11.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:10 smithi138 ceph-mon[89527]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:11.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:11.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:11.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:10 smithi170 ceph-mon[67652]: pgmap v38: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:12.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:12.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:13.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:13 smithi138 ceph-mon[89527]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:13.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:13 smithi170 ceph-mon[67652]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]': finished 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]': finished 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:57:15.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:15.556 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi138"}]': finished 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi170"}]': finished 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:57:15.557 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:16.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:16 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all crash 2024-02-15T22:57:16.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:16 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:57:16.460 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:16 smithi138 ceph-mon[89527]: Upgrade: osd.0 is safe to restart 2024-02-15T22:57:16.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:16 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all crash 2024-02-15T22:57:16.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:16 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T22:57:16.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:16 smithi170 ceph-mon[67652]: Upgrade: osd.0 is safe to restart 2024-02-15T22:57:17.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:17 smithi138 ceph-mon[89527]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:17.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:17 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:17.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:17 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:57:17.292 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:17 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:17.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:17 smithi170 ceph-mon[67652]: pgmap v41: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:17.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:17 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:17.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:17 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T22:57:17.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:17 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:18.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:18 smithi170 ceph-mon[67652]: Upgrade: Updating osd.0 2024-02-15T22:57:18.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:18 smithi170 ceph-mon[67652]: Deploying daemon osd.0 on smithi138 2024-02-15T22:57:18.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:18 smithi138 ceph-mon[89527]: Upgrade: Updating osd.0 2024-02-15T22:57:18.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:18 smithi138 ceph-mon[89527]: Deploying daemon osd.0 on smithi138 2024-02-15T22:57:19.705 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:19 smithi138 ceph-mon[89527]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:19.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:19 smithi170 ceph-mon[67652]: pgmap v42: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:19.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:19 smithi138 systemd[1]: Stopping Ceph osd.0 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:57:19.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:19 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[44140]: 2024-02-15T22:57:19.927+0000 7feeb7844700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:57:19.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:19 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[44140]: 2024-02-15T22:57:19.927+0000 7feeb7844700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-15T22:57:19.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:19 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[44140]: 2024-02-15T22:57:19.927+0000 7feeb7844700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:57:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:20 smithi138 ceph-mon[89527]: osd.0 marked itself down and dead 2024-02-15T22:57:20.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:20 smithi170 ceph-mon[67652]: osd.0 marked itself down and dead 2024-02-15T22:57:21.114 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:20 smithi138 podman[100914]: 2024-02-15 22:57:20.806254755 +0000 UTC m=+0.963483494 container died aa1ac3281d07833a07b334bc657aa55f177836833694910e1bf365b619e7b3ca (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD) 2024-02-15T22:57:21.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:21 smithi138 ceph-mon[89527]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:21.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:21 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:57:21.432 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:21 smithi138 ceph-mon[89527]: osdmap e50: 6 total, 5 up, 6 in 2024-02-15T22:57:21.432 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:21 smithi138 podman[100914]: 2024-02-15 22:57:21.21187479 +0000 UTC m=+1.369103529 container cleanup aa1ac3281d07833a07b334bc657aa55f177836833694910e1bf365b619e7b3ca (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-15T22:57:21.432 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:21 smithi138 bash[100914]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0 2024-02-15T22:57:21.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:21 smithi138 podman[100931]: 2024-02-15 22:57:21.430332205 +0000 UTC m=+0.628164970 container remove aa1ac3281d07833a07b334bc657aa55f177836833694910e1bf365b619e7b3ca (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, RELEASE=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212) 2024-02-15T22:57:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:21 smithi170 ceph-mon[67652]: pgmap v43: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:21.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:21 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:57:21.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:21 smithi170 ceph-mon[67652]: osdmap e50: 6 total, 5 up, 6 in 2024-02-15T22:57:22.145 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:21 smithi138 podman[101021]: 2024-02-15 22:57:21.732661792 +0000 UTC m=+0.018689120 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:57:22.145 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:21 smithi138 podman[101021]: 2024-02-15 22:57:21.831386982 +0000 UTC m=+0.117414302 container create 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-15T22:57:22.145 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 podman[101021]: 2024-02-15 22:57:22.068001419 +0000 UTC m=+0.354028741 container init 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:57:22.145 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 podman[101021]: 2024-02-15 22:57:22.071043597 +0000 UTC m=+0.357070920 container start 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240214) 2024-02-15T22:57:22.145 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 podman[101021]: 2024-02-15 22:57:22.143009686 +0000 UTC m=+0.429037005 container attach 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-15T22:57:22.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:22 smithi138 ceph-mon[89527]: osdmap e51: 6 total, 5 up, 6 in 2024-02-15T22:57:22.485 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 podman[101021]: 2024-02-15 22:57:22.372036581 +0000 UTC m=+0.658063906 container died 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:57:22.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 -- 172.21.15.138:0/1808895701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 msgr2=0x7f29fc0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:22.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 --2- 172.21.15.138:0/1808895701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc0ff690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29f400b0a0 tx=0x7f29f400b3b0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 -- 172.21.15.138:0/1808895701 shutdown_connections 2024-02-15T22:57:22.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 --2- 172.21.15.138:0/1808895701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29fc0ffc60 0x7f29fc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 --2- 172.21.15.138:0/1808895701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc0ff690 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 -- 172.21.15.138:0/1808895701 >> 172.21.15.138:0/1808895701 conn(0x7f29fc0fab60 msgr2=0x7f29fc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:22.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 -- 172.21.15.138:0/1808895701 shutdown_connections 2024-02-15T22:57:22.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.713+0000 7f2a01629700 1 -- 172.21.15.138:0/1808895701 wait complete. 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 Processor -- start 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 -- start start 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29fc0ffc60 0x7f29fc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc197790 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f2a01629700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29fc1978d0 con 0x7f29fc0ffc60 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f29faffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:22.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f29faffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40064/0 (socket says 172.21.15.138:40064) 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.714+0000 7f29faffd700 1 -- 172.21.15.138:0/1416602509 learned_addr learned my addr 172.21.15.138:0/1416602509 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29faffd700 1 -- 172.21.15.138:0/1416602509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29fc0ffc60 msgr2=0x7f29fc197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29faffd700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29fc0ffc60 0x7f29fc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29faffd700 1 -- 172.21.15.138:0/1416602509 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4009d00 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29faffd700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000f80 tx=0x7f29f400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f400e040 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc19fca0 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29f4003de0 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29f401d790 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.715+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc1a00b0 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.716+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29fc1075d0 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.716+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f29f4004040 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.717+0000 7f29f3fff700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 0x7f29e806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.717+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f29f408ef20 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.717+0000 7f29fa7fc700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 0x7f29e806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:22.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.717+0000 7f29fa7fc700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 0x7f29e806fe90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29e4005950 tx=0x7f29e40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:22.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.722+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f29f40c2d20 con 0x7f29fc0ff2c0 2024-02-15T22:57:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:22 smithi170 ceph-mon[67652]: osdmap e51: 6 total, 5 up, 6 in 2024-02-15T22:57:22.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.942+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29fc02cd40 con 0x7f29e806d9e0 2024-02-15T22:57:22.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.943+0000 7f29f3fff700 1 -- 172.21.15.138:0/1416602509 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f29fc02cd40 con 0x7f29e806d9e0 2024-02-15T22:57:22.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 msgr2=0x7f29e806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:22.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 0x7f29e806fe90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29e4005950 tx=0x7f29e40058e0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 msgr2=0x7f29fc196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000f80 tx=0x7f29f400cdd0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 shutdown_connections 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f29e806d9e0 0x7f29e806fe90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29fc0ff2c0 0x7f29fc196c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 --2- 172.21.15.138:0/1416602509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29fc0ffc60 0x7f29fc197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 >> 172.21.15.138:0/1416602509 conn(0x7f29fc0fab60 msgr2=0x7f29fc0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 shutdown_connections 2024-02-15T22:57:22.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:22.945+0000 7f2a01629700 1 -- 172.21.15.138:0/1416602509 wait complete. 2024-02-15T22:57:22.959 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 -- 172.21.15.138:0/3670724000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 msgr2=0x7f422c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 --2- 172.21.15.138:0/3670724000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c104dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f421c009910 tx=0x7f421c009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 -- 172.21.15.138:0/3670724000 shutdown_connections 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 --2- 172.21.15.138:0/3670724000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c104dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 --2- 172.21.15.138:0/3670724000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 0x7f422c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 -- 172.21.15.138:0/3670724000 >> 172.21.15.138:0/3670724000 conn(0x7f422c0fbd00 msgr2=0x7f422c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 -- 172.21.15.138:0/3670724000 shutdown_connections 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 -- 172.21.15.138:0/3670724000 wait complete. 2024-02-15T22:57:23.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.064+0000 7f42320e3700 1 Processor -- start 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f42320e3700 1 -- start start 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f42320e3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 0x7f422c073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f42320e3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f42320e3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c073ad0 con 0x7f422c100e00 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f42320e3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c073c10 con 0x7f422c100460 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40078/0 (socket says 172.21.15.138:40078) 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422b7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 0x7f422c073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 -- 172.21.15.138:0/3000856300 learned_addr learned my addr 172.21.15.138:0/3000856300 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 -- 172.21.15.138:0/3000856300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 msgr2=0x7f422c073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 0x7f422c073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.065+0000 7f422affd700 1 -- 172.21.15.138:0/3000856300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0095f0 con 0x7f422c100e00 2024-02-15T22:57:23.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f422affd700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f421c00bda0 tx=0x7f421c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c01d070 con 0x7f422c100e00 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f421c00f460 con 0x7f422c100e00 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c073e90 con 0x7f422c100e00 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f421c017630 con 0x7f422c100e00 2024-02-15T22:57:23.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.066+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c1a2250 con 0x7f422c100e00 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.067+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c1087d0 con 0x7f422c100e00 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.067+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f421c017790 con 0x7f422c100e00 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.068+0000 7f4228ff9700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 0x7f421406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.068+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f421c08eb30 con 0x7f422c100e00 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.068+0000 7f422b7fe700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 0x7f421406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.068+0000 7f422b7fe700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 0x7f421406fe90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f422000ac50 tx=0x7f422000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.072+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f421c058340 con 0x7f422c100e00 2024-02-15T22:57:23.212 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 podman[101047]: 2024-02-15 22:57:22.968480924 +0000 UTC m=+0.587201727 container remove 041eba1df8978f99e31c30c88d6b4f5130fbaea15c740a8f1c5247cb86848d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:57:23.213 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-15T22:57:23.213 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 systemd[1]: Stopped Ceph osd.0 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:57:23.213 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:22 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.0.service: Consumed 56.671s CPU time. 2024-02-15T22:57:23.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.305+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f422c061190 con 0x7f421406d9e0 2024-02-15T22:57:23.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.307+0000 7f4228ff9700 1 -- 172.21.15.138:0/3000856300 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f422c061190 con 0x7f421406d9e0 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 msgr2=0x7f421406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 0x7f421406fe90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f422000ac50 tx=0x7f422000a380 comp rx=0 tx=0).stop 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 msgr2=0x7f422c073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f421c00bda0 tx=0x7f421c00bdd0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 shutdown_connections 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f421406d9e0 0x7f421406fe90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c100460 0x7f422c073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 --2- 172.21.15.138:0/3000856300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f422c100e00 0x7f422c073590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 >> 172.21.15.138:0/3000856300 conn(0x7f422c0fbd00 msgr2=0x7f422c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 shutdown_connections 2024-02-15T22:57:23.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.309+0000 7f42320e3700 1 -- 172.21.15.138:0/3000856300 wait complete. 2024-02-15T22:57:23.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 -- 172.21.15.138:0/1863799363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 msgr2=0x7fd154101740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 --2- 172.21.15.138:0/1863799363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154101740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd150009910 tx=0x7fd150009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 -- 172.21.15.138:0/1863799363 shutdown_connections 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 --2- 172.21.15.138:0/1863799363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 0x7fd15410a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 --2- 172.21.15.138:0/1863799363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154101740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 -- 172.21.15.138:0/1863799363 >> 172.21.15.138:0/1863799363 conn(0x7fd1540fabd0 msgr2=0x7fd1540fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 -- 172.21.15.138:0/1863799363 shutdown_connections 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.423+0000 7fd15b482700 1 -- 172.21.15.138:0/1863799363 wait complete. 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 Processor -- start 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 -- start start 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 0x7fd154196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154196930 con 0x7fd154101370 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15b482700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15419a6c0 con 0x7fd154101c80 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40092/0 (socket says 172.21.15.138:40092) 2024-02-15T22:57:23.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 -- 172.21.15.138:0/1450200116 learned_addr learned my addr 172.21.15.138:0/1450200116 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:23.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd158a1d700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 0x7fd154196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 -- 172.21.15.138:0/1450200116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 msgr2=0x7fd154196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 0x7fd154196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.424+0000 7fd15921e700 1 -- 172.21.15.138:0/1450200116 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500095f0 con 0x7fd154101370 2024-02-15T22:57:23.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd15921e700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1500092e0 tx=0x7fd15000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15001d070 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd150005e00 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15419a940 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd150017400 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.425+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15419ae30 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.426+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd154107850 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.426+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fd15000f460 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.427+0000 7fd14a7fc700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 0x7fd14006fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.427+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd15008ec50 con 0x7fd154101370 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.427+0000 7fd158a1d700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 0x7fd14006fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.427+0000 7fd158a1d700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 0x7fd14006fe80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd144005950 tx=0x7fd1440058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.432+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd150058290 con 0x7fd154101370 2024-02-15T22:57:23.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:23 smithi138 ceph-mon[89527]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T22:57:23.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:23 smithi138 ceph-mon[89527]: Health check failed: Reduced data availability: 24 pgs peering (PG_AVAILABILITY) 2024-02-15T22:57:23.485 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 systemd[1]: Starting Ceph osd.0 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:57:23.485 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 podman[101198]: 2024-02-15 22:57:23.341074218 +0000 UTC m=+0.019457831 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:57:23.485 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 podman[101198]: 2024-02-15 22:57:23.449691385 +0000 UTC m=+0.128074984 container create 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-02-15T22:57:23.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.655+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd15402cd10 con 0x7fd14006d9d0 2024-02-15T22:57:23.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.666+0000 7fd14a7fc700 1 -- 172.21.15.138:0/1450200116 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd15402cd10 con 0x7fd14006d9d0 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (3m) 13s ago 14m 25.6M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (14m) 13s ago 14m 8224k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (13m) 16s ago 13m 8182k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (24s) 13s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (19s) 16s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (2m) 13s ago 14m 86.9M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (8m) 13s ago 8m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (8m) 13s ago 8m 134M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (8m) 16s ago 8m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (8m) 16s ago 8m 60.3M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (6m) 13s ago 15m 495M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:57:23.669 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (4m) 16s ago 13m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (92s) 13s ago 16m 44.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (67s) 16s ago 13m 40.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (4m) 13s ago 14m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (4m) 16s ago 13m 16.6M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (12m) 13s ago 12m 224M 1216M 18.2.0 dc2bc1663786 aa1ac3281d07 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (12m) 13s ago 12m 243M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (11m) 13s ago 11m 196M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (11m) 16s ago 11m 272M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (10m) 16s ago 10m 254M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (10m) 16s ago 10m 228M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:57:23.670 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (4m) 13s ago 13m 67.2M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 msgr2=0x7fd14006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 0x7fd14006fe80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd144005950 tx=0x7fd1440058e0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 msgr2=0x7fd154195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1500092e0 tx=0x7fd15000be20 comp rx=0 tx=0).stop 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 shutdown_connections 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd14006d9d0 0x7fd14006fe80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd154101370 0x7fd154195d10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 --2- 172.21.15.138:0/1450200116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd154101c80 0x7fd154196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 >> 172.21.15.138:0/1450200116 conn(0x7fd1540fabd0 msgr2=0x7fd154104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 shutdown_connections 2024-02-15T22:57:23.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.668+0000 7fd15b482700 1 -- 172.21.15.138:0/1450200116 wait complete. 2024-02-15T22:57:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:23 smithi170 ceph-mon[67652]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T22:57:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:23 smithi170 ceph-mon[67652]: Health check failed: Reduced data availability: 24 pgs peering (PG_AVAILABILITY) 2024-02-15T22:57:23.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/1164952645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ffd30 msgr2=0x7fc5cc103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/1164952645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc103ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009910 tx=0x7fc5b8009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/1164952645 shutdown_connections 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/1164952645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc103ce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/1164952645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/1164952645 >> 172.21.15.138:0/1164952645 conn(0x7fc5cc074f50 msgr2=0x7fc5cc075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/1164952645 shutdown_connections 2024-02-15T22:57:23.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.776+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/1164952645 wait complete. 2024-02-15T22:57:23.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 Processor -- start 2024-02-15T22:57:23.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 -- start start 2024-02-15T22:57:23.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc19af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc19b5b0 con 0x7fc5cc0ff390 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d2ab4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc194a60 con 0x7fc5cc0ffd30 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49026/0 (socket says 172.21.15.138:49026) 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 -- 172.21.15.138:0/190496101 learned_addr learned my addr 172.21.15.138:0/190496101 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5cbfff700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc19af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 -- 172.21.15.138:0/190496101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ffd30 msgr2=0x7fc5cc19af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc19af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:23.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.777+0000 7fc5d0850700 1 -- 172.21.15.138:0/190496101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80095f0 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5d0850700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000e920 tx=0x7fc5c000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c0009790 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc194d40 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5c000cba0 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c0018650 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.778+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc195290 con 0x7fc5cc0ff390 2024-02-15T22:57:23.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.779+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc107600 con 0x7fc5cc0ff390 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.780+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fc5c0018910 con 0x7fc5cc0ff390 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.780+0000 7fc5c9ffb700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 0x7fc5bc06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.780+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc5c0014070 con 0x7fc5cc0ff390 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.780+0000 7fc5cbfff700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 0x7fc5bc06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:23.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.781+0000 7fc5cbfff700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 0x7fc5bc06fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800b760 tx=0x7fc5b8009f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:23.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:23.785+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5c0052d20 con 0x7fc5cc0ff390 2024-02-15T22:57:23.984 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 podman[101198]: 2024-02-15 22:57:23.712137436 +0000 UTC m=+0.390521034 container init 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-15T22:57:23.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 podman[101198]: 2024-02-15 22:57:23.715497237 +0000 UTC m=+0.393880845 container start 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:57:23.985 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:23 smithi138 podman[101198]: 2024-02-15 22:57:23.794932312 +0000 UTC m=+0.473315932 container attach 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:57:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.078+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc5cc195570 con 0x7fc5cc0ff390 2024-02-15T22:57:24.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.078+0000 7fc5c9ffb700 1 -- 172.21.15.138:0/190496101 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+687 (secure 0 0 0) 0x7fc5c005ab40 con 0x7fc5cc0ff390 2024-02-15T22:57:24.081 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:57:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:57:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:57:24.083 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 msgr2=0x7fc5bc06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 0x7fc5bc06fe80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800b760 tx=0x7fc5b8009f90 comp rx=0 tx=0).stop 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 msgr2=0x7fc5cc19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000e920 tx=0x7fc5c000ece0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 shutdown_connections 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5bc06d9d0 0x7fc5bc06fe80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5cc0ff390 0x7fc5cc19a9e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 --2- 172.21.15.138:0/190496101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5cc0ffd30 0x7fc5cc19af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 >> 172.21.15.138:0/190496101 conn(0x7fc5cc074f50 msgr2=0x7fc5cc0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 shutdown_connections 2024-02-15T22:57:24.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.081+0000 7fc5d2ab4700 1 -- 172.21.15.138:0/190496101 wait complete. 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.210+0000 7f4a14d73700 1 -- 172.21.15.138:0/3867844304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100400 msgr2=0x7f4a101007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.210+0000 7f4a14d73700 1 --2- 172.21.15.138:0/3867844304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100400 0x7f4a101007d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009910 tx=0x7f4a04009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 -- 172.21.15.138:0/3867844304 shutdown_connections 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 --2- 172.21.15.138:0/3867844304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100da0 0x7f4a10104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 --2- 172.21.15.138:0/3867844304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100400 0x7f4a101007d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 -- 172.21.15.138:0/3867844304 >> 172.21.15.138:0/3867844304 conn(0x7f4a100fbca0 msgr2=0x7f4a100fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 -- 172.21.15.138:0/3867844304 shutdown_connections 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 -- 172.21.15.138:0/3867844304 wait complete. 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.211+0000 7f4a14d73700 1 Processor -- start 2024-02-15T22:57:24.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a14d73700 1 -- start start 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a14d73700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100400 0x7f4a10195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a14d73700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a14d73700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10196970 con 0x7f4a10100da0 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a14d73700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1019a700 con 0x7f4a10100400 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49040/0 (socket says 172.21.15.138:49040) 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 -- 172.21.15.138:0/981142713 learned_addr learned my addr 172.21.15.138:0/981142713 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0e59c700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100400 0x7f4a10195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 -- 172.21.15.138:0/981142713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100400 msgr2=0x7f4a10195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100400 0x7f4a10195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 -- 172.21.15.138:0/981142713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040095f0 con 0x7f4a10100da0 2024-02-15T22:57:24.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.212+0000 7f4a0dd9b700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d900 tx=0x7f4a0000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.213+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a00009900 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.213+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a00010460 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.213+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1019a9e0 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.213+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1019af30 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.213+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0000f5f0 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.214+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10108710 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.215+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f4a000105d0 con 0x7f4a10100da0 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.215+0000 7f49ff7fe700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 0x7f49f806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.215+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4a0008d1a0 con 0x7f4a10100da0 2024-02-15T22:57:24.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.215+0000 7f4a0e59c700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 0x7f49f806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.216+0000 7f4a0e59c700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 0x7f49f806fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a04006010 tx=0x7f4a0401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.220+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4a00056860 con 0x7f4a10100da0 2024-02-15T22:57:24.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.467+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a1004ea50 con 0x7f4a10100da0 2024-02-15T22:57:24.471 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-mon[89527]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:24.471 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-mon[89527]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:24.471 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/190496101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:24.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.468+0000 7f49ff7fe700 1 -- 172.21.15.138:0/981142713 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f4a00020770 con 0x7f4a10100da0 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T22:57:24.472 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T22:57:24.473 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 bash[101198]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-15T22:57:24.473 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate[101234]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-15T22:57:24.473 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 podman[101198]: 2024-02-15 22:57:24.214573185 +0000 UTC m=+0.892956792 container died 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:57:24.473 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:57:24.474 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:24.475 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:24.476 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:24.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 msgr2=0x7f49f806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 0x7f49f806fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a04006010 tx=0x7f4a0401a040 comp rx=0 tx=0).stop 2024-02-15T22:57:24.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 msgr2=0x7f4a10196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000d900 tx=0x7f4a0000dc10 comp rx=0 tx=0).stop 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 shutdown_connections 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f49f806d9e0 0x7f49f806fe90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a10100400 0x7f4a10195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 --2- 172.21.15.138:0/981142713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4a10100da0 0x7f4a10196290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 >> 172.21.15.138:0/981142713 conn(0x7f4a100fbca0 msgr2=0x7f4a100fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 shutdown_connections 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.470+0000 7f4a14d73700 1 -- 172.21.15.138:0/981142713 wait complete. 2024-02-15T22:57:24.477 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:57:24.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 -- 172.21.15.138:0/633302656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2548100d50 msgr2=0x7f2548104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 --2- 172.21.15.138:0/633302656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2548100d50 0x7f2548104d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f253c009910 tx=0x7f253c009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 -- 172.21.15.138:0/633302656 shutdown_connections 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 --2- 172.21.15.138:0/633302656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2548100d50 0x7f2548104d20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 --2- 172.21.15.138:0/633302656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25481003b0 0x7f2548100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 -- 172.21.15.138:0/633302656 >> 172.21.15.138:0/633302656 conn(0x7f25480fbc30 msgr2=0x7f25480fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 -- 172.21.15.138:0/633302656 shutdown_connections 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.579+0000 7f2550390700 1 -- 172.21.15.138:0/633302656 wait complete. 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 Processor -- start 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 -- start start 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2548100d50 0x7f2548073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548073ad0 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f2550390700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548073c10 con 0x7f2548100d50 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49054/0 (socket says 172.21.15.138:49054) 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 -- 172.21.15.138:0/1312071936 learned_addr learned my addr 172.21.15.138:0/1312071936 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254d92b700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2548100d50 0x7f2548073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 -- 172.21.15.138:0/1312071936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2548100d50 msgr2=0x7f2548073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2548100d50 0x7f2548073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 -- 172.21.15.138:0/1312071936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0095f0 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f254e12c700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25380060b0 tx=0x7f253800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.580+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f253800dda0 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.581+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f253800f040 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.581+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25481a1f90 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.581+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2538014790 con 0x7f25481003b0 2024-02-15T22:57:24.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.581+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25481a23a0 con 0x7f25481003b0 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.581+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2548108720 con 0x7f25481003b0 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.582+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7f2538014980 con 0x7f25481003b0 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.582+0000 7f25477fe700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 0x7f253006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.582+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f253808d1c0 con 0x7f25481003b0 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.582+0000 7f254d92b700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 0x7f253006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.583+0000 7f254d92b700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 0x7f253006fe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2548074840 tx=0x7f253c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.587+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f25380568b0 con 0x7f25481003b0 2024-02-15T22:57:24.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:24 smithi170 ceph-mon[67652]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:24.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:24 smithi170 ceph-mon[67652]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:24.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:24 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/190496101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:24.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.807+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f254802cc80 con 0x7f253006d9e0 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.808+0000 7f25477fe700 1 -- 172.21.15.138:0/1312071936 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f254802cc80 con 0x7f253006d9e0 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:57:24.811 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:57:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "6/23 daemons upgraded", 2024-02-15T22:57:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:57:24.812 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:57:24.812 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:57:24.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.810+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 msgr2=0x7f253006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.810+0000 7f2550390700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 0x7f253006fe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2548074840 tx=0x7f253c01a040 comp rx=0 tx=0).stop 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.810+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 msgr2=0x7f2548073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.810+0000 7f2550390700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25380060b0 tx=0x7f253800d3b0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 shutdown_connections 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f253006d9e0 0x7f253006fe90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25481003b0 0x7f2548073050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 --2- 172.21.15.138:0/1312071936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2548100d50 0x7f2548073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 >> 172.21.15.138:0/1312071936 conn(0x7f25480fbc30 msgr2=0x7f25480fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 shutdown_connections 2024-02-15T22:57:24.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.811+0000 7f2550390700 1 -- 172.21.15.138:0/1312071936 wait complete. 2024-02-15T22:57:24.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.926+0000 7fe51417c700 1 -- 172.21.15.138:0/4203799025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 msgr2=0x7fe50c0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.926+0000 7fe51417c700 1 --2- 172.21.15.138:0/4203799025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c0734c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe504009910 tx=0x7fe504009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 -- 172.21.15.138:0/4203799025 shutdown_connections 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 --2- 172.21.15.138:0/4203799025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c110cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 --2- 172.21.15.138:0/4203799025 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c0734c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 -- 172.21.15.138:0/4203799025 >> 172.21.15.138:0/4203799025 conn(0x7fe50c0fbd00 msgr2=0x7fe50c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 -- 172.21.15.138:0/4203799025 shutdown_connections 2024-02-15T22:57:24.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 -- 172.21.15.138:0/4203799025 wait complete. 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 Processor -- start 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.927+0000 7fe51417c700 1 -- start start 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe51417c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe51417c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe51417c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c06df50 con 0x7fe50c0730f0 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe51417c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c06e0c0 con 0x7fe50c073a00 2024-02-15T22:57:24.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49076/0 (socket says 172.21.15.138:49076) 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 -- 172.21.15.138:0/3042196208 learned_addr learned my addr 172.21.15.138:0/3042196208 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511717700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 -- 172.21.15.138:0/3042196208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 msgr2=0x7fe50c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 -- 172.21.15.138:0/3042196208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040095f0 con 0x7fe50c0730f0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511717700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.928+0000 7fe511f18700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe504006010 tx=0x7fe50400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.929+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50401d070 con 0x7fe50c0730f0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.929+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe504004fb0 con 0x7fe50c0730f0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.929+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c06e3a0 con 0x7fe50c0730f0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.929+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe504022ea0 con 0x7fe50c0730f0 2024-02-15T22:57:24.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.929+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c1aefa0 con 0x7fe50c0730f0 2024-02-15T22:57:24.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.930+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c10e450 con 0x7fe50c0730f0 2024-02-15T22:57:24.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.930+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 38) v1 ==== 91597+0+0 (secure 0 0 0) 0x7fe50400f690 con 0x7fe50c0730f0 2024-02-15T22:57:24.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.931+0000 7fe502ffd700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 0x7fe4f806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:24.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.931+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe50408eb20 con 0x7fe50c0730f0 2024-02-15T22:57:24.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.931+0000 7fe511717700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 0x7fe4f806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:24.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.932+0000 7fe511717700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 0x7fe4f806fe90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06f170 tx=0x7fe4fc005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:24.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:24.936+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe504058290 con 0x7fe50c0730f0 2024-02-15T22:57:25.087 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:24 smithi138 podman[101420]: 2024-02-15 22:57:24.858880076 +0000 UTC m=+0.634695950 container remove 9b89724f7ad2f68814ca55e23248f335fc76fa6d1ec012abff63e7b07d72ac6b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:57:25.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.235+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe50c04ea50 con 0x7fe50c0730f0 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.235+0000 7fe502ffd700 1 -- 172.21.15.138:0/3042196208 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+2087 (secure 0 0 0) 0x7fe504027090 con 0x7fe50c0730f0 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 24 pgs peering 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: osd.0 (root=default,host=smithi138) is down 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 24 pgs peering 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.c is stuck peering for 84s, current state peering, last acting [2,3] 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.e is stuck peering for 84s, current state peering, last acting [2,3] 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.f is stuck peering for 83s, current state peering, last acting [4,5] 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.10 is stuck peering for 84s, current state peering, last acting [2,1] 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.12 is stuck peering for 83s, current state peering, last acting [3,1] 2024-02-15T22:57:25.238 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.13 is stuck peering for 6m, current state peering, last acting [4,2] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.15 is stuck peering for 83s, current state peering, last acting [1,3] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.19 is stuck peering for 4m, current state peering, last acting [4,2] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.1b is stuck peering for 83s, current state peering, last acting [1,5] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.1d is stuck peering for 83s, current state peering, last acting [3,5] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 2.1f is stuck peering for 5m, current state peering, last acting [3,4] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.1 is stuck peering for 4m, current state peering, last acting [4,2] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.6 is stuck peering for 4m, current state peering, last acting [1,4] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.b is stuck peering for 83s, current state peering, last acting [1,4] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.c is stuck peering for 83s, current state peering, last acting [5,3] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.f is stuck peering for 83s, current state peering, last acting [5,3] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.10 is stuck peering for 83s, current state peering, last acting [5,1] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.11 is stuck peering for 83s, current state peering, last acting [3,4] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.12 is stuck peering for 4m, current state peering, last acting [3,1] 2024-02-15T22:57:25.239 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.15 is stuck peering for 83s, current state peering, last acting [3,4] 2024-02-15T22:57:25.240 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.17 is stuck peering for 4m, current state peering, last acting [5,2] 2024-02-15T22:57:25.240 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.18 is stuck peering for 84s, current state peering, last acting [2,1] 2024-02-15T22:57:25.240 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.1b is stuck peering for 4m, current state peering, last acting [4,3] 2024-02-15T22:57:25.240 INFO:teuthology.orchestra.run.smithi138.stdout: pg 3.1f is stuck peering for 4m, current state peering, last acting [3,2] 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 msgr2=0x7fe4f806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 0x7fe4f806fe90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06f170 tx=0x7fe4fc005f50 comp rx=0 tx=0).stop 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 msgr2=0x7fe50c072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe504006010 tx=0x7fe50400be20 comp rx=0 tx=0).stop 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 shutdown_connections 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4f806d9e0 0x7fe4f806fe90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe50c0730f0 0x7fe50c072980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 --2- 172.21.15.138:0/3042196208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50c073a00 0x7fe50c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:25.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 >> 172.21.15.138:0/3042196208 conn(0x7fe50c0fbd00 msgr2=0x7fe50c1027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:25.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 shutdown_connections 2024-02-15T22:57:25.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:25.237+0000 7fe51417c700 1 -- 172.21.15.138:0/3042196208 wait complete. 2024-02-15T22:57:25.366 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-mon[89527]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:25.366 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-mon[89527]: pgmap v47: 65 pgs: 34 peering, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:57:25.366 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/981142713' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:57:25.366 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3042196208' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:57:25.366 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 podman[101526]: 2024-02-15 22:57:24.988499463 +0000 UTC m=+0.018040652 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:57:25.366 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 podman[101526]: 2024-02-15 22:57:25.126899947 +0000 UTC m=+0.156441126 container create a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-15T22:57:25.366 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 podman[101526]: 2024-02-15 22:57:25.363929447 +0000 UTC m=+0.393470636 container init a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:57:25.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 podman[101526]: 2024-02-15 22:57:25.367222554 +0000 UTC m=+0.396763742 container start a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:57:25.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-osd[101548]: -- 172.21.15.138:0/3483593513 <== mon.0 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555918a391e0 con 0x555918a0b000 2024-02-15T22:57:25.735 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 bash[101526]: a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 2024-02-15T22:57:25.735 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 systemd[1]: Started Ceph osd.0 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:57:25.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:25 smithi170 ceph-mon[67652]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:25.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:25 smithi170 ceph-mon[67652]: pgmap v47: 65 pgs: 34 peering, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:57:25.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:25 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/981142713' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:57:25.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:25 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3042196208' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:57:26.189 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:25 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T22:57:25.913+0000 7f46798f17c0 -1 Falling back to public interface 2024-02-15T22:57:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:26 smithi138 ceph-mon[89527]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:26 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:26 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:26 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:26 smithi170 ceph-mon[67652]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:26 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:26 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:26 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:27.415 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:27 smithi138 ceph-mon[89527]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:27.415 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:27 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 69/360 objects degraded (19.167%), 19 pgs degraded (PG_DEGRADED) 2024-02-15T22:57:27.415 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:27 smithi138 ceph-mon[89527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 24 pgs peering) 2024-02-15T22:57:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:27 smithi170 ceph-mon[67652]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:27.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:27 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 69/360 objects degraded (19.167%), 19 pgs degraded (PG_DEGRADED) 2024-02-15T22:57:27.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:27 smithi170 ceph-mon[67652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 24 pgs peering) 2024-02-15T22:57:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:29 smithi138 ceph-mon[89527]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:29.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:29 smithi170 ceph-mon[67652]: pgmap v49: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:30.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:30 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T22:57:30.377+0000 7f46798f17c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-15T22:57:31.234 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:30 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T22:57:30.833+0000 7f46798f17c0 -1 osd.0 49 log_to_monitors true 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:31.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: pgmap v50: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T22:57:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:32.484 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T22:57:32.183+0000 7f4666d41700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: osdmap e52: 6 total, 5 up, 6 in 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: mgrmap e39: smithi138.jqscxs(active, since 91s), standbys: smithi170.gczrzt 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:32 smithi138 ceph-mon[89527]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: osdmap e52: 6 total, 5 up, 6 in 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: mgrmap e39: smithi138.jqscxs(active, since 91s), standbys: smithi170.gczrzt 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:32 smithi170 ceph-mon[67652]: from='osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094]' entity='osd.0' 2024-02-15T22:57:33.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:33 smithi138 ceph-mon[89527]: pgmap v52: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:33.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:33 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:57:33.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:33 smithi138 ceph-mon[89527]: osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094] boot 2024-02-15T22:57:33.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:33 smithi138 ceph-mon[89527]: osdmap e53: 6 total, 6 up, 6 in 2024-02-15T22:57:33.603 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:33 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:57:33.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:33 smithi170 ceph-mon[67652]: pgmap v52: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:33.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:33 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:57:33.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:33 smithi170 ceph-mon[67652]: osd.0 [v2:172.21.15.138:6802/3741024094,v1:172.21.15.138:6803/3741024094] boot 2024-02-15T22:57:33.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:33 smithi170 ceph-mon[67652]: osdmap e53: 6 total, 6 up, 6 in 2024-02-15T22:57:33.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:33 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T22:57:35.462 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:35 smithi138 ceph-mon[89527]: osdmap e54: 6 total, 6 up, 6 in 2024-02-15T22:57:35.462 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:35 smithi138 ceph-mon[89527]: pgmap v55: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:35.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:35 smithi170 ceph-mon[67652]: osdmap e54: 6 total, 6 up, 6 in 2024-02-15T22:57:35.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:35 smithi170 ceph-mon[67652]: pgmap v55: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 69/360 objects degraded (19.167%) 2024-02-15T22:57:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:57:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T22:57:36.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:36 smithi170 ceph-mon[67652]: pgmap v56: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 1023 B/s wr, 7 op/s; 12/360 objects degraded (3.333%) 2024-02-15T22:57:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T22:57:36.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:36 smithi138 ceph-mon[89527]: pgmap v56: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 1023 B/s wr, 7 op/s; 12/360 objects degraded (3.333%) 2024-02-15T22:57:37.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:37 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 12/360 objects degraded (3.333%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:57:37.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:37 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 12/360 objects degraded (3.333%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T22:57:38.951 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:38 smithi170 ceph-mon[67652]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:57:38.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:38 smithi138 ceph-mon[89527]: pgmap v57: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:57:39.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:39 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/360 objects degraded (3.333%), 3 pgs degraded) 2024-02-15T22:57:39.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:39 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T22:57:40.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:39 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/360 objects degraded (3.333%), 3 pgs degraded) 2024-02-15T22:57:40.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:39 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T22:57:40.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:40 smithi138 ceph-mon[89527]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-15T22:57:41.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:40 smithi170 ceph-mon[67652]: pgmap v58: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-15T22:57:43.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:43 smithi170 ceph-mon[67652]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:57:43.623 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:43 smithi138 ceph-mon[89527]: pgmap v59: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:57:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:45 smithi138 ceph-mon[89527]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:57:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:45.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:45.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:45 smithi170 ceph-mon[67652]: pgmap v60: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:57:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:57:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:47.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:47 smithi138 ceph-mon[89527]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-15T22:57:47.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:47 smithi170 ceph-mon[67652]: pgmap v61: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-15T22:57:49.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:49 smithi170 ceph-mon[67652]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:49 smithi138 ceph-mon[89527]: pgmap v62: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:51.524 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:51 smithi138 ceph-mon[89527]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:51.524 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:51 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:51 smithi170 ceph-mon[67652]: pgmap v63: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:51 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:52 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:52 smithi138 ceph-mon[89527]: Upgrade: osd.1 is safe to restart 2024-02-15T22:57:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:52 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T22:57:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:52 smithi170 ceph-mon[67652]: Upgrade: osd.1 is safe to restart 2024-02-15T22:57:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:53 smithi138 ceph-mon[89527]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:57:53.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:53 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:53 smithi170 ceph-mon[67652]: pgmap v64: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:53.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:57:53.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T22:57:53.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:53 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:57:54.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:54 smithi138 ceph-mon[89527]: Upgrade: Updating osd.1 2024-02-15T22:57:54.645 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:54 smithi138 ceph-mon[89527]: Deploying daemon osd.1 on smithi138 2024-02-15T22:57:54.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:54 smithi170 ceph-mon[67652]: Upgrade: Updating osd.1 2024-02-15T22:57:54.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:54 smithi170 ceph-mon[67652]: Deploying daemon osd.1 on smithi138 2024-02-15T22:57:55.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 -- 172.21.15.138:0/3111865797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 msgr2=0x7f22200ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 --2- 172.21.15.138:0/3111865797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f22200ff760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2210009910 tx=0x7f2210009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 -- 172.21.15.138:0/3111865797 shutdown_connections 2024-02-15T22:57:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 --2- 172.21.15.138:0/3111865797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 0x7f2220103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 --2- 172.21.15.138:0/3111865797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f22200ff760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 -- 172.21.15.138:0/3111865797 >> 172.21.15.138:0/3111865797 conn(0x7f2220074f50 msgr2=0x7f2220075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 -- 172.21.15.138:0/3111865797 shutdown_connections 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 -- 172.21.15.138:0/3111865797 wait complete. 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.351+0000 7f22254af700 1 Processor -- start 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f22254af700 1 -- start start 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f22254af700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f22254af700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 0x7f222019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f22254af700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222019b640 con 0x7f22200ff390 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f22254af700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220194b00 con 0x7f22200ffd30 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49122/0 (socket says 172.21.15.138:49122) 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 -- 172.21.15.138:0/4038668589 learned_addr learned my addr 172.21.15.138:0/4038668589 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:55.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221e7fc700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 0x7f222019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 -- 172.21.15.138:0/4038668589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 msgr2=0x7f222019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 0x7f222019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 -- 172.21.15.138:0/4038668589 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100095f0 con 0x7f22200ff390 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.352+0000 7f221effd700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2210006010 tx=0x7f221000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.353+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221001d070 con 0x7f22200ff390 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.353+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2210004fb0 con 0x7f22200ff390 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.353+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2220194d80 con 0x7f22200ff390 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.353+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2210022ea0 con 0x7f22200ff390 2024-02-15T22:57:55.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.353+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2220195270 con 0x7f22200ff390 2024-02-15T22:57:55.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.354+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2220107650 con 0x7f22200ff390 2024-02-15T22:57:55.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.354+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2210022470 con 0x7f22200ff390 2024-02-15T22:57:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.354+0000 7f2207fff700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 0x7f220806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.355+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f221008eb00 con 0x7f22200ff390 2024-02-15T22:57:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.355+0000 7f221e7fc700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 0x7f220806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.355+0000 7f221e7fc700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 0x7f220806fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2214005fd0 tx=0x7f221400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:55.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.359+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f221005c060 con 0x7f22200ff390 2024-02-15T22:57:55.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.597+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2220195490 con 0x7f220806d8a0 2024-02-15T22:57:55.601 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:55 smithi138 ceph-mon[89527]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:55.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.599+0000 7f2207fff700 1 -- 172.21.15.138:0/4038668589 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2220195490 con 0x7f220806d8a0 2024-02-15T22:57:55.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.601+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 msgr2=0x7f220806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.601+0000 7f22254af700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 0x7f220806fd50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2214005fd0 tx=0x7f221400a560 comp rx=0 tx=0).stop 2024-02-15T22:57:55.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.601+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 msgr2=0x7f222019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.601+0000 7f22254af700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2210006010 tx=0x7f221000be20 comp rx=0 tx=0).stop 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 shutdown_connections 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f220806d8a0 0x7f220806fd50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22200ff390 0x7f222019aa20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 --2- 172.21.15.138:0/4038668589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22200ffd30 0x7f222019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 >> 172.21.15.138:0/4038668589 conn(0x7f2220074f50 msgr2=0x7f22200fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 shutdown_connections 2024-02-15T22:57:55.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.602+0000 7f22254af700 1 -- 172.21.15.138:0/4038668589 wait complete. 2024-02-15T22:57:55.615 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:57:55.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 -- 172.21.15.138:0/452565349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 msgr2=0x7fa1f4103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 --2- 172.21.15.138:0/452565349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f4103c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009910 tx=0x7fa1e8009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:55.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 -- 172.21.15.138:0/452565349 shutdown_connections 2024-02-15T22:57:55.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 --2- 172.21.15.138:0/452565349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f4103c30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 --2- 172.21.15.138:0/452565349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 0x7fa1f40ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 -- 172.21.15.138:0/452565349 >> 172.21.15.138:0/452565349 conn(0x7fa1f40fab80 msgr2=0x7fa1f40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:55.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 -- 172.21.15.138:0/452565349 shutdown_connections 2024-02-15T22:57:55.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.723+0000 7fa1f951f700 1 -- 172.21.15.138:0/452565349 wait complete. 2024-02-15T22:57:55.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 Processor -- start 2024-02-15T22:57:55.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 -- start start 2024-02-15T22:57:55.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 0x7fa1f4195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4196990 con 0x7fa1f40ffc60 2024-02-15T22:57:55.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f951f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f419a720 con 0x7fa1f40ff2c0 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49138/0 (socket says 172.21.15.138:49138) 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 -- 172.21.15.138:0/1266687523 learned_addr learned my addr 172.21.15.138:0/1266687523 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f2ffd700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 0x7fa1f4195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 -- 172.21.15.138:0/1266687523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 msgr2=0x7fa1f4195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 0x7fa1f4195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.724+0000 7fa1f27fc700 1 -- 172.21.15.138:0/1266687523 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80095f0 con 0x7fa1f40ffc60 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1f27fc700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800bd70 tx=0x7fa1e800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e801d070 con 0x7fa1f40ffc60 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1e8005dc0 con 0x7fa1f40ffc60 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f419a9a0 con 0x7fa1f40ffc60 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f419ae90 con 0x7fa1f40ffc60 2024-02-15T22:57:55.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.725+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e8017400 con 0x7fa1f40ffc60 2024-02-15T22:57:55.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.726+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e0005320 con 0x7fa1f40ffc60 2024-02-15T22:57:55.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.726+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa1e8003a60 con 0x7fa1f40ffc60 2024-02-15T22:57:55.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.727+0000 7fa1dbfff700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 0x7fa1dc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:55.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.727+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa1e808e810 con 0x7fa1f40ffc60 2024-02-15T22:57:55.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.727+0000 7fa1f2ffd700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 0x7fa1dc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:55.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.727+0000 7fa1f2ffd700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 0x7fa1dc06fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005950 tx=0x7fa1e400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:55.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.731+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa1e8058070 con 0x7fa1f40ffc60 2024-02-15T22:57:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:55 smithi170 ceph-mon[67652]: pgmap v65: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:57:55.904 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:55 smithi138 systemd[1]: Stopping Ceph osd.1 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:57:55.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.970+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1e0000bf0 con 0x7fa1dc06d8a0 2024-02-15T22:57:55.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.971+0000 7fa1dbfff700 1 -- 172.21.15.138:0/1266687523 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa1e0000bf0 con 0x7fa1dc06d8a0 2024-02-15T22:57:55.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 msgr2=0x7fa1dc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 0x7fa1dc06fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4005950 tx=0x7fa1e400b410 comp rx=0 tx=0).stop 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 msgr2=0x7fa1f41962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800bd70 tx=0x7fa1e800bda0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 shutdown_connections 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa1dc06d8a0 0x7fa1dc06fd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1f40ff2c0 0x7fa1f4195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 --2- 172.21.15.138:0/1266687523 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1f40ffc60 0x7fa1f41962b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.973+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 >> 172.21.15.138:0/1266687523 conn(0x7fa1f40fab80 msgr2=0x7fa1f4068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.974+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 shutdown_connections 2024-02-15T22:57:55.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:55.974+0000 7fa1f951f700 1 -- 172.21.15.138:0/1266687523 wait complete. 2024-02-15T22:57:56.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 -- 172.21.15.138:0/4056963860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ffc60 msgr2=0x7f6c40103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 --2- 172.21.15.138:0/4056963860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ffc60 0x7f6c40103c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009910 tx=0x7f6c34009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 -- 172.21.15.138:0/4056963860 shutdown_connections 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 --2- 172.21.15.138:0/4056963860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ffc60 0x7f6c40103c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 --2- 172.21.15.138:0/4056963860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ff2c0 0x7f6c400ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 -- 172.21.15.138:0/4056963860 >> 172.21.15.138:0/4056963860 conn(0x7f6c400fab80 msgr2=0x7f6c400fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 -- 172.21.15.138:0/4056963860 shutdown_connections 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.078+0000 7f6c45c68700 1 -- 172.21.15.138:0/4056963860 wait complete. 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 Processor -- start 2024-02-15T22:57:56.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 -- start start 2024-02-15T22:57:56.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ffc60 0x7f6c4019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4019b5f0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c45c68700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40194aa0 con 0x7f6c400ffc60 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.079+0000 7f6c3f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49168/0 (socket says 172.21.15.138:49168) 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 -- 172.21.15.138:0/3111563482 learned_addr learned my addr 172.21.15.138:0/3111563482 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3effd700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ffc60 0x7f6c4019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 -- 172.21.15.138:0/3111563482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ffc60 msgr2=0x7f6c4019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ffc60 0x7f6c4019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 -- 172.21.15.138:0/3111563482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340095f0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3f7fe700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c8a0 tx=0x7f6c3000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c300078e0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c40194d80 con 0x7f6c400ff2c0 2024-02-15T22:57:56.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c3000f450 con 0x7f6c400ff2c0 2024-02-15T22:57:56.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3000e5e0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.080+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c401952d0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.081+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40107630 con 0x7f6c400ff2c0 2024-02-15T22:57:56.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.082+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6c3000f5c0 con 0x7f6c400ff2c0 2024-02-15T22:57:56.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.082+0000 7f6c3cff9700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 0x7f6c2806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.082+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6c3008d320 con 0x7f6c400ff2c0 2024-02-15T22:57:56.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.082+0000 7f6c3effd700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 0x7f6c2806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.083+0000 7f6c3effd700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 0x7f6c2806fd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c400fb2d0 tx=0x7f6c3401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.087+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6c3005a730 con 0x7f6c400ff2c0 2024-02-15T22:57:56.189 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:55 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[49751]: 2024-02-15T22:57:55.900+0000 7fc11bd3b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:57:56.189 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:55 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[49751]: 2024-02-15T22:57:55.900+0000 7fc11bd3b700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-15T22:57:56.189 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:55 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[49751]: 2024-02-15T22:57:55.900+0000 7fc11bd3b700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:57:56.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.296+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c40195640 con 0x7f6c2806d8a0 2024-02-15T22:57:56.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.316+0000 7f6c3cff9700 1 -- 172.21.15.138:0/3111563482 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6c40195640 con 0x7f6c2806d8a0 2024-02-15T22:57:56.318 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:57:56.318 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (4m) 25s ago 14m 25.6M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (15m) 25s ago 15m 8250k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (14m) 48s ago 14m 8182k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (57s) 25s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (52s) 48s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (3m) 25s ago 14m 86.9M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (9m) 25s ago 9m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (9m) 25s ago 9m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (9m) 48s ago 9m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (9m) 48s ago 9m 60.3M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (6m) 25s ago 16m 497M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (5m) 48s ago 13m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (2m) 25s ago 16m 46.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:57:56.319 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (99s) 48s ago 13m 40.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 25s ago 15m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 48s ago 14m 16.6M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (31s) 25s ago 13m 12.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (12m) 25s ago 12m 243M 1216M 18.2.0 dc2bc1663786 47d4ef0fe64d 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (12m) 25s ago 12m 196M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (11m) 48s ago 11m 272M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (11m) 48s ago 11m 254M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (10m) 48s ago 10m 228M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:57:56.320 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (4m) 25s ago 14m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 msgr2=0x7f6c2806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 0x7f6c2806fd50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c400fb2d0 tx=0x7f6c3401a040 comp rx=0 tx=0).stop 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 msgr2=0x7f6c4019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c8a0 tx=0x7f6c3000cbb0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 shutdown_connections 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6c2806d8a0 0x7f6c2806fd50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c400ff2c0 0x7f6c4019aa20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 --2- 172.21.15.138:0/3111563482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c400ffc60 0x7f6c4019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 >> 172.21.15.138:0/3111563482 conn(0x7f6c400fab80 msgr2=0x7f6c400fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:56.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 shutdown_connections 2024-02-15T22:57:56.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.318+0000 7f6c45c68700 1 -- 172.21.15.138:0/3111563482 wait complete. 2024-02-15T22:57:56.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 -- 172.21.15.138:0/3684301481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ffc60 msgr2=0x7fc44c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 --2- 172.21.15.138:0/3684301481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ffc60 0x7fc44c103c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc440009910 tx=0x7fc440009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 -- 172.21.15.138:0/3684301481 shutdown_connections 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 --2- 172.21.15.138:0/3684301481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ffc60 0x7fc44c103c30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 --2- 172.21.15.138:0/3684301481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 -- 172.21.15.138:0/3684301481 >> 172.21.15.138:0/3684301481 conn(0x7fc44c0fab80 msgr2=0x7fc44c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 -- 172.21.15.138:0/3684301481 shutdown_connections 2024-02-15T22:57:56.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.422+0000 7fc451747700 1 -- 172.21.15.138:0/3684301481 wait complete. 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 Processor -- start 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 -- start start 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ffc60 0x7fc44c196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c196a50 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc451747700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c19a7e0 con 0x7fc44c0ffc60 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc44affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc44affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49184/0 (socket says 172.21.15.138:49184) 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc44affd700 1 -- 172.21.15.138:0/1175487945 learned_addr learned my addr 172.21.15.138:0/1175487945 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:56.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.423+0000 7fc44a7fc700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ffc60 0x7fc44c196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc44affd700 1 -- 172.21.15.138:0/1175487945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ffc60 msgr2=0x7fc44c196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc44affd700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ffc60 0x7fc44c196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc44affd700 1 -- 172.21.15.138:0/1175487945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4400095f0 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc44affd700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00b4b0 tx=0x7fc43c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c011800 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc43c011e20 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c19aac0 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c00f2e0 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.424+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c19b010 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.425+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c04ea50 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.425+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc43c00f510 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.426+0000 7fc433fff700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 0x7fc43406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.426+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc43c08cfb0 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.426+0000 7fc44a7fc700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 0x7fc43406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.426+0000 7fc44a7fc700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 0x7fc43406fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc44c197450 tx=0x7fc44001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.430+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc43c056880 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:56 smithi138 ceph-mon[89527]: osd.1 marked itself down and dead 2024-02-15T22:57:56.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.715+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc44c19b3e0 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.716+0000 7fc433fff700 1 -- 172.21.15.138:0/1175487945 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fc43c059f40 con 0x7fc44c0ff2c0 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:57:56.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:57:56.720 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:57:56.720 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-02-15T22:57:56.720 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-15T22:57:56.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:57:56.720 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 msgr2=0x7fc43406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 0x7fc43406fd50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc44c197450 tx=0x7fc44001a040 comp rx=0 tx=0).stop 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 msgr2=0x7fc44c195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00b4b0 tx=0x7fc43c00b7c0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 shutdown_connections 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc43406d8a0 0x7fc43406fd50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc44c0ff2c0 0x7fc44c195e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 --2- 172.21.15.138:0/1175487945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc44c0ffc60 0x7fc44c196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 >> 172.21.15.138:0/1175487945 conn(0x7fc44c0fab80 msgr2=0x7fc44c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 shutdown_connections 2024-02-15T22:57:56.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.718+0000 7fc451747700 1 -- 172.21.15.138:0/1175487945 wait complete. 2024-02-15T22:57:56.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:56 smithi170 ceph-mon[67652]: osd.1 marked itself down and dead 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 -- 172.21.15.138:0/1243930793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ffd30 msgr2=0x7f5d04103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/1243930793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ffd30 0x7f5d04103ce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009910 tx=0x7f5cf4009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 -- 172.21.15.138:0/1243930793 shutdown_connections 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/1243930793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ffd30 0x7f5d04103ce0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/1243930793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ff390 0x7f5d040ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 -- 172.21.15.138:0/1243930793 >> 172.21.15.138:0/1243930793 conn(0x7f5d04074f50 msgr2=0x7f5d04075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 -- 172.21.15.138:0/1243930793 shutdown_connections 2024-02-15T22:57:56.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.828+0000 7f5d0b1be700 1 -- 172.21.15.138:0/1243930793 wait complete. 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 Processor -- start 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 -- start start 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ffd30 0x7f5d041970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d041976e0 con 0x7f5d040ff390 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d0b1be700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d04197820 con 0x7f5d040ffd30 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49198/0 (socket says 172.21.15.138:49198) 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 -- 172.21.15.138:0/690264903 learned_addr learned my addr 172.21.15.138:0/690264903 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:56.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d03fff700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ffd30 0x7f5d041970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 -- 172.21.15.138:0/690264903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ffd30 msgr2=0x7f5d041970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ffd30 0x7f5d041970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.829+0000 7f5d08f5a700 1 -- 172.21.15.138:0/690264903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf40095f0 con 0x7f5d040ff390 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d08f5a700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00ada0 tx=0x7f5cfc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc00f070 con 0x7f5d040ff390 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0419fbf0 con 0x7f5d040ff390 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cfc007bf0 con 0x7f5d040ff390 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc005690 con 0x7f5d040ff390 2024-02-15T22:57:56.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.830+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d041a00b0 con 0x7f5d040ff390 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.831+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d04107600 con 0x7f5d040ff390 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.831+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5cfc005900 con 0x7f5d040ff390 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.832+0000 7f5d01ffb700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 0x7f5cf006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.832+0000 7f5d03fff700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 0x7f5cf006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.832+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5cfc08cef0 con 0x7f5d040ff390 2024-02-15T22:57:56.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.832+0000 7f5d03fff700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 0x7f5cf006fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006010 tx=0x7f5cf401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:56.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:56.837+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5cfc056750 con 0x7f5d040ff390 2024-02-15T22:57:56.984 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:56 smithi138 podman[106668]: 2024-02-15 22:57:56.76488264 +0000 UTC m=+0.973894326 container died 47d4ef0fe64d480b240b669b6e850663bd24cd0fe51a300404786bda02f8b2b0 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-15T22:57:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.084+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5d0402ccd0 con 0x7f5d040ff390 2024-02-15T22:57:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.085+0000 7f5d01ffb700 1 -- 172.21.15.138:0/690264903 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f5cfc059e10 con 0x7f5d040ff390 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:57:57.088 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:57:57.089 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:57.090 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 msgr2=0x7f5cf006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 0x7f5cf006fd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006010 tx=0x7f5cf401a040 comp rx=0 tx=0).stop 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 msgr2=0x7f5d04196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00ada0 tx=0x7f5cfc00c330 comp rx=0 tx=0).stop 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 shutdown_connections 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5cf006d8a0 0x7f5cf006fd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d040ff390 0x7f5d04196b80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 --2- 172.21.15.138:0/690264903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d040ffd30 0x7f5d041970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 >> 172.21.15.138:0/690264903 conn(0x7f5d04074f50 msgr2=0x7f5d040fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:57.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 shutdown_connections 2024-02-15T22:57:57.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.087+0000 7f5d0b1be700 1 -- 172.21.15.138:0/690264903 wait complete. 2024-02-15T22:57:57.092 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 -- 172.21.15.138:0/2006247111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 msgr2=0x7f5ed80ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 --2- 172.21.15.138:0/2006247111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed80ff690 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009910 tx=0x7f5ed4009c20 comp rx=0 tx=0).stop 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 -- 172.21.15.138:0/2006247111 shutdown_connections 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 --2- 172.21.15.138:0/2006247111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 0x7f5ed8103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 --2- 172.21.15.138:0/2006247111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed80ff690 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 -- 172.21.15.138:0/2006247111 >> 172.21.15.138:0/2006247111 conn(0x7f5ed80fab80 msgr2=0x7f5ed80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 -- 172.21.15.138:0/2006247111 shutdown_connections 2024-02-15T22:57:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.194+0000 7f5edf438700 1 -- 172.21.15.138:0/2006247111 wait complete. 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 Processor -- start 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 -- start start 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 0x7f5ed819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed819b5c0 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edf438700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8194a70 con 0x7f5ed80ffc60 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49226/0 (socket says 172.21.15.138:49226) 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 -- 172.21.15.138:0/330618785 learned_addr learned my addr 172.21.15.138:0/330618785 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:57.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edc9d3700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 0x7f5ed819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 -- 172.21.15.138:0/330618785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 msgr2=0x7f5ed819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 0x7f5ed819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.195+0000 7f5edd1d4700 1 -- 172.21.15.138:0/330618785 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40095f0 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5edd1d4700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4005f50 tx=0x7f5ed400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed401d070 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed8194cf0 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ed400b610 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed4022470 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.196+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81951e0 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.197+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed81075d0 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.198+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5ed4003780 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.198+0000 7f5ece7fc700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 0x7f5ec406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.198+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5ed408e870 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.198+0000 7f5edc9d3700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 0x7f5ec406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.198+0000 7f5edc9d3700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 0x7f5ec406fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80fb320 tx=0x7f5ec8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:57.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.207+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5ed405bc00 con 0x7f5ed80ff2c0 2024-02-15T22:57:57.413 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:57 smithi138 podman[106668]: 2024-02-15 22:57:57.168530336 +0000 UTC m=+1.377542026 container cleanup 47d4ef0fe64d480b240b669b6e850663bd24cd0fe51a300404786bda02f8b2b0 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-15T22:57:57.414 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:57 smithi138 bash[106668]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: osdmap e55: 6 total, 5 up, 6 in 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1175487945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:57.414 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:57 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/690264903' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:57:57.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.451+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ed802cc80 con 0x7f5ec406d8a0 2024-02-15T22:57:57.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.453+0000 7f5ece7fc700 1 -- 172.21.15.138:0/330618785 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5ed802cc80 con 0x7f5ec406d8a0 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "7/23 daemons upgraded", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:57:57.456 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 msgr2=0x7f5ec406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 0x7f5ec406fd50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80fb320 tx=0x7f5ec8009260 comp rx=0 tx=0).stop 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 msgr2=0x7f5ed819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4005f50 tx=0x7f5ed400f690 comp rx=0 tx=0).stop 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 shutdown_connections 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5ec406d8a0 0x7f5ec406fd50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ed80ff2c0 0x7f5ed819a9f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 --2- 172.21.15.138:0/330618785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ed80ffc60 0x7f5ed819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.455+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 >> 172.21.15.138:0/330618785 conn(0x7f5ed80fab80 msgr2=0x7f5ed80fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:57.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.456+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 shutdown_connections 2024-02-15T22:57:57.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.456+0000 7f5edf438700 1 -- 172.21.15.138:0/330618785 wait complete. 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 -- 172.21.15.138:0/829095877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 msgr2=0x7fa91c10a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 --2- 172.21.15.138:0/829095877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c10a6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009940 tx=0x7fa90c009c50 comp rx=0 tx=0).stop 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 -- 172.21.15.138:0/829095877 shutdown_connections 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 --2- 172.21.15.138:0/829095877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c10a6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 --2- 172.21.15.138:0/829095877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 0x7fa91c0ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 -- 172.21.15.138:0/829095877 >> 172.21.15.138:0/829095877 conn(0x7fa91c0748b0 msgr2=0x7fa91c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:57.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.567+0000 7fa9245e8700 1 -- 172.21.15.138:0/829095877 shutdown_connections 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 -- 172.21.15.138:0/829095877 wait complete. 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 Processor -- start 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 -- start start 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 0x7fa91c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c19c6a0 con 0x7fa91c0ffc30 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.568+0000 7fa9245e8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c195b50 con 0x7fa91c0ff320 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49234/0 (socket says 172.21.15.138:49234) 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 -- 172.21.15.138:0/1487527848 learned_addr learned my addr 172.21.15.138:0/1487527848 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:57:57.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa922384700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 0x7fa91c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 -- 172.21.15.138:0/1487527848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 msgr2=0x7fa91c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 0x7fa91c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 -- 172.21.15.138:0/1487527848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0095f0 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.569+0000 7fa921b83700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b870 tx=0x7fa90c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.570+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90c01d070 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.570+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c195e30 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.570+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa90c005e00 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.570+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c196400 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.570+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90c021410 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.571+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa900005320 con 0x7fa91c0ffc30 2024-02-15T22:57:57.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.571+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa90c003a60 con 0x7fa91c0ffc30 2024-02-15T22:57:57.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.572+0000 7fa9137fe700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 0x7fa90806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:57:57.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.572+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa90c08e3d0 con 0x7fa91c0ffc30 2024-02-15T22:57:57.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.572+0000 7fa922384700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 0x7fa90806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:57:57.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.573+0000 7fa922384700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 0x7fa90806fd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa91c075bb0 tx=0x7fa918009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:57:57.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.577+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa90c05b890 con 0x7fa91c0ffc30 2024-02-15T22:57:57.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:57 smithi138 podman[106735]: 2024-02-15 22:57:57.412006861 +0000 UTC m=+0.642854277 container remove 47d4ef0fe64d480b240b669b6e850663bd24cd0fe51a300404786bda02f8b2b0 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:57:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: pgmap v66: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: osdmap e55: 6 total, 5 up, 6 in 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1175487945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:57:57.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:57 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/690264903' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:57:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.868+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa900005190 con 0x7fa91c0ffc30 2024-02-15T22:57:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.869+0000 7fa9137fe700 1 -- 172.21.15.138:0/1487527848 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fa90c05b420 con 0x7fa91c0ffc30 2024-02-15T22:57:57.871 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_WARN 1 osds down 2024-02-15T22:57:57.872 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-15T22:57:57.872 INFO:teuthology.orchestra.run.smithi138.stdout: osd.1 (root=default,host=smithi138) is down 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 msgr2=0x7fa90806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 0x7fa90806fd50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa91c075bb0 tx=0x7fa918009190 comp rx=0 tx=0).stop 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 msgr2=0x7fa91c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b870 tx=0x7fa90c0055f0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 shutdown_connections 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa90806d8a0 0x7fa90806fd50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa91c0ff320 0x7fa91c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 --2- 172.21.15.138:0/1487527848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa91c0ffc30 0x7fa91c19c010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 >> 172.21.15.138:0/1487527848 conn(0x7fa91c0748b0 msgr2=0x7fa91c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:57:57.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 shutdown_connections 2024-02-15T22:57:57.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:57:57.871+0000 7fa9245e8700 1 -- 172.21.15.138:0/1487527848 wait complete. 2024-02-15T22:57:58.010 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:57 smithi138 podman[106895]: 2024-02-15 22:57:57.647821229 +0000 UTC m=+0.018358056 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:57:58.010 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:57 smithi138 podman[106895]: 2024-02-15 22:57:57.784451131 +0000 UTC m=+0.154987958 container create 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-15T22:57:58.010 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:58 smithi138 podman[106895]: 2024-02-15 22:57:58.008470249 +0000 UTC m=+0.379007074 container init 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:57:58.305 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:58 smithi138 podman[106895]: 2024-02-15 22:57:58.011870933 +0000 UTC m=+0.382407765 container start 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux ) 2024-02-15T22:57:58.305 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:58 smithi138 podman[106895]: 2024-02-15 22:57:58.108472777 +0000 UTC m=+0.479009615 container attach 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-15T22:57:58.589 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:58 smithi138 ceph-mon[89527]: osdmap e56: 6 total, 5 up, 6 in 2024-02-15T22:57:58.589 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:58 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1487527848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:57:58.589 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:58 smithi138 podman[106895]: 2024-02-15 22:57:58.30364075 +0000 UTC m=+0.674177581 container died 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:57:58.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:58 smithi170 ceph-mon[67652]: osdmap e56: 6 total, 5 up, 6 in 2024-02-15T22:57:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:58 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1487527848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:57:59.314 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:58 smithi138 podman[106923]: 2024-02-15 22:57:58.999224473 +0000 UTC m=+0.689032066 container remove 248dff96811596288fe7532bb375447752a4930db5e50304a56710587a7eb29b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-15T22:57:59.314 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-15T22:57:59.314 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 systemd[1]: Stopped Ceph osd.1 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:57:59.314 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.1.service: Consumed 1min 4.446s CPU time. 2024-02-15T22:57:59.314 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 systemd[1]: Starting Ceph osd.1 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:57:59.564 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:59 smithi138 ceph-mon[89527]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:59.564 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:59 smithi138 ceph-mon[89527]: pgmap v69: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:57:59.565 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:57:59 smithi138 ceph-mon[89527]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T22:57:59.565 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 podman[107028]: 2024-02-15 22:57:59.354891618 +0000 UTC m=+0.018612786 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:57:59.565 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 podman[107028]: 2024-02-15 22:57:59.458821392 +0000 UTC m=+0.122542550 container create 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-15T22:57:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:59 smithi170 ceph-mon[67652]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:57:59.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:59 smithi170 ceph-mon[67652]: pgmap v69: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:57:59.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:57:59 smithi170 ceph-mon[67652]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T22:57:59.984 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 podman[107028]: 2024-02-15 22:57:59.678619466 +0000 UTC m=+0.342340631 container init 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-15T22:57:59.984 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 podman[107028]: 2024-02-15 22:57:59.682540514 +0000 UTC m=+0.346261678 container start 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-15T22:57:59.984 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:57:59 smithi138 podman[107028]: 2024-02-15 22:57:59.753500933 +0000 UTC m=+0.417222095 container attach 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-15T22:58:00.484 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:58:00.484 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 bash[107028]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate[107042]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-15T22:58:00.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 podman[107028]: 2024-02-15 22:58:00.148439107 +0000 UTC m=+0.812160267 container died 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-15T22:58:01.234 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:00 smithi138 podman[107173]: 2024-02-15 22:58:00.875848094 +0000 UTC m=+0.719935354 container remove 704c2afe1ff0b304e7d9c63ea8b4b25cd5e648f0e97ed38df9ac9ef0387ced55 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-15T22:58:01.234 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 podman[107237]: 2024-02-15 22:58:00.994464666 +0000 UTC m=+0.018510155 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:58:01.235 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 podman[107237]: 2024-02-15 22:58:01.118704583 +0000 UTC m=+0.142750059 container create 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:58:01.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:01 smithi170 ceph-mon[67652]: pgmap v70: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:58:01.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:01.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:01 smithi138 ceph-mon[89527]: pgmap v70: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-15T22:58:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:01.735 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 podman[107237]: 2024-02-15 22:58:01.372326358 +0000 UTC m=+0.396371846 container init 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True) 2024-02-15T22:58:01.735 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 podman[107237]: 2024-02-15 22:58:01.375578519 +0000 UTC m=+0.399623996 container start 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-15T22:58:01.735 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 ceph-osd[107257]: -- 172.21.15.138:0/3544212138 <== mon.0 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d65771d1e0 con 0x55d6576ef000 2024-02-15T22:58:01.735 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 bash[107237]: 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 2024-02-15T22:58:01.735 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 systemd[1]: Started Ceph osd.1 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:58:02.234 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:01 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T22:58:01.916+0000 7f205a4c37c0 -1 Falling back to public interface 2024-02-15T22:58:02.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:02.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:02.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:02 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:02.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:02 smithi138 ceph-mon[89527]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:03.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:03.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:03.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:02 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:03.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:02 smithi170 ceph-mon[67652]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:03 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:03 smithi138 ceph-mon[89527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T22:58:03.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:03 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:03.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:03 smithi170 ceph-mon[67652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T22:58:04.774 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:04 smithi138 ceph-mon[89527]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:05.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:04 smithi170 ceph-mon[67652]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:06.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:06 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T22:58:06.475+0000 7f205a4c37c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-15T22:58:07.484 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:07 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T22:58:07.024+0000 7f205a4c37c0 -1 osd.1 54 log_to_monitors true 2024-02-15T22:58:07.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:07 smithi138 ceph-mon[89527]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:07.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:07.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:07.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:07 smithi138 ceph-mon[89527]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:58:07.715 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:07 smithi170 ceph-mon[67652]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T22:58:07.715 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:07.715 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:07.715 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:07 smithi170 ceph-mon[67652]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T22:58:08.922 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T22:58:08.648+0000 7f2047913700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:58:08.922 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:58:08.922 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: osdmap e57: 6 total, 5 up, 6 in 2024-02-15T22:58:08.922 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:58:08.922 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:08.923 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:08.923 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: pgmap v75: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:58:08.923 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:08 smithi138 ceph-mon[89527]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: osdmap e57: 6 total, 5 up, 6 in 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: pgmap v75: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:58:09.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:08 smithi170 ceph-mon[67652]: from='osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010]' entity='osd.1' 2024-02-15T22:58:10.223 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:09 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:58:10.223 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:09 smithi138 ceph-mon[89527]: osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010] boot 2024-02-15T22:58:10.224 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:09 smithi138 ceph-mon[89527]: osdmap e58: 6 total, 6 up, 6 in 2024-02-15T22:58:10.224 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:58:10.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:09 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:58:10.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:09 smithi170 ceph-mon[67652]: osd.1 [v2:172.21.15.138:6810/320789010,v1:172.21.15.138:6811/320789010] boot 2024-02-15T22:58:10.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:09 smithi170 ceph-mon[67652]: osdmap e58: 6 total, 6 up, 6 in 2024-02-15T22:58:10.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T22:58:11.172 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:10 smithi138 ceph-mon[89527]: pgmap v77: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:58:11.172 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:10 smithi138 ceph-mon[89527]: osdmap e59: 6 total, 6 up, 6 in 2024-02-15T22:58:11.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:10 smithi170 ceph-mon[67652]: pgmap v77: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:58:11.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:10 smithi170 ceph-mon[67652]: osdmap e59: 6 total, 6 up, 6 in 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T22:58:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:12 smithi138 ceph-mon[89527]: pgmap v79: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 23/360 objects degraded (6.389%) 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:13.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:13.013 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T22:58:13.013 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:12 smithi170 ceph-mon[67652]: pgmap v79: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 23/360 objects degraded (6.389%) 2024-02-15T22:58:13.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:13 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 23/360 objects degraded (6.389%), 7 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:13.886 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:13 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 23/360 objects degraded (6.389%), 7 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:14.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:14 smithi138 ceph-mon[89527]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:58:15.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:14 smithi170 ceph-mon[67652]: pgmap v80: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:58:15.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:15 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/360 objects degraded (6.389%), 7 pgs degraded) 2024-02-15T22:58:15.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:15 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T22:58:15.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:15.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:16.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:15 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/360 objects degraded (6.389%), 7 pgs degraded) 2024-02-15T22:58:16.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:15 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T22:58:16.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:16.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:16.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:16 smithi138 ceph-mon[89527]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:58:17.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:16 smithi170 ceph-mon[67652]: pgmap v81: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:58:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:19 smithi138 ceph-mon[89527]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:58:19.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:19 smithi170 ceph-mon[67652]: pgmap v82: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-15T22:58:21.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:21 smithi138 ceph-mon[89527]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:58:21.609 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:21 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:21 smithi170 ceph-mon[67652]: pgmap v83: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-02-15T22:58:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:21 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:23.536 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:23 smithi170 ceph-mon[67652]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 5 op/s 2024-02-15T22:58:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:23 smithi138 ceph-mon[89527]: pgmap v84: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 5 op/s 2024-02-15T22:58:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:25 smithi138 ceph-mon[89527]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:25.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:25 smithi170 ceph-mon[67652]: pgmap v85: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:27.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:27 smithi138 ceph-mon[89527]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:58:27.608 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:27 smithi170 ceph-mon[67652]: pgmap v86: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:58:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- 172.21.15.138:0/518095844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 msgr2=0x7fe844103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 --2- 172.21.15.138:0/518095844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe844103c30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe838009910 tx=0x7fe838009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- 172.21.15.138:0/518095844 shutdown_connections 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 --2- 172.21.15.138:0/518095844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe844103c30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 --2- 172.21.15.138:0/518095844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 0x7fe8440ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- 172.21.15.138:0/518095844 >> 172.21.15.138:0/518095844 conn(0x7fe8440fab80 msgr2=0x7fe8440fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- 172.21.15.138:0/518095844 shutdown_connections 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- 172.21.15.138:0/518095844 wait complete. 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 Processor -- start 2024-02-15T22:58:27.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.985+0000 7fe8498a4700 1 -- start start 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8498a4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 0x7fe844195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8498a4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8498a4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844196900 con 0x7fe8440ffc60 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8498a4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844196a40 con 0x7fe8440ff2c0 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39838/0 (socket says 172.21.15.138:39838) 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 -- 172.21.15.138:0/715283379 learned_addr learned my addr 172.21.15.138:0/715283379 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe842ffd700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 0x7fe844195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 -- 172.21.15.138:0/715283379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 msgr2=0x7fe844195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 0x7fe844195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 -- 172.21.15.138:0/715283379 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380095f0 con 0x7fe8440ffc60 2024-02-15T22:58:27.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8427fc700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe83800bda0 tx=0x7fe83800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:27.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83801d070 con 0x7fe8440ffc60 2024-02-15T22:58:27.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84419a830 con 0x7fe8440ffc60 2024-02-15T22:58:27.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe838004fb0 con 0x7fe8440ffc60 2024-02-15T22:58:27.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.986+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83800f480 con 0x7fe8440ffc60 2024-02-15T22:58:27.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.987+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84419ad20 con 0x7fe8440ffc60 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.988+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84404ea50 con 0x7fe8440ffc60 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.988+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe838022870 con 0x7fe8440ffc60 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.988+0000 7fe8488a2700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 0x7fe82c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.989+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe83808ec00 con 0x7fe8440ffc60 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.989+0000 7fe842ffd700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 0x7fe82c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:27.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.989+0000 7fe842ffd700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 0x7fe82c06fd50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe834005ea0 tx=0x7fe834005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:27.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:27.993+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe838094020 con 0x7fe8440ffc60 2024-02-15T22:58:28.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.211+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe844108210 con 0x7fe82c06d8a0 2024-02-15T22:58:28.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.212+0000 7fe8488a2700 1 -- 172.21.15.138:0/715283379 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe844108210 con 0x7fe82c06d8a0 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 msgr2=0x7fe82c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 0x7fe82c06fd50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe834005ea0 tx=0x7fe834005e30 comp rx=0 tx=0).stop 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 msgr2=0x7fe8441962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe83800bda0 tx=0x7fe83800be80 comp rx=0 tx=0).stop 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 shutdown_connections 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe82c06d8a0 0x7fe82c06fd50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8440ff2c0 0x7fe844195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 --2- 172.21.15.138:0/715283379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8440ffc60 0x7fe8441962b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 >> 172.21.15.138:0/715283379 conn(0x7fe8440fab80 msgr2=0x7fe844068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 shutdown_connections 2024-02-15T22:58:28.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.214+0000 7fe8498a4700 1 -- 172.21.15.138:0/715283379 wait complete. 2024-02-15T22:58:28.228 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:58:28.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 -- 172.21.15.138:0/4054726358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 msgr2=0x7f1e141007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 --2- 172.21.15.138:0/4054726358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e141007a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009910 tx=0x7f1e04009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 -- 172.21.15.138:0/4054726358 shutdown_connections 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 --2- 172.21.15.138:0/4054726358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 0x7f1e14104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 --2- 172.21.15.138:0/4054726358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e141007a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 -- 172.21.15.138:0/4054726358 >> 172.21.15.138:0/4054726358 conn(0x7f1e140fbc90 msgr2=0x7f1e140fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 -- 172.21.15.138:0/4054726358 shutdown_connections 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.322+0000 7f1e1a418700 1 -- 172.21.15.138:0/4054726358 wait complete. 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.323+0000 7f1e1a418700 1 Processor -- start 2024-02-15T22:58:28.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.323+0000 7f1e1a418700 1 -- start start 2024-02-15T22:58:28.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e1a418700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e1a418700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 0x7f1e141962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e1a418700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14196980 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e1a418700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1419a710 con 0x7f1e14100d70 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39858/0 (socket says 172.21.15.138:39858) 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 -- 172.21.15.138:0/1750636857 learned_addr learned my addr 172.21.15.138:0/1750636857 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e137fe700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 0x7f1e141962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 -- 172.21.15.138:0/1750636857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 msgr2=0x7f1e141962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 0x7f1e141962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 -- 172.21.15.138:0/1750636857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e040095f0 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e13fff700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e04006010 tx=0x7f1e0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.324+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e0401d070 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.325+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e0400f460 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.325+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e04017630 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.325+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1419a990 con 0x7f1e141003d0 2024-02-15T22:58:28.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.325+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1419ae80 con 0x7f1e141003d0 2024-02-15T22:58:28.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.326+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e141086e0 con 0x7f1e141003d0 2024-02-15T22:58:28.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.326+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f1e0400f5d0 con 0x7f1e141003d0 2024-02-15T22:58:28.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.326+0000 7f1e117fa700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 0x7f1dfc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.327+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1e0408e950 con 0x7f1e141003d0 2024-02-15T22:58:28.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.327+0000 7f1e137fe700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 0x7f1dfc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.327+0000 7f1e137fe700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 0x7f1dfc06fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005950 tx=0x7f1e080058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.331+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1e040581b0 con 0x7f1e141003d0 2024-02-15T22:58:28.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.582+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e1402ccf0 con 0x7f1dfc06d8a0 2024-02-15T22:58:28.585 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:28 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:28.585 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:28 smithi138 ceph-mon[89527]: Upgrade: osd.2 is safe to restart 2024-02-15T22:58:28.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.584+0000 7f1e117fa700 1 -- 172.21.15.138:0/1750636857 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e1402ccf0 con 0x7f1dfc06d8a0 2024-02-15T22:58:28.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:28 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T22:58:28.589 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:28 smithi170 ceph-mon[67652]: Upgrade: osd.2 is safe to restart 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.586+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 msgr2=0x7f1dfc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 0x7f1dfc06fd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005950 tx=0x7f1e080058e0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 msgr2=0x7f1e14195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e04006010 tx=0x7f1e0400be20 comp rx=0 tx=0).stop 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 shutdown_connections 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f1dfc06d8a0 0x7f1dfc06fd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e141003d0 0x7f1e14195d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 --2- 172.21.15.138:0/1750636857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e14100d70 0x7f1e141962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 >> 172.21.15.138:0/1750636857 conn(0x7f1e140fbc90 msgr2=0x7f1e140fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 shutdown_connections 2024-02-15T22:58:28.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.587+0000 7f1e1a418700 1 -- 172.21.15.138:0/1750636857 wait complete. 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 -- 172.21.15.138:0/2434496332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 msgr2=0x7f76d8103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 --2- 172.21.15.138:0/2434496332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d8103c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009910 tx=0x7f76c8009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 -- 172.21.15.138:0/2434496332 shutdown_connections 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 --2- 172.21.15.138:0/2434496332 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d8103c30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 --2- 172.21.15.138:0/2434496332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 0x7f76d80ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 -- 172.21.15.138:0/2434496332 >> 172.21.15.138:0/2434496332 conn(0x7f76d80fab80 msgr2=0x7f76d80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 -- 172.21.15.138:0/2434496332 shutdown_connections 2024-02-15T22:58:28.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.696+0000 7f76df81a700 1 -- 172.21.15.138:0/2434496332 wait complete. 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 Processor -- start 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 -- start start 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 0x7f76d8195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8196910 con 0x7f76d80ffc60 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76df81a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8196a50 con 0x7f76d80ff2c0 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39866/0 (socket says 172.21.15.138:39866) 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 -- 172.21.15.138:0/121699230 learned_addr learned my addr 172.21.15.138:0/121699230 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dd5b6700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 0x7f76d8195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 -- 172.21.15.138:0/121699230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 msgr2=0x7f76d8195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 0x7f76d8195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.697+0000 7f76dcdb5700 1 -- 172.21.15.138:0/121699230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80095f0 con 0x7f76d80ffc60 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76dcdb5700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76c800bda0 tx=0x7f76c800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c801d070 con 0x7f76d80ffc60 2024-02-15T22:58:28.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76c800f460 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d819a840 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76c8017630 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.698+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d819ad30 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.699+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d804ea50 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.699+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f76c800fab0 con 0x7f76d80ffc60 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.700+0000 7f76ce7fc700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 0x7f76c406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:28.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.700+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f76c808e950 con 0x7f76d80ffc60 2024-02-15T22:58:28.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.700+0000 7f76dd5b6700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 0x7f76c406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:28.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.700+0000 7f76dd5b6700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 0x7f76c406fd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76d400ac50 tx=0x7f76d400a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:28.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.705+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f76c80581b0 con 0x7f76d80ffc60 2024-02-15T22:58:28.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.920+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f76d8108210 con 0x7f76c406d8a0 2024-02-15T22:58:28.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.931+0000 7f76ce7fc700 1 -- 172.21.15.138:0/121699230 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f76d8108210 con 0x7f76c406d8a0 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (5m) 22s ago 15m 24.9M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (15m) 22s ago 15m 8535k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (14m) 81s ago 14m 8182k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (89s) 22s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (84s) 81s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (3m) 22s ago 15m 86.9M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (9m) 22s ago 9m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (9m) 22s ago 9m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (9m) 81s ago 9m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (9m) 81s ago 9m 60.3M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (7m) 22s ago 17m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (5m) 81s ago 14m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (2m) 22s ago 17m 48.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:58:28.934 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (2m) 81s ago 14m 40.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (5m) 22s ago 15m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (5m) 81s ago 14m 16.6M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (63s) 22s ago 13m 92.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (27s) 22s ago 13m 11.6M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (12m) 22s ago 12m 197M 1216M 18.2.0 dc2bc1663786 d9bcd188737a 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (12m) 81s ago 12m 272M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (11m) 81s ago 11m 254M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (11m) 81s ago 11m 228M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:58:28.935 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (5m) 22s ago 15m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:58:28.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 msgr2=0x7f76c406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 0x7f76c406fd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76d400ac50 tx=0x7f76d400a380 comp rx=0 tx=0).stop 2024-02-15T22:58:28.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 msgr2=0x7f76d81962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:28.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f76c800bda0 tx=0x7f76c800bdd0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 shutdown_connections 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f76c406d8a0 0x7f76c406fd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76d80ff2c0 0x7f76d8195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 --2- 172.21.15.138:0/121699230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76d80ffc60 0x7f76d81962c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.933+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 >> 172.21.15.138:0/121699230 conn(0x7f76d80fab80 msgr2=0x7f76d8068f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.934+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 shutdown_connections 2024-02-15T22:58:28.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:28.934+0000 7f76df81a700 1 -- 172.21.15.138:0/121699230 wait complete. 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 -- 172.21.15.138:0/2027438145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ffd30 msgr2=0x7fda00103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2027438145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ffd30 0x7fda00103ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009910 tx=0x7fd9f0009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 -- 172.21.15.138:0/2027438145 shutdown_connections 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2027438145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ffd30 0x7fda00103ce0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2027438145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ff390 0x7fda000ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 -- 172.21.15.138:0/2027438145 >> 172.21.15.138:0/2027438145 conn(0x7fda00074f50 msgr2=0x7fda00075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 -- 172.21.15.138:0/2027438145 shutdown_connections 2024-02-15T22:58:29.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.053+0000 7fda07fb6700 1 -- 172.21.15.138:0/2027438145 wait complete. 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 Processor -- start 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 -- start start 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ffd30 0x7fda0019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0019b5b0 con 0x7fda000ff390 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda07fb6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00194a60 con 0x7fda000ffd30 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39878/0 (socket says 172.21.15.138:39878) 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 -- 172.21.15.138:0/2731631101 learned_addr learned my addr 172.21.15.138:0/2731631101 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05551700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ffd30 0x7fda0019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 -- 172.21.15.138:0/2731631101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ffd30 msgr2=0x7fda0019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ffd30 0x7fda0019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.054+0000 7fda05d52700 1 -- 172.21.15.138:0/2731631101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00095f0 con 0x7fda000ff390 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fda05d52700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00e920 tx=0x7fd9fc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9fc00c9d0 con 0x7fda000ff390 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9fc010430 con 0x7fda000ff390 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda00194d40 con 0x7fda000ff390 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9fc018630 con 0x7fda000ff390 2024-02-15T22:58:29.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.055+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda00195260 con 0x7fda000ff390 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.056+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0004ea50 con 0x7fda000ff390 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.056+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd9fc0105a0 con 0x7fda000ff390 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.057+0000 7fd9f6ffd700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 0x7fd9ec06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.057+0000 7fda05551700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 0x7fd9ec06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.057+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd9fc014070 con 0x7fda000ff390 2024-02-15T22:58:29.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.057+0000 7fda05551700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 0x7fd9ec06fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00059d0 tx=0x7fd9f0005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.061+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9fc052d20 con 0x7fda000ff390 2024-02-15T22:58:29.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.376+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda00195740 con 0x7fda000ff390 2024-02-15T22:58:29.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.377+0000 7fd9f6ffd700 1 -- 172.21.15.138:0/2731631101 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fd9fc05aad0 con 0x7fda000ff390 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:58:29.380 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:58:29.381 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 msgr2=0x7fd9ec06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 0x7fd9ec06fd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00059d0 tx=0x7fd9f0005940 comp rx=0 tx=0).stop 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 msgr2=0x7fda0019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00e920 tx=0x7fd9fc00ec30 comp rx=0 tx=0).stop 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 shutdown_connections 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd9ec06d8a0 0x7fd9ec06fd50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda000ff390 0x7fda0019a9e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 --2- 172.21.15.138:0/2731631101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda000ffd30 0x7fda0019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 >> 172.21.15.138:0/2731631101 conn(0x7fda00074f50 msgr2=0x7fda000fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:29.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.379+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 shutdown_connections 2024-02-15T22:58:29.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.380+0000 7fda07fb6700 1 -- 172.21.15.138:0/2731631101 wait complete. 2024-02-15T22:58:29.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 -- 172.21.15.138:0/3188101578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ffd30 msgr2=0x7fddf8103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 --2- 172.21.15.138:0/3188101578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ffd30 0x7fddf8103ce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fddec009910 tx=0x7fddec009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 -- 172.21.15.138:0/3188101578 shutdown_connections 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 --2- 172.21.15.138:0/3188101578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ffd30 0x7fddf8103ce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 --2- 172.21.15.138:0/3188101578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ff390 0x7fddf80ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 -- 172.21.15.138:0/3188101578 >> 172.21.15.138:0/3188101578 conn(0x7fddf8074f50 msgr2=0x7fddf8075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 -- 172.21.15.138:0/3188101578 shutdown_connections 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.488+0000 7fddff743700 1 -- 172.21.15.138:0/3188101578 wait complete. 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 Processor -- start 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 -- start start 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ffd30 0x7fddf8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8198bf0 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddff743700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819c980 con 0x7fddf80ffd30 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39886/0 (socket says 172.21.15.138:39886) 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 -- 172.21.15.138:0/1028925202 learned_addr learned my addr 172.21.15.138:0/1028925202 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfccde700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ffd30 0x7fddf8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 -- 172.21.15.138:0/1028925202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ffd30 msgr2=0x7fddf8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ffd30 0x7fddf8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.489+0000 7fddfd4df700 1 -- 172.21.15.138:0/1028925202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0095f0 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddfd4df700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fddf00060b0 tx=0x7fddf000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf000dda0 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddf000f040 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf819cc60 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddf00146f0 con 0x7fddf80ff390 2024-02-15T22:58:29.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.490+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf819d1b0 con 0x7fddf80ff390 2024-02-15T22:58:29.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.491+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf804ea50 con 0x7fddf80ff390 2024-02-15T22:58:29.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.491+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fddf0015400 con 0x7fddf80ff390 2024-02-15T22:58:29.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.492+0000 7fddf67fc700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 0x7fdde006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.492+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fddf008cd80 con 0x7fddf80ff390 2024-02-15T22:58:29.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.492+0000 7fddfccde700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 0x7fdde006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.492+0000 7fddfccde700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 0x7fdde006fd50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fddf81995f0 tx=0x7fddec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.496+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fddf0056710 con 0x7fddf80ff390 2024-02-15T22:58:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:29 smithi138 ceph-mon[89527]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:29 smithi138 ceph-mon[89527]: pgmap v87: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:58:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:29.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.740+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fddf819cdf0 con 0x7fddf80ff390 2024-02-15T22:58:29.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.741+0000 7fddf67fc700 1 -- 172.21.15.138:0/1028925202 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7fddf819cdf0 con 0x7fddf80ff390 2024-02-15T22:58:29.743 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:58:29.743 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:58:29.743 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:58:29.744 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:58:29.745 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:58:29.746 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:58:29.746 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:58:29.746 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:58:29.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 msgr2=0x7fdde006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 0x7fdde006fd50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fddf81995f0 tx=0x7fddec01a040 comp rx=0 tx=0).stop 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 msgr2=0x7fddf8197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fddf00060b0 tx=0x7fddf000d3b0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 shutdown_connections 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fdde006d8a0 0x7fdde006fd50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddf80ff390 0x7fddf8197fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 --2- 172.21.15.138:0/1028925202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf80ffd30 0x7fddf8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 >> 172.21.15.138:0/1028925202 conn(0x7fddf8074f50 msgr2=0x7fddf8068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 shutdown_connections 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.744+0000 7fddff743700 1 -- 172.21.15.138:0/1028925202 wait complete. 2024-02-15T22:58:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:58:29.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:29 smithi170 ceph-mon[67652]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:29.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:29 smithi170 ceph-mon[67652]: pgmap v87: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:29.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:29.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T22:58:29.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- 172.21.15.138:0/2816970478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 msgr2=0x7fa4fc0ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 --2- 172.21.15.138:0/2816970478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc0ff710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009910 tx=0x7fa4ec009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:29.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- 172.21.15.138:0/2816970478 shutdown_connections 2024-02-15T22:58:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 --2- 172.21.15.138:0/2816970478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 0x7fa4fc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 --2- 172.21.15.138:0/2816970478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc0ff710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- 172.21.15.138:0/2816970478 >> 172.21.15.138:0/2816970478 conn(0x7fa4fc0fabe0 msgr2=0x7fa4fc0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- 172.21.15.138:0/2816970478 shutdown_connections 2024-02-15T22:58:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- 172.21.15.138:0/2816970478 wait complete. 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 Processor -- start 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.850+0000 7fa5036cf700 1 -- start start 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 0x7fa4fc1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc198bd0 con 0x7fa4fc0ff340 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc19c960 con 0x7fa4fc0ffce0 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39904/0 (socket says 172.21.15.138:39904) 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 -- 172.21.15.138:0/186903103 learned_addr learned my addr 172.21.15.138:0/186903103 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa500c6a700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 0x7fa4fc1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 -- 172.21.15.138:0/186903103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 msgr2=0x7fa4fc1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 0x7fa4fc1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 -- 172.21.15.138:0/186903103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0095f0 con 0x7fa4fc0ff340 2024-02-15T22:58:29.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa50146b700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec006010 tx=0x7fa4ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec01d070 con 0x7fa4fc0ff340 2024-02-15T22:58:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4ec00f460 con 0x7fa4fc0ff340 2024-02-15T22:58:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc19cbe0 con 0x7fa4fc0ff340 2024-02-15T22:58:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4ec017610 con 0x7fa4fc0ff340 2024-02-15T22:58:29.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.851+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc19d0d0 con 0x7fa4fc0ff340 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.852+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc04ea50 con 0x7fa4fc0ff340 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.853+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa4ec00f5d0 con 0x7fa4fc0ff340 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.853+0000 7fa4fa7fc700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 0x7fa4e406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.853+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa4ec08ea00 con 0x7fa4fc0ff340 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.854+0000 7fa500c6a700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 0x7fa4e406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.854+0000 7fa500c6a700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 0x7fa4e406fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc1995d0 tx=0x7fa4f000a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:29.858+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa4ec058260 con 0x7fa4fc0ff340 2024-02-15T22:58:30.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.076+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4fc19d560 con 0x7fa4e406d8a0 2024-02-15T22:58:30.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.077+0000 7fa4fa7fc700 1 -- 172.21.15.138:0/186903103 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa4fc19d560 con 0x7fa4e406d8a0 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "8/23 daemons upgraded", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:58:30.080 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 msgr2=0x7fa4e406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 0x7fa4e406fd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc1995d0 tx=0x7fa4f000a300 comp rx=0 tx=0).stop 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 msgr2=0x7fa4fc197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec006010 tx=0x7fa4ec00bd70 comp rx=0 tx=0).stop 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 shutdown_connections 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa4e406d8a0 0x7fa4e406fd50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4fc0ff340 0x7fa4fc197fb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 --2- 172.21.15.138:0/186903103 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4fc0ffce0 0x7fa4fc1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 >> 172.21.15.138:0/186903103 conn(0x7fa4fc0fabe0 msgr2=0x7fa4fc069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 shutdown_connections 2024-02-15T22:58:30.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.079+0000 7fa5036cf700 1 -- 172.21.15.138:0/186903103 wait complete. 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 -- 172.21.15.138:0/868131240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 msgr2=0x7f495c0ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 --2- 172.21.15.138:0/868131240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c0ff760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f494c009910 tx=0x7f494c009c20 comp rx=0 tx=0).stop 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 -- 172.21.15.138:0/868131240 shutdown_connections 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 --2- 172.21.15.138:0/868131240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 --2- 172.21.15.138:0/868131240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c0ff760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 -- 172.21.15.138:0/868131240 >> 172.21.15.138:0/868131240 conn(0x7f495c074f50 msgr2=0x7f495c075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 -- 172.21.15.138:0/868131240 shutdown_connections 2024-02-15T22:58:30.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.185+0000 7f496172f700 1 -- 172.21.15.138:0/868131240 wait complete. 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 Processor -- start 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 -- start start 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c197860 con 0x7f495c0ff390 2024-02-15T22:58:30.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f496172f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c1979d0 con 0x7f495c0ffd30 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f495affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f495affd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39914/0 (socket says 172.21.15.138:39914) 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f495affd700 1 -- 172.21.15.138:0/3686435279 learned_addr learned my addr 172.21.15.138:0/3686435279 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.186+0000 7f495a7fc700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f495affd700 1 -- 172.21.15.138:0/3686435279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 msgr2=0x7f495c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f495affd700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f495affd700 1 -- 172.21.15.138:0/3686435279 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0095f0 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f495a7fc700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f495affd700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f494c006010 tx=0x7f494c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494c01d070 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495c19fcb0 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f494c00f460 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f494c017630 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.187+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c1a0120 con 0x7f495c0ff390 2024-02-15T22:58:30.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.188+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c107650 con 0x7f495c0ff390 2024-02-15T22:58:30.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.188+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f494c00f5d0 con 0x7f495c0ff390 2024-02-15T22:58:30.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.189+0000 7f4943fff700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 0x7f494406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:58:30.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.189+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f494c08e920 con 0x7f495c0ff390 2024-02-15T22:58:30.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.189+0000 7f495a7fc700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 0x7f494406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:58:30.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.189+0000 7f495a7fc700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 0x7f494406fd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4950005fd0 tx=0x7f4950005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:58:30.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.193+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f494c058180 con 0x7f495c0ff390 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: Upgrade: Updating osd.2 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: Deploying daemon osd.2 on smithi138 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2731631101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:30.377 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1028925202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:58:30.378 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:30.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.489+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f495c04ea50 con 0x7f495c0ff390 2024-02-15T22:58:30.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.489+0000 7f4943fff700 1 -- 172.21.15.138:0/3686435279 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f494c05b840 con 0x7f495c0ff390 2024-02-15T22:58:30.492 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:58:30.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 msgr2=0x7f494406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 0x7f494406fd50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4950005fd0 tx=0x7f4950005ee0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 msgr2=0x7f495c196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:58:30.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f494c006010 tx=0x7f494c00be20 comp rx=0 tx=0).stop 2024-02-15T22:58:30.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 shutdown_connections 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f494406d8a0 0x7f494406fd50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c0ff390 0x7f495c196c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 --2- 172.21.15.138:0/3686435279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f495c0ffd30 0x7f495c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 >> 172.21.15.138:0/3686435279 conn(0x7f495c074f50 msgr2=0x7f495c0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.491+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 shutdown_connections 2024-02-15T22:58:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:58:30.492+0000 7f496172f700 1 -- 172.21.15.138:0/3686435279 wait complete. 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: Upgrade: Updating osd.2 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: Deploying daemon osd.2 on smithi138 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2731631101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1028925202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:58:30.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:31.622 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:31 smithi138 ceph-mon[89527]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:31.623 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:31 smithi138 ceph-mon[89527]: pgmap v88: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:31.623 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:31 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3686435279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:58:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:31 smithi170 ceph-mon[67652]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:58:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:31 smithi170 ceph-mon[67652]: pgmap v88: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:31 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3686435279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:58:31.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:31 smithi138 systemd[1]: Stopping Ceph osd.2 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:58:32.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:32 smithi138 ceph-mon[89527]: osd.2 marked itself down and dead 2024-02-15T22:58:32.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:32 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[55314]: 2024-02-15T22:58:32.092+0000 7fb425a47700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:58:32.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:32 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[55314]: 2024-02-15T22:58:32.092+0000 7fb425a47700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-15T22:58:32.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:32 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[55314]: 2024-02-15T22:58:32.092+0000 7fb425a47700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:58:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:32 smithi170 ceph-mon[67652]: osd.2 marked itself down and dead 2024-02-15T22:58:33.063 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:32 smithi138 podman[112388]: 2024-02-15 22:58:32.76738479 +0000 UTC m=+0.805040410 container died d9bcd188737afc0c96f8b52d0195c4aa72ade4b41142808d4eeb23e072cec879 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-15T22:58:33.473 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:33 smithi138 ceph-mon[89527]: pgmap v89: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:58:33.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:33 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:58:33.474 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:33 smithi138 ceph-mon[89527]: osdmap e60: 6 total, 5 up, 6 in 2024-02-15T22:58:33.474 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:33 smithi138 podman[112388]: 2024-02-15 22:58:33.261099628 +0000 UTC m=+1.298755293 container cleanup d9bcd188737afc0c96f8b52d0195c4aa72ade4b41142808d4eeb23e072cec879 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-15T22:58:33.474 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:33 smithi138 bash[112388]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2 2024-02-15T22:58:33.642 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:33 smithi170 ceph-mon[67652]: pgmap v89: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:58:33.642 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:33 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:58:33.642 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:33 smithi170 ceph-mon[67652]: osdmap e60: 6 total, 5 up, 6 in 2024-02-15T22:58:33.734 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:33 smithi138 podman[112407]: 2024-02-15 22:58:33.471520327 +0000 UTC m=+0.704052177 container remove d9bcd188737afc0c96f8b52d0195c4aa72ade4b41142808d4eeb23e072cec879 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-15T22:58:34.060 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:33 smithi138 podman[112497]: 2024-02-15 22:58:33.69061322 +0000 UTC m=+0.018429020 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:58:34.060 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:33 smithi138 podman[112497]: 2024-02-15 22:58:33.806086474 +0000 UTC m=+0.133902312 container create e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True) 2024-02-15T22:58:34.060 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:34 smithi138 podman[112497]: 2024-02-15 22:58:34.058648871 +0000 UTC m=+0.386464666 container init e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-15T22:58:34.322 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:34 smithi138 podman[112497]: 2024-02-15 22:58:34.06198778 +0000 UTC m=+0.389803581 container start e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-02-15T22:58:34.322 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:34 smithi138 podman[112497]: 2024-02-15 22:58:34.142188196 +0000 UTC m=+0.470004006 container attach e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-15T22:58:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:34 smithi138 ceph-mon[89527]: osdmap e61: 6 total, 5 up, 6 in 2024-02-15T22:58:34.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:34 smithi138 podman[112497]: 2024-02-15 22:58:34.356744094 +0000 UTC m=+0.684559900 container died e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:58:34.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:34 smithi170 ceph-mon[67652]: osdmap e61: 6 total, 5 up, 6 in 2024-02-15T22:58:35.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:35 smithi138 ceph-mon[89527]: pgmap v92: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T22:58:35.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:35 smithi138 ceph-mon[89527]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-15T22:58:35.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 podman[112523]: 2024-02-15 22:58:35.231493668 +0000 UTC m=+0.869773215 container remove e76f04a1bd540d3261b75a79e6466f682d376a3a90a4c62f720257455f499417 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-15T22:58:35.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-15T22:58:35.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 systemd[1]: Stopped Ceph osd.2 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:58:35.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.2.service: Consumed 51.718s CPU time. 2024-02-15T22:58:35.485 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 systemd[1]: Starting Ceph osd.2 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:58:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:35 smithi170 ceph-mon[67652]: pgmap v92: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T22:58:35.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:35 smithi170 ceph-mon[67652]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-15T22:58:35.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 podman[112626]: 2024-02-15 22:58:35.594378427 +0000 UTC m=+0.017767355 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:58:35.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 podman[112626]: 2024-02-15 22:58:35.715775116 +0000 UTC m=+0.139164045 container create 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-15T22:58:36.376 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 podman[112626]: 2024-02-15 22:58:35.986497545 +0000 UTC m=+0.409886470 container init 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5) 2024-02-15T22:58:36.377 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:35 smithi138 podman[112626]: 2024-02-15 22:58:35.989699163 +0000 UTC m=+0.413088089 container start 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-15T22:58:36.377 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 podman[112626]: 2024-02-15 22:58:36.068967117 +0000 UTC m=+0.492356054 container attach 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-15T22:58:36.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-mon[89527]: pgmap v93: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 17/360 objects degraded (4.722%) 2024-02-15T22:58:36.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 17/360 objects degraded (4.722%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 bash[112626]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T22:58:36.735 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T22:58:36.736 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T22:58:36.736 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate[112641]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-15T22:58:36.736 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:36 smithi138 podman[112626]: 2024-02-15 22:58:36.456863582 +0000 UTC m=+0.880252514 container died 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-15T22:58:36.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:36 smithi170 ceph-mon[67652]: pgmap v93: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 17/360 objects degraded (4.722%) 2024-02-15T22:58:36.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:36 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 17/360 objects degraded (4.722%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:37.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 podman[112776]: 2024-02-15 22:58:37.17448032 +0000 UTC m=+0.707008566 container remove 64c443bd5ab50c2ea0254e04464c4da2830a65a0ffcfffb7bdaf9ebe0978809b (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-activate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-15T22:58:37.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 podman[112841]: 2024-02-15 22:58:37.29490057 +0000 UTC m=+0.018143459 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:58:37.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 podman[112841]: 2024-02-15 22:58:37.392300845 +0000 UTC m=+0.115543776 container create 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T22:58:37.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 podman[112841]: 2024-02-15 22:58:37.645147272 +0000 UTC m=+0.368390162 container init 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:58:37.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 podman[112841]: 2024-02-15 22:58:37.648095497 +0000 UTC m=+0.371338389 container start 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-15T22:58:37.985 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 ceph-osd[112860]: -- 172.21.15.138:0/2791253522 <== mon.0 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555dfde411e0 con 0x555dfde13000 2024-02-15T22:58:37.985 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 bash[112841]: 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 2024-02-15T22:58:37.985 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:37 smithi138 systemd[1]: Started Ceph osd.2 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:58:38.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:38 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T22:58:38.191+0000 7f74d6b817c0 -1 Falling back to public interface 2024-02-15T22:58:38.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:38 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:38.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:38 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:38.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:38 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:38.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:38 smithi138 ceph-mon[89527]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/360 objects degraded (11.944%) 2024-02-15T22:58:39.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:38 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:39.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:38 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:39.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:38 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:39.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:38 smithi170 ceph-mon[67652]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/360 objects degraded (11.944%) 2024-02-15T22:58:40.158 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:39 smithi138 ceph-mon[89527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-02-15T22:58:40.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:39 smithi170 ceph-mon[67652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-02-15T22:58:41.097 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:40 smithi138 ceph-mon[89527]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2024-02-15T22:58:41.198 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:40 smithi170 ceph-mon[67652]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2024-02-15T22:58:42.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:41 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 43/360 objects degraded (11.944%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:42.235 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:42 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T22:58:42.118+0000 7f74d6b817c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-15T22:58:42.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:41 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 43/360 objects degraded (11.944%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:42.734 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:42 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T22:58:42.513+0000 7f74d6b817c0 -1 osd.2 59 log_to_monitors true 2024-02-15T22:58:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:42 smithi138 ceph-mon[89527]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/360 objects degraded (11.944%) 2024-02-15T22:58:43.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:42 smithi138 ceph-mon[89527]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:58:43.235 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 22:58:42 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T22:58:42.927+0000 7f74c7fd9700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:58:43.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:42 smithi170 ceph-mon[67652]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/360 objects degraded (11.944%) 2024-02-15T22:58:43.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:42 smithi170 ceph-mon[67652]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T22:58:44.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:43 smithi170 ceph-mon[67652]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:58:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:43 smithi170 ceph-mon[67652]: osdmap e62: 6 total, 5 up, 6 in 2024-02-15T22:58:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:43 smithi170 ceph-mon[67652]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:58:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:43 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:44.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:43 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:43 smithi138 ceph-mon[89527]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T22:58:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:43 smithi138 ceph-mon[89527]: osdmap e62: 6 total, 5 up, 6 in 2024-02-15T22:58:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:43 smithi138 ceph-mon[89527]: from='osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]: dispatch 2024-02-15T22:58:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:43 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:44.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:43 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839] boot 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: osdmap e63: 6 total, 6 up, 6 in 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:45.213 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:44 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:45.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: osd.2 [v2:172.21.15.138:6818/3347258839,v1:172.21.15.138:6819/3347258839] boot 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: osdmap e63: 6 total, 6 up, 6 in 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:45.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:44 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:46.189 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:45 smithi138 ceph-mon[89527]: osdmap e64: 6 total, 6 up, 6 in 2024-02-15T22:58:46.189 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:46.189 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:46.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:45 smithi170 ceph-mon[67652]: osdmap e64: 6 total, 6 up, 6 in 2024-02-15T22:58:46.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:46.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:58:47.192 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:46 smithi138 ceph-mon[89527]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 6 op/s; 26/360 objects degraded (7.222%) 2024-02-15T22:58:47.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:46 smithi170 ceph-mon[67652]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 10 active+undersized, 48 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 6 op/s; 26/360 objects degraded (7.222%) 2024-02-15T22:58:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 26/360 objects degraded (7.222%), 7 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:48.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:58:48.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:47 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 26/360 objects degraded (7.222%), 7 pgs degraded (PG_DEGRADED) 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:58:48.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:47 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-02-15T22:58:49.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:48 smithi138 ceph-mon[89527]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-02-15T22:58:49.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:48 smithi170 ceph-mon[67652]: pgmap v102: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-02-15T22:58:50.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:49 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/360 objects degraded (7.222%), 7 pgs degraded) 2024-02-15T22:58:50.235 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:49 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T22:58:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:49 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/360 objects degraded (7.222%), 7 pgs degraded) 2024-02-15T22:58:50.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:49 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T22:58:51.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:50 smithi170 ceph-mon[67652]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:58:51.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:50 smithi138 ceph-mon[89527]: pgmap v103: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:58:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:53 smithi138 ceph-mon[89527]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-15T22:58:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:53 smithi170 ceph-mon[67652]: pgmap v104: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-02-15T22:58:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:55 smithi138 ceph-mon[89527]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T22:58:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:55 smithi170 ceph-mon[67652]: pgmap v105: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T22:58:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:56 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:56.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:56 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:58:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:57 smithi138 ceph-mon[89527]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-02-15T22:58:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:57 smithi170 ceph-mon[67652]: pgmap v106: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-02-15T22:58:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:58:59 smithi138 ceph-mon[89527]: pgmap v107: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:58:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:58:59 smithi170 ceph-mon[67652]: pgmap v107: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:00.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 -- 172.21.15.138:0/1663142568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 msgr2=0x7ff6f8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/1663142568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8104d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009910 tx=0x7ff6e0009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 -- 172.21.15.138:0/1663142568 shutdown_connections 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/1663142568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8104d40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/1663142568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 -- 172.21.15.138:0/1663142568 >> 172.21.15.138:0/1663142568 conn(0x7ff6f80fbc90 msgr2=0x7ff6f80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 -- 172.21.15.138:0/1663142568 shutdown_connections 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.612+0000 7ff6fd11c700 1 -- 172.21.15.138:0/1663142568 wait complete. 2024-02-15T22:59:00.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 Processor -- start 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 -- start start 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f8195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8196960 con 0x7ff6f8100d70 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.613+0000 7ff6fd11c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f819a6f0 con 0x7ff6f81003d0 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44516/0 (socket says 172.21.15.138:44516) 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 -- 172.21.15.138:0/893960998 learned_addr learned my addr 172.21.15.138:0/893960998 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f6d9d700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f8195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 -- 172.21.15.138:0/893960998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 msgr2=0x7ff6f8195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f8195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 -- 172.21.15.138:0/893960998 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00095f0 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f6d9d700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f8195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6f659c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00092e0 tx=0x7ff6e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e001d070 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6e000f460 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f819a970 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.614+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e00175f0 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.615+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f819ae60 con 0x7ff6f8100d70 2024-02-15T22:59:00.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.615+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f8108740 con 0x7ff6f8100d70 2024-02-15T22:59:00.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.616+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff6e000f5d0 con 0x7ff6f8100d70 2024-02-15T22:59:00.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.616+0000 7ff6effff700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 0x7ff6e406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.617+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff6e008e9f0 con 0x7ff6f8100d70 2024-02-15T22:59:00.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.617+0000 7ff6f6d9d700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 0x7ff6e406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.617+0000 7ff6f6d9d700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 0x7ff6e406fd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007fd0 tx=0x7ff6f0007830 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:00.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.621+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff6e0090e60 con 0x7ff6f8100d70 2024-02-15T22:59:00.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.839+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f802cd10 con 0x7ff6e406d8a0 2024-02-15T22:59:00.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.841+0000 7ff6effff700 1 -- 172.21.15.138:0/893960998 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff6f802cd10 con 0x7ff6e406d8a0 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 msgr2=0x7ff6e406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 0x7ff6e406fd50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0007fd0 tx=0x7ff6f0007830 comp rx=0 tx=0).stop 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 msgr2=0x7ff6f8196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00092e0 tx=0x7ff6e000be20 comp rx=0 tx=0).stop 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 shutdown_connections 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff6e406d8a0 0x7ff6e406fd50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6f81003d0 0x7ff6f8195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 --2- 172.21.15.138:0/893960998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6f8100d70 0x7ff6f8196280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 >> 172.21.15.138:0/893960998 conn(0x7ff6f80fbc90 msgr2=0x7ff6f80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:00.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 shutdown_connections 2024-02-15T22:59:00.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.843+0000 7ff6fd11c700 1 -- 172.21.15.138:0/893960998 wait complete. 2024-02-15T22:59:00.856 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:59:00.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 -- 172.21.15.138:0/2143011459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ffd30 msgr2=0x7f16e4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/2143011459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ffd30 0x7f16e4103ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009910 tx=0x7f16e0009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 -- 172.21.15.138:0/2143011459 shutdown_connections 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/2143011459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ffd30 0x7f16e4103ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/2143011459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ff390 0x7f16e40ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 -- 172.21.15.138:0/2143011459 >> 172.21.15.138:0/2143011459 conn(0x7f16e4074f50 msgr2=0x7f16e4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 -- 172.21.15.138:0/2143011459 shutdown_connections 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.950+0000 7f16ec4d0700 1 -- 172.21.15.138:0/2143011459 wait complete. 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 Processor -- start 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 -- start start 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ffd30 0x7f16e41970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e41976e0 con 0x7f16e40ff390 2024-02-15T22:59:00.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ec4d0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4197820 con 0x7f16e40ffd30 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ea26c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ea26c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44546/0 (socket says 172.21.15.138:44546) 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16ea26c700 1 -- 172.21.15.138:0/3556460528 learned_addr learned my addr 172.21.15.138:0/3556460528 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.951+0000 7f16e9a6b700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ffd30 0x7f16e41970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ea26c700 1 -- 172.21.15.138:0/3556460528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ffd30 msgr2=0x7f16e41970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ea26c700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ffd30 0x7f16e41970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ea26c700 1 -- 172.21.15.138:0/3556460528 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00095f0 con 0x7f16e40ff390 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ea26c700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16d400d900 tx=0x7f16d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d40041f0 con 0x7f16e40ff390 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16d4004cf0 con 0x7f16e40ff390 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e419fbf0 con 0x7f16e40ff390 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16d400b750 con 0x7f16e40ff390 2024-02-15T22:59:00.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.952+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e41a00b0 con 0x7f16e40ff390 2024-02-15T22:59:00.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.953+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e4107600 con 0x7f16e40ff390 2024-02-15T22:59:00.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.954+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f16d4004350 con 0x7f16e40ff390 2024-02-15T22:59:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.954+0000 7f16db7fe700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 0x7f16d006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.954+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f16d408d5a0 con 0x7f16e40ff390 2024-02-15T22:59:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.954+0000 7f16e9a6b700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 0x7f16d006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:00.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.955+0000 7f16e9a6b700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 0x7f16d006fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e0006010 tx=0x7f16e001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:00.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:00.959+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f16d4056e00 con 0x7f16e40ff390 2024-02-15T22:59:01.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.171+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16e402cd40 con 0x7f16d006d8a0 2024-02-15T22:59:01.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.172+0000 7f16db7fe700 1 -- 172.21.15.138:0/3556460528 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f16e402cd40 con 0x7f16d006d8a0 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 msgr2=0x7f16d006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 0x7f16d006fd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16e0006010 tx=0x7f16e001a040 comp rx=0 tx=0).stop 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 msgr2=0x7f16e4196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16d400d900 tx=0x7f16d400dcc0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 shutdown_connections 2024-02-15T22:59:01.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f16d006d8a0 0x7f16d006fd50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e40ff390 0x7f16e4196b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 --2- 172.21.15.138:0/3556460528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e40ffd30 0x7f16e41970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 >> 172.21.15.138:0/3556460528 conn(0x7f16e4074f50 msgr2=0x7f16e40fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 shutdown_connections 2024-02-15T22:59:01.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.174+0000 7f16ec4d0700 1 -- 172.21.15.138:0/3556460528 wait complete. 2024-02-15T22:59:01.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 -- 172.21.15.138:0/3737539246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d24100d70 msgr2=0x7f5d24104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 --2- 172.21.15.138:0/3737539246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d24100d70 0x7f5d24104d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009910 tx=0x7f5d18009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 -- 172.21.15.138:0/3737539246 shutdown_connections 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 --2- 172.21.15.138:0/3737539246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d24100d70 0x7f5d24104d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 --2- 172.21.15.138:0/3737539246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d241003d0 0x7f5d241007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 -- 172.21.15.138:0/3737539246 >> 172.21.15.138:0/3737539246 conn(0x7f5d240fbc90 msgr2=0x7f5d240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 -- 172.21.15.138:0/3737539246 shutdown_connections 2024-02-15T22:59:01.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.282+0000 7f5d289e1700 1 -- 172.21.15.138:0/3737539246 wait complete. 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 Processor -- start 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 -- start start 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d24100d70 0x7f5d24196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24196960 con 0x7f5d241003d0 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d289e1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2419a6f0 con 0x7f5d24100d70 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44578/0 (socket says 172.21.15.138:44578) 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 -- 172.21.15.138:0/312607003 learned_addr learned my addr 172.21.15.138:0/312607003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:01.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d21d9b700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d24100d70 0x7f5d24196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 -- 172.21.15.138:0/312607003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d24100d70 msgr2=0x7f5d24196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d24100d70 0x7f5d24196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 -- 172.21.15.138:0/312607003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180095f0 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.283+0000 7f5d2259c700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c8a0 tx=0x7f5d1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.284+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1400cea0 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.284+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d14004830 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.284+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2419a9d0 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.284+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d140055b0 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.284+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2419af20 con 0x7f5d241003d0 2024-02-15T22:59:01.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.285+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24108740 con 0x7f5d241003d0 2024-02-15T22:59:01.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.285+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5d140049a0 con 0x7f5d241003d0 2024-02-15T22:59:01.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.285+0000 7f5d137fe700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 0x7f5d0c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.286+0000 7f5d21d9b700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 0x7f5d0c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.286+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5d1408d140 con 0x7f5d241003d0 2024-02-15T22:59:01.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.286+0000 7f5d21d9b700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 0x7f5d0c06fd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d180059d0 tx=0x7f5d18005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:01.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.290+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d140569a0 con 0x7f5d241003d0 2024-02-15T22:59:01.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.494+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d2419b270 con 0x7f5d0c06d8a0 2024-02-15T22:59:01.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.505+0000 7f5d137fe700 1 -- 172.21.15.138:0/312607003 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f5d2419b270 con 0x7f5d0c06d8a0 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (5m) 18s ago 16m 24.9M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (16m) 18s ago 16m 8732k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (15m) 113s ago 15m 8182k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (2m) 18s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (117s) 113s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (4m) 18s ago 15m 84.8M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (10m) 18s ago 10m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (10m) 18s ago 10m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (10m) 113s ago 10m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (10m) 113s ago 10m 60.3M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:59:01.508 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (7m) 18s ago 17m 501M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (6m) 113s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (3m) 18s ago 17m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (2m) 113s ago 14m 40.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 18s ago 16m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 113s ago 15m 16.6M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (96s) 18s ago 14m 93.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (60s) 18s ago 13m 99.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (24s) 18s ago 13m 12.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (12m) 113s ago 12m 272M 2240M 18.2.0 dc2bc1663786 cc24a20142ce 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (12m) 113s ago 12m 254M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (12m) 113s ago 12m 228M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:59:01.509 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (5m) 18s ago 15m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 msgr2=0x7f5d0c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 0x7f5d0c06fd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d180059d0 tx=0x7f5d18005960 comp rx=0 tx=0).stop 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 msgr2=0x7f5d24195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c8a0 tx=0x7f5d1400cc60 comp rx=0 tx=0).stop 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 shutdown_connections 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d0c06d8a0 0x7f5d0c06fd50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d241003d0 0x7f5d24195d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 --2- 172.21.15.138:0/312607003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d24100d70 0x7f5d24196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 >> 172.21.15.138:0/312607003 conn(0x7f5d240fbc90 msgr2=0x7f5d240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:01.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 shutdown_connections 2024-02-15T22:59:01.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.507+0000 7f5d289e1700 1 -- 172.21.15.138:0/312607003 wait complete. 2024-02-15T22:59:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 -- 172.21.15.138:0/2920595206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 msgr2=0x7fb3b81017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2920595206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b81017b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009940 tx=0x7fb3a8009c50 comp rx=0 tx=0).stop 2024-02-15T22:59:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 -- 172.21.15.138:0/2920595206 shutdown_connections 2024-02-15T22:59:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2920595206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 0x7fb3b810a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2920595206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b81017b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 -- 172.21.15.138:0/2920595206 >> 172.21.15.138:0/2920595206 conn(0x7fb3b80fac20 msgr2=0x7fb3b80fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:01.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 -- 172.21.15.138:0/2920595206 shutdown_connections 2024-02-15T22:59:01.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:01 smithi138 ceph-mon[89527]: pgmap v108: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:01.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:01.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.611+0000 7fb3bd717700 1 -- 172.21.15.138:0/2920595206 wait complete. 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 Processor -- start 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 -- start start 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 0x7fb3b8196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8196960 con 0x7fb3b81013e0 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3bd717700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b819a6f0 con 0x7fb3b8101cf0 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3b6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3b6ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44598/0 (socket says 172.21.15.138:44598) 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3b6ffd700 1 -- 172.21.15.138:0/2881197608 learned_addr learned my addr 172.21.15.138:0/2881197608 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:01.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.612+0000 7fb3ae7fc700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 0x7fb3b8196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b6ffd700 1 -- 172.21.15.138:0/2881197608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 msgr2=0x7fb3b8196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b6ffd700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 0x7fb3b8196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b6ffd700 1 -- 172.21.15.138:0/2881197608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80095f0 con 0x7fb3b81013e0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b6ffd700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80055f0 tx=0x7fb3a80056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a801d070 con 0x7fb3b81013e0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3a800f460 con 0x7fb3b81013e0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3a8021640 con 0x7fb3b81013e0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b819a970 con 0x7fb3b81013e0 2024-02-15T22:59:01.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.613+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b819ae60 con 0x7fb3b81013e0 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.614+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b81078c0 con 0x7fb3b81013e0 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.614+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb3a800fa60 con 0x7fb3b81013e0 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.615+0000 7fb3b4ff9700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 0x7fb3a406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.615+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb3a808e690 con 0x7fb3b81013e0 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.615+0000 7fb3ae7fc700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 0x7fb3a406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:01.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.615+0000 7fb3ae7fc700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 0x7fb3a406fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005950 tx=0x7fb3a00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:01.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.619+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb3a8057ed0 con 0x7fb3b81013e0 2024-02-15T22:59:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:01 smithi170 ceph-mon[67652]: pgmap v108: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:01.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.898+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3b804ea50 con 0x7fb3b81013e0 2024-02-15T22:59:01.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.898+0000 7fb3b4ff9700 1 -- 172.21.15.138:0/2881197608 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fb3a805b590 con 0x7fb3b81013e0 2024-02-15T22:59:01.901 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:59:01.901 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:59:01.901 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 7 2024-02-15T22:59:01.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:59:01.903 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:59:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.900+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 msgr2=0x7fb3a406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.900+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 0x7fb3a406fd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0005950 tx=0x7fb3a00058e0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.900+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 msgr2=0x7fb3b8195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.900+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80055f0 tx=0x7fb3a80056d0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 shutdown_connections 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb3a406d8a0 0x7fb3a406fd50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b81013e0 0x7fb3b8195d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 --2- 172.21.15.138:0/2881197608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b8101cf0 0x7fb3b8196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 >> 172.21.15.138:0/2881197608 conn(0x7fb3b80fac20 msgr2=0x7fb3b8104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 shutdown_connections 2024-02-15T22:59:01.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:01.901+0000 7fb3bd717700 1 -- 172.21.15.138:0/2881197608 wait complete. 2024-02-15T22:59:02.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 -- 172.21.15.138:0/3463704576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 msgr2=0x7ff388104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/3463704576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388104b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff378009910 tx=0x7ff378009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:02.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 -- 172.21.15.138:0/3463704576 shutdown_connections 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/3463704576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 0x7ff3881038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/3463704576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388104b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 -- 172.21.15.138:0/3463704576 >> 172.21.15.138:0/3463704576 conn(0x7ff388074850 msgr2=0x7ff388074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.005+0000 7ff38d9e1700 1 -- 172.21.15.138:0/3463704576 shutdown_connections 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.006+0000 7ff38d9e1700 1 -- 172.21.15.138:0/3463704576 wait complete. 2024-02-15T22:59:02.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.006+0000 7ff38d9e1700 1 Processor -- start 2024-02-15T22:59:02.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.006+0000 7ff38d9e1700 1 -- start start 2024-02-15T22:59:02.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 0x7ff388195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881968a0 con 0x7ff388104790 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881995d0 con 0x7ff388103450 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44610/0 (socket says 172.21.15.138:44610) 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 -- 172.21.15.138:0/1247339544 learned_addr learned my addr 172.21.15.138:0/1247339544 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff386ffd700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 0x7ff388195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 -- 172.21.15.138:0/1247339544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 msgr2=0x7ff388195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 0x7ff388195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 -- 172.21.15.138:0/1247339544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780095f0 con 0x7ff388104790 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff3867fc700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00d900 tx=0x7ff37c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff37c0041f0 con 0x7ff388104790 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3881998b0 con 0x7ff388104790 2024-02-15T22:59:02.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff37c004cf0 con 0x7ff388104790 2024-02-15T22:59:02.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff37c00b750 con 0x7ff388104790 2024-02-15T22:59:02.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.007+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388199e00 con 0x7ff388104790 2024-02-15T22:59:02.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.008+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38804ea50 con 0x7ff388104790 2024-02-15T22:59:02.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.009+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff37c004750 con 0x7ff388104790 2024-02-15T22:59:02.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.009+0000 7ff38c9df700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 0x7ff37006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.009+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff37c08d3b0 con 0x7ff388104790 2024-02-15T22:59:02.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.009+0000 7ff386ffd700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 0x7ff37006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.010+0000 7ff386ffd700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 0x7ff37006fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff378006010 tx=0x7ff37801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.014+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff37c056c10 con 0x7ff388104790 2024-02-15T22:59:02.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.253+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff388196ff0 con 0x7ff388104790 2024-02-15T22:59:02.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.253+0000 7ff38c9df700 1 -- 172.21.15.138:0/1247339544 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7ff37c016770 con 0x7ff388104790 2024-02-15T22:59:02.256 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:59:02.256 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:59:02.256 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:59:02.257 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:59:02.258 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:02.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.255+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 msgr2=0x7ff37006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.255+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 0x7ff37006fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff378006010 tx=0x7ff37801a040 comp rx=0 tx=0).stop 2024-02-15T22:59:02.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.255+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 msgr2=0x7ff388196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.255+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00d900 tx=0x7ff37c00dc10 comp rx=0 tx=0).stop 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 shutdown_connections 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff37006d8a0 0x7ff37006fd50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff388103450 0x7ff388195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 --2- 172.21.15.138:0/1247339544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff388104790 0x7ff388196210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 >> 172.21.15.138:0/1247339544 conn(0x7ff388074850 msgr2=0x7ff388107b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 shutdown_connections 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.256+0000 7ff38d9e1700 1 -- 172.21.15.138:0/1247339544 wait complete. 2024-02-15T22:59:02.261 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 -- 172.21.15.138:0/227511827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 msgr2=0x7fb0980ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/227511827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb0980ff690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009910 tx=0x7fb08c009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 -- 172.21.15.138:0/227511827 shutdown_connections 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/227511827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 0x7fb098103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/227511827 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb0980ff690 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 -- 172.21.15.138:0/227511827 >> 172.21.15.138:0/227511827 conn(0x7fb0980fab60 msgr2=0x7fb0980fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 -- 172.21.15.138:0/227511827 shutdown_connections 2024-02-15T22:59:02.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.361+0000 7fb09d4b9700 1 -- 172.21.15.138:0/227511827 wait complete. 2024-02-15T22:59:02.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 Processor -- start 2024-02-15T22:59:02.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 -- start start 2024-02-15T22:59:02.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 0x7fb098196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981969e0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb09d4b9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09819a770 con 0x7fb0980ffc60 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44630/0 (socket says 172.21.15.138:44630) 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 -- 172.21.15.138:0/1214378494 learned_addr learned my addr 172.21.15.138:0/1214378494 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb0967fc700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 0x7fb098196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 -- 172.21.15.138:0/1214378494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 msgr2=0x7fb098196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 0x7fb098196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.362+0000 7fb096ffd700 1 -- 172.21.15.138:0/1214378494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0095f0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb096ffd700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006010 tx=0x7fb08c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c01d070 con 0x7fb0980ff2c0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09819a9f0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb08c00f460 con 0x7fb0980ff2c0 2024-02-15T22:59:02.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c0175f0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.363+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09819aee0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.364+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0981085e0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.364+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb08c00f5d0 con 0x7fb0980ff2c0 2024-02-15T22:59:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.365+0000 7fb07ffff700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.365+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb08c08ea20 con 0x7fb0980ff2c0 2024-02-15T22:59:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.365+0000 7fb0967fc700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.365+0000 7fb0967fc700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb088005fd0 tx=0x7fb08800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.369+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb08c058280 con 0x7fb0980ff2c0 2024-02-15T22:59:02.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.589+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb09802cd20 con 0x7fb08006d8a0 2024-02-15T22:59:02.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:02 smithi138 ceph-mon[89527]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:02.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:02 smithi138 ceph-mon[89527]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:02.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:02 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2881197608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:02.592 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:02 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1247339544' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.590+0000 7fb07ffff700 1 -- 172.21.15.138:0/1214378494 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb09802cd20 con 0x7fb08006d8a0 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:59:02.593 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "9/23 daemons upgraded", 2024-02-15T22:59:02.594 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:59:02.594 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:59:02.594 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 msgr2=0x7fb08006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb088005fd0 tx=0x7fb08800a560 comp rx=0 tx=0).stop 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 msgr2=0x7fb098195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb08c006010 tx=0x7fb08c00be20 comp rx=0 tx=0).stop 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 shutdown_connections 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ff2c0 0x7fb098195dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 --2- 172.21.15.138:0/1214378494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ffc60 0x7fb098196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.593+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 >> 172.21.15.138:0/1214378494 conn(0x7fb0980fab60 msgr2=0x7fb098068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.594+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 shutdown_connections 2024-02-15T22:59:02.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.594+0000 7fb09d4b9700 1 -- 172.21.15.138:0/1214378494 wait complete. 2024-02-15T22:59:02.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 -- 172.21.15.138:0/1651478251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55001003d0 msgr2=0x7f55001007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 --2- 172.21.15.138:0/1651478251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55001003d0 0x7f55001007a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009910 tx=0x7f54f0009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 -- 172.21.15.138:0/1651478251 shutdown_connections 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 --2- 172.21.15.138:0/1651478251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5500100d70 0x7f5500104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 --2- 172.21.15.138:0/1651478251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f55001003d0 0x7f55001007a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 -- 172.21.15.138:0/1651478251 >> 172.21.15.138:0/1651478251 conn(0x7f55000fbc90 msgr2=0x7f55000fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 -- 172.21.15.138:0/1651478251 shutdown_connections 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.697+0000 7f5505d09700 1 -- 172.21.15.138:0/1651478251 wait complete. 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 Processor -- start 2024-02-15T22:59:02.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 -- start start 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55001003d0 0x7f5500195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500196980 con 0x7f5500100d70 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.698+0000 7f5505d09700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550019a710 con 0x7f55001003d0 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44642/0 (socket says 172.21.15.138:44642) 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 -- 172.21.15.138:0/883288003 learned_addr learned my addr 172.21.15.138:0/883288003 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54ff7fe700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55001003d0 0x7f5500195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 -- 172.21.15.138:0/883288003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55001003d0 msgr2=0x7f5500195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55001003d0 0x7f5500195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 -- 172.21.15.138:0/883288003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00095f0 con 0x7f5500100d70 2024-02-15T22:59:02.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54feffd700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c8f0 tx=0x7f54f400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f40078a0 con 0x7f5500100d70 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54f400f450 con 0x7f5500100d70 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550019a9f0 con 0x7f5500100d70 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54f4018610 con 0x7f5500100d70 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.699+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550019af40 con 0x7f5500100d70 2024-02-15T22:59:02.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.700+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55001086e0 con 0x7f5500100d70 2024-02-15T22:59:02.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.701+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f54f400f5c0 con 0x7f5500100d70 2024-02-15T22:59:02.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.701+0000 7f54fcff9700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 0x7f54e806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:02.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.701+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f54f408d3f0 con 0x7f5500100d70 2024-02-15T22:59:02.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.701+0000 7f54ff7fe700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 0x7f54e806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:02.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.702+0000 7f54ff7fe700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 0x7f54e806fd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54f0006010 tx=0x7f54f001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:02.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.706+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f54f4056c50 con 0x7f5500100d70 2024-02-15T22:59:02.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:02 smithi170 ceph-mon[67652]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:02.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:02 smithi170 ceph-mon[67652]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:02.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:02 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2881197608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:02.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:02 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1247339544' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:59:02.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.982+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f550004ea50 con 0x7f5500100d70 2024-02-15T22:59:02.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.982+0000 7f54fcff9700 1 -- 172.21.15.138:0/883288003 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f54f405a310 con 0x7f5500100d70 2024-02-15T22:59:02.985 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 msgr2=0x7f54e806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 0x7f54e806fd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54f0006010 tx=0x7f54f001a040 comp rx=0 tx=0).stop 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 msgr2=0x7f55001962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c8f0 tx=0x7f54f400cc00 comp rx=0 tx=0).stop 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 shutdown_connections 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f54e806d8a0 0x7f54e806fd50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55001003d0 0x7f5500195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 --2- 172.21.15.138:0/883288003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5500100d70 0x7f55001962a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 >> 172.21.15.138:0/883288003 conn(0x7f55000fbc90 msgr2=0x7f55000fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 shutdown_connections 2024-02-15T22:59:02.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:02.984+0000 7f5505d09700 1 -- 172.21.15.138:0/883288003 wait complete. 2024-02-15T22:59:03.614 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:03 smithi170 ceph-mon[67652]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:03.614 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:03 smithi170 ceph-mon[67652]: pgmap v109: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:03.615 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:03 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/883288003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:59:03.615 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:03 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:59:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:03 smithi138 ceph-mon[89527]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:03 smithi138 ceph-mon[89527]: pgmap v109: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:03 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/883288003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:59:03.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:03 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:59:04.554 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:04 smithi138 ceph-mon[89527]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:04.554 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:04 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:59:04.554 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:04 smithi138 ceph-mon[89527]: Upgrade: osd.3 is safe to restart 2024-02-15T22:59:04.617 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:04 smithi170 ceph-mon[67652]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:04.617 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:04 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T22:59:04.618 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:04 smithi170 ceph-mon[67652]: Upgrade: osd.3 is safe to restart 2024-02-15T22:59:05.520 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:05 smithi170 ceph-mon[67652]: pgmap v110: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:05.520 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:05.520 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:59:05.521 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:05 smithi138 ceph-mon[89527]: pgmap v110: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T22:59:05.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:06.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:06 smithi138 ceph-mon[89527]: Upgrade: Updating osd.3 2024-02-15T22:59:06.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:06 smithi138 ceph-mon[89527]: Deploying daemon osd.3 on smithi170 2024-02-15T22:59:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:06 smithi170 ceph-mon[67652]: Upgrade: Updating osd.3 2024-02-15T22:59:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:06 smithi170 ceph-mon[67652]: Deploying daemon osd.3 on smithi170 2024-02-15T22:59:07.427 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:07 smithi170 ceph-mon[67652]: pgmap v111: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:07 smithi138 ceph-mon[89527]: pgmap v111: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:08.375 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:08 smithi170 systemd[1]: Stopping Ceph osd.3 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:59:08.762 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:08 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:59:08.371+0000 7f43bf824700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:59:08.762 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:08 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:59:08.371+0000 7f43bf824700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-15T22:59:08.762 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:08 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[41171]: 2024-02-15T22:59:08.371+0000 7f43bf824700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:59:09.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:09 smithi138 ceph-mon[89527]: pgmap v112: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:09.614 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:09 smithi138 ceph-mon[89527]: osd.3 marked itself down and dead 2024-02-15T22:59:09.745 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:09 smithi170 ceph-mon[67652]: pgmap v112: 65 pgs: 65 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:09.745 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:09 smithi170 ceph-mon[67652]: osd.3 marked itself down and dead 2024-02-15T22:59:10.011 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:09 smithi170 podman[76652]: 2024-02-15 22:59:09.743125494 +0000 UTC m=+1.489586271 container died cc24a20142ceb19b88e2ef9d47d0b974bdcb7806a6ad5693e1f279ca34bbe8f2 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-02-15T22:59:10.305 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:10 smithi170 podman[76652]: 2024-02-15 22:59:10.130266327 +0000 UTC m=+1.876727105 container cleanup cc24a20142ceb19b88e2ef9d47d0b974bdcb7806a6ad5693e1f279ca34bbe8f2 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212) 2024-02-15T22:59:10.305 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:10 smithi170 bash[76652]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3 2024-02-15T22:59:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:10 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:59:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:10 smithi138 ceph-mon[89527]: osdmap e65: 6 total, 5 up, 6 in 2024-02-15T22:59:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:10 smithi138 ceph-mon[89527]: osdmap e66: 6 total, 5 up, 6 in 2024-02-15T22:59:10.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:10 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:59:10.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:10 smithi170 ceph-mon[67652]: osdmap e65: 6 total, 5 up, 6 in 2024-02-15T22:59:10.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:10 smithi170 ceph-mon[67652]: osdmap e66: 6 total, 5 up, 6 in 2024-02-15T22:59:10.762 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:10 smithi170 podman[76671]: 2024-02-15 22:59:10.431756334 +0000 UTC m=+0.685265056 container remove cc24a20142ceb19b88e2ef9d47d0b974bdcb7806a6ad5693e1f279ca34bbe8f2 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, RELEASE=HEAD) 2024-02-15T22:59:11.087 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:10 smithi170 podman[76762]: 2024-02-15 22:59:10.69510995 +0000 UTC m=+0.018163758 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:11.087 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:10 smithi170 podman[76762]: 2024-02-15 22:59:10.849547963 +0000 UTC m=+0.172601769 container create 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-15T22:59:11.087 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 podman[76762]: 2024-02-15 22:59:11.085653348 +0000 UTC m=+0.408707155 container init 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-15T22:59:11.381 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:11 smithi170 ceph-mon[67652]: pgmap v114: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:59:11.381 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 podman[76762]: 2024-02-15 22:59:11.088868081 +0000 UTC m=+0.411921889 container start 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-02-15T22:59:11.382 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 podman[76762]: 2024-02-15 22:59:11.169023583 +0000 UTC m=+0.492077402 container attach 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-02-15T22:59:11.732 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 podman[76762]: 2024-02-15 22:59:11.379943779 +0000 UTC m=+0.702997588 container died 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:59:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:11 smithi138 ceph-mon[89527]: pgmap v114: 65 pgs: 16 stale+active+clean, 49 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:59:11.982 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 podman[76788]: 2024-02-15 22:59:11.964222523 +0000 UTC m=+0.578247543 container remove 237e322955fb831d30e536152dd7014d7e343a2faa204ffba19dc125a23daccd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:59:12.261 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-15T22:59:12.261 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 systemd[1]: Stopped Ceph osd.3 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:59:12.261 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:11 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.3.service: Consumed 1min 10.364s CPU time. 2024-02-15T22:59:12.261 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 systemd[1]: Starting Ceph osd.3 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:59:12.629 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:12 smithi170 ceph-mon[67652]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 52/360 objects degraded (14.444%) 2024-02-15T22:59:12.629 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:12 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 52/360 objects degraded (14.444%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:12.629 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 podman[76894]: 2024-02-15 22:59:12.306288234 +0000 UTC m=+0.019300995 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:12.629 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 podman[76894]: 2024-02-15 22:59:12.415842216 +0000 UTC m=+0.128855015 container create 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-15T22:59:12.629 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 podman[76894]: 2024-02-15 22:59:12.627352718 +0000 UTC m=+0.340365476 container init 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-15T22:59:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:12 smithi138 ceph-mon[89527]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 37 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 52/360 objects degraded (14.444%) 2024-02-15T22:59:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:12 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 52/360 objects degraded (14.444%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:13.011 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 podman[76894]: 2024-02-15 22:59:12.630813921 +0000 UTC m=+0.343826682 container start 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-15T22:59:13.011 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:12 smithi170 podman[76894]: 2024-02-15 22:59:12.718616008 +0000 UTC m=+0.431628783 container attach 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 bash[76894]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-15T22:59:13.474 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-15T22:59:13.475 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T22:59:13.475 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T22:59:13.475 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T22:59:13.475 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate[76909]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-15T22:59:13.475 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 podman[76894]: 2024-02-15 22:59:13.097741002 +0000 UTC m=+0.810753756 container died 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:59:14.060 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:13 smithi170 podman[77045]: 2024-02-15 22:59:13.797705444 +0000 UTC m=+0.694454449 container remove 30b358d2d65f002dee1613e1811e50e1f1e54475dbbd5b53510c660e42585157 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-15T22:59:14.060 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 podman[77107]: 2024-02-15 22:59:13.916040052 +0000 UTC m=+0.018573436 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:14.061 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 podman[77107]: 2024-02-15 22:59:14.015148748 +0000 UTC m=+0.117682126 container create ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-15T22:59:14.336 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 podman[77107]: 2024-02-15 22:59:14.234455836 +0000 UTC m=+0.336989215 container init ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-15T22:59:14.336 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 podman[77107]: 2024-02-15 22:59:14.237367835 +0000 UTC m=+0.339901216 container start ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-15T22:59:14.336 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 ceph-osd[77125]: -- 172.21.15.170:0/3788437076 <== mon.1 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d4546fb1e0 con 0x55d4546ccc00 2024-02-15T22:59:14.761 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 bash[77107]: ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 2024-02-15T22:59:14.762 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 systemd[1]: Started Ceph osd.3 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:59:15.158 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:14 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T22:59:14.781+0000 7f358ec2a7c0 -1 Falling back to public interface 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:15.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:17 smithi138 ceph-mon[89527]: pgmap v118: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:17 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:17 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:17.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:17 smithi170 ceph-mon[67652]: pgmap v118: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:17.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:17 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:17.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:17 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:19 smithi138 ceph-mon[89527]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:19 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:19 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:19.761 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:19 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T22:59:19.341+0000 7f358ec2a7c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-15T22:59:19.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:19 smithi170 ceph-mon[67652]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:19.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:19 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:19.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:19 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:20.170 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:19 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T22:59:19.899+0000 7f358ec2a7c0 -1 osd.3 64 log_to_monitors true 2024-02-15T22:59:20.457 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:20 smithi170 ceph-mon[67652]: from='osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:59:20.458 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:20 smithi170 ceph-mon[67652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:59:20.458 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 22:59:20 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T22:59:20.320+0000 7f3580082700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:59:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:20 smithi138 ceph-mon[89527]: from='osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:59:20.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:20 smithi138 ceph-mon[89527]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T22:59:21.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:21 smithi170 ceph-mon[67652]: pgmap v120: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:21.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:21 smithi170 ceph-mon[67652]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:59:21.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:21 smithi170 ceph-mon[67652]: from='osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:21.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:21 smithi170 ceph-mon[67652]: osdmap e67: 6 total, 5 up, 6 in 2024-02-15T22:59:21.696 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:21 smithi170 ceph-mon[67652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:21 smithi138 ceph-mon[89527]: pgmap v120: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 307 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 75/360 objects degraded (20.833%) 2024-02-15T22:59:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:21 smithi138 ceph-mon[89527]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T22:59:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:21 smithi138 ceph-mon[89527]: from='osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:21 smithi138 ceph-mon[89527]: osdmap e67: 6 total, 5 up, 6 in 2024-02-15T22:59:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:21 smithi138 ceph-mon[89527]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:59:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523] boot 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: osdmap e68: 6 total, 6 up, 6 in 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 75/360 objects degraded (20.833%), 19 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:22 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:59:22.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: osd.3 [v2:172.21.15.170:6800/246812523,v1:172.21.15.170:6801/246812523] boot 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: osdmap e68: 6 total, 6 up, 6 in 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 75/360 objects degraded (20.833%), 19 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:22.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:22 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:23 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:23 smithi138 ceph-mon[89527]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T22:59:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:23 smithi138 ceph-mon[89527]: pgmap v123: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 71/360 objects degraded (19.722%) 2024-02-15T22:59:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:23 smithi138 ceph-mon[89527]: osdmap e69: 6 total, 6 up, 6 in 2024-02-15T22:59:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:23 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:23.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:23 smithi170 ceph-mon[67652]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T22:59:23.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:23 smithi170 ceph-mon[67652]: pgmap v123: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 71/360 objects degraded (19.722%) 2024-02-15T22:59:23.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:23 smithi170 ceph-mon[67652]: osdmap e69: 6 total, 6 up, 6 in 2024-02-15T22:59:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:25 smithi138 ceph-mon[89527]: pgmap v125: 65 pgs: 4 peering, 13 active+undersized+degraded, 11 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:59:25.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:25 smithi170 ceph-mon[67652]: pgmap v125: 65 pgs: 4 peering, 13 active+undersized+degraded, 11 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/360 objects degraded (15.556%) 2024-02-15T22:59:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:26 smithi138 ceph-mon[89527]: pgmap v126: 65 pgs: 4 peering, 61 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-02-15T22:59:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:26 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 13 pgs degraded) 2024-02-15T22:59:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:26 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T22:59:26.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:26 smithi170 ceph-mon[67652]: pgmap v126: 65 pgs: 4 peering, 61 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-02-15T22:59:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:26 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 13 pgs degraded) 2024-02-15T22:59:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:26 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T22:59:29.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:29 smithi170 ceph-mon[67652]: pgmap v127: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:59:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:29 smithi138 ceph-mon[89527]: pgmap v127: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-15T22:59:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:31 smithi138 ceph-mon[89527]: pgmap v128: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 687 B/s rd, 1 op/s 2024-02-15T22:59:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:31 smithi170 ceph-mon[67652]: pgmap v128: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 687 B/s rd, 1 op/s 2024-02-15T22:59:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:33.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 -- 172.21.15.138:0/2843521273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101c30 msgr2=0x7f289410a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2843521273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101c30 0x7f289410a130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2888009940 tx=0x7f2888009c50 comp rx=0 tx=0).stop 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 -- 172.21.15.138:0/2843521273 shutdown_connections 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2843521273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101c30 0x7f289410a130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2843521273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101320 0x7f28941016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 -- 172.21.15.138:0/2843521273 >> 172.21.15.138:0/2843521273 conn(0x7f28940fab80 msgr2=0x7f28940fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 -- 172.21.15.138:0/2843521273 shutdown_connections 2024-02-15T22:59:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 -- 172.21.15.138:0/2843521273 wait complete. 2024-02-15T22:59:33.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.103+0000 7f2899cd4700 1 Processor -- start 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2899cd4700 1 -- start start 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2899cd4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2899cd4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101c30 0x7f289419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2899cd4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289419c5f0 con 0x7f2894101320 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2899cd4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2894195b30 con 0x7f2894101c30 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46630/0 (socket says 172.21.15.138:46630) 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 -- 172.21.15.138:0/2833639480 learned_addr learned my addr 172.21.15.138:0/2833639480 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f2892ffd700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101c30 0x7f289419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 -- 172.21.15.138:0/2833639480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101c30 msgr2=0x7f289419bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101c30 0x7f289419bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 -- 172.21.15.138:0/2833639480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880095f0 con 0x7f2894101320 2024-02-15T22:59:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.104+0000 7f28937fe700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f288400c930 tx=0x7f288400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.105+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2884007ad0 con 0x7f2894101320 2024-02-15T22:59:33.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.105+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2894195e10 con 0x7f2894101320 2024-02-15T22:59:33.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.105+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2884007c30 con 0x7f2894101320 2024-02-15T22:59:33.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.105+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2894196360 con 0x7f2894101320 2024-02-15T22:59:33.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.105+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2884018610 con 0x7f2894101320 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.106+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28941077a0 con 0x7f2894101320 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.106+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f288400f450 con 0x7f2894101320 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.106+0000 7f2890ff9700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 0x7f287c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.107+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f288408d6c0 con 0x7f2894101320 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.107+0000 7f2892ffd700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 0x7f287c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.107+0000 7f2892ffd700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 0x7f287c06fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28940fc300 tx=0x7f2888005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.111+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f288405aa50 con 0x7f2894101320 2024-02-15T22:59:33.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:32 smithi138 ceph-mon[89527]: pgmap v129: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:59:33.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:32 smithi170 ceph-mon[67652]: pgmap v129: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-15T22:59:33.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.330+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2894196690 con 0x7f287c06d8a0 2024-02-15T22:59:33.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.331+0000 7f2890ff9700 1 -- 172.21.15.138:0/2833639480 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2894196690 con 0x7f287c06d8a0 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 msgr2=0x7f287c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 0x7f287c06fd50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28940fc300 tx=0x7f2888005a90 comp rx=0 tx=0).stop 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 msgr2=0x7f289419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f288400c930 tx=0x7f288400ccf0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 shutdown_connections 2024-02-15T22:59:33.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f287c06d8a0 0x7f287c06fd50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2894101320 0x7f289419bab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 --2- 172.21.15.138:0/2833639480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2894101c30 0x7f289419bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 >> 172.21.15.138:0/2833639480 conn(0x7f28940fab80 msgr2=0x7f28941048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:33.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 shutdown_connections 2024-02-15T22:59:33.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.333+0000 7f2899cd4700 1 -- 172.21.15.138:0/2833639480 wait complete. 2024-02-15T22:59:33.347 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 -- 172.21.15.138:0/1305921395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ff380 msgr2=0x7f4e2c0ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 --2- 172.21.15.138:0/1305921395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c0ff750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009910 tx=0x7f4e1c009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 -- 172.21.15.138:0/1305921395 shutdown_connections 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 --2- 172.21.15.138:0/1305921395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 --2- 172.21.15.138:0/1305921395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c0ff750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 -- 172.21.15.138:0/1305921395 >> 172.21.15.138:0/1305921395 conn(0x7f4e2c0fac20 msgr2=0x7f4e2c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 -- 172.21.15.138:0/1305921395 shutdown_connections 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.438+0000 7f4e32587700 1 -- 172.21.15.138:0/1305921395 wait complete. 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 Processor -- start 2024-02-15T22:59:33.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 -- start start 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c19b690 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e32587700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c194b40 con 0x7f4e2c0ff380 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2b7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46638/0 (socket says 172.21.15.138:46638) 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2b7fe700 1 -- 172.21.15.138:0/3358500887 learned_addr learned my addr 172.21.15.138:0/3358500887 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2bfff700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2b7fe700 1 -- 172.21.15.138:0/3358500887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ff380 msgr2=0x7f4e2c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.439+0000 7f4e2b7fe700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e2b7fe700 1 -- 172.21.15.138:0/3358500887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0095f0 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e2b7fe700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000d900 tx=0x7f4e2000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e20009900 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e20010460 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c194e20 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2000f5f0 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.440+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c195370 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.441+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c107690 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.441+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4e200105d0 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.442+0000 7f4e297fa700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 0x7f4e1406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.442+0000 7f4e2bfff700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 0x7f4e1406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.442+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4e2008d030 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.442+0000 7f4e2bfff700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 0x7f4e1406fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.446+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e2005a3c0 con 0x7f4e2c0ffd20 2024-02-15T22:59:33.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.664+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2c195590 con 0x7f4e1406d8a0 2024-02-15T22:59:33.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.666+0000 7f4e297fa700 1 -- 172.21.15.138:0/3358500887 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4e2c195590 con 0x7f4e1406d8a0 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 msgr2=0x7f4e1406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 0x7f4e1406fd50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c01a040 comp rx=0 tx=0).stop 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 msgr2=0x7f4e2c19b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000d900 tx=0x7f4e2000dc10 comp rx=0 tx=0).stop 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 shutdown_connections 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4e1406d8a0 0x7f4e1406fd50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2c0ff380 0x7f4e2c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 --2- 172.21.15.138:0/3358500887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e2c0ffd20 0x7f4e2c19b000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 >> 172.21.15.138:0/3358500887 conn(0x7f4e2c0fac20 msgr2=0x7f4e2c0fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 shutdown_connections 2024-02-15T22:59:33.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.668+0000 7f4e32587700 1 -- 172.21.15.138:0/3358500887 wait complete. 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 -- 172.21.15.138:0/1867924598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068630 msgr2=0x7f2ec4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/1867924598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068630 0x7f2ec4068a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00b0a0 tx=0x7f2ebc00b3b0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 -- 172.21.15.138:0/1867924598 shutdown_connections 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/1867924598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/1867924598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068630 0x7f2ec4068a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 -- 172.21.15.138:0/1867924598 >> 172.21.15.138:0/1867924598 conn(0x7f2ec4074f50 msgr2=0x7f2ec4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 -- 172.21.15.138:0/1867924598 shutdown_connections 2024-02-15T22:59:33.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.772+0000 7f2ec9f65700 1 -- 172.21.15.138:0/1867924598 wait complete. 2024-02-15T22:59:33.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 Processor -- start 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 -- start start 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068630 0x7f2ec4195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4196950 con 0x7f2ec4068fd0 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec9f65700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec419a6e0 con 0x7f2ec4068630 2024-02-15T22:59:33.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec2ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49844/0 (socket says 172.21.15.138:49844) 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec2ffd700 1 -- 172.21.15.138:0/2998229428 learned_addr learned my addr 172.21.15.138:0/2998229428 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.773+0000 7f2ec37fe700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068630 0x7f2ec4195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec2ffd700 1 -- 172.21.15.138:0/2998229428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068630 msgr2=0x7f2ec4195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec2ffd700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068630 0x7f2ec4195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec2ffd700 1 -- 172.21.15.138:0/2998229428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009d00 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec2ffd700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800e8f0 tx=0x7f2eb800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb8009790 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb800c810 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec419a9c0 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb8005580 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.774+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec419af10 con 0x7f2ec4068fd0 2024-02-15T22:59:33.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.775+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec41086f0 con 0x7f2ec4068fd0 2024-02-15T22:59:33.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.775+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2eb800c980 con 0x7f2ec4068fd0 2024-02-15T22:59:33.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.776+0000 7f2ec0ff9700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 0x7f2eac06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:33.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.776+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2eb8014070 con 0x7f2ec4068fd0 2024-02-15T22:59:33.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.776+0000 7f2ec37fe700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 0x7f2eac06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:33.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.776+0000 7f2ec37fe700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 0x7f2eac06fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f80 tx=0x7f2ebc0060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:33.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.780+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2eb8056f80 con 0x7f2ec4068fd0 2024-02-15T22:59:33.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:33 smithi138 ceph-mon[89527]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:33.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.988+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec419b280 con 0x7f2eac06d8a0 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:33.998+0000 7f2ec0ff9700 1 -- 172.21.15.138:0/2998229428 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f2ec419b280 con 0x7f2eac06d8a0 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (6m) 50s ago 16m 24.9M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (16m) 50s ago 16m 8732k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (15m) 16s ago 15m 8358k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (2m) 50s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T22:59:34.001 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (2m) 16s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (4m) 50s ago 16m 84.8M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (11m) 50s ago 11m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (10m) 50s ago 10m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (11m) 16s ago 11m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (10m) 16s ago 10m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (8m) 50s ago 18m 501M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (6m) 16s ago 15m 451M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (3m) 50s ago 18m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (3m) 16s ago 15m 41.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (6m) 50s ago 16m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (6m) 16s ago 15m 16.7M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (2m) 50s ago 14m 93.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (92s) 50s ago 14m 99.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (56s) 50s ago 13m 12.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (20s) 16s ago 13m 11.7M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (13m) 16s ago 12m 255M 2240M 18.2.0 dc2bc1663786 24b82207f172 2024-02-15T22:59:34.002 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (12m) 16s ago 12m 228M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T22:59:34.003 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (6m) 50s ago 16m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T22:59:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 msgr2=0x7f2eac06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 0x7f2eac06fd50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f80 tx=0x7f2ebc0060c0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 msgr2=0x7f2ec4196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800e8f0 tx=0x7f2eb800ec00 comp rx=0 tx=0).stop 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 shutdown_connections 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2eac06d8a0 0x7f2eac06fd50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec4068630 0x7f2ec4195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 --2- 172.21.15.138:0/2998229428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec4068fd0 0x7f2ec4196270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 >> 172.21.15.138:0/2998229428 conn(0x7f2ec4074f50 msgr2=0x7f2ec40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 shutdown_connections 2024-02-15T22:59:34.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.001+0000 7f2ec9f65700 1 -- 172.21.15.138:0/2998229428 wait complete. 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 -- 172.21.15.138:0/2645816707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 msgr2=0x7f6d4c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 --2- 172.21.15.138:0/2645816707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c1007a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009910 tx=0x7f6d48009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 -- 172.21.15.138:0/2645816707 shutdown_connections 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 --2- 172.21.15.138:0/2645816707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 --2- 172.21.15.138:0/2645816707 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c1007a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.103+0000 7f6d53a58700 1 -- 172.21.15.138:0/2645816707 >> 172.21.15.138:0/2645816707 conn(0x7f6d4c0fbc90 msgr2=0x7f6d4c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.104+0000 7f6d53a58700 1 -- 172.21.15.138:0/2645816707 shutdown_connections 2024-02-15T22:59:34.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.104+0000 7f6d53a58700 1 -- 172.21.15.138:0/2645816707 wait complete. 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.104+0000 7f6d53a58700 1 Processor -- start 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.104+0000 7f6d53a58700 1 -- start start 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c196b40 con 0x7f6d4c1003d0 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c19a830 con 0x7f6d4c100d70 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49864/0 (socket says 172.21.15.138:49864) 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 -- 172.21.15.138:0/1682043022 learned_addr learned my addr 172.21.15.138:0/1682043022 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d50ff3700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 -- 172.21.15.138:0/1682043022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 msgr2=0x7f6d4c196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 -- 172.21.15.138:0/1682043022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480095f0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d50ff3700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d517f4700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006010 tx=0x7f6d4800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4801d070 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d48004fb0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c19aab0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4800f690 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.105+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c19afa0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.106+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c1086e0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.107+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6d480228a0 con 0x7f6d4c1003d0 2024-02-15T22:59:34.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.107+0000 7f6d427fc700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 0x7f6d3806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.107+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6d4808ed30 con 0x7f6d4c1003d0 2024-02-15T22:59:34.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.107+0000 7f6d50ff3700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 0x7f6d3806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.108+0000 7f6d50ff3700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 0x7f6d3806fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c1974a0 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.112+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d48058590 con 0x7f6d4c1003d0 2024-02-15T22:59:34.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:33 smithi170 ceph-mon[67652]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:34.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.390+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d4c04ea50 con 0x7f6d4c1003d0 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.390+0000 7f6d427fc700 1 -- 172.21.15.138:0/1682043022 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f6d48027330 con 0x7f6d4c1003d0 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T22:59:34.393 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 8 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T22:59:34.394 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 msgr2=0x7f6d3806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 0x7f6d3806fd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c1974a0 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 msgr2=0x7f6d4c195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6d48006010 tx=0x7f6d4800be20 comp rx=0 tx=0).stop 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 shutdown_connections 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.392+0000 7f6d53a58700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6d3806d8a0 0x7f6d3806fd50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.393+0000 7f6d53a58700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d4c1003d0 0x7f6d4c195f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.393+0000 7f6d53a58700 1 --2- 172.21.15.138:0/1682043022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d4c100d70 0x7f6d4c196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.393+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 >> 172.21.15.138:0/1682043022 conn(0x7f6d4c0fbc90 msgr2=0x7f6d4c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.393+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 shutdown_connections 2024-02-15T22:59:34.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.393+0000 7f6d53a58700 1 -- 172.21.15.138:0/1682043022 wait complete. 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- 172.21.15.138:0/2041437597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc100d70 msgr2=0x7fc5bc104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 --2- 172.21.15.138:0/2041437597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc100d70 0x7fc5bc104d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009910 tx=0x7fc5ac009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- 172.21.15.138:0/2041437597 shutdown_connections 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 --2- 172.21.15.138:0/2041437597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc100d70 0x7fc5bc104d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 --2- 172.21.15.138:0/2041437597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- 172.21.15.138:0/2041437597 >> 172.21.15.138:0/2041437597 conn(0x7fc5bc0fbc90 msgr2=0x7fc5bc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- 172.21.15.138:0/2041437597 shutdown_connections 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- 172.21.15.138:0/2041437597 wait complete. 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 Processor -- start 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- start start 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 0x7fc5bc196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc196960 con 0x7fc5bc1003d0 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.497+0000 7fc5c3457700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc19a6f0 con 0x7fc5bc100d70 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49880/0 (socket says 172.21.15.138:49880) 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 -- 172.21.15.138:0/4102941140 learned_addr learned my addr 172.21.15.138:0/4102941140 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c09f2700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 0x7fc5bc196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 -- 172.21.15.138:0/4102941140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 msgr2=0x7fc5bc196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 0x7fc5bc196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 -- 172.21.15.138:0/4102941140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac0095f0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c09f2700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 0x7fc5bc196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c11f3700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c8a0 tx=0x7fc5b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b800cea0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5b8004830 con 0x7fc5bc1003d0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc19a9d0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b80055b0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.498+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc19af20 con 0x7fc5bc1003d0 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.499+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc108740 con 0x7fc5bc1003d0 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.500+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc5b80049a0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.500+0000 7fc5b27fc700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 0x7fc5a806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.500+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc5b808d0a0 con 0x7fc5bc1003d0 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.500+0000 7fc5c09f2700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 0x7fc5a806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.501+0000 7fc5c09f2700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 0x7fc5a806fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc197360 tx=0x7fc5ac01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.505+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5b8056980 con 0x7fc5bc1003d0 2024-02-15T22:59:34.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.747+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5bc19b250 con 0x7fc5bc1003d0 2024-02-15T22:59:34.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.748+0000 7fc5b27fc700 1 -- 172.21.15.138:0/4102941140 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7fc5b801d070 con 0x7fc5bc1003d0 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T22:59:34.751 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T22:59:34.752 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:34.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 msgr2=0x7fc5a806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 0x7fc5a806fd50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc197360 tx=0x7fc5ac01a040 comp rx=0 tx=0).stop 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 msgr2=0x7fc5bc195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c8a0 tx=0x7fc5b800cc60 comp rx=0 tx=0).stop 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 shutdown_connections 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc5a806d8a0 0x7fc5a806fd50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5bc1003d0 0x7fc5bc195d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 --2- 172.21.15.138:0/4102941140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5bc100d70 0x7fc5bc196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 >> 172.21.15.138:0/4102941140 conn(0x7fc5bc0fbc90 msgr2=0x7fc5bc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 shutdown_connections 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.750+0000 7fc5c3457700 1 -- 172.21.15.138:0/4102941140 wait complete. 2024-02-15T22:59:34.755 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 -- 172.21.15.138:0/3202780451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 msgr2=0x7f8ccc0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 --2- 172.21.15.138:0/3202780451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc0ff6a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009910 tx=0x7f8cbc009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 -- 172.21.15.138:0/3202780451 shutdown_connections 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 --2- 172.21.15.138:0/3202780451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ccc0ffc70 0x7f8ccc103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 --2- 172.21.15.138:0/3202780451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc0ff6a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 -- 172.21.15.138:0/3202780451 >> 172.21.15.138:0/3202780451 conn(0x7f8ccc0fabb0 msgr2=0x7f8ccc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 -- 172.21.15.138:0/3202780451 shutdown_connections 2024-02-15T22:59:34.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.855+0000 7f8cd1431700 1 -- 172.21.15.138:0/3202780451 wait complete. 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 Processor -- start 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 -- start start 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ccc0ffc70 0x7f8ccc101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc101760 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8cd1431700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc1018a0 con 0x7f8ccc0ffc70 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49884/0 (socket says 172.21.15.138:49884) 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.856+0000 7f8ccaffd700 1 -- 172.21.15.138:0/2831821624 learned_addr learned my addr 172.21.15.138:0/2831821624 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:34.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8ccaffd700 1 -- 172.21.15.138:0/2831821624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ccc0ffc70 msgr2=0x7f8ccc101220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8ccaffd700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ccc0ffc70 0x7f8ccc101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8ccaffd700 1 -- 172.21.15.138:0/2831821624 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0095f0 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8ccaffd700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc006010 tx=0x7f8cbc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cbc01d070 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cbc004fb0 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc101b20 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cbc022ea0 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.857+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc1a23b0 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.858+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc04ea50 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.858+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8cbc022470 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.859+0000 7f8cb3fff700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 0x7f8cb406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.859+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8cbc08eb30 con 0x7f8ccc0ff2d0 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.859+0000 7f8cca7fc700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 0x7f8cb406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:34.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.859+0000 7f8cca7fc700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 0x7f8cb406fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc1024d0 tx=0x7f8cc0006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:34.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:34.863+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8cbc058560 con 0x7f8ccc0ff2d0 2024-02-15T22:59:35.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.088+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ccc0fb970 con 0x7f8cb406d8a0 2024-02-15T22:59:35.091 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:34 smithi138 ceph-mon[89527]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:35.091 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:34 smithi138 ceph-mon[89527]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:35.091 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:34 smithi138 ceph-mon[89527]: pgmap v130: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-15T22:59:35.091 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:34 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1682043022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:35.091 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:34 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/4102941140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.089+0000 7f8cb3fff700 1 -- 172.21.15.138:0/2831821624 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8ccc0fb970 con 0x7f8cb406d8a0 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T22:59:35.092 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T22:59:35.093 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T22:59:35.093 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "10/23 daemons upgraded", 2024-02-15T22:59:35.093 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T22:59:35.093 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T22:59:35.093 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T22:59:35.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 msgr2=0x7f8cb406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 0x7f8cb406fd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc1024d0 tx=0x7f8cc0006d20 comp rx=0 tx=0).stop 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 msgr2=0x7f8ccc100ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc006010 tx=0x7f8cbc00be20 comp rx=0 tx=0).stop 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 shutdown_connections 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8cb406d8a0 0x7f8cb406fd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ccc0ff2d0 0x7f8ccc100ce0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 --2- 172.21.15.138:0/2831821624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ccc0ffc70 0x7f8ccc101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 >> 172.21.15.138:0/2831821624 conn(0x7f8ccc0fabb0 msgr2=0x7f8ccc103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 shutdown_connections 2024-02-15T22:59:35.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.092+0000 7f8cd1431700 1 -- 172.21.15.138:0/2831821624 wait complete. 2024-02-15T22:59:35.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 -- 172.21.15.138:0/3989179337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b8100d70 msgr2=0x7f02b8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/3989179337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b8100d70 0x7f02b8104d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009910 tx=0x7f02a0009c20 comp rx=0 tx=0).stop 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 -- 172.21.15.138:0/3989179337 shutdown_connections 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/3989179337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b8100d70 0x7f02b8104d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/3989179337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b81003d0 0x7f02b81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 -- 172.21.15.138:0/3989179337 >> 172.21.15.138:0/3989179337 conn(0x7f02b80fbc90 msgr2=0x7f02b80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 -- 172.21.15.138:0/3989179337 shutdown_connections 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 -- 172.21.15.138:0/3989179337 wait complete. 2024-02-15T22:59:35.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.196+0000 7f02bcf4a700 1 Processor -- start 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02bcf4a700 1 -- start start 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02bcf4a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02bcf4a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 0x7f02b81962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02bcf4a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81969a0 con 0x7f02b81003d0 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02bcf4a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b819a730 con 0x7f02b8100d70 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:35.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49902/0 (socket says 172.21.15.138:49902) 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 -- 172.21.15.138:0/2063384039 learned_addr learned my addr 172.21.15.138:0/2063384039 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02add9b700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 0x7f02b81962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 -- 172.21.15.138:0/2063384039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 msgr2=0x7f02b81962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 0x7f02b81962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 -- 172.21.15.138:0/2063384039 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00095f0 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02add9b700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 0x7f02b81962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.197+0000 7f02b659c700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c8f0 tx=0x7f02a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.198+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a8007a70 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.198+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b819aa10 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.198+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02a8004cf0 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.198+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a8005610 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.198+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b819af60 con 0x7f02b81003d0 2024-02-15T22:59:35.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.199+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b8108650 con 0x7f02b81003d0 2024-02-15T22:59:35.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.199+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f02a8004750 con 0x7f02b81003d0 2024-02-15T22:59:35.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.200+0000 7f02affff700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 0x7f02a406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T22:59:35.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.200+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f02a8013070 con 0x7f02b81003d0 2024-02-15T22:59:35.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.200+0000 7f02add9b700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 0x7f02a406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T22:59:35.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.200+0000 7f02add9b700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 0x7f02a406fd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02a000b5c0 tx=0x7f02a0005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T22:59:35.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.204+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f02a8056b70 con 0x7f02b81003d0 2024-02-15T22:59:35.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:34 smithi170 ceph-mon[67652]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:34 smithi170 ceph-mon[67652]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:34 smithi170 ceph-mon[67652]: pgmap v130: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-15T22:59:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:34 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1682043022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:35.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:34 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/4102941140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T22:59:35.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.487+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f02b819b240 con 0x7f02b81003d0 2024-02-15T22:59:35.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.488+0000 7f02affff700 1 -- 172.21.15.138:0/2063384039 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f02a805a230 con 0x7f02b81003d0 2024-02-15T22:59:35.490 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T22:59:35.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 msgr2=0x7f02a406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 0x7f02a406fd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02a000b5c0 tx=0x7f02a0005480 comp rx=0 tx=0).stop 2024-02-15T22:59:35.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 msgr2=0x7f02b8195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T22:59:35.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c8f0 tx=0x7f02a800ccb0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 shutdown_connections 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f02a406d8a0 0x7f02a406fd50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02b81003d0 0x7f02b8195d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 --2- 172.21.15.138:0/2063384039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f02b8100d70 0x7f02b81962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 >> 172.21.15.138:0/2063384039 conn(0x7f02b80fbc90 msgr2=0x7f02b81045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 shutdown_connections 2024-02-15T22:59:35.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T22:59:35.490+0000 7f02bcf4a700 1 -- 172.21.15.138:0/2063384039 wait complete. 2024-02-15T22:59:36.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:36 smithi138 ceph-mon[89527]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:36 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:36.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:36 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2063384039' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:59:36.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:36 smithi170 ceph-mon[67652]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T22:59:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:36 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:36.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:36 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2063384039' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T22:59:37.611 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:37 smithi170 ceph-mon[67652]: pgmap v131: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:59:37.611 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:37 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:37.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:37 smithi138 ceph-mon[89527]: pgmap v131: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T22:59:37.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:37 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:38 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:38 smithi138 ceph-mon[89527]: Upgrade: osd.4 is safe to restart 2024-02-15T22:59:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:38 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T22:59:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:38 smithi170 ceph-mon[67652]: Upgrade: osd.4 is safe to restart 2024-02-15T22:59:39.725 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:39 smithi170 ceph-mon[67652]: pgmap v132: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:39.725 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:39.725 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:59:39.725 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:39 smithi138 ceph-mon[89527]: pgmap v132: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T22:59:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:40.706 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:40 smithi170 ceph-mon[67652]: Upgrade: Updating osd.4 2024-02-15T22:59:40.706 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:40 smithi170 ceph-mon[67652]: Deploying daemon osd.4 on smithi170 2024-02-15T22:59:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:40 smithi138 ceph-mon[89527]: Upgrade: Updating osd.4 2024-02-15T22:59:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:40 smithi138 ceph-mon[89527]: Deploying daemon osd.4 on smithi170 2024-02-15T22:59:41.675 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:41 smithi170 ceph-mon[67652]: pgmap v133: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:41 smithi138 ceph-mon[89527]: pgmap v133: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T22:59:41.933 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:41 smithi170 systemd[1]: Stopping Ceph osd.4 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:59:42.261 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:41 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[45881]: 2024-02-15T22:59:41.943+0000 7fbc23473700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T22:59:42.261 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:41 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[45881]: 2024-02-15T22:59:41.943+0000 7fbc23473700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-15T22:59:42.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:41 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[45881]: 2024-02-15T22:59:41.943+0000 7fbc23473700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T22:59:42.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:42 smithi138 ceph-mon[89527]: osd.4 marked itself down and dead 2024-02-15T22:59:42.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:42 smithi170 ceph-mon[67652]: osd.4 marked itself down and dead 2024-02-15T22:59:43.147 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:42 smithi170 podman[81563]: 2024-02-15 22:59:42.859363415 +0000 UTC m=+1.038288130 container died 24b82207f1726b628f87c548df61dda652162513310268f5c6aa60cdffc6da5d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, ceph=True, org.label-schema.vendor=CentOS) 2024-02-15T22:59:43.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:43 smithi170 ceph-mon[67652]: pgmap v134: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:43.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:43 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:59:43.505 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:43 smithi170 ceph-mon[67652]: osdmap e70: 6 total, 5 up, 6 in 2024-02-15T22:59:43.506 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:43 smithi170 podman[81563]: 2024-02-15 22:59:43.235307347 +0000 UTC m=+1.414232066 container cleanup 24b82207f1726b628f87c548df61dda652162513310268f5c6aa60cdffc6da5d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1) 2024-02-15T22:59:43.506 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:43 smithi170 bash[81563]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4 2024-02-15T22:59:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:43 smithi138 ceph-mon[89527]: pgmap v134: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T22:59:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:43 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T22:59:43.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:43 smithi138 ceph-mon[89527]: osdmap e70: 6 total, 5 up, 6 in 2024-02-15T22:59:43.761 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:43 smithi170 podman[81591]: 2024-02-15 22:59:43.503673406 +0000 UTC m=+0.644584354 container remove 24b82207f1726b628f87c548df61dda652162513310268f5c6aa60cdffc6da5d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212) 2024-02-15T22:59:44.167 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:43 smithi170 podman[81683]: 2024-02-15 22:59:43.765357901 +0000 UTC m=+0.017636182 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:44.167 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:43 smithi170 podman[81683]: 2024-02-15 22:59:43.863027943 +0000 UTC m=+0.115306224 container create f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:59:44.167 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 podman[81683]: 2024-02-15 22:59:44.091375234 +0000 UTC m=+0.343653519 container init f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS) 2024-02-15T22:59:44.167 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 podman[81683]: 2024-02-15 22:59:44.094842335 +0000 UTC m=+0.347120627 container start f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-15T22:59:44.167 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 podman[81683]: 2024-02-15 22:59:44.165644817 +0000 UTC m=+0.417923109 container attach f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T22:59:44.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:44 smithi170 ceph-mon[67652]: osdmap e71: 6 total, 5 up, 6 in 2024-02-15T22:59:44.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 podman[81683]: 2024-02-15 22:59:44.381281367 +0000 UTC m=+0.633559650 container died f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-15T22:59:44.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:44 smithi138 ceph-mon[89527]: osdmap e71: 6 total, 5 up, 6 in 2024-02-15T22:59:45.011 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 podman[81708]: 2024-02-15 22:59:44.911043468 +0000 UTC m=+0.524122190 container remove f5c490a0b71affaafa76c6ebd9b9726073ee845b58a9c7d44a1c63cd7b4a2a5c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-15T22:59:45.012 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-15T22:59:45.012 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 systemd[1]: Stopped Ceph osd.4 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:59:45.012 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:44 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.4.service: Consumed 1min 383ms CPU time. 2024-02-15T22:59:45.489 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:45 smithi170 ceph-mon[67652]: pgmap v137: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:59:45.489 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:45 smithi170 ceph-mon[67652]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T22:59:45.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:45.490 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:45.490 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 systemd[1]: Starting Ceph osd.4 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T22:59:45.490 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 podman[81808]: 2024-02-15 22:59:45.249733536 +0000 UTC m=+0.017796163 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:45.490 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 podman[81808]: 2024-02-15 22:59:45.353990319 +0000 UTC m=+0.122052969 container create 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T22:59:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:45 smithi138 ceph-mon[89527]: pgmap v137: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T22:59:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:45 smithi138 ceph-mon[89527]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-15T22:59:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T22:59:45.761 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 podman[81808]: 2024-02-15 22:59:45.589776607 +0000 UTC m=+0.357839214 container init 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-15T22:59:45.761 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 podman[81808]: 2024-02-15 22:59:45.592947732 +0000 UTC m=+0.361010341 container start 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True) 2024-02-15T22:59:45.762 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:45 smithi170 podman[81808]: 2024-02-15 22:59:45.656692207 +0000 UTC m=+0.424754820 container attach 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate[81823]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-15T22:59:46.391 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-15T22:59:46.392 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T22:59:46.392 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T22:59:46.392 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T22:59:46.392 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 bash[81808]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-15T22:59:46.392 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 podman[81808]: 2024-02-15 22:59:46.065879469 +0000 UTC m=+0.833942074 container died 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-15T22:59:46.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:46 smithi138 ceph-mon[89527]: pgmap v138: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/360 objects degraded (9.722%) 2024-02-15T22:59:46.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:46 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 35/360 objects degraded (9.722%), 8 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:46.670 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-mon[67652]: pgmap v138: 65 pgs: 8 active+undersized+degraded, 10 peering, 2 stale+active+clean, 8 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/360 objects degraded (9.722%) 2024-02-15T22:59:46.671 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:46 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 35/360 objects degraded (9.722%), 8 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:46.977 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 podman[81959]: 2024-02-15 22:59:46.669070345 +0000 UTC m=+0.598436188 container remove 4cd255f2cc3645f4342b5f0d4bbaf66d213b2864e398fd5eb7fff1f601398b1f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-02-15T22:59:46.978 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 podman[82022]: 2024-02-15 22:59:46.878238155 +0000 UTC m=+0.108542452 container create 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-15T22:59:46.978 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:46 smithi170 podman[82022]: 2024-02-15 22:59:46.78829416 +0000 UTC m=+0.018598465 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T22:59:47.511 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 podman[82022]: 2024-02-15 22:59:47.089013806 +0000 UTC m=+0.319318104 container init 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-15T22:59:47.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 podman[82022]: 2024-02-15 22:59:47.092023411 +0000 UTC m=+0.322327710 container start 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T22:59:47.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 ceph-osd[82041]: -- 172.21.15.170:0/2088367674 <== mon.1 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56298e08d1e0 con 0x56298e05ec00 2024-02-15T22:59:47.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 bash[82022]: 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 2024-02-15T22:59:47.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 systemd[1]: Started Ceph osd.4 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T22:59:48.012 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:47 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T22:59:47.632+0000 7fb622cc77c0 -1 Falling back to public interface 2024-02-15T22:59:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:48.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:48.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:48.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:49.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:49 smithi170 ceph-mon[67652]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:49 smithi138 ceph-mon[89527]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:50 smithi138 ceph-mon[89527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T22:59:50.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:50.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:50 smithi170 ceph-mon[67652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-15T22:59:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:51.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:51 smithi170 ceph-mon[67652]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:51 smithi138 ceph-mon[89527]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:52.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:52.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:52 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:52.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:52 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:52.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:52 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T22:59:52.211+0000 7fb622cc77c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-15T22:59:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:52 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:52 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:53.011 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:52 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T22:59:52.734+0000 7fb622cc77c0 -1 osd.4 69 log_to_monitors true 2024-02-15T22:59:53.348 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:53 smithi170 ceph-mon[67652]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:53.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:53 smithi170 ceph-mon[67652]: from='osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:59:53.349 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:53 smithi170 ceph-mon[67652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:59:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:53 smithi138 ceph-mon[89527]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:53 smithi138 ceph-mon[89527]: from='osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:59:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:53 smithi138 ceph-mon[89527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T22:59:54.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T22:59:54.001+0000 7fb610117700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T22:59:54.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-mon[67652]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:59:54.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-mon[67652]: osdmap e72: 6 total, 5 up, 6 in 2024-02-15T22:59:54.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-mon[67652]: from='osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:54.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-mon[67652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:54.684 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:54 smithi170 ceph-mon[67652]: from='osd.4 ' entity='osd.4' 2024-02-15T22:59:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:54 smithi138 ceph-mon[89527]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T22:59:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:54 smithi138 ceph-mon[89527]: osdmap e72: 6 total, 5 up, 6 in 2024-02-15T22:59:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:54 smithi138 ceph-mon[89527]: from='osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:54 smithi138 ceph-mon[89527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T22:59:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:54 smithi138 ceph-mon[89527]: from='osd.4 ' entity='osd.4' 2024-02-15T22:59:55.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: pgmap v143: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:55.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:59:55.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342] boot 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: osdmap e73: 6 total, 6 up, 6 in 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: pgmap v143: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: osd.4 [v2:172.21.15.170:6808/1376172342,v1:172.21.15.170:6809/1376172342] boot 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: osdmap e73: 6 total, 6 up, 6 in 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T22:59:55.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T22:59:55.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T22:59:55.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T22:59:55.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:59:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:56 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:59:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:56 smithi138 ceph-mon[89527]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T22:59:56.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:56 smithi138 ceph-mon[89527]: osdmap e74: 6 total, 6 up, 6 in 2024-02-15T22:59:56.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:56 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T22:59:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:56 smithi170 ceph-mon[67652]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T22:59:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:56 smithi170 ceph-mon[67652]: osdmap e74: 6 total, 6 up, 6 in 2024-02-15T22:59:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:57 smithi138 ceph-mon[89527]: pgmap v146: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 31/360 objects degraded (8.611%) 2024-02-15T22:59:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:57 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 31/360 objects degraded (8.611%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:57 smithi170 ceph-mon[67652]: pgmap v146: 65 pgs: 10 peering, 10 active+undersized+degraded, 10 active+undersized, 35 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 31/360 objects degraded (8.611%) 2024-02-15T22:59:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:57 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 31/360 objects degraded (8.611%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T22:59:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 22:59:59 smithi138 ceph-mon[89527]: pgmap v147: 65 pgs: 10 peering, 3 active+undersized+degraded, 3 active+undersized, 49 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 7/360 objects degraded (1.944%) 2024-02-15T22:59:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 22:59:59 smithi170 ceph-mon[67652]: pgmap v147: 65 pgs: 10 peering, 3 active+undersized+degraded, 3 active+undersized, 49 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 7/360 objects degraded (1.944%) 2024-02-15T23:00:00.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: Health detail: HEALTH_WARN Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:00:00.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: [WRN] PG_DEGRADED: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:00:00.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-15T23:00:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-15T23:00:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-15T23:00:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:00.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:00.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: Health detail: HEALTH_WARN Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: [WRN] PG_DEGRADED: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:01 smithi138 ceph-mon[89527]: pgmap v148: 65 pgs: 10 peering, 55 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T23:00:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:01 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-02-15T23:00:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:01 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T23:00:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:01 smithi170 ceph-mon[67652]: pgmap v148: 65 pgs: 10 peering, 55 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-15T23:00:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:01 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded) 2024-02-15T23:00:01.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:01 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T23:00:03.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:02 smithi138 ceph-mon[89527]: pgmap v149: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T23:00:03.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:02 smithi170 ceph-mon[67652]: pgmap v149: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.606+0000 7f3dc3953700 1 -- 172.21.15.138:0/2745892612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 msgr2=0x7f3dbc0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.606+0000 7f3dc3953700 1 --2- 172.21.15.138:0/2745892612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc0ff6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009910 tx=0x7f3db8009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.606+0000 7f3dc3953700 1 -- 172.21.15.138:0/2745892612 shutdown_connections 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 --2- 172.21.15.138:0/2745892612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 --2- 172.21.15.138:0/2745892612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc0ff6b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 -- 172.21.15.138:0/2745892612 >> 172.21.15.138:0/2745892612 conn(0x7f3dbc0fab80 msgr2=0x7f3dbc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 -- 172.21.15.138:0/2745892612 shutdown_connections 2024-02-15T23:00:05.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 -- 172.21.15.138:0/2745892612 wait complete. 2024-02-15T23:00:05.610 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:05 smithi138 ceph-mon[89527]: pgmap v150: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T23:00:05.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 Processor -- start 2024-02-15T23:00:05.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.607+0000 7f3dc3953700 1 -- start start 2024-02-15T23:00:05.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc3953700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc3953700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc193f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc3953700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc195b30 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc3953700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc195c70 con 0x7f3dbc0ffc80 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60852/0 (socket says 172.21.15.138:60852) 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 -- 172.21.15.138:0/482640192 learned_addr learned my addr 172.21.15.138:0/482640192 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc0eee700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc193f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 -- 172.21.15.138:0/482640192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 msgr2=0x7f3dbc193f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc193f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 -- 172.21.15.138:0/482640192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80095f0 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc0eee700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc193f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3dc16ef700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006010 tx=0x7f3db800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db801d070 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.608+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3db8004fb0 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.609+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc1945d0 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.609+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db8022ea0 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.609+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc1a6800 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.610+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc04ea50 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.610+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3db8022470 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.611+0000 7f3db27fc700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 0x7f3da806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.611+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3db808eb00 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.611+0000 7f3dc0eee700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 0x7f3da806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.611+0000 7f3dc0eee700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 0x7f3da806fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc195200 tx=0x7f3dac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:05.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.615+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3db8058530 con 0x7f3dbc0ff2e0 2024-02-15T23:00:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:05 smithi170 ceph-mon[67652]: pgmap v150: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-15T23:00:05.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.830+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dbc102c30 con 0x7f3da806d8a0 2024-02-15T23:00:05.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.832+0000 7f3db27fc700 1 -- 172.21.15.138:0/482640192 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3dbc102c30 con 0x7f3da806d8a0 2024-02-15T23:00:05.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 msgr2=0x7f3da806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 0x7f3da806fd50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc195200 tx=0x7f3dac008040 comp rx=0 tx=0).stop 2024-02-15T23:00:05.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 msgr2=0x7f3dbc193a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3db8006010 tx=0x7f3db800be20 comp rx=0 tx=0).stop 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 shutdown_connections 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3da806d8a0 0x7f3da806fd50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dbc0ff2e0 0x7f3dbc193a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 --2- 172.21.15.138:0/482640192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3dbc0ffc80 0x7f3dbc193f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 >> 172.21.15.138:0/482640192 conn(0x7f3dbc0fab80 msgr2=0x7f3dbc0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 shutdown_connections 2024-02-15T23:00:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.834+0000 7f3dc3953700 1 -- 172.21.15.138:0/482640192 wait complete. 2024-02-15T23:00:05.847 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/2601998607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ffd30 msgr2=0x7f9f64103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/2601998607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ffd30 0x7f9f64103ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009910 tx=0x7f9f58009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/2601998607 shutdown_connections 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/2601998607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ffd30 0x7f9f64103ce0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/2601998607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ff390 0x7f9f640ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/2601998607 >> 172.21.15.138:0/2601998607 conn(0x7f9f64074f50 msgr2=0x7f9f64075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/2601998607 shutdown_connections 2024-02-15T23:00:05.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.939+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/2601998607 wait complete. 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 Processor -- start 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 -- start start 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ffd30 0x7f9f641970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641976e0 con 0x7f9f640ff390 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.940+0000 7f9f6a6c4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64197820 con 0x7f9f640ffd30 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60872/0 (socket says 172.21.15.138:60872) 2024-02-15T23:00:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 -- 172.21.15.138:0/557552699 learned_addr learned my addr 172.21.15.138:0/557552699 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f637fe700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ffd30 0x7f9f641970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 -- 172.21.15.138:0/557552699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ffd30 msgr2=0x7f9f641970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ffd30 0x7f9f641970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 -- 172.21.15.138:0/557552699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580095f0 con 0x7f9f640ff390 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f63fff700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400d900 tx=0x7f9f5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f540041f0 con 0x7f9f640ff390 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6419fbf0 con 0x7f9f640ff390 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f54004cf0 con 0x7f9f640ff390 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f5400b750 con 0x7f9f640ff390 2024-02-15T23:00:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.941+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f641a00b0 con 0x7f9f640ff390 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.942+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f64107600 con 0x7f9f640ff390 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.943+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9f54004350 con 0x7f9f640ff390 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.943+0000 7f9f617fa700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 0x7f9f4c074160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.943+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9f5408d380 con 0x7f9f640ff390 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.943+0000 7f9f637fe700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 0x7f9f4c074160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:05.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.944+0000 7f9f637fe700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 0x7f9f4c074160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006010 tx=0x7f9f5801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:05.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:05.948+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9f54056be0 con 0x7f9f640ff390 2024-02-15T23:00:06.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.164+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f64061190 con 0x7f9f4c071cb0 2024-02-15T23:00:06.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.165+0000 7f9f617fa700 1 -- 172.21.15.138:0/557552699 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9f64061190 con 0x7f9f4c071cb0 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 msgr2=0x7f9f4c074160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 0x7f9f4c074160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f58006010 tx=0x7f9f5801a040 comp rx=0 tx=0).stop 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 msgr2=0x7f9f64196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400d900 tx=0x7f9f5400dcc0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 shutdown_connections 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f4c071cb0 0x7f9f4c074160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f640ff390 0x7f9f64196b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 --2- 172.21.15.138:0/557552699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f640ffd30 0x7f9f641970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.167+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 >> 172.21.15.138:0/557552699 conn(0x7f9f64074f50 msgr2=0x7f9f640fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.168+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 shutdown_connections 2024-02-15T23:00:06.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.168+0000 7f9f6a6c4700 1 -- 172.21.15.138:0/557552699 wait complete. 2024-02-15T23:00:06.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- 172.21.15.138:0/834365615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ff290 msgr2=0x7f24680ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 --2- 172.21.15.138:0/834365615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ff290 0x7f24680ff660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2450009910 tx=0x7f2450009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- 172.21.15.138:0/834365615 shutdown_connections 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 --2- 172.21.15.138:0/834365615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ffba0 0x7f246810a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 --2- 172.21.15.138:0/834365615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ff290 0x7f24680ff660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- 172.21.15.138:0/834365615 >> 172.21.15.138:0/834365615 conn(0x7f2468074850 msgr2=0x7f2468074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- 172.21.15.138:0/834365615 shutdown_connections 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- 172.21.15.138:0/834365615 wait complete. 2024-02-15T23:00:06.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 Processor -- start 2024-02-15T23:00:06.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.273+0000 7f246de0a700 1 -- start start 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f246de0a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ff290 0x7f2468100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f246de0a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f246de0a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468100ef0 con 0x7f24680ffba0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f246de0a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468101030 con 0x7f24680ff290 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60894/0 (socket says 172.21.15.138:60894) 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 -- 172.21.15.138:0/3376929716 learned_addr learned my addr 172.21.15.138:0/3376929716 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f24677fe700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ff290 0x7f2468100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 -- 172.21.15.138:0/3376929716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ff290 msgr2=0x7f2468100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ff290 0x7f2468100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 -- 172.21.15.138:0/3376929716 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500095f0 con 0x7f24680ffba0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2466ffd700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f245800e940 tx=0x7f245800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245800cba0 con 0x7f24680ffba0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f245800ee90 con 0x7f24680ffba0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.274+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24681a1f80 con 0x7f24680ffba0 2024-02-15T23:00:06.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.275+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24580055d0 con 0x7f24680ffba0 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.275+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24681a2390 con 0x7f24680ffba0 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.276+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2468107d10 con 0x7f24680ffba0 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.276+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2458004750 con 0x7f24680ffba0 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.276+0000 7f2464ff9700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 0x7f245406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.276+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2458014070 con 0x7f24680ffba0 2024-02-15T23:00:06.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.276+0000 7f24677fe700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 0x7f245406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.277+0000 7f24677fe700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 0x7f245406fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2450005b40 tx=0x7f2450005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:06.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.281+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2458056ff0 con 0x7f24680ffba0 2024-02-15T23:00:06.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.485+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f246802cd60 con 0x7f245406d8a0 2024-02-15T23:00:06.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.496+0000 7f2464ff9700 1 -- 172.21.15.138:0/3376929716 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f246802cd60 con 0x7f245406d8a0 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (6m) 83s ago 17m 24.9M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (17m) 83s ago 17m 8732k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (16m) 16s ago 16m 8577k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (3m) 83s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (3m) 16s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (5m) 83s ago 16m 84.8M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (11m) 83s ago 11m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (11m) 83s ago 11m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (11m) 16s ago 11m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (11m) 16s ago 11m 60.3M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (8m) 83s ago 18m 501M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (7m) 16s ago 16m 452M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:00:06.499 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (4m) 83s ago 18m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (3m) 16s ago 16m 42.8M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 83s ago 17m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 16s ago 16m 16.4M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (2m) 83s ago 15m 93.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (2m) 83s ago 14m 99.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (89s) 83s ago 14m 12.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (52s) 16s ago 13m 96.1M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (19s) 16s ago 13m 12.2M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (13m) 16s ago 13m 229M 2240M 18.2.0 dc2bc1663786 80e5703662fe 2024-02-15T23:00:06.500 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (6m) 83s ago 16m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 msgr2=0x7f245406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 0x7f245406fd50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2450005b40 tx=0x7f2450005a90 comp rx=0 tx=0).stop 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 msgr2=0x7f24681009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f245800e940 tx=0x7f245800ec50 comp rx=0 tx=0).stop 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 shutdown_connections 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f245406d8a0 0x7f245406fd50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24680ff290 0x7f2468100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 --2- 172.21.15.138:0/3376929716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24680ffba0 0x7f24681009b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 >> 172.21.15.138:0/3376929716 conn(0x7f2468074850 msgr2=0x7f2468104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.498+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 shutdown_connections 2024-02-15T23:00:06.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.499+0000 7f246de0a700 1 -- 172.21.15.138:0/3376929716 wait complete. 2024-02-15T23:00:06.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 -- 172.21.15.138:0/3155180688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 msgr2=0x7fb044104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 --2- 172.21.15.138:0/3155180688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb044104df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb038009910 tx=0x7fb038009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 -- 172.21.15.138:0/3155180688 shutdown_connections 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 --2- 172.21.15.138:0/3155180688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb044104df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 --2- 172.21.15.138:0/3155180688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 0x7fb044068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 -- 172.21.15.138:0/3155180688 >> 172.21.15.138:0/3155180688 conn(0x7fb044074f50 msgr2=0x7fb044075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 -- 172.21.15.138:0/3155180688 shutdown_connections 2024-02-15T23:00:06.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.601+0000 7fb049ba3700 1 -- 172.21.15.138:0/3155180688 wait complete. 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 Processor -- start 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 -- start start 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 0x7fb0440ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440ffc80 con 0x7fb044068fd0 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb049ba3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440ffdc0 con 0x7fb044068630 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb042ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb042ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60924/0 (socket says 172.21.15.138:60924) 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.602+0000 7fb042ffd700 1 -- 172.21.15.138:0/2207888219 learned_addr learned my addr 172.21.15.138:0/2207888219 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb0437fe700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 0x7fb0440ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb042ffd700 1 -- 172.21.15.138:0/2207888219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 msgr2=0x7fb0440ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb042ffd700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 0x7fb0440ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb042ffd700 1 -- 172.21.15.138:0/2207888219 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380095f0 con 0x7fb044068fd0 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb042ffd700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb038000c00 tx=0x7fb03800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb03801d070 con 0x7fb044068fd0 2024-02-15T23:00:06.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb038005dc0 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb038017400 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb044100040 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.603+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0441a2320 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.604+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0441086d0 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.605+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb03800f460 con 0x7fb044068fd0 2024-02-15T23:00:06.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.605+0000 7fb040ff9700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 0x7fb02c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:06.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.605+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb03808e7c0 con 0x7fb044068fd0 2024-02-15T23:00:06.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.605+0000 7fb0437fe700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 0x7fb02c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:06.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.606+0000 7fb0437fe700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 0x7fb02c06fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb034005950 tx=0x7fb03400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:06.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.610+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb0380580a0 con 0x7fb044068fd0 2024-02-15T23:00:06.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.888+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0441080b0 con 0x7fb044068fd0 2024-02-15T23:00:06.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.889+0000 7fb040ff9700 1 -- 172.21.15.138:0/2207888219 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fb03805b760 con 0x7fb044068fd0 2024-02-15T23:00:06.891 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:00:06.891 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:06.892 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:00:06.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-02-15T23:00:06.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-15T23:00:06.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:00:06.893 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 msgr2=0x7fb02c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 0x7fb02c06fd50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb034005950 tx=0x7fb03400b410 comp rx=0 tx=0).stop 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 msgr2=0x7fb0440ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb038000c00 tx=0x7fb03800bd70 comp rx=0 tx=0).stop 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 shutdown_connections 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb02c06d8a0 0x7fb02c06fd50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb044068630 0x7fb0440ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 --2- 172.21.15.138:0/2207888219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb044068fd0 0x7fb0440ff740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.891+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 >> 172.21.15.138:0/2207888219 conn(0x7fb044074f50 msgr2=0x7fb0440fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.892+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 shutdown_connections 2024-02-15T23:00:06.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.892+0000 7fb049ba3700 1 -- 172.21.15.138:0/2207888219 wait complete. 2024-02-15T23:00:06.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 -- 172.21.15.138:0/4036623057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ff2d0 msgr2=0x7f80000ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:06.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 --2- 172.21.15.138:0/4036623057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ff2d0 0x7f80000ff6a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009910 tx=0x7f7ffc009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:06.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 -- 172.21.15.138:0/4036623057 shutdown_connections 2024-02-15T23:00:06.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 --2- 172.21.15.138:0/4036623057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ffc70 0x7f8000103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 --2- 172.21.15.138:0/4036623057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ff2d0 0x7f80000ff6a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:06.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 -- 172.21.15.138:0/4036623057 >> 172.21.15.138:0/4036623057 conn(0x7f80000fab70 msgr2=0x7f80000fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:06.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 -- 172.21.15.138:0/4036623057 shutdown_connections 2024-02-15T23:00:06.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 -- 172.21.15.138:0/4036623057 wait complete. 2024-02-15T23:00:07.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.996+0000 7f8007882700 1 Processor -- start 2024-02-15T23:00:07.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8007882700 1 -- start start 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8007882700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ff2d0 0x7f800019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8007882700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8007882700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800019b5a0 con 0x7f80000ffc70 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8007882700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000194a50 con 0x7f80000ff2d0 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60938/0 (socket says 172.21.15.138:60938) 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 -- 172.21.15.138:0/3793308455 learned_addr learned my addr 172.21.15.138:0/3793308455 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f800561e700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ff2d0 0x7f800019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 -- 172.21.15.138:0/3793308455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ff2d0 msgr2=0x7f800019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ff2d0 0x7f800019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 -- 172.21.15.138:0/3793308455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0095f0 con 0x7f80000ffc70 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f8004e1d700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000c8f0 tx=0x7f7ff000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.997+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff00078a0 con 0x7f80000ffc70 2024-02-15T23:00:07.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.998+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ff000f450 con 0x7f80000ffc70 2024-02-15T23:00:07.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.998+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000194d30 con 0x7f80000ffc70 2024-02-15T23:00:07.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.998+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff0018610 con 0x7f80000ffc70 2024-02-15T23:00:07.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.998+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000195280 con 0x7f80000ffc70 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.999+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80001075e0 con 0x7f80000ffc70 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:06.999+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7ff000f5c0 con 0x7f80000ffc70 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.000+0000 7f7ff67fc700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 0x7f7fec06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.000+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ff008d350 con 0x7f80000ffc70 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.000+0000 7f800561e700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 0x7f7fec06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.000+0000 7f800561e700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 0x7f7fec06fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc006010 tx=0x7f7ffc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.004+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ff005a760 con 0x7f80000ffc70 2024-02-15T23:00:07.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.242+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f800004ea50 con 0x7f80000ffc70 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.242+0000 7f7ff67fc700 1 -- 172.21.15.138:0/3793308455 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f7ff005a2f0 con 0x7f80000ffc70 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:e23 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 23 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T22:55:27.884255+0000 2024-02-15T23:00:07.245 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 46 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=14476,1=24273} 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T23:00:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{0:14476} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.138:6828/1693530689,v1:172.21.15.138:6829/1693530689] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:14486} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2716267624,v1:172.21.15.138:6827/2716267624] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{1:24273} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.170:6824/4027411393,v1:172.21.15.170:6825/4027411393] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.170:6826/2026647764,v1:172.21.15.170:6827/2026647764] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:07.247 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 msgr2=0x7f7fec06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 0x7f7fec06fd50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc006010 tx=0x7f7ffc01a040 comp rx=0 tx=0).stop 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 msgr2=0x7f800019af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000c8f0 tx=0x7f7ff000cc00 comp rx=0 tx=0).stop 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 shutdown_connections 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7fec06d8a0 0x7f7fec06fd50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80000ff2d0 0x7f800019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 --2- 172.21.15.138:0/3793308455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80000ffc70 0x7f800019af10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 >> 172.21.15.138:0/3793308455 conn(0x7f80000fab70 msgr2=0x7f80000fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:07.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 shutdown_connections 2024-02-15T23:00:07.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.244+0000 7f8007882700 1 -- 172.21.15.138:0/3793308455 wait complete. 2024-02-15T23:00:07.249 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T23:00:07.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- 172.21.15.138:0/1804993426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 msgr2=0x7fd8b40ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/1804993426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b40ff760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009910 tx=0x7fd8b0009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- 172.21.15.138:0/1804993426 shutdown_connections 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/1804993426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b4103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/1804993426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b40ff760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- 172.21.15.138:0/1804993426 >> 172.21.15.138:0/1804993426 conn(0x7fd8b4074f50 msgr2=0x7fd8b4075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- 172.21.15.138:0/1804993426 shutdown_connections 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- 172.21.15.138:0/1804993426 wait complete. 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 Processor -- start 2024-02-15T23:00:07.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.350+0000 7fd8bc31d700 1 -- start start 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b41971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b41977f0 con 0x7fd8b40ff390 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4197960 con 0x7fd8b40ffd30 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60958/0 (socket says 172.21.15.138:60958) 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 -- 172.21.15.138:0/3032674191 learned_addr learned my addr 172.21.15.138:0/3032674191 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8b98b8700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b41971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 -- 172.21.15.138:0/3032674191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 msgr2=0x7fd8b41971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b41971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 -- 172.21.15.138:0/3032674191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00095f0 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8b98b8700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b41971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ba0b9700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006010 tx=0x7fd8b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b001d070 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8b0004fb0 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b419fd00 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b0022ea0 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.351+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b41a0170 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.352+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b4107650 con 0x7fd8b40ff390 2024-02-15T23:00:07.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.353+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd8b0022470 con 0x7fd8b40ff390 2024-02-15T23:00:07.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.353+0000 7fd8ab7fe700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 0x7fd8a006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.353+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd8b008eb30 con 0x7fd8b40ff390 2024-02-15T23:00:07.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.353+0000 7fd8b98b8700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 0x7fd8a006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.354+0000 7fd8b98b8700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 0x7fd8a006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4068ca0 tx=0x7fd8a4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.358+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd8b0058560 con 0x7fd8b40ff390 2024-02-15T23:00:07.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.569+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b402ccf0 con 0x7fd8a006d8a0 2024-02-15T23:00:07.571 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:07 smithi138 ceph-mon[89527]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:07.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:07 smithi138 ceph-mon[89527]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:07.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:07 smithi138 ceph-mon[89527]: pgmap v151: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-15T23:00:07.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:07 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2207888219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:07.572 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:07 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3793308455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:00:07.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.570+0000 7fd8ab7fe700 1 -- 172.21.15.138:0/3032674191 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd8b402ccf0 con 0x7fd8a006d8a0 2024-02-15T23:00:07.572 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "11/23 daemons upgraded", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T23:00:07.573 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 msgr2=0x7fd8a006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 0x7fd8a006fd50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4068ca0 tx=0x7fd8a4008040 comp rx=0 tx=0).stop 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 msgr2=0x7fd8b4196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0006010 tx=0x7fd8b000be20 comp rx=0 tx=0).stop 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 shutdown_connections 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd8a006d8a0 0x7fd8a006fd50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd8b40ff390 0x7fd8b4196c90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 --2- 172.21.15.138:0/3032674191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b40ffd30 0x7fd8b41971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 >> 172.21.15.138:0/3032674191 conn(0x7fd8b4074f50 msgr2=0x7fd8b40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 shutdown_connections 2024-02-15T23:00:07.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.572+0000 7fd8bc31d700 1 -- 172.21.15.138:0/3032674191 wait complete. 2024-02-15T23:00:07.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 -- 172.21.15.138:0/2752040215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 msgr2=0x7fe6d40ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 --2- 172.21.15.138:0/2752040215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d40ff6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009910 tx=0x7fe6c4009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 -- 172.21.15.138:0/2752040215 shutdown_connections 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 --2- 172.21.15.138:0/2752040215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 0x7fe6d4103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 --2- 172.21.15.138:0/2752040215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d40ff6d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 -- 172.21.15.138:0/2752040215 >> 172.21.15.138:0/2752040215 conn(0x7fe6d40faba0 msgr2=0x7fe6d40fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 -- 172.21.15.138:0/2752040215 shutdown_connections 2024-02-15T23:00:07.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.676+0000 7fe6da38f700 1 -- 172.21.15.138:0/2752040215 wait complete. 2024-02-15T23:00:07.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 Processor -- start 2024-02-15T23:00:07.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 -- start start 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 0x7fe6d41962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d41969a0 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6da38f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d419a730 con 0x7fe6d40ffca0 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:60974/0 (socket says 172.21.15.138:60974) 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 -- 172.21.15.138:0/556366553 learned_addr learned my addr 172.21.15.138:0/556366553 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d37fe700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 0x7fe6d41962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 -- 172.21.15.138:0/556366553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 msgr2=0x7fe6d41962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 0x7fe6d41962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.677+0000 7fe6d3fff700 1 -- 172.21.15.138:0/556366553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40095f0 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6d3fff700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4005f50 tx=0x7fe6c400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6c401d070 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d419a9b0 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6c400b610 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6c4022470 con 0x7fe6d40ff300 2024-02-15T23:00:07.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.678+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d419aea0 con 0x7fe6d40ff300 2024-02-15T23:00:07.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.679+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d404ea50 con 0x7fe6d40ff300 2024-02-15T23:00:07.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.679+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe6c4003680 con 0x7fe6d40ff300 2024-02-15T23:00:07.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.680+0000 7fe6d17fa700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 0x7fe6bc06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:07.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.680+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe6c408e920 con 0x7fe6d40ff300 2024-02-15T23:00:07.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.680+0000 7fe6d37fe700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 0x7fe6bc06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:07.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.680+0000 7fe6d37fe700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 0x7fe6bc06fd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6d41973a0 tx=0x7fe6c8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:07.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.684+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe6c4058180 con 0x7fe6d40ff300 2024-02-15T23:00:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:07 smithi170 ceph-mon[67652]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:07 smithi170 ceph-mon[67652]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:07 smithi170 ceph-mon[67652]: pgmap v151: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-15T23:00:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:07 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2207888219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:07.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:07 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3793308455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:00:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.960+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe6d41970e0 con 0x7fe6d40ff300 2024-02-15T23:00:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.961+0000 7fe6d17fa700 1 -- 172.21.15.138:0/556366553 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe6c405b840 con 0x7fe6d40ff300 2024-02-15T23:00:07.964 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T23:00:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 msgr2=0x7fe6bc06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 0x7fe6bc06fd50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6d41973a0 tx=0x7fe6c8009260 comp rx=0 tx=0).stop 2024-02-15T23:00:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 msgr2=0x7fe6d4195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4005f50 tx=0x7fe6c400f740 comp rx=0 tx=0).stop 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 shutdown_connections 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe6bc06d8a0 0x7fe6bc06fd50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6d40ff300 0x7fe6d4195d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 --2- 172.21.15.138:0/556366553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6d40ffca0 0x7fe6d41962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 >> 172.21.15.138:0/556366553 conn(0x7fe6d40faba0 msgr2=0x7fe6d4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 shutdown_connections 2024-02-15T23:00:07.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:07.963+0000 7fe6da38f700 1 -- 172.21.15.138:0/556366553 wait complete. 2024-02-15T23:00:08.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:08 smithi138 ceph-mon[89527]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:08.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:08 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/556366553' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:00:08.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:08 smithi170 ceph-mon[67652]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:08.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:08 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/556366553' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:00:09.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:09 smithi170 ceph-mon[67652]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:09.653 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:09 smithi170 ceph-mon[67652]: pgmap v152: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:09 smithi138 ceph-mon[89527]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:09 smithi138 ceph-mon[89527]: pgmap v152: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T23:00:10.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T23:00:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:11 smithi138 ceph-mon[89527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T23:00:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:11 smithi138 ceph-mon[89527]: Upgrade: osd.5 is safe to restart 2024-02-15T23:00:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:11 smithi138 ceph-mon[89527]: pgmap v153: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:11.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:11 smithi170 ceph-mon[67652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T23:00:11.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:11 smithi170 ceph-mon[67652]: Upgrade: osd.5 is safe to restart 2024-02-15T23:00:11.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:11 smithi170 ceph-mon[67652]: pgmap v153: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:11.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:11 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:12.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: Upgrade: Updating osd.5 2024-02-15T23:00:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T23:00:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: Deploying daemon osd.5 on smithi170 2024-02-15T23:00:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:12 smithi170 ceph-mon[67652]: pgmap v154: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:00:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: Upgrade: Updating osd.5 2024-02-15T23:00:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T23:00:12.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: Deploying daemon osd.5 on smithi170 2024-02-15T23:00:12.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:12 smithi138 ceph-mon[89527]: pgmap v154: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:00:15.012 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:14 smithi170 systemd[1]: Stopping Ceph osd.5 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:00:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-mon[67652]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-mon[67652]: osd.5 marked itself down and dead 2024-02-15T23:00:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:15.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:15.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[50588]: 2024-02-15T23:00:15.069+0000 7f47c5557700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:00:15.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[50588]: 2024-02-15T23:00:15.069+0000 7f47c5557700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-15T23:00:15.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:15 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[50588]: 2024-02-15T23:00:15.069+0000 7f47c5557700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:00:15.687 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:15 smithi138 ceph-mon[89527]: pgmap v155: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:00:15.687 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:15 smithi138 ceph-mon[89527]: osd.5 marked itself down and dead 2024-02-15T23:00:15.687 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:15.688 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:15.916 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:15 smithi170 podman[86493]: 2024-02-15 23:00:15.643390691 +0000 UTC m=+0.706987960 container died 80e5703662fed0de5d707c3d82382c7c52879aa57777eadc7529704bfb5f80bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1) 2024-02-15T23:00:16.261 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86493]: 2024-02-15 23:00:16.002859801 +0000 UTC m=+1.066457119 container cleanup 80e5703662fed0de5d707c3d82382c7c52879aa57777eadc7529704bfb5f80bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, RELEASE=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-15T23:00:16.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 bash[86493]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5 2024-02-15T23:00:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:16 smithi138 ceph-mon[89527]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T23:00:16.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:16 smithi138 ceph-mon[89527]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-15T23:00:16.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:16 smithi138 ceph-mon[89527]: osdmap e75: 6 total, 5 up, 6 in 2024-02-15T23:00:16.638 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86513]: 2024-02-15 23:00:16.287509215 +0000 UTC m=+0.638922667 container remove 80e5703662fed0de5d707c3d82382c7c52879aa57777eadc7529704bfb5f80bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20231212, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-02-15T23:00:16.638 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:16 smithi170 ceph-mon[67652]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T23:00:16.639 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:16 smithi170 ceph-mon[67652]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-15T23:00:16.639 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:16 smithi170 ceph-mon[67652]: osdmap e75: 6 total, 5 up, 6 in 2024-02-15T23:00:16.918 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86605]: 2024-02-15 23:00:16.539254261 +0000 UTC m=+0.018626021 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:00:16.918 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86605]: 2024-02-15 23:00:16.688975181 +0000 UTC m=+0.168346978 container create 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:00:16.918 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86605]: 2024-02-15 23:00:16.916285157 +0000 UTC m=+0.395656909 container init 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:00:17.205 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86605]: 2024-02-15 23:00:16.919601852 +0000 UTC m=+0.398973613 container start 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:00:17.205 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:16 smithi170 podman[86605]: 2024-02-15 23:00:16.991391825 +0000 UTC m=+0.470763603 container attach 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:00:17.487 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:17 smithi170 ceph-mon[67652]: pgmap v157: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T23:00:17.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:17 smithi170 ceph-mon[67652]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T23:00:17.488 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:17 smithi170 ceph-mon[67652]: osdmap e76: 6 total, 5 up, 6 in 2024-02-15T23:00:17.488 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:17 smithi170 podman[86605]: 2024-02-15 23:00:17.204232893 +0000 UTC m=+0.683604648 container died 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-15T23:00:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:17 smithi138 ceph-mon[89527]: pgmap v157: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-15T23:00:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:17 smithi138 ceph-mon[89527]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-02-15T23:00:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:17 smithi138 ceph-mon[89527]: osdmap e76: 6 total, 5 up, 6 in 2024-02-15T23:00:18.224 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:17 smithi170 podman[86631]: 2024-02-15 23:00:17.778542971 +0000 UTC m=+0.569310963 container remove 16203152a3d91dd7dea35b37c66ee586ed94d100002e3c7fce88885ac7d89209 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:00:18.224 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:17 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-15T23:00:18.224 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:17 smithi170 systemd[1]: Stopped Ceph osd.5 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T23:00:18.224 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:17 smithi170 systemd[1]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.5.service: Consumed 1min 2.851s CPU time. 2024-02-15T23:00:18.224 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 systemd[1]: Starting Ceph osd.5 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:00:18.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-mon[67652]: Health check failed: Degraded data redundancy: 16/360 objects degraded (4.444%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:18.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 podman[86733]: 2024-02-15 23:00:18.124950456 +0000 UTC m=+0.017432431 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:00:18.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 podman[86733]: 2024-02-15 23:00:18.27967128 +0000 UTC m=+0.172153254 container create 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-15T23:00:18.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:18 smithi138 ceph-mon[89527]: Health check failed: Degraded data redundancy: 16/360 objects degraded (4.444%), 5 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:18.978 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 podman[86733]: 2024-02-15 23:00:18.528826946 +0000 UTC m=+0.421308922 container init 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-15T23:00:18.978 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 podman[86733]: 2024-02-15 23:00:18.532172224 +0000 UTC m=+0.424654199 container start 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-02-15T23:00:18.978 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 podman[86733]: 2024-02-15 23:00:18.607837 +0000 UTC m=+0.500318983 container attach 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 bash[86733]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T23:00:19.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T23:00:19.263 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:18 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate[86748]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-15T23:00:19.263 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:19 smithi170 podman[86733]: 2024-02-15 23:00:19.000503726 +0000 UTC m=+0.892985712 container died 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-15T23:00:19.613 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:19 smithi170 ceph-mon[67652]: pgmap v159: 65 pgs: 5 active+undersized+degraded, 10 peering, 4 stale+active+clean, 6 active+undersized, 40 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 16/360 objects degraded (4.444%) 2024-02-15T23:00:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:19 smithi138 ceph-mon[89527]: pgmap v159: 65 pgs: 5 active+undersized+degraded, 10 peering, 4 stale+active+clean, 6 active+undersized, 40 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 16/360 objects degraded (4.444%) 2024-02-15T23:00:19.929 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:19 smithi170 podman[86884]: 2024-02-15 23:00:19.611808929 +0000 UTC m=+0.606219413 container remove 8487f80686a86d8ce7929348f2591edb2c0a589c3a17470b7dc9690ed55bd790 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-15T23:00:19.929 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:19 smithi170 podman[86948]: 2024-02-15 23:00:19.821171487 +0000 UTC m=+0.107649896 container create 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-15T23:00:19.929 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:19 smithi170 podman[86948]: 2024-02-15 23:00:19.73125201 +0000 UTC m=+0.017730419 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:00:20.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 podman[86948]: 2024-02-15 23:00:20.066885176 +0000 UTC m=+0.353363587 container init 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-02-15T23:00:20.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 podman[86948]: 2024-02-15 23:00:20.070309334 +0000 UTC m=+0.356787755 container start 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-15T23:00:20.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 ceph-osd[86966]: -- 172.21.15.170:0/2077234453 <== mon.1 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ffa98671e0 con 0x55ffa9839000 2024-02-15T23:00:20.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 bash[86948]: 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db 2024-02-15T23:00:20.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 systemd[1]: Started Ceph osd.5 for 3fa87466-cc53-11ee-95ba-87774f69a715. 2024-02-15T23:00:20.997 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:20 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:00:20.617+0000 7f3fd4dbb7c0 -1 Falling back to public interface 2024-02-15T23:00:21.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:21 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:21.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:21 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:21.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:21 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:21.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:21 smithi170 ceph-mon[67652]: pgmap v160: 65 pgs: 8 active+undersized+degraded, 10 peering, 10 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/360 objects degraded (6.667%) 2024-02-15T23:00:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:21 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:21 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:21 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:21 smithi138 ceph-mon[89527]: pgmap v160: 65 pgs: 8 active+undersized+degraded, 10 peering, 10 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24/360 objects degraded (6.667%) 2024-02-15T23:00:22.660 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:22 smithi170 ceph-mon[67652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T23:00:22.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:22 smithi138 ceph-mon[89527]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-02-15T23:00:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:23 smithi138 ceph-mon[89527]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:23 smithi170 ceph-mon[67652]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:25.162 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:24 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:00:24.852+0000 7f3fd4dbb7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-15T23:00:25.511 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:00:25.276+0000 7f3fd4dbb7c0 -1 osd.5 74 log_to_monitors true 2024-02-15T23:00:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-mon[67652]: pgmap v162: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-mon[67652]: from='osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T23:00:25.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:25 smithi170 ceph-mon[67652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T23:00:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:25 smithi138 ceph-mon[89527]: pgmap v162: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:25.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:25.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:25 smithi138 ceph-mon[89527]: from='osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T23:00:25.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:25 smithi138 ceph-mon[89527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T23:00:26.261 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:00:26.114+0000 7f3fc220b700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T23:00:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:26 smithi138 ceph-mon[89527]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T23:00:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:26 smithi138 ceph-mon[89527]: from='osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T23:00:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:26 smithi138 ceph-mon[89527]: osdmap e77: 6 total, 5 up, 6 in 2024-02-15T23:00:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:26 smithi138 ceph-mon[89527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T23:00:26.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:26 smithi138 ceph-mon[89527]: from='osd.5 ' entity='osd.5' 2024-02-15T23:00:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-mon[67652]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T23:00:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-mon[67652]: from='osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T23:00:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-mon[67652]: osdmap e77: 6 total, 5 up, 6 in 2024-02-15T23:00:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-mon[67652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-02-15T23:00:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:26 smithi170 ceph-mon[67652]: from='osd.5 ' entity='osd.5' 2024-02-15T23:00:27.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:27.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 56/360 objects degraded (15.556%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:27.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T23:00:27.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899] boot 2024-02-15T23:00:27.694 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: osdmap e78: 6 total, 6 up, 6 in 2024-02-15T23:00:27.695 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:27 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: pgmap v164: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 56/360 objects degraded (15.556%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: osd.5 [v2:172.21.15.170:6816/3484244899,v1:172.21.15.170:6817/3484244899] boot 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: osdmap e78: 6 total, 6 up, 6 in 2024-02-15T23:00:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:27 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.172 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all osd 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T23:00:29.173 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: Upgrade: Setting require_osd_release to 19 squid 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: osdmap e79: 6 total, 6 up, 6 in 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-15T23:00:29.174 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:28 smithi170 ceph-mon[67652]: pgmap v167: 65 pgs: 4 peering, 12 active+undersized+degraded, 12 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 50/360 objects degraded (13.889%) 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all osd 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.175 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: Upgrade: Setting require_osd_release to 19 squid 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-15T23:00:29.176 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: osdmap e79: 6 total, 6 up, 6 in 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-15T23:00:29.177 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:28 smithi138 ceph-mon[89527]: pgmap v167: 65 pgs: 4 peering, 12 active+undersized+degraded, 12 active+undersized, 37 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 50/360 objects degraded (13.889%) 2024-02-15T23:00:29.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[89523]: 2024-02-15T23:00:29.287+0000 7fcf68d57700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: osdmap e80: 6 total, 6 up, 6 in 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:30.086 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: osdmap e81: 6 total, 6 up, 6 in 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.170:6826/4288390842,v1:172.21.15.170:6827/4288390842] up:boot 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2375700998,v1:172.21.15.138:6827/2375700998] up:boot 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:30.087 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:29 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: osdmap e80: 6 total, 6 up, 6 in 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: fsmap cephfs:2 {0=cephfs.smithi138.fzypgq=up:active,1=cephfs.smithi170.banvev=up:active} 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.262 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: osdmap e81: 6 total, 6 up, 6 in 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.170:6826/4288390842,v1:172.21.15.170:6827/4288390842] up:boot 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2375700998,v1:172.21.15.138:6827/2375700998] up:boot 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:30.263 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:29 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: pgmap v170: 65 pgs: 4 peering, 10 active+undersized+degraded, 11 active+undersized, 40 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/360 objects degraded (12.778%) 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.170:6824/3599825155,v1:172.21.15.170:6825/3599825155] up:boot 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/4266863139,v1:172.21.15.138:6829/4266863139] up:boot 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:00:31.627 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: pgmap v170: 65 pgs: 4 peering, 10 active+undersized+degraded, 11 active+undersized, 40 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 46/360 objects degraded (12.778%) 2024-02-15T23:00:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.170:6824/3599825155,v1:172.21.15.170:6825/3599825155] up:boot 2024-02-15T23:00:31.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/4266863139,v1:172.21.15.138:6829/4266863139] up:boot 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.bnqzne", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:00:31.763 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:32.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:32 smithi138 ceph-mon[89527]: Upgrade: Updating mds.cephfs.smithi138.bnqzne 2024-02-15T23:00:32.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:32 smithi138 ceph-mon[89527]: Deploying daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T23:00:32.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:32 smithi138 ceph-mon[89527]: Health check update: Degraded data redundancy: 46/360 objects degraded (12.778%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:32.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:32 smithi170 ceph-mon[67652]: Upgrade: Updating mds.cephfs.smithi138.bnqzne 2024-02-15T23:00:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:32 smithi170 ceph-mon[67652]: Deploying daemon mds.cephfs.smithi138.bnqzne on smithi138 2024-02-15T23:00:32.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:32 smithi170 ceph-mon[67652]: Health check update: Degraded data redundancy: 46/360 objects degraded (12.778%), 10 pgs degraded (PG_DEGRADED) 2024-02-15T23:00:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:33 smithi138 ceph-mon[89527]: pgmap v171: 65 pgs: 4 peering, 61 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:33.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:33 smithi138 ceph-mon[89527]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/360 objects degraded (12.778%), 10 pgs degraded) 2024-02-15T23:00:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:33 smithi170 ceph-mon[67652]: pgmap v171: 65 pgs: 4 peering, 61 active+clean; 307 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:33 smithi170 ceph-mon[67652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/360 objects degraded (12.778%), 10 pgs degraded) 2024-02-15T23:00:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:34 smithi138 ceph-mon[89527]: osdmap e82: 6 total, 6 up, 6 in 2024-02-15T23:00:34.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:34 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:00:34.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:34 smithi170 ceph-mon[67652]: osdmap e82: 6 total, 6 up, 6 in 2024-02-15T23:00:34.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:34 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:00:35.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:35 smithi138 ceph-mon[89527]: pgmap v173: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:35.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:35 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:35.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:35 smithi170 ceph-mon[67652]: pgmap v173: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:35.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:35 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:37.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:37 smithi138 ceph-mon[89527]: pgmap v174: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:37.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:37 smithi170 ceph-mon[67652]: pgmap v174: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 -- 172.21.15.138:0/368351860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 msgr2=0x7fa300104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 --2- 172.21.15.138:0/368351860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa300104dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009910 tx=0x7fa2f4009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 -- 172.21.15.138:0/368351860 shutdown_connections 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 --2- 172.21.15.138:0/368351860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa300104dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 --2- 172.21.15.138:0/368351860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 0x7fa300100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 -- 172.21.15.138:0/368351860 >> 172.21.15.138:0/368351860 conn(0x7fa3000fbd00 msgr2=0x7fa3000fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 -- 172.21.15.138:0/368351860 shutdown_connections 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.078+0000 7fa30534e700 1 -- 172.21.15.138:0/368351860 wait complete. 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 Processor -- start 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 -- start start 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 0x7fa300195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300196930 con 0x7fa300100e00 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa30534e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300196a70 con 0x7fa300100460 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa2fe7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa2fe7fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58066/0 (socket says 172.21.15.138:58066) 2024-02-15T23:00:38.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa2fe7fc700 1 -- 172.21.15.138:0/2267725288 learned_addr learned my addr 172.21.15.138:0/2267725288 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.079+0000 7fa2feffd700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 0x7fa300195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2fe7fc700 1 -- 172.21.15.138:0/2267725288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 msgr2=0x7fa300195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2fe7fc700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 0x7fa300195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2fe7fc700 1 -- 172.21.15.138:0/2267725288 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40095f0 con 0x7fa300100e00 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2fe7fc700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400bda0 tx=0x7fa2f400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f401d070 con 0x7fa300100e00 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f400f460 con 0x7fa300100e00 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30019a860 con 0x7fa300100e00 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f4017630 con 0x7fa300100e00 2024-02-15T23:00:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.080+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30019ad50 con 0x7fa300100e00 2024-02-15T23:00:38.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.081+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3001087d0 con 0x7fa300100e00 2024-02-15T23:00:38.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.082+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa2f400fab0 con 0x7fa300100e00 2024-02-15T23:00:38.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.082+0000 7fa2e7fff700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 0x7fa2e806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.082+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa2f408e980 con 0x7fa300100e00 2024-02-15T23:00:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.082+0000 7fa2feffd700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 0x7fa2e806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.083+0000 7fa2feffd700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 0x7fa2e806fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000ac50 tx=0x7fa2f000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.087+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa2f40581b0 con 0x7fa300100e00 2024-02-15T23:00:38.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.322+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa30002cca0 con 0x7fa2e806d8a0 2024-02-15T23:00:38.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.324+0000 7fa2e7fff700 1 -- 172.21.15.138:0/2267725288 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa30002cca0 con 0x7fa2e806d8a0 2024-02-15T23:00:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 msgr2=0x7fa2e806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 0x7fa2e806fd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000ac50 tx=0x7fa2f000a380 comp rx=0 tx=0).stop 2024-02-15T23:00:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 msgr2=0x7fa3001962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400bda0 tx=0x7fa2f400bdd0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 shutdown_connections 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa2e806d8a0 0x7fa2e806fd50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa300100460 0x7fa300195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 --2- 172.21.15.138:0/2267725288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa300100e00 0x7fa3001962e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.326+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 >> 172.21.15.138:0/2267725288 conn(0x7fa3000fbd00 msgr2=0x7fa3000fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.327+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 shutdown_connections 2024-02-15T23:00:38.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.327+0000 7fa30534e700 1 -- 172.21.15.138:0/2267725288 wait complete. 2024-02-15T23:00:38.342 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/3478202971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ffc60 msgr2=0x7f3b18103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/3478202971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ffc60 0x7f3b18103c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009910 tx=0x7f3b0c009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/3478202971 shutdown_connections 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/3478202971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ffc60 0x7f3b18103c30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/3478202971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ff2c0 0x7f3b180ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/3478202971 >> 172.21.15.138:0/3478202971 conn(0x7f3b180fab80 msgr2=0x7f3b180fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/3478202971 shutdown_connections 2024-02-15T23:00:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.460+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/3478202971 wait complete. 2024-02-15T23:00:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 Processor -- start 2024-02-15T23:00:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 -- start start 2024-02-15T23:00:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ffc60 0x7f3b18197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18197720 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b1d5f1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18197860 con 0x7f3b180ffc60 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58078/0 (socket says 172.21.15.138:58078) 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b16ffd700 1 -- 172.21.15.138:0/109449021 learned_addr learned my addr 172.21.15.138:0/109449021 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.461+0000 7f3b167fc700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ffc60 0x7f3b18197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b16ffd700 1 -- 172.21.15.138:0/109449021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ffc60 msgr2=0x7f3b18197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b16ffd700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ffc60 0x7f3b18197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b16ffd700 1 -- 172.21.15.138:0/109449021 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0095f0 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b16ffd700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d8d0 tx=0x7f3b0800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b080098a0 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b08010460 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1819fc30 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0800f5f0 con 0x7f3b180ff2c0 2024-02-15T23:00:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.462+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b181a00f0 con 0x7f3b180ff2c0 2024-02-15T23:00:38.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.463+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b18107630 con 0x7f3b180ff2c0 2024-02-15T23:00:38.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.464+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3b08009a00 con 0x7f3b180ff2c0 2024-02-15T23:00:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.464+0000 7f3afffff700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 0x7f3b0006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.464+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3b0808d400 con 0x7f3b180ff2c0 2024-02-15T23:00:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.464+0000 7f3b167fc700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 0x7f3b0006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.464+0000 7f3b167fc700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 0x7f3b0006fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006010 tx=0x7f3b0c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.469+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b08056bb0 con 0x7f3b180ff2c0 2024-02-15T23:00:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.688+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1802cd40 con 0x7f3b0006d8a0 2024-02-15T23:00:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.690+0000 7f3afffff700 1 -- 172.21.15.138:0/109449021 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3b1802cd40 con 0x7f3b0006d8a0 2024-02-15T23:00:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 msgr2=0x7f3b0006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 0x7f3b0006fd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c006010 tx=0x7f3b0c01a040 comp rx=0 tx=0).stop 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 msgr2=0x7f3b18196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d8d0 tx=0x7f3b0800dbe0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 shutdown_connections 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3b0006d8a0 0x7f3b0006fd50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b180ff2c0 0x7f3b18196bc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 --2- 172.21.15.138:0/109449021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b180ffc60 0x7f3b18197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 >> 172.21.15.138:0/109449021 conn(0x7f3b180fab80 msgr2=0x7f3b180fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 shutdown_connections 2024-02-15T23:00:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.692+0000 7f3b1d5f1700 1 -- 172.21.15.138:0/109449021 wait complete. 2024-02-15T23:00:38.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 -- 172.21.15.138:0/3555870322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 msgr2=0x7f248c101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 --2- 172.21.15.138:0/3555870322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c101760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f248400b0a0 tx=0x7f248400b3b0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 -- 172.21.15.138:0/3555870322 shutdown_connections 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 --2- 172.21.15.138:0/3555870322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 0x7f248c10a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 --2- 172.21.15.138:0/3555870322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c101760 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 -- 172.21.15.138:0/3555870322 >> 172.21.15.138:0/3555870322 conn(0x7f248c0fabb0 msgr2=0x7f248c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 -- 172.21.15.138:0/3555870322 shutdown_connections 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.800+0000 7f2492bdd700 1 -- 172.21.15.138:0/3555870322 wait complete. 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 Processor -- start 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 -- start start 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 0x7f248c1962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c196990 con 0x7f248c101390 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2492bdd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c19a720 con 0x7f248c101ca0 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58094/0 (socket says 172.21.15.138:58094) 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 -- 172.21.15.138:0/154083211 learned_addr learned my addr 172.21.15.138:0/154083211 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f248bfff700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 0x7f248c1962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 -- 172.21.15.138:0/154083211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 msgr2=0x7f248c1962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 0x7f248c1962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.801+0000 7f2490979700 1 -- 172.21.15.138:0/154083211 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484009d00 con 0x7f248c101390 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2490979700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f248400b070 tx=0x7f248400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248400e040 con 0x7f248c101390 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2484004040 con 0x7f248c101390 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c19a9a0 con 0x7f248c101390 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248401d6b0 con 0x7f248c101390 2024-02-15T23:00:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.802+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c19ae90 con 0x7f248c101390 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.803+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c107870 con 0x7f248c101390 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.803+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2484007af0 con 0x7f248c101390 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.804+0000 7f2489ffb700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 0x7f247406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.804+0000 7f248bfff700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 0x7f247406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.804+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f248408eb60 con 0x7f248c101390 2024-02-15T23:00:38.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.804+0000 7f248bfff700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 0x7f247406fd50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f248c197390 tx=0x7f2480009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:38.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:38.809+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2484058310 con 0x7f248c101390 2024-02-15T23:00:39.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.026+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f248c19b170 con 0x7f247406d8a0 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.037+0000 7f2489ffb700 1 -- 172.21.15.138:0/154083211 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f248c19b170 con 0x7f247406d8a0 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (7m) 115s ago 17m 24.9M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (17m) 115s ago 17m 8732k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (16m) 15s ago 16m 8812k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (3m) 115s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (3m) 15s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:00:39.040 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (6m) 115s ago 17m 84.8M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (12m) 115s ago 12m 72.7M - 18.2.0 dc2bc1663786 cc50947e5b19 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (12m) 115s ago 12m 135M - 18.2.0 dc2bc1663786 318b49062142 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (12m) 15s ago 12m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (12m) 15s ago 11m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (9m) 115s ago 19m 501M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (8m) 15s ago 16m 452M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (4m) 115s ago 19m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (4m) 15s ago 16m 43.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (7m) 115s ago 17m 15.7M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (7m) 15s ago 16m 16.7M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (3m) 115s ago 15m 93.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (2m) 115s ago 15m 99.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (2m) 115s ago 14m 12.5M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (85s) 15s ago 14m 97.2M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:00:39.041 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (52s) 15s ago 14m 102M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (19s) 15s ago 13m 12.4M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 142b7035a2a9 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (7m) 115s ago 17m 69.4M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 msgr2=0x7f247406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 0x7f247406fd50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f248c197390 tx=0x7f2480009260 comp rx=0 tx=0).stop 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 msgr2=0x7f248c195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f248400b070 tx=0x7f248400cf10 comp rx=0 tx=0).stop 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 shutdown_connections 2024-02-15T23:00:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f247406d8a0 0x7f247406fd50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f248c101390 0x7f248c195d70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 --2- 172.21.15.138:0/154083211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f248c101ca0 0x7f248c1962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 >> 172.21.15.138:0/154083211 conn(0x7f248c0fabb0 msgr2=0x7f248c1049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 shutdown_connections 2024-02-15T23:00:39.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.040+0000 7f2492bdd700 1 -- 172.21.15.138:0/154083211 wait complete. 2024-02-15T23:00:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 -- 172.21.15.138:0/2318056646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2940ff860 msgr2=0x7fb2940ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 --2- 172.21.15.138:0/2318056646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2940ff860 0x7fb2940ffcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb288009940 tx=0x7fb288009c50 comp rx=0 tx=0).stop 2024-02-15T23:00:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 -- 172.21.15.138:0/2318056646 shutdown_connections 2024-02-15T23:00:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 --2- 172.21.15.138:0/2318056646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2940ff860 0x7fb2940ffcd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 --2- 172.21.15.138:0/2318056646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb294067ed0 0x7fb2940ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 -- 172.21.15.138:0/2318056646 >> 172.21.15.138:0/2318056646 conn(0x7fb2940748b0 msgr2=0x7fb294074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 -- 172.21.15.138:0/2318056646 shutdown_connections 2024-02-15T23:00:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.148+0000 7fb29a2af700 1 -- 172.21.15.138:0/2318056646 wait complete. 2024-02-15T23:00:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.149+0000 7fb29a2af700 1 Processor -- start 2024-02-15T23:00:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.149+0000 7fb29a2af700 1 -- start start 2024-02-15T23:00:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb29a2af700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb29a2af700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2940ff860 0x7fb2941983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb29a2af700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294198a90 con 0x7fb294067ed0 2024-02-15T23:00:39.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb29a2af700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29419c820 con 0x7fb2940ff860 2024-02-15T23:00:39.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58122/0 (socket says 172.21.15.138:58122) 2024-02-15T23:00:39.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 -- 172.21.15.138:0/3704340663 learned_addr learned my addr 172.21.15.138:0/3704340663 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:39.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb2937fe700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2940ff860 0x7fb2941983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 -- 172.21.15.138:0/3704340663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2940ff860 msgr2=0x7fb2941983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2940ff860 0x7fb2941983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 -- 172.21.15.138:0/3704340663 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880095f0 con 0x7fb294067ed0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.150+0000 7fb293fff700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb28400d900 tx=0x7fb28400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.151+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2840041f0 con 0x7fb294067ed0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.151+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb284004cf0 con 0x7fb294067ed0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.151+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29419cb00 con 0x7fb294067ed0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.151+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28400b750 con 0x7fb294067ed0 2024-02-15T23:00:39.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.151+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29419d020 con 0x7fb294067ed0 2024-02-15T23:00:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.152+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29404ea50 con 0x7fb294067ed0 2024-02-15T23:00:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.152+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb284004830 con 0x7fb294067ed0 2024-02-15T23:00:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.153+0000 7fb2917fa700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 0x7fb27c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.153+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb28408d3a0 con 0x7fb294067ed0 2024-02-15T23:00:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.153+0000 7fb2937fe700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 0x7fb27c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.154+0000 7fb2937fe700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 0x7fb27c06fd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb288009910 tx=0x7fb288005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.158+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb284056bd0 con 0x7fb294067ed0 2024-02-15T23:00:39.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.451+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb29419d4e0 con 0x7fb294067ed0 2024-02-15T23:00:39.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:39 smithi138 ceph-mon[89527]: pgmap v175: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:39.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:39 smithi138 ceph-mon[89527]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:39.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:39.454 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:39.455 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.452+0000 7fb2917fa700 1 -- 172.21.15.138:0/3704340663 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fb284016340 con 0x7fb294067ed0 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:00:39.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 11 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:00:39.456 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 msgr2=0x7fb27c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 0x7fb27c06fd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb288009910 tx=0x7fb288005a90 comp rx=0 tx=0).stop 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 msgr2=0x7fb294197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb28400d900 tx=0x7fb28400dc10 comp rx=0 tx=0).stop 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 shutdown_connections 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb27c06d8a0 0x7fb27c06fd50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb294067ed0 0x7fb294197e70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 --2- 172.21.15.138:0/3704340663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2940ff860 0x7fb2941983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.454+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 >> 172.21.15.138:0/3704340663 conn(0x7fb2940748b0 msgr2=0x7fb2940fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.455+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 shutdown_connections 2024-02-15T23:00:39.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.455+0000 7fb29a2af700 1 -- 172.21.15.138:0/3704340663 wait complete. 2024-02-15T23:00:39.564 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:39 smithi170 ceph-mon[67652]: pgmap v175: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:39.564 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:39 smithi170 ceph-mon[67652]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:39.564 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:39.564 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:39.564 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 -- 172.21.15.138:0/4162004268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 msgr2=0x7fe764073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/4162004268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764073460 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe760009940 tx=0x7fe760009c50 comp rx=0 tx=0).stop 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 -- 172.21.15.138:0/4162004268 shutdown_connections 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/4162004268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 0x7fe76410c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/4162004268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764073460 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 -- 172.21.15.138:0/4162004268 >> 172.21.15.138:0/4162004268 conn(0x7fe7640fbcf0 msgr2=0x7fe7640fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 -- 172.21.15.138:0/4162004268 shutdown_connections 2024-02-15T23:00:39.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.565+0000 7fe76c3e8700 1 -- 172.21.15.138:0/4162004268 wait complete. 2024-02-15T23:00:39.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 Processor -- start 2024-02-15T23:00:39.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 -- start start 2024-02-15T23:00:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 0x7fe764198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe764198b70 con 0x7fe764073090 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76c3e8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76419c900 con 0x7fe7640739a0 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76a184700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76a184700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58144/0 (socket says 172.21.15.138:58144) 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe76a184700 1 -- 172.21.15.138:0/1261828922 learned_addr learned my addr 172.21.15.138:0/1261828922 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.566+0000 7fe769983700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 0x7fe764198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76a184700 1 -- 172.21.15.138:0/1261828922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 msgr2=0x7fe764198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76a184700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 0x7fe764198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76a184700 1 -- 172.21.15.138:0/1261828922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600095f0 con 0x7fe764073090 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76a184700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe76000bb10 tx=0x7fe76000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76001d070 con 0x7fe764073090 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76419cb80 con 0x7fe764073090 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe760003d10 con 0x7fe764073090 2024-02-15T23:00:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe760021410 con 0x7fe764073090 2024-02-15T23:00:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.567+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76419d070 con 0x7fe764073090 2024-02-15T23:00:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.568+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764109c30 con 0x7fe764073090 2024-02-15T23:00:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.569+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe76000f460 con 0x7fe764073090 2024-02-15T23:00:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.569+0000 7fe75b7fe700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 0x7fe75006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.570+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe76008e5d0 con 0x7fe764073090 2024-02-15T23:00:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.570+0000 7fe769983700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 0x7fe75006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.570+0000 7fe769983700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 0x7fe75006fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe764199570 tx=0x7fe754009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.578+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe760057d80 con 0x7fe764073090 2024-02-15T23:00:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.844+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe76419d350 con 0x7fe764073090 2024-02-15T23:00:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.845+0000 7fe75b7fe700 1 -- 172.21.15.138:0/1261828922 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1845 (secure 0 0 0) 0x7fe76005b440 con 0x7fe764073090 2024-02-15T23:00:39.847 INFO:teuthology.orchestra.run.smithi138.stdout:e28 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 25 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T23:00:29.288140+0000 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T23:00:39.848 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 81 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:up {} 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:failed 0,1 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T23:00:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:Standby daemons: 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6828/4266863139,v1:172.21.15.138:6829/4266863139] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{-1:44251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/4288390842,v1:172.21.15.170:6827/4288390842] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:39.850 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{-1:44259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6824/3599825155,v1:172.21.15.170:6825/3599825155] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 msgr2=0x7fe75006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 0x7fe75006fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe764199570 tx=0x7fe754009260 comp rx=0 tx=0).stop 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 msgr2=0x7fe764197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe76000bb10 tx=0x7fe76000bb40 comp rx=0 tx=0).stop 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 shutdown_connections 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe75006d8a0 0x7fe75006fd50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe764073090 0x7fe764197f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 --2- 172.21.15.138:0/1261828922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7640739a0 0x7fe764198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 >> 172.21.15.138:0/1261828922 conn(0x7fe7640fbcf0 msgr2=0x7fe764106d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 shutdown_connections 2024-02-15T23:00:39.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.847+0000 7fe76c3e8700 1 -- 172.21.15.138:0/1261828922 wait complete. 2024-02-15T23:00:39.852 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-02-15T23:00:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.955+0000 7f977f469700 1 -- 172.21.15.138:0/1698325608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100430 msgr2=0x7f9778100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.955+0000 7f977f469700 1 --2- 172.21.15.138:0/1698325608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100430 0x7f9778100800 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9774009910 tx=0x7f9774009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 -- 172.21.15.138:0/1698325608 shutdown_connections 2024-02-15T23:00:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 --2- 172.21.15.138:0/1698325608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100d40 0x7f97781094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 --2- 172.21.15.138:0/1698325608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100430 0x7f9778100800 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 -- 172.21.15.138:0/1698325608 >> 172.21.15.138:0/1698325608 conn(0x7f97780748b0 msgr2=0x7f9778074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 -- 172.21.15.138:0/1698325608 shutdown_connections 2024-02-15T23:00:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 -- 172.21.15.138:0/1698325608 wait complete. 2024-02-15T23:00:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 Processor -- start 2024-02-15T23:00:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.956+0000 7f977f469700 1 -- start start 2024-02-15T23:00:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977f469700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 0x7f9778101510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977f469700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977f469700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778101f90 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977f469700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97781020d0 con 0x7f9778100430 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58156/0 (socket says 172.21.15.138:58156) 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 -- 172.21.15.138:0/3535705538 learned_addr learned my addr 172.21.15.138:0/3535705538 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977d205700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 0x7f9778101510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 -- 172.21.15.138:0/3535705538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 msgr2=0x7f9778101510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 0x7f9778101510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 -- 172.21.15.138:0/3535705538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740095f0 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977d205700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 0x7f9778101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977ca04700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f976800d8d0 tx=0x7f976800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97680098a0 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.957+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97781a1e20 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.958+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97781a22b0 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.958+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9768010460 con 0x7f9778100d40 2024-02-15T23:00:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.958+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976800f5f0 con 0x7f9778100d40 2024-02-15T23:00:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.959+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c005320 con 0x7f9778100d40 2024-02-15T23:00:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.959+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9768009a00 con 0x7f9778100d40 2024-02-15T23:00:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.959+0000 7f976e7fc700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 0x7f976406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.960+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f976808d260 con 0x7f9778100d40 2024-02-15T23:00:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.960+0000 7f977d205700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 0x7f976406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:39.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.960+0000 7f977d205700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 0x7f976406fd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9774006010 tx=0x7f977401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:39.964+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9768056a90 con 0x7f9778100d40 2024-02-15T23:00:40.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.205+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f975c000bf0 con 0x7f976406d8a0 2024-02-15T23:00:40.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.207+0000 7f976e7fc700 1 -- 172.21.15.138:0/3535705538 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f975c000bf0 con 0x7f976406d8a0 2024-02-15T23:00:40.210 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:00:40.210 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T23:00:40.210 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T23:00:40.210 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T23:00:40.210 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: "osd", 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T23:00:40.211 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "12/23 daemons upgraded", 2024-02-15T23:00:40.212 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T23:00:40.212 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T23:00:40.212 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:00:40.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 msgr2=0x7f976406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 0x7f976406fd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9774006010 tx=0x7f977401a040 comp rx=0 tx=0).stop 2024-02-15T23:00:40.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 msgr2=0x7f9778101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f976800d8d0 tx=0x7f976800dbe0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 shutdown_connections 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f976406d8a0 0x7f976406fd50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9778100430 0x7f9778101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 --2- 172.21.15.138:0/3535705538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9778100d40 0x7f9778101a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 >> 172.21.15.138:0/3535705538 conn(0x7f97780748b0 msgr2=0x7f97780ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 shutdown_connections 2024-02-15T23:00:40.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.209+0000 7f977f469700 1 -- 172.21.15.138:0/3535705538 wait complete. 2024-02-15T23:00:40.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.319+0000 7f4f533e2700 1 -- 172.21.15.138:0/4270006571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 msgr2=0x7f4f4c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.319+0000 7f4f533e2700 1 --2- 172.21.15.138:0/4270006571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c1094a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009910 tx=0x7f4f3c009c20 comp rx=0 tx=0).stop 2024-02-15T23:00:40.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- 172.21.15.138:0/4270006571 shutdown_connections 2024-02-15T23:00:40.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 --2- 172.21.15.138:0/4270006571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c1094a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 --2- 172.21.15.138:0/4270006571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- 172.21.15.138:0/4270006571 >> 172.21.15.138:0/4270006571 conn(0x7f4f4c0748b0 msgr2=0x7f4f4c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:40.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- 172.21.15.138:0/4270006571 shutdown_connections 2024-02-15T23:00:40.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- 172.21.15.138:0/4270006571 wait complete. 2024-02-15T23:00:40.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 Processor -- start 2024-02-15T23:00:40.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- start start 2024-02-15T23:00:40.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:40.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c19c620 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.320+0000 7f4f533e2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c195ad0 con 0x7f4f4c100430 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5117e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58166/0 (socket says 172.21.15.138:58166) 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 -- 172.21.15.138:0/482958458 learned_addr learned my addr 172.21.15.138:0/482958458 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 -- 172.21.15.138:0/482958458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 msgr2=0x7f4f4c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 -- 172.21.15.138:0/482958458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0095f0 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5117e700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f5097d700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c005f50 tx=0x7f4f3c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c01d070 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c195d50 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f3c00b610 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c022470 con 0x7f4f4c100d40 2024-02-15T23:00:40.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.321+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c196320 con 0x7f4f4c100d40 2024-02-15T23:00:40.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.322+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c107e10 con 0x7f4f4c100d40 2024-02-15T23:00:40.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.324+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f4f3c003780 con 0x7f4f4c100d40 2024-02-15T23:00:40.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.324+0000 7f4f427fc700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 0x7f4f3806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:00:40.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.324+0000 7f4f5117e700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 0x7f4f3806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:00:40.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.324+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4f3c08ea70 con 0x7f4f4c100d40 2024-02-15T23:00:40.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.325+0000 7f4f5117e700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 0x7f4f3806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f48011490 tx=0x7f4f48009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:00:40.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.328+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f3c05bf30 con 0x7f4f4c100d40 2024-02-15T23:00:40.419 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:40.419 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:40.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:boot 2024-02-15T23:00:40.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:00:40.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:40.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3704340663' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:40.420 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:40 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1261828922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:00:40.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.642+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f4c04ea50 con 0x7f4f4c100d40 2024-02-15T23:00:40.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.643+0000 7f4f427fc700 1 -- 172.21.15.138:0/482958458 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f4f3c05bac0 con 0x7f4f4c100d40 2024-02-15T23:00:40.645 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-15T23:00:40.645 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T23:00:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: fs cephfs is degraded 2024-02-15T23:00:40.646 INFO:teuthology.orchestra.run.smithi138.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T23:00:40.646 INFO:teuthology.orchestra.run.smithi138.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-15T23:00:40.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 msgr2=0x7f4f3806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 0x7f4f3806fd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f48011490 tx=0x7f4f48009260 comp rx=0 tx=0).stop 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 msgr2=0x7f4f4c19bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c005f50 tx=0x7f4f3c00f690 comp rx=0 tx=0).stop 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 shutdown_connections 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f4f3806d8a0 0x7f4f3806fd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f4c100430 0x7f4f4c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 --2- 172.21.15.138:0/482958458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f4c100d40 0x7f4f4c19bf90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 >> 172.21.15.138:0/482958458 conn(0x7f4f4c0748b0 msgr2=0x7f4f4c0ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 shutdown_connections 2024-02-15T23:00:40.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:00:40.645+0000 7f4f533e2700 1 -- 172.21.15.138:0/482958458 wait complete. 2024-02-15T23:00:40.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:boot 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3704340663' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:40.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:40 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1261828922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:00:41.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:41 smithi138 ceph-mon[89527]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:41.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:41 smithi138 ceph-mon[89527]: pgmap v176: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:41.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:41.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:41 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/482958458' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:00:41.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:41 smithi170 ceph-mon[67652]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:00:41.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:41 smithi170 ceph-mon[67652]: pgmap v176: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:41.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:41.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:41 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/482958458' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:00:43.718 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:43 smithi138 ceph-mon[89527]: pgmap v177: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:43.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:43 smithi170 ceph-mon[67652]: pgmap v177: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:45 smithi138 ceph-mon[89527]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:45.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:45 smithi170 ceph-mon[67652]: pgmap v178: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:45.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:00:46.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:46 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:46.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:46 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:46.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:46 smithi138 ceph-mon[89527]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:47.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:46 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:47.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:46 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:47.012 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:46 smithi170 ceph-mon[67652]: pgmap v179: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:49.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:49.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:49.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:49.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:49.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:49.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: pgmap v180: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:00:49.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:50.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:50.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:50 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.591 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:50.591 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.591 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.591 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:50.591 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:50 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:00:51.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:51 smithi138 ceph-mon[89527]: pgmap v181: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:51.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:51 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:51.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:51 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:00:51.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:51 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:51 smithi170 ceph-mon[67652]: pgmap v181: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:51 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:51 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi138.fzypgq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:00:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:51 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:00:52.639 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:52 smithi138 ceph-mon[89527]: Upgrade: Updating mds.cephfs.smithi138.fzypgq 2024-02-15T23:00:52.639 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:52 smithi138 ceph-mon[89527]: Deploying daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T23:00:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:52 smithi170 ceph-mon[67652]: Upgrade: Updating mds.cephfs.smithi138.fzypgq 2024-02-15T23:00:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:52 smithi170 ceph-mon[67652]: Deploying daemon mds.cephfs.smithi138.fzypgq on smithi138 2024-02-15T23:00:53.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:53 smithi138 ceph-mon[89527]: pgmap v182: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:53 smithi170 ceph-mon[67652]: pgmap v182: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:54 smithi138 ceph-mon[89527]: osdmap e83: 6 total, 6 up, 6 in 2024-02-15T23:00:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:54 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:00:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:54 smithi170 ceph-mon[67652]: osdmap e83: 6 total, 6 up, 6 in 2024-02-15T23:00:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:54 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:00:55.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:55 smithi170 ceph-mon[67652]: pgmap v184: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:55.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:55 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:00:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:55 smithi138 ceph-mon[89527]: pgmap v184: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:55 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:00:57.464 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:57 smithi138 ceph-mon[89527]: pgmap v185: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:57 smithi170 ceph-mon[67652]: pgmap v185: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:59.671 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:59 smithi138 ceph-mon[89527]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:59.671 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:59 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:59.671 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:59 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:59.671 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:00:59 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:00:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:59 smithi170 ceph-mon[67652]: pgmap v186: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:00:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:59 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:59.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:59 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:00:59.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:00:59 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:00.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:00 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:boot 2024-02-15T23:01:00.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:00 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:00.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:01:00.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:00 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:boot 2024-02-15T23:01:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:00 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:01:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:01.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:01 smithi138 ceph-mon[89527]: pgmap v187: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:01 smithi170 ceph-mon[67652]: pgmap v187: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:03 smithi138 ceph-mon[89527]: pgmap v188: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:03.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:03 smithi170 ceph-mon[67652]: pgmap v188: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:05.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:05.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:05.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:05 smithi138 ceph-mon[89527]: pgmap v189: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:05.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:05.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:05 smithi170 ceph-mon[67652]: pgmap v189: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:06.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:06 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:06.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:06 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:06 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:06.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:06 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:07.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:07 smithi138 ceph-mon[89527]: pgmap v190: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:07 smithi170 ceph-mon[67652]: pgmap v190: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:09.620 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: pgmap v191: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.621 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: pgmap v191: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:10.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 -- 172.21.15.138:0/4244499565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 msgr2=0x7f52481007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:10.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 --2- 172.21.15.138:0/4244499565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f52481007a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5238009910 tx=0x7f5238009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 -- 172.21.15.138:0/4244499565 shutdown_connections 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 --2- 172.21.15.138:0/4244499565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 0x7f5248104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 --2- 172.21.15.138:0/4244499565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f52481007a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 -- 172.21.15.138:0/4244499565 >> 172.21.15.138:0/4244499565 conn(0x7f52480fbc50 msgr2=0x7f52480fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 -- 172.21.15.138:0/4244499565 shutdown_connections 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.764+0000 7f524e77d700 1 -- 172.21.15.138:0/4244499565 wait complete. 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 Processor -- start 2024-02-15T23:01:10.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 -- start start 2024-02-15T23:01:10.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:10.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 0x7f5248073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248073ad0 con 0x7f52481003d0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f524e77d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248073c10 con 0x7f5248100d70 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.765+0000 7f5247fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44494/0 (socket says 172.21.15.138:44494) 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 -- 172.21.15.138:0/743205641 learned_addr learned my addr 172.21.15.138:0/743205641 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f52477fe700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 0x7f5248073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 -- 172.21.15.138:0/743205641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 msgr2=0x7f5248073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 0x7f5248073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 -- 172.21.15.138:0/743205641 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380095f0 con 0x7f52481003d0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f5247fff700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5238005f50 tx=0x7f523800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523801d070 con 0x7f52481003d0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5248073e90 con 0x7f52481003d0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f523800b610 con 0x7f52481003d0 2024-02-15T23:01:10.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5238022470 con 0x7f52481003d0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.766+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52481a22b0 con 0x7f52481003d0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.767+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52481086e0 con 0x7f52481003d0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.768+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5238003780 con 0x7f52481003d0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.768+0000 7f52457fa700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 0x7f523006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.768+0000 7f52477fe700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 0x7f523006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.768+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f523808e900 con 0x7f52481003d0 2024-02-15T23:01:10.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.769+0000 7f52477fe700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 0x7f523006fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5248074840 tx=0x7f523c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:10.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.773+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f52380580b0 con 0x7f52481003d0 2024-02-15T23:01:10.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.988+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5248061190 con 0x7f523006d8a0 2024-02-15T23:01:10.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.990+0000 7f52457fa700 1 -- 172.21.15.138:0/743205641 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5248061190 con 0x7f523006d8a0 2024-02-15T23:01:10.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 msgr2=0x7f523006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:10.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 0x7f523006fd50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5248074840 tx=0x7f523c009260 comp rx=0 tx=0).stop 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 msgr2=0x7f5248073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5238005f50 tx=0x7f523800f690 comp rx=0 tx=0).stop 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 shutdown_connections 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f523006d8a0 0x7f523006fd50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52481003d0 0x7f5248073050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 --2- 172.21.15.138:0/743205641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5248100d70 0x7f5248073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 >> 172.21.15.138:0/743205641 conn(0x7f52480fbc50 msgr2=0x7f52480fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 shutdown_connections 2024-02-15T23:01:10.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:10.992+0000 7f524e77d700 1 -- 172.21.15.138:0/743205641 wait complete. 2024-02-15T23:01:11.005 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- 172.21.15.138:0/2044102364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ff2d0 msgr2=0x7f14340ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 --2- 172.21.15.138:0/2044102364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ff2d0 0x7f14340ff6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1424009910 tx=0x7f1424009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- 172.21.15.138:0/2044102364 shutdown_connections 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 --2- 172.21.15.138:0/2044102364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ffc70 0x7f1434103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 --2- 172.21.15.138:0/2044102364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ff2d0 0x7f14340ff6a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- 172.21.15.138:0/2044102364 >> 172.21.15.138:0/2044102364 conn(0x7f14340fabb0 msgr2=0x7f14340fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- 172.21.15.138:0/2044102364 shutdown_connections 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- 172.21.15.138:0/2044102364 wait complete. 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 Processor -- start 2024-02-15T23:01:11.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.105+0000 7f143a957700 1 -- start start 2024-02-15T23:01:11.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f143a957700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 0x7f1434195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f143a957700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 0x7f14341962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f143a957700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341969a0 con 0x7f14340ffc70 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f143a957700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143419a730 con 0x7f14340ff2d0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f14337fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 0x7f14341962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f14337fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 0x7f14341962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44510/0 (socket says 172.21.15.138:44510) 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f1433fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 0x7f1434195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f14337fe700 1 -- 172.21.15.138:0/2181347877 learned_addr learned my addr 172.21.15.138:0/2181347877 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f1433fff700 1 -- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 msgr2=0x7f14341962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f1433fff700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 0x7f14341962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.106+0000 7f1433fff700 1 -- 172.21.15.138:0/2181347877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240095f0 con 0x7f14340ff2d0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f1433fff700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 0x7f1434195d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1424009910 tx=0x7f142401cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1424021070 con 0x7f14340ff2d0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1424005dc0 con 0x7f14340ff2d0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143419a9b0 con 0x7f14340ff2d0 2024-02-15T23:01:11.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f142400f690 con 0x7f14340ff2d0 2024-02-15T23:01:11.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.107+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143419aea0 con 0x7f14340ff2d0 2024-02-15T23:01:11.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.108+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143404ea50 con 0x7f14340ff2d0 2024-02-15T23:01:11.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.108+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f142400bbb0 con 0x7f14340ff2d0 2024-02-15T23:01:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.109+0000 7f14317fa700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 0x7f141c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.109+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1424092b10 con 0x7f14340ff2d0 2024-02-15T23:01:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.109+0000 7f14337fe700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 0x7f141c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.109+0000 7f14337fe700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 0x7f141c06fd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14341973a0 tx=0x7f142800b480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.113+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f142405c2c0 con 0x7f14340ff2d0 2024-02-15T23:01:11.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.330+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f143419b420 con 0x7f141c06d8a0 2024-02-15T23:01:11.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.331+0000 7f14317fa700 1 -- 172.21.15.138:0/2181347877 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f143419b420 con 0x7f141c06d8a0 2024-02-15T23:01:11.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 msgr2=0x7f141c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 0x7f141c06fd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14341973a0 tx=0x7f142800b480 comp rx=0 tx=0).stop 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 msgr2=0x7f1434195d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 0x7f1434195d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1424009910 tx=0x7f142401cdc0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 shutdown_connections 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f141c06d8a0 0x7f141c06fd50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14340ff2d0 0x7f1434195d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 --2- 172.21.15.138:0/2181347877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14340ffc70 0x7f14341962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 >> 172.21.15.138:0/2181347877 conn(0x7f14340fabb0 msgr2=0x7f14340fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 shutdown_connections 2024-02-15T23:01:11.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.333+0000 7f143a957700 1 -- 172.21.15.138:0/2181347877 wait complete. 2024-02-15T23:01:11.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 -- 172.21.15.138:0/2799007823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 msgr2=0x7fb998104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 --2- 172.21.15.138:0/2799007823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998104d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb988009910 tx=0x7fb988009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 -- 172.21.15.138:0/2799007823 shutdown_connections 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 --2- 172.21.15.138:0/2799007823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998104d40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 --2- 172.21.15.138:0/2799007823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb9981007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 -- 172.21.15.138:0/2799007823 >> 172.21.15.138:0/2799007823 conn(0x7fb9980fbc90 msgr2=0x7fb9980fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 -- 172.21.15.138:0/2799007823 shutdown_connections 2024-02-15T23:01:11.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.439+0000 7fb99fa75700 1 -- 172.21.15.138:0/2799007823 wait complete. 2024-02-15T23:01:11.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:11 smithi138 ceph-mon[89527]: pgmap v192: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:11.442 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:11.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:01:11.443 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:11.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 Processor -- start 2024-02-15T23:01:11.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 -- start start 2024-02-15T23:01:11.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998073ad0 con 0x7fb998100d70 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99fa75700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998073c10 con 0x7fb9981003d0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99d811700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99d010700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99d811700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.138:38336/0 (socket says 172.21.15.138:38336) 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99d010700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44536/0 (socket says 172.21.15.138:44536) 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.440+0000 7fb99d811700 1 -- 172.21.15.138:0/1412008231 learned_addr learned my addr 172.21.15.138:0/1412008231 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99d811700 1 -- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 msgr2=0x7fb998073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99d811700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99d811700 1 -- 172.21.15.138:0/1412008231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880095f0 con 0x7fb9981003d0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99d010700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99d811700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ef10 tx=0x7fb99000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99000c9f0 con 0x7fb9981003d0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb99000f040 con 0x7fb9981003d0 2024-02-15T23:01:11.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb998073e90 con 0x7fb9981003d0 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9900146b0 con 0x7fb9981003d0 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.441+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9981a22a0 con 0x7fb9981003d0 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.442+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb998108740 con 0x7fb9981003d0 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.442+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb99000cb50 con 0x7fb9981003d0 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.443+0000 7fb98effd700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 0x7fb98406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.443+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb99008d7b0 con 0x7fb9981003d0 2024-02-15T23:01:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.443+0000 7fb99d010700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 0x7fb98406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.443+0000 7fb99d010700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 0x7fb98406fd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb988005b40 tx=0x7fb988005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.448+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb990056fe0 con 0x7fb9981003d0 2024-02-15T23:01:11.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.654+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb99802cca0 con 0x7fb98406d8a0 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.665+0000 7fb98effd700 1 -- 172.21.15.138:0/1412008231 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb99802cca0 con 0x7fb98406d8a0 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (7m) 7s ago 18m 24.8M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (18m) 7s ago 18m 9214k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (17m) 48s ago 17m 8812k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (4m) 7s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (4m) 48s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (6m) 7s ago 17m 85.7M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:01:11.668 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (33s) 7s ago 12m 13.4M - 19.0.0-1450-gf78a58c0 f081f847070a 61785145664d 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (13s) 7s ago 12m 13.4M - 19.0.0-1450-gf78a58c0 f081f847070a bba42a1d8492 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (12m) 48s ago 12m 121M - 18.2.0 dc2bc1663786 ba7b4da5ce9d 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (12m) 48s ago 12m 60.6M - 18.2.0 dc2bc1663786 4dff4df6e74d 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (9m) 7s ago 19m 508M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (8m) 48s ago 17m 452M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (5m) 7s ago 19m 56.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (4m) 48s ago 17m 43.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 7s ago 18m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 48s ago 17m 16.7M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (3m) 7s ago 16m 97.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (3m) 7s ago 15m 102M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (2m) 7s ago 15m 84.0M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (117s) 48s ago 15m 97.2M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:01:11.669 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (84s) 48s ago 14m 102M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:01:11.670 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (51s) 48s ago 14m 12.4M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 142b7035a2a9 2024-02-15T23:01:11.670 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (8m) 7s ago 17m 71.7M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 msgr2=0x7fb98406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 0x7fb98406fd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb988005b40 tx=0x7fb988005a90 comp rx=0 tx=0).stop 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 msgr2=0x7fb998073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ef10 tx=0x7fb99000c3a0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 shutdown_connections 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb98406d8a0 0x7fb98406fd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9981003d0 0x7fb998073050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 --2- 172.21.15.138:0/1412008231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb998100d70 0x7fb998073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 >> 172.21.15.138:0/1412008231 conn(0x7fb9980fbc90 msgr2=0x7fb9980fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 shutdown_connections 2024-02-15T23:01:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.668+0000 7fb99fa75700 1 -- 172.21.15.138:0/1412008231 wait complete. 2024-02-15T23:01:11.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:11 smithi170 ceph-mon[67652]: pgmap v192: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:11.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:11 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:11.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:11 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.banvev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:01:11.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:11 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:11.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.772+0000 7f67b76a5700 1 -- 172.21.15.138:0/3475307502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 msgr2=0x7f67b00ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.772+0000 7f67b76a5700 1 --2- 172.21.15.138:0/3475307502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b00ff690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009910 tx=0x7f67ac009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.772+0000 7f67b76a5700 1 -- 172.21.15.138:0/3475307502 shutdown_connections 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.772+0000 7f67b76a5700 1 --2- 172.21.15.138:0/3475307502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 0x7f67b0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.772+0000 7f67b76a5700 1 --2- 172.21.15.138:0/3475307502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b00ff690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- 172.21.15.138:0/3475307502 >> 172.21.15.138:0/3475307502 conn(0x7f67b00fab80 msgr2=0x7f67b00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- 172.21.15.138:0/3475307502 shutdown_connections 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- 172.21.15.138:0/3475307502 wait complete. 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 Processor -- start 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- start start 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 0x7f67b01962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0196920 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.773+0000 7f67b76a5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0196a60 con 0x7f67b00ffc60 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44550/0 (socket says 172.21.15.138:44550) 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 -- 172.21.15.138:0/996147958 learned_addr learned my addr 172.21.15.138:0/996147958 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b4c40700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 0x7f67b01962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 -- 172.21.15.138:0/996147958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 msgr2=0x7f67b01962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 0x7f67b01962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 -- 172.21.15.138:0/996147958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0095f0 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b5441700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b5c0 tx=0x7f67ac00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac01d070 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67ac00f460 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac017630 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b019a850 con 0x7f67b00ff2c0 2024-02-15T23:01:11.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.774+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b019ad40 con 0x7f67b00ff2c0 2024-02-15T23:01:11.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.775+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b004ea50 con 0x7f67b00ff2c0 2024-02-15T23:01:11.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.776+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f67ac00f5d0 con 0x7f67b00ff2c0 2024-02-15T23:01:11.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.776+0000 7f67a67fc700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 0x7f679c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:11.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.776+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f67ac08e9d0 con 0x7f67b00ff2c0 2024-02-15T23:01:11.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.776+0000 7f67b4c40700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 0x7f679c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:11.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.777+0000 7f67b4c40700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 0x7f679c06fd50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67b01973b0 tx=0x7f67a000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:11.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:11.781+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f67ac058200 con 0x7f67b00ff2c0 2024-02-15T23:01:12.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.059+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67b019b2a0 con 0x7f67b00ff2c0 2024-02-15T23:01:12.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.060+0000 7f67a67fc700 1 -- 172.21.15.138:0/996147958 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7f67ac05b8c0 con 0x7f67b00ff2c0 2024-02-15T23:01:12.062 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:01:12.062 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:01:12.062 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:01:12.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 12 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:01:12.063 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:01:12.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 msgr2=0x7f679c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 0x7f679c06fd50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67b01973b0 tx=0x7f67a000a380 comp rx=0 tx=0).stop 2024-02-15T23:01:12.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 msgr2=0x7f67b0195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b5c0 tx=0x7f67ac00bd50 comp rx=0 tx=0).stop 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 shutdown_connections 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f679c06d8a0 0x7f679c06fd50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b00ff2c0 0x7f67b0195d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 --2- 172.21.15.138:0/996147958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67b00ffc60 0x7f67b01962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 >> 172.21.15.138:0/996147958 conn(0x7f67b00fab80 msgr2=0x7f67b0068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 shutdown_connections 2024-02-15T23:01:12.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.063+0000 7f67b76a5700 1 -- 172.21.15.138:0/996147958 wait complete. 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 -- 172.21.15.138:0/2558219645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 msgr2=0x7ff770103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 --2- 172.21.15.138:0/2558219645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff770103cf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff764009910 tx=0x7ff764009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 -- 172.21.15.138:0/2558219645 shutdown_connections 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 --2- 172.21.15.138:0/2558219645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff770103cf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 --2- 172.21.15.138:0/2558219645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 0x7ff7700ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 -- 172.21.15.138:0/2558219645 >> 172.21.15.138:0/2558219645 conn(0x7ff7700fac20 msgr2=0x7ff7700fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 -- 172.21.15.138:0/2558219645 shutdown_connections 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 -- 172.21.15.138:0/2558219645 wait complete. 2024-02-15T23:01:12.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.167+0000 7ff77671c700 1 Processor -- start 2024-02-15T23:01:12.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff77671c700 1 -- start start 2024-02-15T23:01:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff77671c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 0x7ff770195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff77671c700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff77671c700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701969a0 con 0x7ff7700ffd20 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff77671c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77019a730 con 0x7ff7700ff380 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 0x7ff770195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44568/0 (socket says 172.21.15.138:44568) 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 -- 172.21.15.138:0/3328245968 learned_addr learned my addr 172.21.15.138:0/3328245968 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 -- 172.21.15.138:0/3328245968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 msgr2=0x7ff770195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 0x7ff770195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 -- 172.21.15.138:0/3328245968 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640095f0 con 0x7ff7700ffd20 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.168+0000 7ff76f7fe700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7640059d0 tx=0x7ff76400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.169+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff76401d070 con 0x7ff7700ffd20 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.169+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff76400b610 con 0x7ff7700ffd20 2024-02-15T23:01:12.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.169+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff764022470 con 0x7ff7700ffd20 2024-02-15T23:01:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.169+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77019a9b0 con 0x7ff7700ffd20 2024-02-15T23:01:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.169+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77019aea0 con 0x7ff7700ffd20 2024-02-15T23:01:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.170+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77004ea50 con 0x7ff7700ffd20 2024-02-15T23:01:12.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.170+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff764003710 con 0x7ff7700ffd20 2024-02-15T23:01:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.171+0000 7ff76d7fa700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 0x7ff75806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.171+0000 7ff76ffff700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 0x7ff75806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.171+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff76408ea00 con 0x7ff7700ffd20 2024-02-15T23:01:12.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.171+0000 7ff76ffff700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 0x7ff75806fd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff760010d80 tx=0x7ff760012040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.175+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff7640581b0 con 0x7ff7700ffd20 2024-02-15T23:01:12.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.418+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff77019b240 con 0x7ff7700ffd20 2024-02-15T23:01:12.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.418+0000 7ff76d7fa700 1 -- 172.21.15.138:0/3328245968 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) v1 ==== 76+0+1667 (secure 0 0 0) 0x7ff76405b870 con 0x7ff7700ffd20 2024-02-15T23:01:12.421 INFO:teuthology.orchestra.run.smithi138.stdout:e31 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T23:01:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 25 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T23:00:29.288140+0000 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T23:01:12.423 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 81 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:up {} 2024-02-15T23:01:12.424 INFO:teuthology.orchestra.run.smithi138.stdout:failed 0,1 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout:Standby daemons: 2024-02-15T23:01:12.425 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:12.426 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:12.426 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{-1:34424} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:12.426 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{-1:44251} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/4288390842,v1:172.21.15.170:6827/4288390842] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 msgr2=0x7ff75806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 0x7ff75806fd50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff760010d80 tx=0x7ff760012040 comp rx=0 tx=0).stop 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 msgr2=0x7ff7701962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff7640059d0 tx=0x7ff76400f690 comp rx=0 tx=0).stop 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 shutdown_connections 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff75806d8a0 0x7ff75806fd50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7700ff380 0x7ff770195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.420+0000 7ff77671c700 1 --2- 172.21.15.138:0/3328245968 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7700ffd20 0x7ff7701962c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.421+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 >> 172.21.15.138:0/3328245968 conn(0x7ff7700fac20 msgr2=0x7ff770068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.421+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 shutdown_connections 2024-02-15T23:01:12.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.421+0000 7ff77671c700 1 -- 172.21.15.138:0/3328245968 wait complete. 2024-02-15T23:01:12.428 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 31 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 -- 172.21.15.138:0/3898989757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 msgr2=0x7f5da410a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 --2- 172.21.15.138:0/3898989757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da410a130 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009910 tx=0x7f5d98009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 -- 172.21.15.138:0/3898989757 shutdown_connections 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 --2- 172.21.15.138:0/3898989757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da410a130 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 --2- 172.21.15.138:0/3898989757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 0x7f5da41016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 -- 172.21.15.138:0/3898989757 >> 172.21.15.138:0/3898989757 conn(0x7f5da40fab80 msgr2=0x7f5da40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 -- 172.21.15.138:0/3898989757 shutdown_connections 2024-02-15T23:01:12.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.526+0000 7f5da938b700 1 -- 172.21.15.138:0/3898989757 wait complete. 2024-02-15T23:01:12.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 Processor -- start 2024-02-15T23:01:12.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 -- start start 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 0x7f5da419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da419c680 con 0x7f5da4101c30 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da938b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4195b30 con 0x7f5da4101320 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da27fc700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44588/0 (socket says 172.21.15.138:44588) 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da27fc700 1 -- 172.21.15.138:0/609632078 learned_addr learned my addr 172.21.15.138:0/609632078 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.527+0000 7f5da2ffd700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 0x7f5da419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da27fc700 1 -- 172.21.15.138:0/609632078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 msgr2=0x7f5da419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da27fc700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 0x7f5da419bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da27fc700 1 -- 172.21.15.138:0/609632078 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980095f0 con 0x7f5da4101c30 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da27fc700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d98005f50 tx=0x7f5d9800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9801d070 con 0x7f5da4101c30 2024-02-15T23:01:12.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4195db0 con 0x7f5da4101c30 2024-02-15T23:01:12.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d9800b610 con 0x7f5da4101c30 2024-02-15T23:01:12.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d98022470 con 0x7f5da4101c30 2024-02-15T23:01:12.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.528+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da41962a0 con 0x7f5da4101c30 2024-02-15T23:01:12.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.529+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da41077a0 con 0x7f5da4101c30 2024-02-15T23:01:12.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.529+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5d98003780 con 0x7f5da4101c30 2024-02-15T23:01:12.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.530+0000 7f5d8bfff700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 0x7f5d8c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.530+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5d9808e830 con 0x7f5da4101c30 2024-02-15T23:01:12.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.530+0000 7f5da2ffd700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 0x7f5d8c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.530+0000 7f5da2ffd700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 0x7f5d8c06fd50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009c60 tx=0x7f5d94009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.535+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d9805bb90 con 0x7f5da4101c30 2024-02-15T23:01:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:12 smithi138 ceph-mon[89527]: Upgrade: Updating mds.cephfs.smithi170.banvev 2024-02-15T23:01:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:12 smithi138 ceph-mon[89527]: Deploying daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T23:01:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:12 smithi138 ceph-mon[89527]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:12 smithi138 ceph-mon[89527]: from='client.44297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:12.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:12 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/996147958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:12.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.750+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5da402ccf0 con 0x7f5d8c06d8a0 2024-02-15T23:01:12.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.751+0000 7f5d8bfff700 1 -- 172.21.15.138:0/609632078 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5da402ccf0 con 0x7f5d8c06d8a0 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "osd", 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr", 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: "mon" 2024-02-15T23:01:12.754 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T23:01:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "14/23 daemons upgraded", 2024-02-15T23:01:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T23:01:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T23:01:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:01:12.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.753+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 msgr2=0x7f5d8c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.753+0000 7f5da938b700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 0x7f5d8c06fd50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009c60 tx=0x7f5d94009260 comp rx=0 tx=0).stop 2024-02-15T23:01:12.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 msgr2=0x7f5da419bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d98005f50 tx=0x7f5d9800f690 comp rx=0 tx=0).stop 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 shutdown_connections 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5d8c06d8a0 0x7f5d8c06fd50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5da4101320 0x7f5da419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 --2- 172.21.15.138:0/609632078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5da4101c30 0x7f5da419bff0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 >> 172.21.15.138:0/609632078 conn(0x7f5da40fab80 msgr2=0x7f5da41048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 shutdown_connections 2024-02-15T23:01:12.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.754+0000 7f5da938b700 1 -- 172.21.15.138:0/609632078 wait complete. 2024-02-15T23:01:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:12 smithi170 ceph-mon[67652]: Upgrade: Updating mds.cephfs.smithi170.banvev 2024-02-15T23:01:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:12 smithi170 ceph-mon[67652]: Deploying daemon mds.cephfs.smithi170.banvev on smithi170 2024-02-15T23:01:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:12 smithi170 ceph-mon[67652]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:12 smithi170 ceph-mon[67652]: from='client.44297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:12.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:12 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/996147958' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- 172.21.15.138:0/929406966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 msgr2=0x7f7af81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 --2- 172.21.15.138:0/929406966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af81007a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009910 tx=0x7f7af4009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- 172.21.15.138:0/929406966 shutdown_connections 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 --2- 172.21.15.138:0/929406966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 0x7f7af8104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 --2- 172.21.15.138:0/929406966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af81007a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- 172.21.15.138:0/929406966 >> 172.21.15.138:0/929406966 conn(0x7f7af80fbc90 msgr2=0x7f7af80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- 172.21.15.138:0/929406966 shutdown_connections 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- 172.21.15.138:0/929406966 wait complete. 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 Processor -- start 2024-02-15T23:01:12.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.858+0000 7f7b0008d700 1 -- start start 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 0x7f7af8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8198b40 con 0x7f7af81003d0 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af819c8d0 con 0x7f7af8100d70 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44616/0 (socket says 172.21.15.138:44616) 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 -- 172.21.15.138:0/1185612394 learned_addr learned my addr 172.21.15.138:0/1185612394 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afd628700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 0x7f7af8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 -- 172.21.15.138:0/1185612394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 msgr2=0x7f7af8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 0x7f7af8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 -- 172.21.15.138:0/1185612394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40095f0 con 0x7f7af81003d0 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7afde29700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7af400b5c0 tx=0x7f7af400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af401d070 con 0x7f7af81003d0 2024-02-15T23:01:12.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7af400f460 con 0x7f7af81003d0 2024-02-15T23:01:12.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af819cb50 con 0x7f7af81003d0 2024-02-15T23:01:12.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7af4017610 con 0x7f7af81003d0 2024-02-15T23:01:12.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.859+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af819d040 con 0x7f7af81003d0 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.860+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af81044c0 con 0x7f7af81003d0 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.861+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f7af400f5d0 con 0x7f7af81003d0 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.861+0000 7f7aeeffd700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 0x7f7ae406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.861+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7af408eb50 con 0x7f7af81003d0 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.861+0000 7f7afd628700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 0x7f7ae406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:12.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.862+0000 7f7afd628700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 0x7f7ae406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8005fd0 tx=0x7f7ae800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:12.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:12.866+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7af4058300 con 0x7f7af81003d0 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.143+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7af804ea50 con 0x7f7af81003d0 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.143+0000 7f7aeeffd700 1 -- 172.21.15.138:0/1185612394 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7af405b9c0 con 0x7f7af81003d0 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stdout: fs cephfs is degraded 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-15T23:01:13.146 INFO:teuthology.orchestra.run.smithi138.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-15T23:01:13.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 msgr2=0x7f7ae406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:13.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 0x7f7ae406fd50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8005fd0 tx=0x7f7ae800a560 comp rx=0 tx=0).stop 2024-02-15T23:01:13.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 msgr2=0x7f7af8197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:13.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7af400b5c0 tx=0x7f7af400be00 comp rx=0 tx=0).stop 2024-02-15T23:01:13.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 shutdown_connections 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f7ae406d8a0 0x7f7ae406fd50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7af81003d0 0x7f7af8197f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 --2- 172.21.15.138:0/1185612394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7af8100d70 0x7f7af8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 >> 172.21.15.138:0/1185612394 conn(0x7f7af80fbc90 msgr2=0x7f7af80fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 shutdown_connections 2024-02-15T23:01:13.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:13.146+0000 7f7b0008d700 1 -- 172.21.15.138:0/1185612394 wait complete. 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: pgmap v193: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: osdmap e84: 6 total, 6 up, 6 in 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3328245968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:01:13.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:13 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1185612394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:01:13.578 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:13.578 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: pgmap v193: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:13.578 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: osdmap e84: 6 total, 6 up, 6 in 2024-02-15T23:01:13.578 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:01:13.579 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3328245968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:01:13.579 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:13 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1185612394' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:01:14.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:14 smithi170 ceph-mon[67652]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:14.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:14 smithi138 ceph-mon[89527]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:15.635 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:15 smithi138 ceph-mon[89527]: pgmap v195: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:15.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:15.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:15.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:15.636 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:15.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:15 smithi170 ceph-mon[67652]: pgmap v195: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:15.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:15.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:15.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:15.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:16 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.170:6824/411044474,v1:172.21.15.170:6825/411044474] up:boot 2024-02-15T23:01:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:16 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:16.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:16 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:01:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:16 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.170:6824/411044474,v1:172.21.15.170:6825/411044474] up:boot 2024-02-15T23:01:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:16 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:16.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:16 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:01:17.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:17 smithi170 ceph-mon[67652]: pgmap v196: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:17 smithi138 ceph-mon[89527]: pgmap v196: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:19.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:19 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:19.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:19 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:19.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:19 smithi138 ceph-mon[89527]: pgmap v197: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:19 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:19 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:19.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:19 smithi170 ceph-mon[67652]: pgmap v197: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:20.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:20 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:20.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:20 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:20.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:20 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:20.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:20 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:21.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:21 smithi138 ceph-mon[89527]: pgmap v198: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:21.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:21 smithi170 ceph-mon[67652]: pgmap v198: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: pgmap v199: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.622 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.623 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.623 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:23 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: pgmap v199: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:23.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:23 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:25.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:25 smithi170 ceph-mon[67652]: pgmap v200: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:25.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:25.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:01:25.624 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:25 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:25 smithi138 ceph-mon[89527]: pgmap v200: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi170.cbefkf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T23:01:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:25 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:26.422 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:26 smithi170 ceph-mon[67652]: Upgrade: Updating mds.cephfs.smithi170.cbefkf 2024-02-15T23:01:26.422 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:26 smithi170 ceph-mon[67652]: Deploying daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T23:01:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:26 smithi138 ceph-mon[89527]: Upgrade: Updating mds.cephfs.smithi170.cbefkf 2024-02-15T23:01:26.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:26 smithi138 ceph-mon[89527]: Deploying daemon mds.cephfs.smithi170.cbefkf on smithi170 2024-02-15T23:01:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:27 smithi138 ceph-mon[89527]: pgmap v201: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:27 smithi138 ceph-mon[89527]: osdmap e85: 6 total, 6 up, 6 in 2024-02-15T23:01:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:27 smithi170 ceph-mon[67652]: pgmap v201: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:27.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:27 smithi170 ceph-mon[67652]: osdmap e85: 6 total, 6 up, 6 in 2024-02-15T23:01:28.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:28 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:01:28.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:28 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-15T23:01:29.455 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:29 smithi170 ceph-mon[67652]: pgmap v203: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:29 smithi138 ceph-mon[89527]: pgmap v203: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:30.486 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:30.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:31.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:31 smithi138 ceph-mon[89527]: pgmap v204: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:31.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:31.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:31.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:31 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:31.650 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:31 smithi170 ceph-mon[67652]: pgmap v204: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:31.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:31.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:31.651 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:31 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:32.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:32 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.170:6826/85754605,v1:172.21.15.170:6827/85754605] up:boot 2024-02-15T23:01:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:32 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:32.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:32 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:01:32.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:32 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.170:6826/85754605,v1:172.21.15.170:6827/85754605] up:boot 2024-02-15T23:01:32.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:32 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:32.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:32 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:01:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:33 smithi138 ceph-mon[89527]: pgmap v205: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:33 smithi170 ceph-mon[67652]: pgmap v205: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:34.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:34.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:34 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:34.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:34 smithi138 ceph-mon[89527]: pgmap v206: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:34 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:35.011 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:34 smithi170 ceph-mon[67652]: pgmap v206: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:35.910 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:35 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:35.910 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:35 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:35.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:35 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:35.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:35 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:36.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:36 smithi170 ceph-mon[67652]: pgmap v207: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:36.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:36 smithi138 ceph-mon[89527]: pgmap v207: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:39.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: pgmap v208: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.485 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.bnqzne"}]': finished 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.fzypgq"}]': finished 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:01:39.486 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.banvev"}]': finished 2024-02-15T23:01:39.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:01:39.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.cbefkf"}]': finished 2024-02-15T23:01:39.487 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:39 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: pgmap v208: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.bnqzne"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.bnqzne"}]': finished 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.fzypgq"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi138.fzypgq"}]': finished 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.banvev"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.banvev"}]': finished 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.cbefkf"}]: dispatch 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi170.cbefkf"}]': finished 2024-02-15T23:01:39.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:39 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T23:01:40.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all mds 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: Standby daemon mds.cephfs.smithi138.bnqzne assigned to filesystem cephfs as rank 0 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: Standby daemon mds.cephfs.smithi138.fzypgq assigned to filesystem cephfs as rank 1 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:replay} 2 up:standby 2024-02-15T23:01:40.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:40 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-15T23:01:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all mds 2024-02-15T23:01:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T23:01:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T23:01:40.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: Standby daemon mds.cephfs.smithi138.bnqzne assigned to filesystem cephfs as rank 0 2024-02-15T23:01:40.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: Standby daemon mds.cephfs.smithi138.fzypgq assigned to filesystem cephfs as rank 1 2024-02-15T23:01:40.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T23:01:40.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-15T23:01:40.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:replay} 2 up:standby 2024-02-15T23:01:40.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:40 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: pgmap v209: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:replay} 2 up:standby 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:41.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:41 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: pgmap v209: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:replay} 2 up:standby 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:41.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:41 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:42.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:42 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all rgw 2024-02-15T23:01:42.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:42 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T23:01:42.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:42 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all rgw 2024-02-15T23:01:42.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:42 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all rbd-mirror 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 -- 172.21.15.138:0/196659762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 msgr2=0x7fb098103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 --2- 172.21.15.138:0/196659762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098103c30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009910 tx=0x7fb08c009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 -- 172.21.15.138:0/196659762 shutdown_connections 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 --2- 172.21.15.138:0/196659762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098103c30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 --2- 172.21.15.138:0/196659762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 0x7fb0980ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 -- 172.21.15.138:0/196659762 >> 172.21.15.138:0/196659762 conn(0x7fb0980fab60 msgr2=0x7fb0980fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:43.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 -- 172.21.15.138:0/196659762 shutdown_connections 2024-02-15T23:01:43.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.308+0000 7fb09e02d700 1 -- 172.21.15.138:0/196659762 wait complete. 2024-02-15T23:01:43.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.309+0000 7fb09e02d700 1 Processor -- start 2024-02-15T23:01:43.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb09e02d700 1 -- start start 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb09e02d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 0x7fb0981949f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb09e02d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb09e02d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098195550 con 0x7fb0980ffc60 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb09e02d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0981956c0 con 0x7fb0980ff2c0 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb096ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb096ffd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:56388/0 (socket says 172.21.15.138:56388) 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb096ffd700 1 -- 172.21.15.138:0/3547929403 learned_addr learned my addr 172.21.15.138:0/3547929403 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.310+0000 7fb0977fe700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 0x7fb0981949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb096ffd700 1 -- 172.21.15.138:0/3547929403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 msgr2=0x7fb0981949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb096ffd700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 0x7fb0981949f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb096ffd700 1 -- 172.21.15.138:0/3547929403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0095f0 con 0x7fb0980ffc60 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb096ffd700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c01d070 con 0x7fb0980ffc60 2024-02-15T23:01:43.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb08c022470 con 0x7fb0980ffc60 2024-02-15T23:01:43.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.311+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb08c017650 con 0x7fb0980ffc60 2024-02-15T23:01:43.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.312+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb098199a40 con 0x7fb0980ffc60 2024-02-15T23:01:43.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.312+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb098199ea0 con 0x7fb0980ffc60 2024-02-15T23:01:43.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.313+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09804ea50 con 0x7fb0980ffc60 2024-02-15T23:01:43.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.314+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb08c005080 con 0x7fb0980ffc60 2024-02-15T23:01:43.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.315+0000 7fb094ff9700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.315+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb08c08e8c0 con 0x7fb0980ffc60 2024-02-15T23:01:43.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.315+0000 7fb0977fe700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.316+0000 7fb0977fe700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb088009c60 tx=0x7fb088009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:43.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.324+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb08c0580f0 con 0x7fb0980ffc60 2024-02-15T23:01:43.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: pgmap v210: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 3 op/s 2024-02-15T23:01:43.446 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: Upgrade: Updating ceph-exporter.smithi138 (1/2) 2024-02-15T23:01:43.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:43.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T23:01:43.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:43.447 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:43 smithi138 ceph-mon[89527]: Deploying daemon ceph-exporter.smithi138 on smithi138 2024-02-15T23:01:43.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.685+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0980fcea0 con 0x7fb08006d8a0 2024-02-15T23:01:43.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.686+0000 7fb094ff9700 1 -- 172.21.15.138:0/3547929403 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb0980fcea0 con 0x7fb08006d8a0 2024-02-15T23:01:43.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 msgr2=0x7fb08006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb088009c60 tx=0x7fb088009260 comp rx=0 tx=0).stop 2024-02-15T23:01:43.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 msgr2=0x7fb098194f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c00f690 comp rx=0 tx=0).stop 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 shutdown_connections 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb08006d8a0 0x7fb08006fd50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb0980ff2c0 0x7fb0981949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 --2- 172.21.15.138:0/3547929403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb0980ffc60 0x7fb098194f30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 >> 172.21.15.138:0/3547929403 conn(0x7fb0980fab60 msgr2=0x7fb0980fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.689+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 shutdown_connections 2024-02-15T23:01:43.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.690+0000 7fb09e02d700 1 -- 172.21.15.138:0/3547929403 wait complete. 2024-02-15T23:01:43.702 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T23:01:43.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: pgmap v210: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 8.3 MiB/s rd, 3 op/s 2024-02-15T23:01:43.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: Upgrade: Updating ceph-exporter.smithi138 (1/2) 2024-02-15T23:01:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi138", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T23:01:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:43.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:43 smithi170 ceph-mon[67652]: Deploying daemon ceph-exporter.smithi138 on smithi138 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 -- 172.21.15.138:0/3688367164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 msgr2=0x7fce740ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 --2- 172.21.15.138:0/3688367164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce740ff760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fce64009910 tx=0x7fce64009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 -- 172.21.15.138:0/3688367164 shutdown_connections 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 --2- 172.21.15.138:0/3688367164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 0x7fce74103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 --2- 172.21.15.138:0/3688367164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce740ff760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.808+0000 7fce7914f700 1 -- 172.21.15.138:0/3688367164 >> 172.21.15.138:0/3688367164 conn(0x7fce74074f50 msgr2=0x7fce74075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:43.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.809+0000 7fce7914f700 1 -- 172.21.15.138:0/3688367164 shutdown_connections 2024-02-15T23:01:43.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.809+0000 7fce7914f700 1 -- 172.21.15.138:0/3688367164 wait complete. 2024-02-15T23:01:43.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.809+0000 7fce7914f700 1 Processor -- start 2024-02-15T23:01:43.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce7914f700 1 -- start start 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce7914f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce7914f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 0x7fce74197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce7914f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741977b0 con 0x7fce740ff390 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce7914f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74197920 con 0x7fce740ffd30 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.810+0000 7fce72d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce72d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38662/0 (socket says 172.21.15.138:38662) 2024-02-15T23:01:43.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce72d9d700 1 -- 172.21.15.138:0/2706982807 learned_addr learned my addr 172.21.15.138:0/2706982807 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:43.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce7259c700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 0x7fce74197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce72d9d700 1 -- 172.21.15.138:0/2706982807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 msgr2=0x7fce74197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:43.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce72d9d700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 0x7fce74197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:43.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.811+0000 7fce72d9d700 1 -- 172.21.15.138:0/2706982807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640095f0 con 0x7fce740ff390 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.812+0000 7fce72d9d700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce6400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.812+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6401d070 con 0x7fce740ff390 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.812+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce74194a10 con 0x7fce740ff390 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.812+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce74194e40 con 0x7fce740ff390 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.813+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce64004fb0 con 0x7fce740ff390 2024-02-15T23:01:43.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.813+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6400f690 con 0x7fce740ff390 2024-02-15T23:01:43.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.814+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce60005320 con 0x7fce740ff390 2024-02-15T23:01:43.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.814+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fce64004af0 con 0x7fce740ff390 2024-02-15T23:01:43.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.815+0000 7fce5bfff700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 0x7fce5c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:43.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.815+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fce6408ea40 con 0x7fce740ff390 2024-02-15T23:01:43.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.815+0000 7fce7259c700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 0x7fce5c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:43.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.816+0000 7fce7259c700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 0x7fce5c06fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce74069020 tx=0x7fce68005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:43.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:43.822+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce64058280 con 0x7fce740ff390 2024-02-15T23:01:44.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.123+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce60000bf0 con 0x7fce5c06d8a0 2024-02-15T23:01:44.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.124+0000 7fce5bfff700 1 -- 172.21.15.138:0/2706982807 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fce60000bf0 con 0x7fce5c06d8a0 2024-02-15T23:01:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 msgr2=0x7fce5c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 0x7fce5c06fd50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce74069020 tx=0x7fce68005d50 comp rx=0 tx=0).stop 2024-02-15T23:01:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 msgr2=0x7fce74196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce64006010 tx=0x7fce6400be20 comp rx=0 tx=0).stop 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 shutdown_connections 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fce5c06d8a0 0x7fce5c06fd50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce740ff390 0x7fce74196c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 --2- 172.21.15.138:0/2706982807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce740ffd30 0x7fce74197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 >> 172.21.15.138:0/2706982807 conn(0x7fce74074f50 msgr2=0x7fce740fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 shutdown_connections 2024-02-15T23:01:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.128+0000 7fce7914f700 1 -- 172.21.15.138:0/2706982807 wait complete. 2024-02-15T23:01:44.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 -- 172.21.15.138:0/3954130148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ff320 msgr2=0x7fa04c0ff6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 --2- 172.21.15.138:0/3954130148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ff320 0x7fa04c0ff6f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa048009940 tx=0x7fa048009c50 comp rx=0 tx=0).stop 2024-02-15T23:01:44.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 -- 172.21.15.138:0/3954130148 shutdown_connections 2024-02-15T23:01:44.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 --2- 172.21.15.138:0/3954130148 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ffc30 0x7fa04c10a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 --2- 172.21.15.138:0/3954130148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ff320 0x7fa04c0ff6f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.242+0000 7fa05383a700 1 -- 172.21.15.138:0/3954130148 >> 172.21.15.138:0/3954130148 conn(0x7fa04c0748b0 msgr2=0x7fa04c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.243+0000 7fa05383a700 1 -- 172.21.15.138:0/3954130148 shutdown_connections 2024-02-15T23:01:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.243+0000 7fa05383a700 1 -- 172.21.15.138:0/3954130148 wait complete. 2024-02-15T23:01:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.243+0000 7fa05383a700 1 Processor -- start 2024-02-15T23:01:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.243+0000 7fa05383a700 1 -- start start 2024-02-15T23:01:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa05383a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ff320 0x7fa04c100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa05383a700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa05383a700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c1022b0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa05383a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c102420 con 0x7fa04c0ff320 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38692/0 (socket says 172.21.15.138:38692) 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 -- 172.21.15.138:0/314723580 learned_addr learned my addr 172.21.15.138:0/314723580 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa0515d6700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ff320 0x7fa04c100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 -- 172.21.15.138:0/314723580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ff320 msgr2=0x7fa04c100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ff320 0x7fa04c100500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.244+0000 7fa050dd5700 1 -- 172.21.15.138:0/314723580 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480095f0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa050dd5700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00d8d0 tx=0x7fa03c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03c0098a0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c101040 con 0x7fa04c0ffc30 2024-02-15T23:01:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c1a67d0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa03c010460 con 0x7fa04c0ffc30 2024-02-15T23:01:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.245+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03c00f5f0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.246+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c107da0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.247+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa03c009a00 con 0x7fa04c0ffc30 2024-02-15T23:01:44.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.248+0000 7fa0427fc700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 0x7fa03806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.248+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa03c08d3b0 con 0x7fa04c0ffc30 2024-02-15T23:01:44.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.248+0000 7fa0515d6700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 0x7fa03806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.249+0000 7fa0515d6700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 0x7fa03806fda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa048009910 tx=0x7fa048005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:44.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.253+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa03c056b40 con 0x7fa04c0ffc30 2024-02-15T23:01:44.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.608+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa04c02ccf0 con 0x7fa03806d8f0 2024-02-15T23:01:44.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.629+0000 7fa0427fc700 1 -- 172.21.15.138:0/314723580 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa04c02ccf0 con 0x7fa03806d8f0 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (8m) 40s ago 18m 24.8M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (19m) 40s ago 19m 9214k - 18.2.0 dc2bc1663786 998d80cb9c28 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (17m) 11s ago 17m 9009k - 18.2.0 dc2bc1663786 48ff7ddd30b9 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (4m) 40s ago 19m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (4m) 11s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (7m) 40s ago 18m 85.7M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (66s) 40s ago 13m 13.4M - 19.0.0-1450-gf78a58c0 f081f847070a 61785145664d 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (46s) 40s ago 13m 13.4M - 19.0.0-1450-gf78a58c0 f081f847070a bba42a1d8492 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (30s) 11s ago 13m 13.4M - 19.0.0-1450-gf78a58c0 f081f847070a 22d02d90464f 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (14s) 11s ago 13m 12.7M - 19.0.0-1450-gf78a58c0 f081f847070a 3079ae40cdc9 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (10m) 40s ago 20m 508M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (9m) 11s ago 17m 453M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:01:44.632 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (5m) 40s ago 20m 56.0M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (5m) 11s ago 17m 48.4M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (8m) 40s ago 18m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (8m) 11s ago 17m 16.8M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (4m) 40s ago 16m 97.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (3m) 40s ago 16m 102M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (3m) 40s ago 15m 84.0M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (2m) 11s ago 15m 98.5M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (117s) 11s ago 15m 104M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (84s) 11s ago 14m 92.1M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 142b7035a2a9 2024-02-15T23:01:44.633 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (8m) 40s ago 18m 71.7M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 msgr2=0x7fa03806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 0x7fa03806fda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa048009910 tx=0x7fa048005a90 comp rx=0 tx=0).stop 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 msgr2=0x7fa04c100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00d8d0 tx=0x7fa03c00dbe0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 shutdown_connections 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa03806d8f0 0x7fa03806fda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0ff320 0x7fa04c100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 --2- 172.21.15.138:0/314723580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa04c0ffc30 0x7fa04c100a40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 >> 172.21.15.138:0/314723580 conn(0x7fa04c0748b0 msgr2=0x7fa04c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 shutdown_connections 2024-02-15T23:01:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.632+0000 7fa05383a700 1 -- 172.21.15.138:0/314723580 wait complete. 2024-02-15T23:01:44.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.786+0000 7f04e272b700 1 -- 172.21.15.138:0/3643690407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 msgr2=0x7f04dc103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 --2- 172.21.15.138:0/3643690407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc103c30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009910 tx=0x7f04d0009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:44.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 -- 172.21.15.138:0/3643690407 shutdown_connections 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 --2- 172.21.15.138:0/3643690407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc103c30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 --2- 172.21.15.138:0/3643690407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 0x7f04dc0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 -- 172.21.15.138:0/3643690407 >> 172.21.15.138:0/3643690407 conn(0x7f04dc0fab80 msgr2=0x7f04dc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 -- 172.21.15.138:0/3643690407 shutdown_connections 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.787+0000 7f04e272b700 1 -- 172.21.15.138:0/3643690407 wait complete. 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.788+0000 7f04e272b700 1 Processor -- start 2024-02-15T23:01:44.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.788+0000 7f04e272b700 1 -- start start 2024-02-15T23:01:44.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04e272b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 0x7f04dc194930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04e272b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04e272b700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc069b00 con 0x7f04dc0ffc60 2024-02-15T23:01:44.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04e272b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1953b0 con 0x7f04dc0ff2c0 2024-02-15T23:01:44.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38708/0 (socket says 172.21.15.138:38708) 2024-02-15T23:01:44.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04db7fe700 1 -- 172.21.15.138:0/3111652504 learned_addr learned my addr 172.21.15.138:0/3111652504 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:44.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.789+0000 7f04dbfff700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 0x7f04dc194930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04db7fe700 1 -- 172.21.15.138:0/3111652504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 msgr2=0x7f04dc194930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04db7fe700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 0x7f04dc194930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04db7fe700 1 -- 172.21.15.138:0/3111652504 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00095f0 con 0x7f04dc0ffc60 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04db7fe700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04d000f690 tx=0x7f04d000f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d001d070 con 0x7f04dc0ffc60 2024-02-15T23:01:44.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.790+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04d00050d0 con 0x7f04dc0ffc60 2024-02-15T23:01:44.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.791+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d00226a0 con 0x7f04dc0ffc60 2024-02-15T23:01:44.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.791+0000 7f04e272b700 1 -- 172.21.15.138:0/3111652504 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc195630 con 0x7f04dc0ffc60 2024-02-15T23:01:44.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.792+0000 7f04e272b700 1 -- 172.21.15.138:0/3111652504 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1a2170 con 0x7f04dc0ffc60 2024-02-15T23:01:44.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.793+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc04ea50 con 0x7f04dc0ffc60 2024-02-15T23:01:44.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.794+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f04d000fbd0 con 0x7f04dc0ffc60 2024-02-15T23:01:44.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.795+0000 7f04d97fa700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 0x7f04c406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:44.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.795+0000 7f04dbfff700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 0x7f04c406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:44.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.795+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f04d008eb60 con 0x7f04dc0ffc60 2024-02-15T23:01:44.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.796+0000 7f04dbfff700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 0x7f04c406fb90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009bf0 tx=0x7f04cc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:44.799+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f04d005be20 con 0x7f04dc0ffc60 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:01:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.295+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f04dc1007a0 con 0x7f04dc0ffc60 2024-02-15T23:01:45.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.296+0000 7f04d97fa700 1 -- 172.21.15.138:0/3111652504 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f04d005b9b0 con 0x7f04dc0ffc60 2024-02-15T23:01:45.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.299+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 msgr2=0x7f04c406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.299+0000 7f04c2ffd700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 0x7f04c406fb90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009bf0 tx=0x7f04cc009260 comp rx=0 tx=0).stop 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.299+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 msgr2=0x7f04dc194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.299+0000 7f04c2ffd700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04d000f690 tx=0x7f04d000f770 comp rx=0 tx=0).stop 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 shutdown_connections 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f04c406d6e0 0x7f04c406fb90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc0ff2c0 0x7f04dc194930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 --2- 172.21.15.138:0/3111652504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04dc0ffc60 0x7f04dc194e70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 >> 172.21.15.138:0/3111652504 conn(0x7f04dc0fab80 msgr2=0x7f04dc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 shutdown_connections 2024-02-15T23:01:45.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.300+0000 7f04c2ffd700 1 -- 172.21.15.138:0/3111652504 wait complete. 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/830221321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ffc60 msgr2=0x7fc3b4103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/830221321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ffc60 0x7fc3b4103c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009910 tx=0x7fc3a4009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/830221321 shutdown_connections 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/830221321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ffc60 0x7fc3b4103c30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/830221321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b40ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/830221321 >> 172.21.15.138:0/830221321 conn(0x7fc3b40fab80 msgr2=0x7fc3b40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/830221321 shutdown_connections 2024-02-15T23:01:45.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.468+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/830221321 wait complete. 2024-02-15T23:01:45.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.469+0000 7fc3bb8d9700 1 Processor -- start 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.469+0000 7fc3bb8d9700 1 -- start start 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3bb8d9700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3bb8d9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ffc60 0x7fc3b419af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3bb8d9700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b419b5f0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3bb8d9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4194aa0 con 0x7fc3b40ffc60 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b8e74700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ffc60 0x7fc3b419af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38718/0 (socket says 172.21.15.138:38718) 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 -- 172.21.15.138:0/459044336 learned_addr learned my addr 172.21.15.138:0/459044336 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 -- 172.21.15.138:0/459044336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ffc60 msgr2=0x7fc3b419af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ffc60 0x7fc3b419af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.470+0000 7fc3b9675700 1 -- 172.21.15.138:0/459044336 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40095f0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3b9675700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e920 tx=0x7fc3b000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:45.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b000c9d0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3b0010430 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b4194d80 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41952a0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.471+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b0018630 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.473+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4107630 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.473+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc3b00105a0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.474+0000 7fc3aa7fc700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 0x7fc3a006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:45.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.474+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc3b0014070 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.474+0000 7fc3b8e74700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 0x7fc3a006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:45.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.475+0000 7fc3b8e74700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 0x7fc3a006fd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40059d0 tx=0x7fc3a4005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:45.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.479+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3b0052d20 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: pgmap v211: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:45.668 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:45 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3111652504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:45.708 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:45.708 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:45.709 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: pgmap v211: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-15T23:01:45.709 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:45.709 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:01:45.709 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:45 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3111652504' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:01:45.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.928+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3b404ea50 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.929+0000 7fc3aa7fc700 1 -- 172.21.15.138:0/459044336 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1899 (secure 0 0 0) 0x7fc3b005aad0 con 0x7fc3b40ff2c0 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:e37 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 37 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T23:01:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T23:01:39.414828+0000 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 81 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T23:01:45.933 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=34404,1=34424} 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:34404} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{1:34424} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:45.934 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:45.935 INFO:teuthology.orchestra.run.smithi138.stdout:Standby daemons: 2024-02-15T23:01:45.935 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:01:45.935 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6824/411044474,v1:172.21.15.170:6825/411044474] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:45.935 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/85754605,v1:172.21.15.170:6827/85754605] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:01:45.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.932+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 msgr2=0x7fc3a006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.932+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 0x7fc3a006fd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40059d0 tx=0x7fc3a4005940 comp rx=0 tx=0).stop 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.932+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 msgr2=0x7fc3b419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.932+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e920 tx=0x7fc3b000ec30 comp rx=0 tx=0).stop 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 shutdown_connections 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc3a006d8a0 0x7fc3a006fd50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc3b40ff2c0 0x7fc3b419aa20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 --2- 172.21.15.138:0/459044336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3b40ffc60 0x7fc3b419af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 >> 172.21.15.138:0/459044336 conn(0x7fc3b40fab80 msgr2=0x7fc3b40fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 shutdown_connections 2024-02-15T23:01:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:45.933+0000 7fc3bb8d9700 1 -- 172.21.15.138:0/459044336 wait complete. 2024-02-15T23:01:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 37 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 -- 172.21.15.138:0/3486587082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 msgr2=0x7f68a41016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/3486587082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a41016f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009910 tx=0x7f68a0009c20 comp rx=0 tx=0).stop 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 -- 172.21.15.138:0/3486587082 shutdown_connections 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/3486587082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 0x7f68a410a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/3486587082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a41016f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.048+0000 7f68ab9c4700 1 -- 172.21.15.138:0/3486587082 >> 172.21.15.138:0/3486587082 conn(0x7f68a40fab80 msgr2=0x7f68a40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.049+0000 7f68ab9c4700 1 -- 172.21.15.138:0/3486587082 shutdown_connections 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.049+0000 7f68ab9c4700 1 -- 172.21.15.138:0/3486587082 wait complete. 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.049+0000 7f68ab9c4700 1 Processor -- start 2024-02-15T23:01:46.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.049+0000 7f68ab9c4700 1 -- start start 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68ab9c4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68ab9c4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 0x7f68a4196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68ab9c4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4196970 con 0x7f68a4101320 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68ab9c4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a419a700 con 0x7f68a4101c30 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38734/0 (socket says 172.21.15.138:38734) 2024-02-15T23:01:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 -- 172.21.15.138:0/834054458 learned_addr learned my addr 172.21.15.138:0/834054458 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a8f5f700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 0x7f68a4196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 -- 172.21.15.138:0/834054458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 msgr2=0x7f68a4196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 0x7f68a4196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.050+0000 7f68a9760700 1 -- 172.21.15.138:0/834054458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00095f0 con 0x7f68a4101320 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f68a9760700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68a00092e0 tx=0x7f68a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a001d070 con 0x7f68a4101320 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a419a980 con 0x7f68a4101320 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a419ae70 con 0x7f68a4101320 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68a0005e00 con 0x7f68a4101320 2024-02-15T23:01:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.051+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a0017400 con 0x7f68a4101320 2024-02-15T23:01:46.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.052+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6888005320 con 0x7f68a4101320 2024-02-15T23:01:46.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.053+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f68a0003a60 con 0x7f68a4101320 2024-02-15T23:01:46.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.053+0000 7f689a7fc700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 0x7f689006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.053+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f68a008e8f0 con 0x7f68a4101320 2024-02-15T23:01:46.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.053+0000 7f68a8f5f700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 0x7f689006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.054+0000 7f68a8f5f700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 0x7f689006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f68a4197370 tx=0x7f689400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:46.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.058+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f68a00580c0 con 0x7f68a4101320 2024-02-15T23:01:46.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.398+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6888000bf0 con 0x7f689006d8a0 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": true, 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [ 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "crash", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "mon", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "osd", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "mds", 2024-02-15T23:01:46.406 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr" 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": "16/23 daemons upgraded", 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:01:46.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.402+0000 7f689a7fc700 1 -- 172.21.15.138:0/834054458 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f6888000bf0 con 0x7f689006d8a0 2024-02-15T23:01:46.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 msgr2=0x7f689006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 0x7f689006fd50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f68a4197370 tx=0x7f689400b410 comp rx=0 tx=0).stop 2024-02-15T23:01:46.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 msgr2=0x7f68a4195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f68a00092e0 tx=0x7f68a000bd70 comp rx=0 tx=0).stop 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 shutdown_connections 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f689006d8a0 0x7f689006fd50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4101320 0x7f68a4195d50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 --2- 172.21.15.138:0/834054458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4101c30 0x7f68a4196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.406+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 >> 172.21.15.138:0/834054458 conn(0x7f68a40fab80 msgr2=0x7f68a4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.407+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 shutdown_connections 2024-02-15T23:01:46.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.407+0000 7f68ab9c4700 1 -- 172.21.15.138:0/834054458 wait complete. 2024-02-15T23:01:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 -- 172.21.15.138:0/2416384611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c0ff860 msgr2=0x7f946c0ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 --2- 172.21.15.138:0/2416384611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c0ff860 0x7f946c0ffcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f945c009940 tx=0x7f945c009c50 comp rx=0 tx=0).stop 2024-02-15T23:01:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 -- 172.21.15.138:0/2416384611 shutdown_connections 2024-02-15T23:01:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 --2- 172.21.15.138:0/2416384611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c0ff860 0x7f946c0ffcd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 --2- 172.21.15.138:0/2416384611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c067ed0 0x7f946c0ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.514+0000 7f9473775700 1 -- 172.21.15.138:0/2416384611 >> 172.21.15.138:0/2416384611 conn(0x7f946c0748b0 msgr2=0x7f946c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.515+0000 7f9473775700 1 -- 172.21.15.138:0/2416384611 shutdown_connections 2024-02-15T23:01:46.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.515+0000 7f9473775700 1 -- 172.21.15.138:0/2416384611 wait complete. 2024-02-15T23:01:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 Processor -- start 2024-02-15T23:01:46.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 -- start start 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 0x7f946c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c198ab0 con 0x7f946c067ed0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9473775700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c19c840 con 0x7f946c0ff860 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9471511700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9471511700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:38762/0 (socket says 172.21.15.138:38762) 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9471511700 1 -- 172.21.15.138:0/4216155772 learned_addr learned my addr 172.21.15.138:0/4216155772 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.516+0000 7f9470d10700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 0x7f946c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9471511700 1 -- 172.21.15.138:0/4216155772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 msgr2=0x7f946c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9471511700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 0x7f946c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9471511700 1 -- 172.21.15.138:0/4216155772 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0095f0 con 0x7f946c067ed0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9470d10700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 0x7f946c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9471511700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f946800c8f0 tx=0x7f946800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9468004a00 con 0x7f946c067ed0 2024-02-15T23:01:46.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9473775700 1 -- 172.21.15.138:0/4216155772 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c19cb20 con 0x7f946c067ed0 2024-02-15T23:01:46.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94680054e0 con 0x7f946c067ed0 2024-02-15T23:01:46.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.517+0000 7f9473775700 1 -- 172.21.15.138:0/4216155772 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c19d0c0 con 0x7f946c067ed0 2024-02-15T23:01:46.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.519+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9468007c90 con 0x7f946c067ed0 2024-02-15T23:01:46.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.519+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c04ea50 con 0x7f946c067ed0 2024-02-15T23:01:46.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.520+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9468004b60 con 0x7f946c067ed0 2024-02-15T23:01:46.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.520+0000 7f94627fc700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 0x7f945806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:01:46.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.521+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9468013070 con 0x7f946c067ed0 2024-02-15T23:01:46.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.521+0000 7f9470d10700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 0x7f945806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:01:46.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.523+0000 7f9470d10700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 0x7f945806fb50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f945c006010 tx=0x7f945c00b7b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:01:46.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.530+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9468056b20 con 0x7f946c067ed0 2024-02-15T23:01:46.715 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:46 smithi138 ceph-mon[89527]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:46.715 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:46 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/459044336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:01:46.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:46 smithi170 ceph-mon[67652]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:46.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:46 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/459044336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:01:46.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.890+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f946c1991f0 con 0x7f946c067ed0 2024-02-15T23:01:46.893 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_WARN 1 filesystem is degraded 2024-02-15T23:01:46.893 INFO:teuthology.orchestra.run.smithi138.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-15T23:01:46.893 INFO:teuthology.orchestra.run.smithi138.stdout: fs cephfs is degraded 2024-02-15T23:01:46.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.890+0000 7f94627fc700 1 -- 172.21.15.138:0/4216155772 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f9468004e10 con 0x7f946c067ed0 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 msgr2=0x7f945806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 0x7f945806fb50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f945c006010 tx=0x7f945c00b7b0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 msgr2=0x7f946c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f946800c8f0 tx=0x7f946800cc00 comp rx=0 tx=0).stop 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 shutdown_connections 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f945806d6a0 0x7f945806fb50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f946c067ed0 0x7f946c197e90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 --2- 172.21.15.138:0/4216155772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f946c0ff860 0x7f946c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:01:46.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 >> 172.21.15.138:0/4216155772 conn(0x7f946c0748b0 msgr2=0x7f946c0fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:01:46.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 shutdown_connections 2024-02-15T23:01:46.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:01:46.893+0000 7f9457fff700 1 -- 172.21.15.138:0/4216155772 wait complete. 2024-02-15T23:01:47.615 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:47 smithi138 ceph-mon[89527]: pgmap v212: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-15T23:01:47.615 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:47 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/4216155772' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:01:47.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:47 smithi170 ceph-mon[67652]: pgmap v212: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-15T23:01:47.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:47 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/4216155772' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:01:48.633 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:48.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:resolve 2024-02-15T23:01:48.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:resolve} 2 up:standby 2024-02-15T23:01:48.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:48.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:48.634 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:48 smithi138 ceph-mon[89527]: pgmap v213: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:01:48.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:resolve 2024-02-15T23:01:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:replay,1=cephfs.smithi138.fzypgq=up:resolve} 2 up:standby 2024-02-15T23:01:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:48 smithi170 ceph-mon[67652]: pgmap v213: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:resolve 2024-02-15T23:01:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:resolve,1=cephfs.smithi138.fzypgq=up:resolve} 2 up:standby 2024-02-15T23:01:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: Upgrade: Updating ceph-exporter.smithi170 (2/2) 2024-02-15T23:01:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:49.728 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T23:01:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:49.729 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:49 smithi170 ceph-mon[67652]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-02-15T23:01:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:resolve 2024-02-15T23:01:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:resolve,1=cephfs.smithi138.fzypgq=up:resolve} 2 up:standby 2024-02-15T23:01:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: Upgrade: Updating ceph-exporter.smithi170 (2/2) 2024-02-15T23:01:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi170", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-15T23:01:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:01:49.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:49 smithi138 ceph-mon[89527]: Deploying daemon ceph-exporter.smithi170 on smithi170 2024-02-15T23:01:50.721 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: reconnect by client.24313 v1:192.168.0.1:0/1393612965 after 0 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: reconnect by client.14524 v1:192.168.0.1:0/588191077 after 0.000999978 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: reconnect by client.14524 v1:192.168.0.1:0/588191077 after 0.000999978 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: reconnect by client.24313 v1:192.168.0.1:0/1393612965 after 0.000999978 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:reconnect 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:reconnect 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:reconnect,1=cephfs.smithi138.fzypgq=up:reconnect} 2 up:standby 2024-02-15T23:01:50.722 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:50 smithi170 ceph-mon[67652]: pgmap v214: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: reconnect by client.24313 v1:192.168.0.1:0/1393612965 after 0 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: reconnect by client.14524 v1:192.168.0.1:0/588191077 after 0.000999978 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: reconnect by client.14524 v1:192.168.0.1:0/588191077 after 0.000999978 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: reconnect by client.24313 v1:192.168.0.1:0/1393612965 after 0.000999978 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:reconnect 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:reconnect 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:reconnect,1=cephfs.smithi138.fzypgq=up:reconnect} 2 up:standby 2024-02-15T23:01:50.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:50 smithi138 ceph-mon[89527]: pgmap v214: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:51.506 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:51 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:rejoin 2024-02-15T23:01:51.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:51 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:rejoin 2024-02-15T23:01:51.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:51 smithi170 ceph-mon[67652]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:rejoin,1=cephfs.smithi138.fzypgq=up:rejoin} 2 up:standby 2024-02-15T23:01:51.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:51 smithi170 ceph-mon[67652]: daemon mds.cephfs.smithi138.fzypgq is now active in filesystem cephfs as rank 1 2024-02-15T23:01:51.507 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:51 smithi170 ceph-mon[67652]: daemon mds.cephfs.smithi138.bnqzne is now active in filesystem cephfs as rank 0 2024-02-15T23:01:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:51 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:rejoin 2024-02-15T23:01:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:51 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:rejoin 2024-02-15T23:01:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:51 smithi138 ceph-mon[89527]: fsmap cephfs:2/2 {0=cephfs.smithi138.bnqzne=up:rejoin,1=cephfs.smithi138.fzypgq=up:rejoin} 2 up:standby 2024-02-15T23:01:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:51 smithi138 ceph-mon[89527]: daemon mds.cephfs.smithi138.fzypgq is now active in filesystem cephfs as rank 1 2024-02-15T23:01:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:51 smithi138 ceph-mon[89527]: daemon mds.cephfs.smithi138.bnqzne is now active in filesystem cephfs as rank 0 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: Cluster is now healthy 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:active 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:active 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby 2024-02-15T23:01:52.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby-replay 2024-02-15T23:01:52.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:52 smithi138 ceph-mon[89527]: pgmap v215: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T23:01:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: Cluster is now healthy 2024-02-15T23:01:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] up:active 2024-02-15T23:01:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: mds.? [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] up:active 2024-02-15T23:01:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby 2024-02-15T23:01:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby-replay 2024-02-15T23:01:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:52 smithi170 ceph-mon[67652]: pgmap v215: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-02-15T23:01:54.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:54 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:54.294 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:54 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:54.295 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:54 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:54.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:54 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:54.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:54 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:54.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:54 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:01:55.446 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:55 smithi170 ceph-mon[67652]: pgmap v216: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 511 B/s wr, 9 op/s 2024-02-15T23:01:55.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:55 smithi138 ceph-mon[89527]: pgmap v216: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 511 B/s wr, 9 op/s 2024-02-15T23:01:57.421 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:57 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:57.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:57 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:57.422 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:57 smithi138 ceph-mon[89527]: pgmap v217: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 9.8 KiB/s wr, 17 op/s 2024-02-15T23:01:57.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:57 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:57.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:57 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:57.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:57 smithi170 ceph-mon[67652]: pgmap v217: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 9.8 KiB/s wr, 17 op/s 2024-02-15T23:01:58.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:58 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:58 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.875 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:58 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:58 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.876 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:58 smithi170 ceph-mon[67652]: pgmap v218: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 10 KiB/s wr, 18 op/s 2024-02-15T23:01:58.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:58 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:58 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:58 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:58 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:01:58.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:58 smithi138 ceph-mon[89527]: pgmap v218: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 10 KiB/s wr, 18 op/s 2024-02-15T23:02:00.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:01:59 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:00.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:00.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:59 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:00.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:01:59 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:01.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:01.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:01 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:01.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:01 smithi170 ceph-mon[67652]: pgmap v219: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 10 KiB/s wr, 18 op/s 2024-02-15T23:02:01.522 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:01.522 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:01 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:01.522 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:01 smithi138 ceph-mon[89527]: pgmap v219: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 10 KiB/s wr, 18 op/s 2024-02-15T23:02:03.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:03 smithi170 ceph-mon[67652]: pgmap v220: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 10 KiB/s wr, 19 op/s 2024-02-15T23:02:03.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:03 smithi138 ceph-mon[89527]: pgmap v220: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 10 KiB/s wr, 19 op/s 2024-02-15T23:02:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:05 smithi138 ceph-mon[89527]: pgmap v221: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 10 KiB/s wr, 19 op/s 2024-02-15T23:02:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:05 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:05 smithi170 ceph-mon[67652]: pgmap v221: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 10 KiB/s wr, 19 op/s 2024-02-15T23:02:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:05 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: pgmap v222: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 9.6 KiB/s wr, 16 op/s 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:07 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T23:02:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: pgmap v222: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 9.6 KiB/s wr, 16 op/s 2024-02-15T23:02:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:07.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:07 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-15T23:02:08.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T23:02:08.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T23:02:08.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby-replay 2024-02-15T23:02:08.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi138"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi138"}]': finished 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]': finished 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.513 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.514 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T23:02:08.515 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.516 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:08.517 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:08 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: Upgrade: Setting filesystem cephfs Joinable 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: fsmap cephfs:2 {0=cephfs.smithi138.bnqzne=up:active,1=cephfs.smithi138.fzypgq=up:active} 2 up:standby-replay 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi138"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi138"}]': finished 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]: dispatch 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi170"}]': finished 2024-02-15T23:02:08.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T23:02:08.736 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T23:02:08.737 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:08.738 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:08 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all iscsi 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all nfs 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Setting container_image for all nvmeof 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Finalizing container_image settings 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: Upgrade: Complete! 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: pgmap v223: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:09.687 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all ceph-exporter 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all iscsi 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all nfs 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Setting container_image for all nvmeof 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Finalizing container_image settings 2024-02-15T23:02:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: Upgrade: Complete! 2024-02-15T23:02:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: pgmap v223: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9.9 MiB/s rd, 255 B/s wr, 6 op/s 2024-02-15T23:02:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:02:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:02:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:02:09.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:11 smithi138 ceph-mon[89527]: pgmap v224: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s rd, 3 op/s 2024-02-15T23:02:11.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:11 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:11.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:11 smithi170 ceph-mon[67652]: pgmap v224: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s rd, 3 op/s 2024-02-15T23:02:11.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:11 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:02:13.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:13 smithi138 ceph-mon[89527]: pgmap v225: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 4 op/s 2024-02-15T23:02:13.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:13 smithi170 ceph-mon[67652]: pgmap v225: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 4 op/s 2024-02-15T23:02:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:15 smithi138 ceph-mon[89527]: pgmap v226: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 3 op/s 2024-02-15T23:02:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:15.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:15 smithi170 ceph-mon[67652]: pgmap v226: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 3 op/s 2024-02-15T23:02:15.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:17.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/72976241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ffc60 msgr2=0x7fd1b0103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/72976241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0103c30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd198009910 tx=0x7fd198009c20 comp rx=0 tx=0).stop 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/72976241 shutdown_connections 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/72976241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0103c30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/72976241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b00ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/72976241 >> 172.21.15.138:0/72976241 conn(0x7fd1b00fab80 msgr2=0x7fd1b00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/72976241 shutdown_connections 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.001+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/72976241 wait complete. 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 Processor -- start 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 -- start start 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b0197850 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b6cc4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b0197990 con 0x7fd1b00ffc60 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49104/0 (socket says 172.21.15.138:49104) 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 -- 172.21.15.138:0/3349549361 learned_addr learned my addr 172.21.15.138:0/3349549361 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1affff700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 -- 172.21.15.138:0/3349549361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ffc60 msgr2=0x7fd1b0197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.002+0000 7fd1b4a60700 1 -- 172.21.15.138:0/3349549361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980095f0 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1b4a60700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000b4b0 tx=0x7fd1a000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a0011800 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1a0011e20 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b019fd60 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a000f2e0 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.003+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b01a0220 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.004+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b0107560 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.004+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd1a0010380 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.004+0000 7fd1adffb700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 0x7fd19c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.005+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd1a008d110 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.005+0000 7fd1affff700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 0x7fd19c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:17.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.005+0000 7fd1affff700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 0x7fd19c06fd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd198006010 tx=0x7fd19801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:17.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.009+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1a00568c0 con 0x7fd1b00ff2c0 2024-02-15T23:02:17.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.223+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1b002cca0 con 0x7fd19c06d8a0 2024-02-15T23:02:17.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.224+0000 7fd1adffb700 1 -- 172.21.15.138:0/3349549361 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd1b002cca0 con 0x7fd19c06d8a0 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 msgr2=0x7fd19c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 0x7fd19c06fd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd198006010 tx=0x7fd19801a040 comp rx=0 tx=0).stop 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 msgr2=0x7fd1b0196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000b4b0 tx=0x7fd1a000b870 comp rx=0 tx=0).stop 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 shutdown_connections 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd19c06d8a0 0x7fd19c06fd50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b00ff2c0 0x7fd1b0196cf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 --2- 172.21.15.138:0/3349549361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1b00ffc60 0x7fd1b0197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 >> 172.21.15.138:0/3349549361 conn(0x7fd1b00fab80 msgr2=0x7fd1b00fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 shutdown_connections 2024-02-15T23:02:17.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:17.226+0000 7fd1b6cc4700 1 -- 172.21.15.138:0/3349549361 wait complete. 2024-02-15T23:02:17.605 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:17 smithi138 ceph-mon[89527]: pgmap v227: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.8 KiB/s rd, 5 op/s 2024-02-15T23:02:17.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:17 smithi170 ceph-mon[67652]: pgmap v227: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.8 KiB/s rd, 5 op/s 2024-02-15T23:02:18.011 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T23:02:18.264 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:18.617 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:18 smithi138 ceph-mon[89527]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:18.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:18 smithi170 ceph-mon[67652]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:19.619 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:19 smithi138 ceph-mon[89527]: pgmap v228: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:19.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:19 smithi170 ceph-mon[67652]: pgmap v228: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- 172.21.15.138:0/3633510806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101c30 msgr2=0x7f250c10a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 --2- 172.21.15.138:0/3633510806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101c30 0x7f250c10a130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009940 tx=0x7f24fc009c50 comp rx=0 tx=0).stop 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- 172.21.15.138:0/3633510806 shutdown_connections 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 --2- 172.21.15.138:0/3633510806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101c30 0x7f250c10a130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 --2- 172.21.15.138:0/3633510806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101320 0x7f250c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- 172.21.15.138:0/3633510806 >> 172.21.15.138:0/3633510806 conn(0x7f250c0fab80 msgr2=0x7f250c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- 172.21.15.138:0/3633510806 shutdown_connections 2024-02-15T23:02:19.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- 172.21.15.138:0/3633510806 wait complete. 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 Processor -- start 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.941+0000 7f2513e61700 1 -- start start 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2513e61700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2513e61700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101c30 0x7f250c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2513e61700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c19c680 con 0x7f250c101320 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2513e61700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c195b30 con 0x7f250c101c30 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49118/0 (socket says 172.21.15.138:49118) 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 -- 172.21.15.138:0/2051075232 learned_addr learned my addr 172.21.15.138:0/2051075232 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f25113fc700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101c30 0x7f250c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 -- 172.21.15.138:0/2051075232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101c30 msgr2=0x7f250c19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101c30 0x7f250c19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 -- 172.21.15.138:0/2051075232 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc0095f0 con 0x7f250c101320 2024-02-15T23:02:19.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2511bfd700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f250800d8d0 tx=0x7f250800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2508009940 con 0x7f250c101320 2024-02-15T23:02:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c195e10 con 0x7f250c101320 2024-02-15T23:02:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.942+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2508010460 con 0x7f250c101320 2024-02-15T23:02:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.943+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250800f5f0 con 0x7f250c101320 2024-02-15T23:02:19.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.943+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c196360 con 0x7f250c101320 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.944+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c1077a0 con 0x7f250c101320 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.944+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f25080105d0 con 0x7f250c101320 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.944+0000 7f2502ffd700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 0x7f24f806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.945+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f250808d540 con 0x7f250c101320 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.945+0000 7f25113fc700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 0x7f24f806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:19.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.945+0000 7f25113fc700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 0x7f24f806fd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f250c0fc300 tx=0x7f24fc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:19.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:19.949+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f250805a820 con 0x7f250c101320 2024-02-15T23:02:20.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.158+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f250c196640 con 0x7f24f806d8a0 2024-02-15T23:02:20.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.169+0000 7f2502ffd700 1 -- 172.21.15.138:0/2051075232 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f250c196640 con 0x7f24f806d8a0 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (8m) 22s ago 19m 24.8M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (33s) 22s ago 19m 7377k - 19.0.0-1450-gf78a58c0 f081f847070a 8c6209ea2de4 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (27s) 24s ago 18m 7105k - 19.0.0-1450-gf78a58c0 f081f847070a 6a9dc00a6c33 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (5m) 22s ago 19m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (5m) 24s ago 18m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (7m) 22s ago 19m 85.7M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (101s) 22s ago 13m 75.8M - 19.0.0-1450-gf78a58c0 f081f847070a 61785145664d 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (81s) 22s ago 13m 70.2M - 19.0.0-1450-gf78a58c0 f081f847070a bba42a1d8492 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (65s) 24s ago 13m 109M - 19.0.0-1450-gf78a58c0 f081f847070a 22d02d90464f 2024-02-15T23:02:20.172 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (49s) 24s ago 13m 133M - 19.0.0-1450-gf78a58c0 f081f847070a 3079ae40cdc9 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (10m) 22s ago 20m 510M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (9m) 24s ago 18m 453M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (6m) 22s ago 21m 56.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (6m) 24s ago 18m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (9m) 22s ago 19m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (9m) 24s ago 18m 16.3M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (4m) 22s ago 17m 104M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (4m) 22s ago 17m 114M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (3m) 22s ago 16m 91.3M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (3m) 24s ago 16m 108M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (2m) 24s ago 15m 109M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (2m) 24s ago 15m 101M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 142b7035a2a9 2024-02-15T23:02:20.173 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (9m) 22s ago 18m 71.7M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:02:20.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 msgr2=0x7f24f806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:20.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 0x7f24f806fd50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f250c0fc300 tx=0x7f24fc005a90 comp rx=0 tx=0).stop 2024-02-15T23:02:20.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 msgr2=0x7f250c19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:20.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f250800d8d0 tx=0x7f250800dc90 comp rx=0 tx=0).stop 2024-02-15T23:02:20.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 shutdown_connections 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f24f806d8a0 0x7f24f806fd50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f250c101320 0x7f250c19bab0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 --2- 172.21.15.138:0/2051075232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f250c101c30 0x7f250c19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.171+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 >> 172.21.15.138:0/2051075232 conn(0x7f250c0fab80 msgr2=0x7f250c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.172+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 shutdown_connections 2024-02-15T23:02:20.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:20.172+0000 7f2513e61700 1 -- 172.21.15.138:0/2051075232 wait complete. 2024-02-15T23:02:20.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade status' 2024-02-15T23:02:21.134 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:21.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:21 smithi138 ceph-mon[89527]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:21.550 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:21 smithi138 ceph-mon[89527]: pgmap v229: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:21 smithi170 ceph-mon[67652]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:21 smithi170 ceph-mon[67652]: pgmap v229: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 -- 172.21.15.138:0/2358760442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 msgr2=0x7f6098068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 --2- 172.21.15.138:0/2358760442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098068a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f608800b0a0 tx=0x7f608800b3b0 comp rx=0 tx=0).stop 2024-02-15T23:02:22.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 -- 172.21.15.138:0/2358760442 shutdown_connections 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 --2- 172.21.15.138:0/2358760442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 0x7f6098104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 --2- 172.21.15.138:0/2358760442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098068a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 -- 172.21.15.138:0/2358760442 >> 172.21.15.138:0/2358760442 conn(0x7f6098074f50 msgr2=0x7f6098075350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 -- 172.21.15.138:0/2358760442 shutdown_connections 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.866+0000 7f609e180700 1 -- 172.21.15.138:0/2358760442 wait complete. 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 Processor -- start 2024-02-15T23:02:22.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 -- start start 2024-02-15T23:02:22.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 0x7f60981962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098196930 con 0x7f6098068630 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f609e180700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098196a70 con 0x7f6098068fd0 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f60977fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f60977fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:49128/0 (socket says 172.21.15.138:49128) 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.867+0000 7f60977fe700 1 -- 172.21.15.138:0/434340954 learned_addr learned my addr 172.21.15.138:0/434340954 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f608effd700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 0x7f60981962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60977fe700 1 -- 172.21.15.138:0/434340954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 msgr2=0x7f60981962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60977fe700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 0x7f60981962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60977fe700 1 -- 172.21.15.138:0/434340954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088009d00 con 0x7f6098068630 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60977fe700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f608800b070 tx=0x7f608800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608800e040 con 0x7f6098068630 2024-02-15T23:02:22.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6088003de0 con 0x7f6098068630 2024-02-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609819a860 con 0x7f6098068630 2024-02-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608801d850 con 0x7f6098068630 2024-02-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.868+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609819ad50 con 0x7f6098068630 2024-02-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.869+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60981086f0 con 0x7f6098068630 2024-02-15T23:02:22.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.870+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6088004040 con 0x7f6098068630 2024-02-15T23:02:22.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.870+0000 7f60957fa700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 0x7f608406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:22.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.870+0000 7f608effd700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 0x7f608406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:22.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.870+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f608808ecc0 con 0x7f6098068630 2024-02-15T23:02:22.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.871+0000 7f608effd700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 0x7f608406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60981973c0 tx=0x7f608000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:22.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:22.875+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60880584f0 con 0x7f6098068630 2024-02-15T23:02:23.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.091+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f609802ccf0 con 0x7f608406d8a0 2024-02-15T23:02:23.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.092+0000 7f60957fa700 1 -- 172.21.15.138:0/434340954 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f609802ccf0 con 0x7f608406d8a0 2024-02-15T23:02:23.094 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:02:23.094 INFO:teuthology.orchestra.run.smithi138.stdout: "target_image": null, 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "in_progress": false, 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "which": "", 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "services_complete": [], 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "progress": null, 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "message": "", 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout: "is_paused": false 2024-02-15T23:02:23.095 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 msgr2=0x7f608406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 0x7f608406fd50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60981973c0 tx=0x7f608000a380 comp rx=0 tx=0).stop 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 msgr2=0x7f6098195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f608800b070 tx=0x7f608800cd20 comp rx=0 tx=0).stop 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 shutdown_connections 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f608406d8a0 0x7f608406fd50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6098068630 0x7f6098195da0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 --2- 172.21.15.138:0/434340954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6098068fd0 0x7f60981962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 >> 172.21.15.138:0/434340954 conn(0x7f6098074f50 msgr2=0x7f60980fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 shutdown_connections 2024-02-15T23:02:23.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:23.094+0000 7f609e180700 1 -- 172.21.15.138:0/434340954 wait complete. 2024-02-15T23:02:23.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:23 smithi138 ceph-mon[89527]: pgmap v230: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:23.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:23 smithi170 ceph-mon[67652]: pgmap v230: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:23.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph health detail' 2024-02-15T23:02:24.085 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:24.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:24 smithi138 ceph-mon[89527]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:24.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:24 smithi170 ceph-mon[67652]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:02:25.460 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:25 smithi138 ceph-mon[89527]: pgmap v231: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:25.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- 172.21.15.138:0/295491213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 msgr2=0x7f63c410a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 --2- 172.21.15.138:0/295491213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c410a610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009910 tx=0x7f63b0009c20 comp rx=0 tx=0).stop 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- 172.21.15.138:0/295491213 shutdown_connections 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 --2- 172.21.15.138:0/295491213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c410a610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 --2- 172.21.15.138:0/295491213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 0x7f63c40ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- 172.21.15.138:0/295491213 >> 172.21.15.138:0/295491213 conn(0x7f63c4074850 msgr2=0x7f63c4074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- 172.21.15.138:0/295491213 shutdown_connections 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- 172.21.15.138:0/295491213 wait complete. 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 Processor -- start 2024-02-15T23:02:25.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.730+0000 7f63cac4d700 1 -- start start 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63cac4d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 0x7f63c4195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63cac4d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63cac4d700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4196980 con 0x7f63c40ffba0 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63cac4d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c419a710 con 0x7f63c40ff290 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58658/0 (socket says 172.21.15.138:58658) 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 -- 172.21.15.138:0/1344736399 learned_addr learned my addr 172.21.15.138:0/1344736399 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c89e9700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 0x7f63c4195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:25.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 -- 172.21.15.138:0/1344736399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 msgr2=0x7f63c4195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 0x7f63c4195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 -- 172.21.15.138:0/1344736399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00095f0 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c3fff700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63b000f690 tx=0x7f63b000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b001d070 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63b00050d0 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c419a990 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.731+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b0022470 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.732+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c419ae80 con 0x7f63c40ffba0 2024-02-15T23:02:25.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.732+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c4107d10 con 0x7f63c40ffba0 2024-02-15T23:02:25.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.733+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f63b0003780 con 0x7f63c40ffba0 2024-02-15T23:02:25.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.734+0000 7f63c1ffb700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 0x7f63b406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:25.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.734+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f63b008e930 con 0x7f63c40ffba0 2024-02-15T23:02:25.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.734+0000 7f63c89e9700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 0x7f63b406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:25.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.734+0000 7f63c89e9700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 0x7f63b406fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63c406a5c0 tx=0x7f63b8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:25.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:25.739+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f63b0058190 con 0x7f63c40ffba0 2024-02-15T23:02:25.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:25 smithi170 ceph-mon[67652]: pgmap v231: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:26.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.016+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f63c404ea50 con 0x7f63c40ffba0 2024-02-15T23:02:26.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.017+0000 7f63c1ffb700 1 -- 172.21.15.138:0/1344736399 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f63b005b850 con 0x7f63c40ffba0 2024-02-15T23:02:26.019 INFO:teuthology.orchestra.run.smithi138.stdout:HEALTH_OK 2024-02-15T23:02:26.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 msgr2=0x7f63b406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:26.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 0x7f63b406fd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63c406a5c0 tx=0x7f63b8009260 comp rx=0 tx=0).stop 2024-02-15T23:02:26.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 msgr2=0x7f63c41962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63b000f690 tx=0x7f63b000f6c0 comp rx=0 tx=0).stop 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 shutdown_connections 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f63b406d8a0 0x7f63b406fd50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63c40ff290 0x7f63c4195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 --2- 172.21.15.138:0/1344736399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f63c40ffba0 0x7f63c41962a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 >> 172.21.15.138:0/1344736399 conn(0x7f63c4074850 msgr2=0x7f63c4104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 shutdown_connections 2024-02-15T23:02:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:26.019+0000 7f63cac4d700 1 -- 172.21.15.138:0/1344736399 wait complete. 2024-02-15T23:02:26.685 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:26 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1344736399' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:02:26.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-15T23:02:26.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:26 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1344736399' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-15T23:02:26.914 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:27 smithi138 ceph-mon[89527]: pgmap v232: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:27 smithi170 ceph-mon[67652]: pgmap v232: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:28.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 -- 172.21.15.138:0/575835799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07081003b0 msgr2=0x7f0708100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 --2- 172.21.15.138:0/575835799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07081003b0 0x7f0708100780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009910 tx=0x7f06f8009c20 comp rx=0 tx=0).stop 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 -- 172.21.15.138:0/575835799 shutdown_connections 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 --2- 172.21.15.138:0/575835799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0708100d50 0x7f0708104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 --2- 172.21.15.138:0/575835799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07081003b0 0x7f0708100780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 -- 172.21.15.138:0/575835799 >> 172.21.15.138:0/575835799 conn(0x7f07080fbc30 msgr2=0x7f07080fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 -- 172.21.15.138:0/575835799 shutdown_connections 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.519+0000 7f070fef4700 1 -- 172.21.15.138:0/575835799 wait complete. 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 Processor -- start 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 -- start start 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07081003b0 0x7f0708073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:28.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708073ad0 con 0x7f0708100d50 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070fef4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708073c10 con 0x7f07081003b0 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:58682/0 (socket says 172.21.15.138:58682) 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 -- 172.21.15.138:0/1954822310 learned_addr learned my addr 172.21.15.138:0/1954822310 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070dc90700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07081003b0 0x7f0708073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 -- 172.21.15.138:0/1954822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07081003b0 msgr2=0x7f0708073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07081003b0 0x7f0708073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.520+0000 7f070d48f700 1 -- 172.21.15.138:0/1954822310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80095f0 con 0x7f0708100d50 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f070d48f700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f070400d900 tx=0x7f070400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0704009900 con 0x7f0708100d50 2024-02-15T23:02:28.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0704010460 con 0x7f0708100d50 2024-02-15T23:02:28.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07081a1ee0 con 0x7f0708100d50 2024-02-15T23:02:28.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f070400f5f0 con 0x7f0708100d50 2024-02-15T23:02:28.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.521+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07081a22f0 con 0x7f0708100d50 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.522+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07081086c0 con 0x7f0708100d50 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.522+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f07040105d0 con 0x7f0708100d50 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.522+0000 7f06feffd700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 0x7f06f406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.523+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f070408d0e0 con 0x7f0708100d50 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.523+0000 7f070dc90700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 0x7f06f406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:02:28.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.523+0000 7f070dc90700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 0x7f06f406fd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f8006010 tx=0x7f06f801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:02:28.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.527+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0704056890 con 0x7f0708100d50 2024-02-15T23:02:28.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.807+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0708073dd0 con 0x7f0708100d50 2024-02-15T23:02:28.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.808+0000 7f06feffd700 1 -- 172.21.15.138:0/1954822310 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0708073dd0 con 0x7f0708100d50 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:02:28.811 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-15T23:02:28.812 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:02:28.812 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 msgr2=0x7f06f406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 0x7f06f406fd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f8006010 tx=0x7f06f801a040 comp rx=0 tx=0).stop 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 msgr2=0x7f0708073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f070400d900 tx=0x7f070400dc10 comp rx=0 tx=0).stop 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 shutdown_connections 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f06f406d8a0 0x7f06f406fd50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07081003b0 0x7f0708073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 --2- 172.21.15.138:0/1954822310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0708100d50 0x7f0708073590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 >> 172.21.15.138:0/1954822310 conn(0x7f07080fbc30 msgr2=0x7f07080fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 shutdown_connections 2024-02-15T23:02:28.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:02:28.810+0000 7f070fef4700 1 -- 172.21.15.138:0/1954822310 wait complete. 2024-02-15T23:02:29.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:29 smithi138 ceph-mon[89527]: pgmap v233: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:29.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:29 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1954822310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:29.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-15T23:02:29.692 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:29.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:29 smithi170 ceph-mon[67652]: pgmap v233: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:29.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:29 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1954822310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:02:30.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:30.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:31.319 INFO:teuthology.orchestra.run.smithi138.stdout:wait for servicemap items w/ changing names to refresh 2024-02-15T23:02:31.690 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:31 smithi138 ceph-mon[89527]: pgmap v234: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:31 smithi170 ceph-mon[67652]: pgmap v234: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:31.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'sleep 60' 2024-02-15T23:02:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:02:33.599 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:33 smithi138 ceph-mon[89527]: pgmap v235: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:33 smithi170 ceph-mon[67652]: pgmap v235: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:35.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:35 smithi138 ceph-mon[89527]: pgmap v236: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:35 smithi170 ceph-mon[67652]: pgmap v236: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:37.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:37 smithi138 ceph-mon[89527]: pgmap v237: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:37.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:37 smithi170 ceph-mon[67652]: pgmap v237: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:38 smithi138 ceph-mon[89527]: pgmap v238: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:38 smithi170 ceph-mon[67652]: pgmap v238: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:41.731 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:41 smithi170 ceph-mon[67652]: pgmap v239: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:41.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:41 smithi138 ceph-mon[89527]: pgmap v239: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:43.633 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:43 smithi170 ceph-mon[67652]: pgmap v240: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:43.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:43 smithi138 ceph-mon[89527]: pgmap v240: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:45 smithi138 ceph-mon[89527]: pgmap v241: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:45.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:45 smithi170 ceph-mon[67652]: pgmap v241: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:02:47.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:47 smithi138 ceph-mon[89527]: pgmap v242: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:47.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:47 smithi170 ceph-mon[67652]: pgmap v242: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:49.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:49 smithi138 ceph-mon[89527]: pgmap v243: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:49 smithi170 ceph-mon[67652]: pgmap v243: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:51.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:51 smithi138 ceph-mon[89527]: pgmap v244: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:51 smithi170 ceph-mon[67652]: pgmap v244: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:53.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:53 smithi138 ceph-mon[89527]: pgmap v245: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:53.746 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:53 smithi170 ceph-mon[67652]: pgmap v245: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:55 smithi138 ceph-mon[89527]: pgmap v246: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:55 smithi170 ceph-mon[67652]: pgmap v246: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:57 smithi138 ceph-mon[89527]: pgmap v247: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:57 smithi170 ceph-mon[67652]: pgmap v247: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:02:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:02:59 smithi138 ceph-mon[89527]: pgmap v248: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:02:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:02:59 smithi170 ceph-mon[67652]: pgmap v248: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:00.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:01.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:01 smithi138 ceph-mon[89527]: pgmap v249: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:01 smithi170 ceph-mon[67652]: pgmap v249: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:03.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:03 smithi138 ceph-mon[89527]: pgmap v250: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:03.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:03 smithi170 ceph-mon[67652]: pgmap v250: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:05.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:05 smithi138 ceph-mon[89527]: pgmap v251: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:05.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:05 smithi170 ceph-mon[67652]: pgmap v251: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:07.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:07 smithi138 ceph-mon[89527]: pgmap v252: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:07.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:07 smithi170 ceph-mon[67652]: pgmap v252: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:08.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:08 smithi138 ceph-mon[89527]: pgmap v253: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:08.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:08 smithi170 ceph-mon[67652]: pgmap v253: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:03:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:09.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:09 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:09.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T23:03:09.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:09.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:09 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:03:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:03:10.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:10 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:10.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:10 smithi138 ceph-mon[89527]: pgmap v254: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:10.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T23:03:10.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T23:03:10.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:10 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' 2024-02-15T23:03:10.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:10 smithi170 ceph-mon[67652]: pgmap v254: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:13.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:13 smithi138 ceph-mon[89527]: pgmap v255: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:13.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:13 smithi170 ceph-mon[67652]: pgmap v255: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:15 smithi138 ceph-mon[89527]: pgmap v256: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:15.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:15 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:15.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:15 smithi170 ceph-mon[67652]: pgmap v256: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:15.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:15 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:17.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:17 smithi138 ceph-mon[89527]: pgmap v257: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:17.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:17 smithi170 ceph-mon[67652]: pgmap v257: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:19.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:19 smithi138 ceph-mon[89527]: pgmap v258: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:19.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:19 smithi170 ceph-mon[67652]: pgmap v258: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:21.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:21 smithi138 ceph-mon[89527]: pgmap v259: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:21.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:21 smithi170 ceph-mon[67652]: pgmap v259: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:23.234 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:22 smithi138 ceph-mon[89527]: pgmap v260: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:23.261 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:22 smithi170 ceph-mon[67652]: pgmap v260: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:25.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:25 smithi138 ceph-mon[89527]: pgmap v261: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:25.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:25 smithi170 ceph-mon[67652]: pgmap v261: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:27.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:27 smithi138 ceph-mon[89527]: pgmap v262: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:27.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:27 smithi170 ceph-mon[67652]: pgmap v262: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:29.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:29 smithi170 ceph-mon[67652]: pgmap v263: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:29.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:29 smithi138 ceph-mon[89527]: pgmap v263: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:30.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:30 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:30.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:30 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:31.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:31 smithi138 ceph-mon[89527]: pgmap v264: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:31.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:31 smithi170 ceph-mon[67652]: pgmap v264: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:33.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:33 smithi138 ceph-mon[89527]: pgmap v265: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:33.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:33 smithi170 ceph-mon[67652]: pgmap v265: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:34.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-15T23:03:34.812 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:03:35.602 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:35 smithi138 ceph-mon[89527]: pgmap v266: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:35.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:35 smithi170 ceph-mon[67652]: pgmap v266: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:36.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 -- 172.21.15.138:0/602699404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 msgr2=0x7fcefc104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:36.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/602699404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc104b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fceec009910 tx=0x7fceec009c20 comp rx=0 tx=0).stop 2024-02-15T23:03:36.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 -- 172.21.15.138:0/602699404 shutdown_connections 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/602699404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 0x7fcefc1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/602699404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc104b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 -- 172.21.15.138:0/602699404 >> 172.21.15.138:0/602699404 conn(0x7fcefc074850 msgr2=0x7fcefc074c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 -- 172.21.15.138:0/602699404 shutdown_connections 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.447+0000 7fcf00c8f700 1 -- 172.21.15.138:0/602699404 wait complete. 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 Processor -- start 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 -- start start 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 0x7fcefc195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc196880 con 0x7fcefc104790 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcf00c8f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc1995b0 con 0x7fcefc103450 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43786/0 (socket says 172.21.15.138:43786) 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 -- 172.21.15.138:0/1744921873 learned_addr learned my addr 172.21.15.138:0/1744921873 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:36.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcefa59c700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 0x7fcefc195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 -- 172.21.15.138:0/1744921873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 msgr2=0x7fcefc195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 0x7fcefc195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 -- 172.21.15.138:0/1744921873 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0095f0 con 0x7fcefc104790 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.448+0000 7fcef9d9b700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcef000dd40 tx=0x7fcef000a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.449+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef000ad10 con 0x7fcefc104790 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.449+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc199890 con 0x7fcefc104790 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.449+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcef000ae70 con 0x7fcefc104790 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.449+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcef0016960 con 0x7fcefc104790 2024-02-15T23:03:36.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.449+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc199e60 con 0x7fcefc104790 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.450+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc0ffa20 con 0x7fcefc104790 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.450+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fcef000e450 con 0x7fcefc104790 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.450+0000 7fceeb7fe700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 0x7fcee406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.451+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcef008d740 con 0x7fcefc104790 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.451+0000 7fcefa59c700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 0x7fcee406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:36.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.451+0000 7fcefa59c700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 0x7fcee406fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fceec006010 tx=0x7fceec00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:36.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.455+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcef0056fa0 con 0x7fcefc104790 2024-02-15T23:03:36.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.660+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 --> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcefc19a1a0 con 0x7fcee406d8a0 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.670+0000 7fceeb7fe700 1 -- 172.21.15.138:0/1744921873 <== mgr.34104 v2:172.21.15.138:6800/274765672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fcefc19a1a0 con 0x7fcee406d8a0 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:alertmanager.smithi138 smithi138 *:9093,9094 running (10m) 98s ago 20m 24.8M - 0.25.0 c8568f914cd2 56188707e426 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi138 smithi138 running (109s) 98s ago 20m 7377k - 19.0.0-1450-gf78a58c0 f081f847070a 8c6209ea2de4 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-exporter.smithi170 smithi170 running (104s) 100s ago 19m 7105k - 19.0.0-1450-gf78a58c0 f081f847070a 6a9dc00a6c33 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi138 smithi138 running (6m) 98s ago 20m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 7d9c370c44c0 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:crash.smithi170 smithi170 running (6m) 100s ago 19m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a e19f3cb8a6ae 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:grafana.smithi138 smithi138 *:3000 running (9m) 98s ago 20m 85.7M - 9.4.12 a0ea5e3c46d9 3d0ab019576f 2024-02-15T23:03:36.673 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.bnqzne smithi138 running (2m) 98s ago 15m 75.8M - 19.0.0-1450-gf78a58c0 f081f847070a 61785145664d 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi138.fzypgq smithi138 running (2m) 98s ago 14m 70.2M - 19.0.0-1450-gf78a58c0 f081f847070a bba42a1d8492 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.banvev smithi170 running (2m) 100s ago 15m 109M - 19.0.0-1450-gf78a58c0 f081f847070a 22d02d90464f 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mds.cephfs.smithi170.cbefkf smithi170 running (2m) 100s ago 14m 133M - 19.0.0-1450-gf78a58c0 f081f847070a 3079ae40cdc9 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi138.jqscxs smithi138 *:8443,9283,8765 running (12m) 98s ago 22m 510M - 19.0.0-1450-gf78a58c0 f081f847070a a0087d023ee7 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mgr.smithi170.gczrzt smithi170 *:8443,9283,8765 running (11m) 100s ago 19m 453M - 19.0.0-1450-gf78a58c0 f081f847070a 767dad97b1df 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi138 smithi138 running (7m) 98s ago 22m 56.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a 2e5a452862d0 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:mon.smithi170 smithi170 running (7m) 100s ago 19m 49.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a c35b7acf0352 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi138 smithi138 *:9100 running (10m) 98s ago 20m 15.6M - 1.5.0 0da6a335fe13 6548e410f9c0 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:node-exporter.smithi170 smithi170 *:9100 running (10m) 100s ago 19m 16.3M - 1.5.0 0da6a335fe13 0c5e3688506b 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.0 smithi138 running (6m) 98s ago 18m 104M 1216M 19.0.0-1450-gf78a58c0 f081f847070a a4d4d7764e90 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.1 smithi138 running (5m) 98s ago 18m 114M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 5a736bd344dd 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.2 smithi138 running (4m) 98s ago 17m 91.3M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 492877c7029c 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.3 smithi170 running (4m) 100s ago 17m 108M 2240M 19.0.0-1450-gf78a58c0 f081f847070a ac1f4577ac73 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.4 smithi170 running (3m) 100s ago 17m 109M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 71df0ff22ac8 2024-02-15T23:03:36.674 INFO:teuthology.orchestra.run.smithi138.stdout:osd.5 smithi170 running (3m) 100s ago 16m 101M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 142b7035a2a9 2024-02-15T23:03:36.675 INFO:teuthology.orchestra.run.smithi138.stdout:prometheus.smithi138 smithi138 *:9095 running (10m) 98s ago 20m 71.7M - 2.43.0 a07b618ecd1d 26e876a81638 2024-02-15T23:03:36.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.672+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 msgr2=0x7fcee406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.672+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 0x7fcee406fd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fceec006010 tx=0x7fceec00b540 comp rx=0 tx=0).stop 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.672+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 msgr2=0x7fcefc1961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.672+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcef000dd40 tx=0x7fcef000a530 comp rx=0 tx=0).stop 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.672+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 shutdown_connections 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcee406d8a0 0x7fcee406fd50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcefc103450 0x7fcefc195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 --2- 172.21.15.138:0/1744921873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcefc104790 0x7fcefc1961f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:36.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 >> 172.21.15.138:0/1744921873 conn(0x7fcefc074850 msgr2=0x7fcefc107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:36.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 shutdown_connections 2024-02-15T23:03:36.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:36.673+0000 7fcf00c8f700 1 -- 172.21.15.138:0/1744921873 wait complete. 2024-02-15T23:03:37.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-15T23:03:37.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:37 smithi138 ceph-mon[89527]: pgmap v267: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:37.572 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:03:37.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:37 smithi170 ceph-mon[67652]: pgmap v267: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:38.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:38 smithi138 ceph-mon[89527]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:03:38.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:38 smithi170 ceph-mon[67652]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 -- 172.21.15.138:0/3525903690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8100d70 msgr2=0x7f0dd8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 --2- 172.21.15.138:0/3525903690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8100d70 0x7f0dd8104d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009910 tx=0x7f0dc0009c20 comp rx=0 tx=0).stop 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 -- 172.21.15.138:0/3525903690 shutdown_connections 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 --2- 172.21.15.138:0/3525903690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8100d70 0x7f0dd8104d40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 --2- 172.21.15.138:0/3525903690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd81003d0 0x7f0dd81007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 -- 172.21.15.138:0/3525903690 >> 172.21.15.138:0/3525903690 conn(0x7f0dd80fbc90 msgr2=0x7f0dd80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 -- 172.21.15.138:0/3525903690 shutdown_connections 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.261+0000 7f0dddf97700 1 -- 172.21.15.138:0/3525903690 wait complete. 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 Processor -- start 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 -- start start 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:39.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 0x7f0dd8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8073ad0 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dddf97700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd8073c10 con 0x7f0dd8100d70 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43806/0 (socket says 172.21.15.138:43806) 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.262+0000 7f0dd77fe700 1 -- 172.21.15.138:0/954106775 learned_addr learned my addr 172.21.15.138:0/954106775 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd6ffd700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 0x7f0dd8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd77fe700 1 -- 172.21.15.138:0/954106775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 msgr2=0x7f0dd8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd77fe700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 0x7f0dd8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd77fe700 1 -- 172.21.15.138:0/954106775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00095f0 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd6ffd700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 0x7f0dd8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd77fe700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00060b0 tx=0x7f0dd000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd000dda0 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd81a1f10 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dd000f040 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd0014790 con 0x7f0dd81003d0 2024-02-15T23:03:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.263+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd81a2320 con 0x7f0dd81003d0 2024-02-15T23:03:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.264+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd8108740 con 0x7f0dd81003d0 2024-02-15T23:03:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.264+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0dd0014980 con 0x7f0dd81003d0 2024-02-15T23:03:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.265+0000 7f0dd4ff9700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 0x7f0dc406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.265+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0dd008cff0 con 0x7f0dd81003d0 2024-02-15T23:03:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.265+0000 7f0dd6ffd700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 0x7f0dc406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.265+0000 7f0dd6ffd700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 0x7f0dc406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8074840 tx=0x7f0dc001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:39.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.269+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0dd0056850 con 0x7f0dd81003d0 2024-02-15T23:03:39.511 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:39 smithi170 ceph-mon[67652]: pgmap v268: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.552+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0dd802cd90 con 0x7f0dd81003d0 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.553+0000 7f0dd4ff9700 1 -- 172.21.15.138:0/954106775 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0dd0059f10 con 0x7f0dd81003d0 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "mon": { 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "mgr": { 2024-02-15T23:03:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "osd": { 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "overall": { 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-02-15T23:03:39.556 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-02-15T23:03:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 msgr2=0x7f0dc406fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 0x7f0dc406fd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8074840 tx=0x7f0dc001a040 comp rx=0 tx=0).stop 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 msgr2=0x7f0dd8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00060b0 tx=0x7f0dd000d3b0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 shutdown_connections 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f0dc406d8a0 0x7f0dc406fd50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd81003d0 0x7f0dd8073050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 --2- 172.21.15.138:0/954106775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd8100d70 0x7f0dd8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 >> 172.21.15.138:0/954106775 conn(0x7f0dd80fbc90 msgr2=0x7f0dd80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 shutdown_connections 2024-02-15T23:03:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:39.555+0000 7f0dddf97700 1 -- 172.21.15.138:0/954106775 wait complete. 2024-02-15T23:03:39.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:39 smithi138 ceph-mon[89527]: pgmap v268: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:40.215 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-15T23:03:40.425 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:03:40.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:40 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/954106775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:40.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:40 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/954106775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:41.701 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:41 smithi138 ceph-mon[89527]: pgmap v269: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:41.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:41 smithi170 ceph-mon[67652]: pgmap v269: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- 172.21.15.138:0/2810523565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 msgr2=0x7f2cac101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 --2- 172.21.15.138:0/2810523565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac101560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009910 tx=0x7f2ca0009c20 comp rx=0 tx=0).stop 2024-02-15T23:03:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- 172.21.15.138:0/2810523565 shutdown_connections 2024-02-15T23:03:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 --2- 172.21.15.138:0/2810523565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 0x7f2cac109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 --2- 172.21.15.138:0/2810523565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac101560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- 172.21.15.138:0/2810523565 >> 172.21.15.138:0/2810523565 conn(0x7f2cac0fa9d0 msgr2=0x7f2cac0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- 172.21.15.138:0/2810523565 shutdown_connections 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- 172.21.15.138:0/2810523565 wait complete. 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 Processor -- start 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.009+0000 7f2cb199f700 1 -- start start 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb199f700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb199f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 0x7f2cac0ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb199f700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0ff870 con 0x7f2cac101190 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb199f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0ff9b0 con 0x7f2cac101aa0 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:43816/0 (socket says 172.21.15.138:43816) 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 -- 172.21.15.138:0/1147784013 learned_addr learned my addr 172.21.15.138:0/1147784013 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cabfff700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 0x7f2cac0ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:42.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 -- 172.21.15.138:0/1147784013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 msgr2=0x7f2cac0ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 0x7f2cac0ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 -- 172.21.15.138:0/1147784013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00095f0 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb099d700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0006010 tx=0x7f2ca000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca001d070 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ca0004fb0 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac0ffc30 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.010+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca0022ea0 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.011+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac1a2160 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.011+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac107650 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.012+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f2ca0022470 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.012+0000 7f2ca9ffb700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 0x7f2c9c06fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.012+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2ca008eac0 con 0x7f2cac101190 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.012+0000 7f2cabfff700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 0x7f2c9c06fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.013+0000 7f2cabfff700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 0x7f2c9c06fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c98006fd0 tx=0x7f2c98008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:42.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.017+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2ca0058320 con 0x7f2cac101190 2024-02-15T23:03:42.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.293+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2cac04f2a0 con 0x7f2cac101190 2024-02-15T23:03:42.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.294+0000 7f2ca9ffb700 1 -- 172.21.15.138:0/1147784013 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f2ca0022720 con 0x7f2cac101190 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 msgr2=0x7f2c9c06fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 0x7f2c9c06fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c98006fd0 tx=0x7f2c98008040 comp rx=0 tx=0).stop 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 msgr2=0x7f2cac0fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0006010 tx=0x7f2ca000be20 comp rx=0 tx=0).stop 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 shutdown_connections 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f2c9c06d8a0 0x7f2c9c06fd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cac101190 0x7f2cac0fedf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 --2- 172.21.15.138:0/1147784013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cac101aa0 0x7f2cac0ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:42.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 >> 172.21.15.138:0/1147784013 conn(0x7f2cac0fa9d0 msgr2=0x7f2cac104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:42.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 shutdown_connections 2024-02-15T23:03:42.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:42.297+0000 7f2cb199f700 1 -- 172.21.15.138:0/1147784013 wait complete. 2024-02-15T23:03:42.310 INFO:teuthology.orchestra.run.smithi138.stdout:true 2024-02-15T23:03:42.657 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:42 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1147784013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:42.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:42 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1147784013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:42.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-15T23:03:43.188 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:03:43.583 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:43 smithi138 ceph-mon[89527]: pgmap v270: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:43.663 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:43 smithi170 ceph-mon[67652]: pgmap v270: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 -- 172.21.15.138:0/3691739484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 msgr2=0x7fb7c00ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/3691739484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c00ff6e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009910 tx=0x7fb7bc009c20 comp rx=0 tx=0).stop 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 -- 172.21.15.138:0/3691739484 shutdown_connections 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/3691739484 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 0x7fb7c0103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/3691739484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c00ff6e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 -- 172.21.15.138:0/3691739484 >> 172.21.15.138:0/3691739484 conn(0x7fb7c00fabd0 msgr2=0x7fb7c00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 -- 172.21.15.138:0/3691739484 shutdown_connections 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 -- 172.21.15.138:0/3691739484 wait complete. 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.869+0000 7fb7c6f46700 1 Processor -- start 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c6f46700 1 -- start start 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c6f46700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c6f46700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 0x7fb7c019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c6f46700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c019b690 con 0x7fb7c00ff310 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c6f46700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0194b40 con 0x7fb7c00ffcb0 2024-02-15T23:03:44.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39860/0 (socket says 172.21.15.138:39860) 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 -- 172.21.15.138:0/2578444643 learned_addr learned my addr 172.21.15.138:0/2578444643 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7b7fff700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 0x7fb7c019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 -- 172.21.15.138:0/2578444643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 msgr2=0x7fb7c019b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 0x7fb7c019b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 -- 172.21.15.138:0/2578444643 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0095f0 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.870+0000 7fb7c4ce2700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0092e0 tx=0x7fb7bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.871+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7bc01d070 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.871+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7bc005e00 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.871+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c0194dc0 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.871+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7bc017400 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.871+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c01952b0 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.872+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c0107620 con 0x7fb7c00ff310 2024-02-15T23:03:44.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.872+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fb7bc00f460 con 0x7fb7c00ff310 2024-02-15T23:03:44.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.873+0000 7fb7b5ffb700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 0x7fb7a806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:44.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.873+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb7bc08e9a0 con 0x7fb7c00ff310 2024-02-15T23:03:44.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.873+0000 7fb7b7fff700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 0x7fb7a806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:44.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.873+0000 7fb7b7fff700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 0x7fb7a806fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0005950 tx=0x7fb7b00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:44.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:44.878+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7bc05bd00 con 0x7fb7c00ff310 2024-02-15T23:03:45.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.159+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb7c004ea50 con 0x7fb7c00ff310 2024-02-15T23:03:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.159+0000 7fb7b5ffb700 1 -- 172.21.15.138:0/2578444643 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb7bc05b890 con 0x7fb7c00ff310 2024-02-15T23:03:45.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 msgr2=0x7fb7a806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:45.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 0x7fb7a806fd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0005950 tx=0x7fb7b00058e0 comp rx=0 tx=0).stop 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 msgr2=0x7fb7c019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0092e0 tx=0x7fb7bc00be20 comp rx=0 tx=0).stop 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 shutdown_connections 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fb7a806d8a0 0x7fb7a806fd50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb7c00ff310 0x7fb7c019aac0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 --2- 172.21.15.138:0/2578444643 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7c00ffcb0 0x7fb7c019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 >> 172.21.15.138:0/2578444643 conn(0x7fb7c00fabd0 msgr2=0x7fb7c00fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 shutdown_connections 2024-02-15T23:03:45.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:45.162+0000 7fb7c6f46700 1 -- 172.21.15.138:0/2578444643 wait complete. 2024-02-15T23:03:45.175 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-15T23:03:45.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:45 smithi138 ceph-mon[89527]: pgmap v271: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:45.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:45 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2578444643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:45.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:45 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:45 smithi170 ceph-mon[67652]: pgmap v271: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:45 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2578444643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T23:03:45.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:45 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:03:45.923 DEBUG:teuthology.parallel:result is None 2024-02-15T23:03:45.923 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T23:03:45.934 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T23:03:45.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T23:03:46.142 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/mon.smithi138/config 2024-02-15T23:03:47.607 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:47 smithi138 ceph-mon[89527]: pgmap v272: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:47.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:47 smithi170 ceph-mon[67652]: pgmap v272: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 -- 172.21.15.138:0/1899492384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1868100d80 msgr2=0x7f1868104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 --2- 172.21.15.138:0/1899492384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1868100d80 0x7f1868104d50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1858009910 tx=0x7f1858009c20 comp rx=0 tx=0).stop 2024-02-15T23:03:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 -- 172.21.15.138:0/1899492384 shutdown_connections 2024-02-15T23:03:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 --2- 172.21.15.138:0/1899492384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1868100d80 0x7f1868104d50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:47.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 --2- 172.21.15.138:0/1899492384 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18681003e0 0x7f18681007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 -- 172.21.15.138:0/1899492384 >> 172.21.15.138:0/1899492384 conn(0x7f18680fbca0 msgr2=0x7f18680fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 -- 172.21.15.138:0/1899492384 shutdown_connections 2024-02-15T23:03:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.953+0000 7f186d147700 1 -- 172.21.15.138:0/1899492384 wait complete. 2024-02-15T23:03:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 Processor -- start 2024-02-15T23:03:47.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 -- start start 2024-02-15T23:03:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1868100d80 0x7f1868196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18681969f0 con 0x7f18681003e0 2024-02-15T23:03:47.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f186d147700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186819a780 con 0x7f1868100d80 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f1866d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f1866d9d700 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39882/0 (socket says 172.21.15.138:39882) 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.954+0000 7f1866d9d700 1 -- 172.21.15.138:0/667510055 learned_addr learned my addr 172.21.15.138:0/667510055 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f186659c700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1868100d80 0x7f1868196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f1866d9d700 1 -- 172.21.15.138:0/667510055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1868100d80 msgr2=0x7f1868196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f1866d9d700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1868100d80 0x7f1868196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f1866d9d700 1 -- 172.21.15.138:0/667510055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580095f0 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f1866d9d700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c8a0 tx=0x7f185c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c00cea0 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186819aa60 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f185c004830 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c0055b0 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.955+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186819afb0 con 0x7f18681003e0 2024-02-15T23:03:47.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.956+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186804ea50 con 0x7f18681003e0 2024-02-15T23:03:47.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.956+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f185c0049a0 con 0x7f18681003e0 2024-02-15T23:03:47.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.957+0000 7f184ffff700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 0x7f185006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:47.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.957+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f185c08d1d0 con 0x7f18681003e0 2024-02-15T23:03:47.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.957+0000 7f186659c700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 0x7f185006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:47.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.957+0000 7f186659c700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 0x7f185006fd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18580059d0 tx=0x7f1858005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:47.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:47.962+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f185c056980 con 0x7f18681003e0 2024-02-15T23:03:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.202+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f186819b430 con 0x7f18681003e0 2024-02-15T23:03:48.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.203+0000 7f184ffff700 1 -- 172.21.15.138:0/667510055 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1894 (secure 0 0 0) 0x7f185c004c50 con 0x7f18681003e0 2024-02-15T23:03:48.205 INFO:teuthology.orchestra.run.smithi138.stdout:e44 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:legacy client fscid: 1 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:Filesystem 'cephfs' (1) 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:fs_name cephfs 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 44 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-02-15T22:48:24.115503+0000 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:modified 2024-02-15T23:02:07.265983+0000 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:tableserver 0 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:root 0 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:session_timeout 60 2024-02-15T23:03:48.206 INFO:teuthology.orchestra.run.smithi138.stdout:session_autoclose 300 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:max_file_size 1099511627776 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:max_xattr_size 65536 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:required_client_features {} 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure 0 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:last_failure_osd_epoch 81 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:max_mds 2 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:in 0,1 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:up {0=34404,1=34424} 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:failed 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:damaged 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:stopped 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:data_pools [3] 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:metadata_pool 2 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:inline_data disabled 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:balancer 2024-02-15T23:03:48.207 INFO:teuthology.orchestra.run.smithi138.stdout:bal_rank_mask -1 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout:standby_count_wanted 1 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.bnqzne{0:34404} state up:active seq 22 join_fscid=1 addr [v2:172.21.15.138:6826/2312501492,v1:172.21.15.138:6827/2312501492] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.banvev{0:44317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.170:6824/411044474,v1:172.21.15.170:6825/411044474] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi138.fzypgq{1:34424} state up:active seq 17 join_fscid=1 addr [v2:172.21.15.138:6828/3874505948,v1:172.21.15.138:6829/3874505948] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.cephfs.smithi170.cbefkf{1:44321} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.170:6826/85754605,v1:172.21.15.170:6827/85754605] compat {c=[1],r=[1],i=[fff]}] 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.205+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 msgr2=0x7f185006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.205+0000 7f186d147700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 0x7f185006fd50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18580059d0 tx=0x7f1858005960 comp rx=0 tx=0).stop 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.205+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 msgr2=0x7f1868195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.205+0000 7f186d147700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c8a0 tx=0x7f185c00cc60 comp rx=0 tx=0).stop 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 shutdown_connections 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f185006d8a0 0x7f185006fd50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f18681003e0 0x7f1868195dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 --2- 172.21.15.138:0/667510055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1868100d80 0x7f1868196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 >> 172.21.15.138:0/667510055 conn(0x7f18680fbca0 msgr2=0x7f18680fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:48.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 shutdown_connections 2024-02-15T23:03:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.206+0000 7f186d147700 1 -- 172.21.15.138:0/667510055 wait complete. 2024-02-15T23:03:48.210 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 44 2024-02-15T23:03:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:48 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/667510055' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:03:48.484 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:48 smithi138 ceph-mon[89527]: pgmap v273: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:48 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/667510055' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T23:03:48.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:48 smithi170 ceph-mon[67652]: pgmap v273: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:48.856 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-15T23:03:48.869 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:03:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- 172.21.15.138:0/2865075636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 msgr2=0x7fa5b80fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 --2- 172.21.15.138:0/2865075636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b80fec50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009880 tx=0x7fa5ac02bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- 172.21.15.138:0/2865075636 shutdown_connections 2024-02-15T23:03:48.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 --2- 172.21.15.138:0/2865075636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b80fec50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 --2- 172.21.15.138:0/2865075636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b81047f0 0x7fa5b8104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- 172.21.15.138:0/2865075636 >> 172.21.15.138:0/2865075636 conn(0x7fa5b80fa300 msgr2=0x7fa5b80fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- 172.21.15.138:0/2865075636 shutdown_connections 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- 172.21.15.138:0/2865075636 wait complete. 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 Processor -- start 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.971+0000 7fa5be46a640 1 -- start start 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b81047f0 0x7fa5b81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8196ce0 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8196e50 con 0x7fa5b81047f0 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39902/0 (socket says 172.21.15.138:39902) 2024-02-15T23:03:48.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 -- 172.21.15.138:0/3739329957 learned_addr learned my addr 172.21.15.138:0/3739329957 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 -- 172.21.15.138:0/3739329957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b81047f0 msgr2=0x7fa5b81967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b81047f0 0x7fa5b81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 -- 172.21.15.138:0/3739329957 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009560 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b7fff640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c8f0 tx=0x7fa5a800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a80041f0 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5a8007e10 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5a800f450 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b819f2d0 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.972+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b819f770 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.973+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b804e000 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.974+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa5a8007950 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.974+0000 7fa5b57fa640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 0x7fa5a006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.974+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa5a8013070 con 0x7fa5b80fe7e0 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.974+0000 7fa5b77fe640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 0x7fa5a006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:48.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.975+0000 7fa5b77fe640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 0x7fa5a006fd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac036040 tx=0x7fa5ac000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:48.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:48.979+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa5a8056de0 con 0x7fa5b80fe7e0 2024-02-15T23:03:49.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.151+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5b810bb70 con 0x7fa5b80fe7e0 2024-02-15T23:03:49.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.152+0000 7fa5b57fa640 1 -- 172.21.15.138:0/3739329957 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16828 (secure 0 0 0) 0x7fa5a805a4a0 con 0x7fa5b80fe7e0 2024-02-15T23:03:49.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:49.155 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":85,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T23:01:26.420558+0000","last_up_change":"2024-02-15T23:00:27.103248+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:48:22.710517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:48:23.345890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6803","nonce":3741024094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6805","nonce":3741024094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6809","nonce":3741024094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6807","nonce":3741024094}]},"public_addr":"172.21.15.138:6803/3741024094","cluster_addr":"172.21.15.138:6805/3741024094","heartbeat_back_addr":"172.21.15.138:6809/3741024094","heartbeat_front_addr":"172.21.15.138:6807/3741024094","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6811","nonce":320789010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6813","nonce":320789010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6817","nonce":320789010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6815","nonce":320789010}]},"public_addr":"172.21.15.138:6811/320789010","cluster_addr":"172.21.15.138:6813/320789010","heartbeat_back_addr":"172.21.15.138:6817/320789010","heartbeat_front_addr":"172.21.15.138:6815/320789010","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6819","nonce":3347258839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6821","nonce":3347258839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6825","nonce":3347258839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6823","nonce":3347258839}]},"public_addr":"172.21.15.138:6819/3347258839","cluster_addr":"172.21.15.138:6821/3347258839","heartbeat_back_addr":"172.21.15.138:6825/3347258839","heartbeat_front_addr":"172.21.15.138:6823/3347258839","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6801","nonce":246812523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6803","nonce":246812523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6807","nonce":246812523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6805","nonce":246812523}]},"public_addr":"172.21.15.170:6801/246812523","cluster_addr":"172.21.15.170:6803/246812523","heartbeat_back_addr":"172.21.15.170:6807/246812523","heartbeat_front_addr":"172.21.15.170:6805/246812523","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6809","nonce":1376172342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6811","nonce":1376172342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6815","nonce":1376172342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6813","nonce":1376172342}]},"public_addr":"172.21.15.170:6809/1376172342","cluster_addr":"172.21.15.170:6811/1376172342","heartbeat_back_addr":"172.21.15.170:6815/1376172342","heartbeat_front_addr":"172.21.15.170:6813/1376172342","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6817","nonce":3484244899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6819","nonce":3484244899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6823","nonce":3484244899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6821","nonce":3484244899}]},"public_addr":"172.21.15.170:6817/3484244899","cluster_addr":"172.21.15.170:6819/3484244899","heartbeat_back_addr":"172.21.15.170:6823/3484244899","heartbeat_front_addr":"172.21.15.170:6821/3484244899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6824/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:6829/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6828/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6801/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/4125885020":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/1857695595":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1233270825":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2933677068":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6829/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/3892577367":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/3094578310":"2024-02-16T22:51:35.224167+0000","172.21.15.170:6825/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2366055009":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6826/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:6827/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/464877437":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/990488714":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/4266627949":"2024-02-16T22:56:00.176825+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/4136599694":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.170:0/2930297512":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6828/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/698053139":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/998034485":"2024-02-16T22:56:00.176825+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 msgr2=0x7fa5a006fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 0x7fa5a006fd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac036040 tx=0x7fa5ac000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 msgr2=0x7fa5b8196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c8f0 tx=0x7fa5a800cdb0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 shutdown_connections 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa5a006d8d0 0x7fa5a006fd80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b81047f0 0x7fa5b81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 --2- 172.21.15.138:0/3739329957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa5b80fe7e0 0x7fa5b8196260 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 >> 172.21.15.138:0/3739329957 conn(0x7fa5b80fa300 msgr2=0x7fa5b80fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 shutdown_connections 2024-02-15T23:03:49.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.154+0000 7fa5be46a640 1 -- 172.21.15.138:0/3739329957 wait complete. 2024-02-15T23:03:49.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:45:52.286926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:48:22.710517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:48:23.345890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T23:03:49.168 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T23:03:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- 172.21.15.138:0/3430630561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 msgr2=0x7fa248108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/3430630561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248108860 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa230009880 tx=0x7fa23002bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- 172.21.15.138:0/3430630561 shutdown_connections 2024-02-15T23:03:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/3430630561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248108860 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/3430630561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2480ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- 172.21.15.138:0/3430630561 >> 172.21.15.138:0/3430630561 conn(0x7fa248074cf0 msgr2=0x7fa2480750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- 172.21.15.138:0/3430630561 shutdown_connections 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- 172.21.15.138:0/3430630561 wait complete. 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 Processor -- start 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.270+0000 7fa24ca2b640 1 -- start start 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2481961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248196ce0 con 0x7fa248100100 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248196e50 con 0x7fa2480ff7f0 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39920/0 (socket says 172.21.15.138:39920) 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 -- 172.21.15.138:0/91166618 learned_addr learned my addr 172.21.15.138:0/91166618 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24659c640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2481961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 -- 172.21.15.138:0/91166618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 msgr2=0x7fa2481961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2481961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 -- 172.21.15.138:0/91166618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009560 con 0x7fa248100100 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24659c640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2481961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23ffff640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa230009230 tx=0x7fa23002c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2300035f0 con 0x7fa248100100 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa230003c10 con 0x7fa248100100 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24819f240 con 0x7fa248100100 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa230005600 con 0x7fa248100100 2024-02-15T23:03:49.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.271+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24819f660 con 0x7fa248100100 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.272+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24804e000 con 0x7fa248100100 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.273+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fa230004dd0 con 0x7fa248100100 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.273+0000 7fa23f7fe640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 0x7fa23406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.273+0000 7fa24659c640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 0x7fa23406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.273+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa2300af920 con 0x7fa248100100 2024-02-15T23:03:49.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.274+0000 7fa24659c640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 0x7fa23406fcc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2380058c0 tx=0x7fa238005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.278+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa2300790d0 con 0x7fa248100100 2024-02-15T23:03:49.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.451+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa24810b870 con 0x7fa248100100 2024-02-15T23:03:49.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.451+0000 7fa23f7fe640 1 -- 172.21.15.138:0/91166618 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa23007c790 con 0x7fa248100100 2024-02-15T23:03:49.454 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 msgr2=0x7fa23406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 0x7fa23406fcc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2380058c0 tx=0x7fa238005850 comp rx=0 tx=0).stop 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 msgr2=0x7fa248196710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa230009230 tx=0x7fa23002c750 comp rx=0 tx=0).stop 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 shutdown_connections 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fa23406d810 0x7fa23406fcc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa248100100 0x7fa248196710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 --2- 172.21.15.138:0/91166618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2480ff7f0 0x7fa2481961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 >> 172.21.15.138:0/91166618 conn(0x7fa248074cf0 msgr2=0x7fa248103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 shutdown_connections 2024-02-15T23:03:49.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.453+0000 7fa24ca2b640 1 -- 172.21.15.138:0/91166618 wait complete. 2024-02-15T23:03:49.465 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:49 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3739329957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:03:49.467 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.568+0000 7f808bd63640 1 -- 172.21.15.138:0/2603012840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 msgr2=0x7f80840fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.568+0000 7f808bd63640 1 --2- 172.21.15.138:0/2603012840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f80840fea20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8080009880 tx=0x7f808002bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- 172.21.15.138:0/2603012840 shutdown_connections 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 --2- 172.21.15.138:0/2603012840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f80840fea20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 --2- 172.21.15.138:0/2603012840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8084104590 0x7f8084104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- 172.21.15.138:0/2603012840 >> 172.21.15.138:0/2603012840 conn(0x7f80840743d0 msgr2=0x7f80840747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- 172.21.15.138:0/2603012840 shutdown_connections 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- 172.21.15.138:0/2603012840 wait complete. 2024-02-15T23:03:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 Processor -- start 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- start start 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8084104590 0x7f80841967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084196da0 con 0x7f80840fe5b0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f808bd63640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084196f10 con 0x7f8084104590 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f8089aff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f8089aff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39930/0 (socket says 172.21.15.138:39930) 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.569+0000 7f8089aff640 1 -- 172.21.15.138:0/1264295394 learned_addr learned my addr 172.21.15.138:0/1264295394 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f8089aff640 1 -- 172.21.15.138:0/1264295394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8084104590 msgr2=0x7f80841967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f8089aff640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8084104590 0x7f80841967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f8089aff640 1 -- 172.21.15.138:0/1264295394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080009560 con 0x7f80840fe5b0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f8089aff640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f807400b420 tx=0x7f807400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8074011800 con 0x7f80840fe5b0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8074011e20 con 0x7f80840fe5b0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808419f300 con 0x7f80840fe5b0 2024-02-15T23:03:49.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807400f2e0 con 0x7f80840fe5b0 2024-02-15T23:03:49.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.570+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808419f7b0 con 0x7f80840fe5b0 2024-02-15T23:03:49.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.571+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808404e000 con 0x7f80840fe5b0 2024-02-15T23:03:49.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.571+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8074010380 con 0x7f80840fe5b0 2024-02-15T23:03:49.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.572+0000 7f807affd640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 0x7f807006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.572+0000 7f80892fe640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 0x7f807006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.572+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f807408cec0 con 0x7f80840fe5b0 2024-02-15T23:03:49.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.572+0000 7f80892fe640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 0x7f807006fcc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8080036040 tx=0x7f8080000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.576+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8074056670 con 0x7f80840fe5b0 2024-02-15T23:03:49.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.750+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f80841069a0 con 0x7f80840fe5b0 2024-02-15T23:03:49.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.751+0000 7f807affd640 1 -- 172.21.15.138:0/1264295394 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8074059d30 con 0x7f80840fe5b0 2024-02-15T23:03:49.753 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:03:49.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 msgr2=0x7f807006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 0x7f807006fcc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8080036040 tx=0x7f8080000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 msgr2=0x7f8084196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f807400b420 tx=0x7f807400b8e0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 shutdown_connections 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f807006d810 0x7f807006fcc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8084104590 0x7f80841967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 --2- 172.21.15.138:0/1264295394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80840fe5b0 0x7f8084196290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 >> 172.21.15.138:0/1264295394 conn(0x7f80840743d0 msgr2=0x7f80840fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 shutdown_connections 2024-02-15T23:03:49.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.753+0000 7f808bd63640 1 -- 172.21.15.138:0/1264295394 wait complete. 2024-02-15T23:03:49.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:49 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3739329957' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:03:49.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 -- 172.21.15.138:0/610409746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b00fe590 msgr2=0x7ff5b00fea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/610409746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b00fe590 0x7ff5b00fea00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009880 tx=0x7ff5a402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 -- 172.21.15.138:0/610409746 shutdown_connections 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/610409746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b00fe590 0x7ff5b00fea00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/610409746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b01045c0 0x7ff5b0104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 -- 172.21.15.138:0/610409746 >> 172.21.15.138:0/610409746 conn(0x7ff5b00fa070 msgr2=0x7ff5b00fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 -- 172.21.15.138:0/610409746 shutdown_connections 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 -- 172.21.15.138:0/610409746 wait complete. 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.868+0000 7ff5b69ca640 1 Processor -- start 2024-02-15T23:03:49.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5b69ca640 1 -- start start 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5b69ca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b00fe590 0x7ff5b0196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5b69ca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5b69ca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0196d60 con 0x7ff5b01045c0 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5b69ca640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0196ea0 con 0x7ff5b00fe590 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39956/0 (socket says 172.21.15.138:39956) 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 -- 172.21.15.138:0/1042946594 learned_addr learned my addr 172.21.15.138:0/1042946594 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5affff640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b00fe590 0x7ff5b0196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 -- 172.21.15.138:0/1042946594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b00fe590 msgr2=0x7ff5b0196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b00fe590 0x7ff5b0196200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 -- 172.21.15.138:0/1042946594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009560 con 0x7ff5b01045c0 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.869+0000 7ff5af7fe640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009230 tx=0x7ff5a4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.870+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a40035f0 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.870+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5a4003c10 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.870+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b019f270 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.870+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a4034440 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.870+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b019f710 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.871+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b004e000 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.871+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff5a4004fd0 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.872+0000 7ff5ad7fa640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 0x7ff59806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.872+0000 7ff5affff640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 0x7ff59806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.872+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff5a40af9c0 con 0x7ff5b01045c0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.872+0000 7ff5affff640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 0x7ff59806fcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000a810 tx=0x7ff5a0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:49.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:49.876+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff5a4079170 con 0x7ff5b01045c0 2024-02-15T23:03:50.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.048+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff5b0068950 con 0x7ff5b01045c0 2024-02-15T23:03:50.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.049+0000 7ff5ad7fa640 1 -- 172.21.15.138:0/1042946594 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff5a407c830 con 0x7ff5b01045c0 2024-02-15T23:03:50.052 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:03:50.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 msgr2=0x7ff59806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 0x7ff59806fcc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000a810 tx=0x7ff5a0008040 comp rx=0 tx=0).stop 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 msgr2=0x7ff5b0196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009230 tx=0x7ff5a4004040 comp rx=0 tx=0).stop 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 shutdown_connections 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff59806d810 0x7ff59806fcc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5b01045c0 0x7ff5b0196740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 --2- 172.21.15.138:0/1042946594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5b00fe590 0x7ff5b0196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 >> 172.21.15.138:0/1042946594 conn(0x7ff5b00fa070 msgr2=0x7ff5b00fba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 shutdown_connections 2024-02-15T23:03:50.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.051+0000 7ff5b69ca640 1 -- 172.21.15.138:0/1042946594 wait complete. 2024-02-15T23:03:50.064 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 -- 172.21.15.138:0/2223900079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6574105860 msgr2=0x7f6574105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 --2- 172.21.15.138:0/2223900079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6574105860 0x7f6574105c30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6564009880 tx=0x7f656402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 -- 172.21.15.138:0/2223900079 shutdown_connections 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 --2- 172.21.15.138:0/2223900079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65740ff850 0x7f65740ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 --2- 172.21.15.138:0/2223900079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6574105860 0x7f6574105c30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 -- 172.21.15.138:0/2223900079 >> 172.21.15.138:0/2223900079 conn(0x7f65740fb350 msgr2=0x7f65740fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 -- 172.21.15.138:0/2223900079 shutdown_connections 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.163+0000 7f6579e2d640 1 -- 172.21.15.138:0/2223900079 wait complete. 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 Processor -- start 2024-02-15T23:03:50.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 -- start start 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6574105860 0x7f6574072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574072fe0 con 0x7f65740ff850 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f6579e2d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6574073150 con 0x7f6574105860 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39970/0 (socket says 172.21.15.138:39970) 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 -- 172.21.15.138:0/3125745954 learned_addr learned my addr 172.21.15.138:0/3125745954 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f656affd640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6574105860 0x7f6574072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 -- 172.21.15.138:0/3125745954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6574105860 msgr2=0x7f6574072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6574105860 0x7f6574072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 -- 172.21.15.138:0/3125745954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564009560 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.164+0000 7f65737fe640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6564009230 tx=0x7f656402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.165+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65640035f0 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.165+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6564003c10 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.165+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6574073370 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.165+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6564005690 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.165+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65741a19a0 con 0x7f65740ff850 2024-02-15T23:03:50.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.166+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657404e000 con 0x7f65740ff850 2024-02-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.166+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6564004ed0 con 0x7f65740ff850 2024-02-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.166+0000 7f65717fa640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 0x7f656006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.167+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f65640af960 con 0x7f65740ff850 2024-02-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.167+0000 7f656affd640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 0x7f656006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.167+0000 7f656affd640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 0x7f656006fd80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f655c005fd0 tx=0x7f655c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.171+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6564079110 con 0x7f65740ff850 2024-02-15T23:03:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.381+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6574066860 con 0x7f65740ff850 2024-02-15T23:03:50.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.381+0000 7f65717fa640 1 -- 172.21.15.138:0/3125745954 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5032 (secure 0 0 0) 0x7f656407c7d0 con 0x7f65740ff850 2024-02-15T23:03:50.384 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:50.384 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:02:07.265983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44317":{"gid":44317,"name":"cephfs.smithi170.banvev","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44321":{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:50.384 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 44 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 msgr2=0x7f656006fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 0x7f656006fd80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f655c005fd0 tx=0x7f655c005850 comp rx=0 tx=0).stop 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 msgr2=0x7f6574072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6564009230 tx=0x7f656402c850 comp rx=0 tx=0).stop 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 shutdown_connections 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f656006d8d0 0x7f656006fd80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6574105860 0x7f6574072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 --2- 172.21.15.138:0/3125745954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65740ff850 0x7f6574072560 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 >> 172.21.15.138:0/3125745954 conn(0x7f65740fb350 msgr2=0x7f65740fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 shutdown_connections 2024-02-15T23:03:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.383+0000 7f6579e2d640 1 -- 172.21.15.138:0/3125745954 wait complete. 2024-02-15T23:03:50.397 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-02-15T23:03:50.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 -- 172.21.15.138:0/3547486191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 msgr2=0x7f7888104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 --2- 172.21.15.138:0/3547486191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888104990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7878009c20 tx=0x7f787802c1b0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 -- 172.21.15.138:0/3547486191 shutdown_connections 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 --2- 172.21.15.138:0/3547486191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f78880fea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 --2- 172.21.15.138:0/3547486191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888104990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 -- 172.21.15.138:0/3547486191 >> 172.21.15.138:0/3547486191 conn(0x7f78880fa0b0 msgr2=0x7f78880fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 -- 172.21.15.138:0/3547486191 shutdown_connections 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.496+0000 7f788f3b1640 1 -- 172.21.15.138:0/3547486191 wait complete. 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 Processor -- start 2024-02-15T23:03:50.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 -- start start 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f7888196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7888196c80 con 0x7f78881045c0 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788f3b1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7888196dc0 con 0x7f78880fe590 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39978/0 (socket says 172.21.15.138:39978) 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 -- 172.21.15.138:0/93950111 learned_addr learned my addr 172.21.15.138:0/93950111 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788d14d640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f7888196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 -- 172.21.15.138:0/93950111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 msgr2=0x7f7888196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f7888196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788c94c640 1 -- 172.21.15.138:0/93950111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009900 con 0x7f78881045c0 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.497+0000 7f788d14d640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f7888196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f788c94c640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c8f0 tx=0x7f787c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c007b80 con 0x7f78881045c0 2024-02-15T23:03:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f787c0054e0 con 0x7f78881045c0 2024-02-15T23:03:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788819f190 con 0x7f78881045c0 2024-02-15T23:03:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c00f450 con 0x7f78881045c0 2024-02-15T23:03:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.498+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788819f6e0 con 0x7f78881045c0 2024-02-15T23:03:50.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.499+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788804e000 con 0x7f78881045c0 2024-02-15T23:03:50.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.499+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f787c004f60 con 0x7f78881045c0 2024-02-15T23:03:50.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.500+0000 7f78867fc640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 0x7f787006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.500+0000 7f788d14d640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 0x7f787006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.500+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f787c08d350 con 0x7f78881045c0 2024-02-15T23:03:50.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.500+0000 7f788d14d640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 0x7f787006fcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7878009430 tx=0x7f7878009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.504+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f787c056b00 con 0x7f78881045c0 2024-02-15T23:03:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.713+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f78880689b0 con 0x7f78881045c0 2024-02-15T23:03:50.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.714+0000 7f78867fc640 1 -- 172.21.15.138:0/93950111 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v44) v1 ==== 107+0+4869 (secure 0 0 0) 0x7f787c05a1c0 con 0x7f78881045c0 2024-02-15T23:03:50.717 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:50.717 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T22:50:27.255046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2716267624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2716267624},{"type":"v1","addr":"172.21.15.138:6827","nonce":2716267624}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.170:6827/2026647764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2026647764},{"type":"v1","addr":"172.21.15.170:6827","nonce":2026647764}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:50.717 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 20 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 msgr2=0x7f787006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 0x7f787006fcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7878009430 tx=0x7f7878009360 comp rx=0 tx=0).stop 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 msgr2=0x7f7888196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c8f0 tx=0x7f787c00cdb0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 shutdown_connections 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f787006d810 0x7f787006fcc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78881045c0 0x7f7888196660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 --2- 172.21.15.138:0/93950111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880fe590 0x7f7888196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 >> 172.21.15.138:0/93950111 conn(0x7f78880fa0b0 msgr2=0x7f78880fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 shutdown_connections 2024-02-15T23:03:50.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.716+0000 7f788f3b1640 1 -- 172.21.15.138:0/93950111 wait complete. 2024-02-15T23:03:50.729 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:50 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/91166618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.729 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:50 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1264295394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.729 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:50 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1042946594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.729 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:50 smithi138 ceph-mon[89527]: pgmap v274: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:50.729 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:50 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3125745954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T23:03:50.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-15T23:03:50.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:50 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/91166618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:50 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1264295394' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:50 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1042946594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:03:50.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:50 smithi170 ceph-mon[67652]: pgmap v274: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:50.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:50 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3125745954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 -- 172.21.15.138:0/939596404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fe890 msgr2=0x7fee24104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/939596404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fe890 0x7fee24104280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee14009880 tx=0x7fee1402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 -- 172.21.15.138:0/939596404 shutdown_connections 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/939596404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fe890 0x7fee24104280 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/939596404 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fdef0 0x7fee240fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 -- 172.21.15.138:0/939596404 >> 172.21.15.138:0/939596404 conn(0x7fee24075c50 msgr2=0x7fee24076050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 -- 172.21.15.138:0/939596404 shutdown_connections 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.829+0000 7fee2c7ca640 1 -- 172.21.15.138:0/939596404 wait complete. 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 Processor -- start 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 -- start start 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 0x7fee24195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24195ec0 con 0x7fee240fdef0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2c7ca640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24199c90 con 0x7fee240fe890 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:39990/0 (socket says 172.21.15.138:39990) 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 -- 172.21.15.138:0/3864800551 learned_addr learned my addr 172.21.15.138:0/3864800551 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee29d65640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 0x7fee24195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 -- 172.21.15.138:0/3864800551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 msgr2=0x7fee24195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 0x7fee24195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee2a566640 1 -- 172.21.15.138:0/3864800551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14009560 con 0x7fee240fdef0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.830+0000 7fee29d65640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 0x7fee24195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee2a566640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d6f0 tx=0x7fee2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee20009a30 con 0x7fee240fdef0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee200054e0 con 0x7fee240fdef0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee24199f70 con 0x7fee240fdef0 2024-02-15T23:03:50.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee20010460 con 0x7fee240fdef0 2024-02-15T23:03:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.831+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2419a550 con 0x7fee240fdef0 2024-02-15T23:03:50.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.832+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2404e000 con 0x7fee240fdef0 2024-02-15T23:03:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.832+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fee20009b90 con 0x7fee240fdef0 2024-02-15T23:03:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.833+0000 7fee1b7fe640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 0x7fee1006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.833+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fee2008d0c0 con 0x7fee240fdef0 2024-02-15T23:03:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.833+0000 7fee29d65640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 0x7fee1006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:50.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.833+0000 7fee29d65640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 0x7fee1006fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee14005ec0 tx=0x7fee14005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:50.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:50.837+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee20056870 con 0x7fee240fdef0 2024-02-15T23:03:51.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.051+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fee24107ad0 con 0x7fee240fdef0 2024-02-15T23:03:51.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.051+0000 7fee1b7fe640 1 -- 172.21.15.138:0/3864800551 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4870 (secure 0 0 0) 0x7fee20059f30 con 0x7fee240fdef0 2024-02-15T23:03:51.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:51.054 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T22:51:03.815294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2716267624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2716267624},{"type":"v1","addr":"172.21.15.138:6827","nonce":2716267624}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.170:6827/2026647764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2026647764},{"type":"v1","addr":"172.21.15.170:6827","nonce":2026647764}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:51.054 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 21 2024-02-15T23:03:51.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 msgr2=0x7fee1006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 0x7fee1006fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee14005ec0 tx=0x7fee14005fd0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 msgr2=0x7fee241952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d6f0 tx=0x7fee2000dbb0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 shutdown_connections 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee1006d810 0x7fee1006fcc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee240fe890 0x7fee24195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 --2- 172.21.15.138:0/3864800551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee240fdef0 0x7fee241952f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.053+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 >> 172.21.15.138:0/3864800551 conn(0x7fee24075c50 msgr2=0x7fee240fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.054+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 shutdown_connections 2024-02-15T23:03:51.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.054+0000 7fee2c7ca640 1 -- 172.21.15.138:0/3864800551 wait complete. 2024-02-15T23:03:51.067 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/881690866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc0fe6e0 msgr2=0x7f9fdc0feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/881690866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc0feb50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009c20 tx=0x7f9fd002c1b0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/881690866 shutdown_connections 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/881690866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc0feb50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/881690866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/881690866 >> 172.21.15.138:0/881690866 conn(0x7f9fdc074cf0 msgr2=0x7f9fdc0750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/881690866 shutdown_connections 2024-02-15T23:03:51.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.166+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/881690866 wait complete. 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 Processor -- start 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 -- start start 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc195e60 con 0x7f9fdc102d10 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc199c30 con 0x7f9fdc0fe6e0 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40004/0 (socket says 172.21.15.138:40004) 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 -- 172.21.15.138:0/2940199804 learned_addr learned my addr 172.21.15.138:0/2940199804 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe184b640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 -- 172.21.15.138:0/2940199804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc0fe6e0 msgr2=0x7f9fdc195290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc195290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 -- 172.21.15.138:0/2940199804 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0009900 con 0x7f9fdc102d10 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe104a640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0037040 tx=0x7f9fd0032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd0034820 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fd0003e30 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc199eb0 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd003f440 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.167+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc19a3b0 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.168+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc04e000 con 0x7f9fdc102d10 2024-02-15T23:03:51.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.169+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9fd003b040 con 0x7f9fdc102d10 2024-02-15T23:03:51.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.169+0000 7f9fdaffd640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 0x7f9fc406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.169+0000 7f9fe184b640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 0x7f9fc406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.170+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9fd00b0390 con 0x7f9fdc102d10 2024-02-15T23:03:51.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.170+0000 7f9fe184b640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 0x7f9fc406fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005d00 tx=0x7f9fd4005c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.174+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9fd0079d20 con 0x7f9fdc102d10 2024-02-15T23:03:51.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.381+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f9fdc1965e0 con 0x7f9fdc102d10 2024-02-15T23:03:51.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.382+0000 7f9fdaffd640 1 -- 172.21.15.138:0/2940199804 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4869 (secure 0 0 0) 0x7f9fd007d3e0 con 0x7f9fdc102d10 2024-02-15T23:03:51.384 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:51.384 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T22:55:13.856303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2716267624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2716267624},{"type":"v1","addr":"172.21.15.138:6827","nonce":2716267624}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.170:6827/2026647764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2026647764},{"type":"v1","addr":"172.21.15.170:6827","nonce":2026647764}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:51.385 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 22 2024-02-15T23:03:51.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.383+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 msgr2=0x7f9fc406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 0x7f9fc406fcc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4005d00 tx=0x7f9fd4005c50 comp rx=0 tx=0).stop 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 msgr2=0x7f9fdc1957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0037040 tx=0x7f9fd0032b60 comp rx=0 tx=0).stop 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 shutdown_connections 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9fc406d810 0x7f9fc406fcc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9fdc102d10 0x7f9fdc1957d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 --2- 172.21.15.138:0/2940199804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fdc0fe6e0 0x7f9fdc195290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 >> 172.21.15.138:0/2940199804 conn(0x7f9fdc074cf0 msgr2=0x7f9fdc0fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 shutdown_connections 2024-02-15T23:03:51.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.384+0000 7f9fe3aaf640 1 -- 172.21.15.138:0/2940199804 wait complete. 2024-02-15T23:03:51.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-15T23:03:51.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 -- 172.21.15.138:0/1419615054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 msgr2=0x7f92a8104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 --2- 172.21.15.138:0/1419615054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8104b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9298009880 tx=0x7f929802bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 -- 172.21.15.138:0/1419615054 shutdown_connections 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 --2- 172.21.15.138:0/1419615054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a80febc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 --2- 172.21.15.138:0/1419615054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8104b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 -- 172.21.15.138:0/1419615054 >> 172.21.15.138:0/1419615054 conn(0x7f92a80fa270 msgr2=0x7f92a80fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 -- 172.21.15.138:0/1419615054 shutdown_connections 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.497+0000 7f92add20640 1 -- 172.21.15.138:0/1419615054 wait complete. 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 Processor -- start 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 -- start start 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a8194150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a8194bd0 con 0x7f92a8104760 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92add20640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a8194d40 con 0x7f92a80fe750 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40014/0 (socket says 172.21.15.138:40014) 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 -- 172.21.15.138:0/1630753662 learned_addr learned my addr 172.21.15.138:0/1630753662 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a77fe640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a8194150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 -- 172.21.15.138:0/1630753662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 msgr2=0x7f92a8194150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a8194150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 -- 172.21.15.138:0/1630753662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009560 con 0x7f92a8104760 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a77fe640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a8194150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.498+0000 7f92a6ffd640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d6f0 tx=0x7f929c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.499+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929c009a30 con 0x7f92a8104760 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.499+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f929c0054e0 con 0x7f92a8104760 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.499+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a81a17c0 con 0x7f92a8104760 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.499+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929c010460 con 0x7f92a8104760 2024-02-15T23:03:51.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.499+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a81a1bb0 con 0x7f92a8104760 2024-02-15T23:03:51.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.500+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a804e000 con 0x7f92a8104760 2024-02-15T23:03:51.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.500+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f929c009b90 con 0x7f92a8104760 2024-02-15T23:03:51.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.500+0000 7f92a4ff9640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 0x7f929006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.501+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f929c08cf50 con 0x7f92a8104760 2024-02-15T23:03:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.501+0000 7f92a77fe640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 0x7f929006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.501+0000 7f92a77fe640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 0x7f929006fcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9298006010 tx=0x7f929802cb40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.505+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f929c0c0d20 con 0x7f92a8104760 2024-02-15T23:03:51.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.716+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f92a810b970 con 0x7f92a8104760 2024-02-15T23:03:51.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.716+0000 7f92a4ff9640 1 -- 172.21.15.138:0/1630753662 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4868 (secure 0 0 0) 0x7f929c017090 con 0x7f92a8104760 2024-02-15T23:03:51.719 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:51.719 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T22:55:27.884255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14486":{"gid":14486,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6827/2716267624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2716267624},{"type":"v1","addr":"172.21.15.138:6827","nonce":2716267624}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.170:6827/2026647764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2026647764},{"type":"v1","addr":"172.21.15.170:6827","nonce":2026647764}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:51.719 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 23 2024-02-15T23:03:51.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.718+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 msgr2=0x7f929006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.718+0000 7f92add20640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 0x7f929006fcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9298006010 tx=0x7f929802cb40 comp rx=0 tx=0).stop 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.718+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 msgr2=0x7f92a8194690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.718+0000 7f92add20640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d6f0 tx=0x7f929c00dbb0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 shutdown_connections 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f929006d810 0x7f929006fcc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92a8104760 0x7f92a8194690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 --2- 172.21.15.138:0/1630753662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92a80fe750 0x7f92a8194150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 >> 172.21.15.138:0/1630753662 conn(0x7f92a80fa270 msgr2=0x7f92a80fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 shutdown_connections 2024-02-15T23:03:51.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.719+0000 7f92add20640 1 -- 172.21.15.138:0/1630753662 wait complete. 2024-02-15T23:03:51.731 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:51 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/93950111' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T23:03:51.731 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:51 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3864800551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T23:03:51.731 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:51 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2940199804' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T23:03:51.732 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-15T23:03:51.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:51 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/93950111' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T23:03:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:51 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3864800551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T23:03:51.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:51 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2940199804' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 -- 172.21.15.138:0/1839095914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 msgr2=0x7f44c80fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 --2- 172.21.15.138:0/1839095914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c80fea20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009880 tx=0x7f44b802bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 -- 172.21.15.138:0/1839095914 shutdown_connections 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 --2- 172.21.15.138:0/1839095914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c80fea20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 --2- 172.21.15.138:0/1839095914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 0x7f44c8104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.831+0000 7f44cfebd640 1 -- 172.21.15.138:0/1839095914 >> 172.21.15.138:0/1839095914 conn(0x7f44c80743d0 msgr2=0x7f44c80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 -- 172.21.15.138:0/1839095914 shutdown_connections 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 -- 172.21.15.138:0/1839095914 wait complete. 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 Processor -- start 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 -- start start 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 0x7f44c8194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8194f00 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cfebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c8198cd0 con 0x7f44c8104590 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cdc59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cdc59640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40026/0 (socket says 172.21.15.138:40026) 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.832+0000 7f44cdc59640 1 -- 172.21.15.138:0/3387330627 learned_addr learned my addr 172.21.15.138:0/3387330627 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cd458640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 0x7f44c8194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cdc59640 1 -- 172.21.15.138:0/3387330627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 msgr2=0x7f44c8194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cdc59640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 0x7f44c8194870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cdc59640 1 -- 172.21.15.138:0/3387330627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8009560 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cdc59640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44c400b420 tx=0x7f44c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c4011800 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44c4011e20 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8198fb0 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c400f2e0 con 0x7f44c80fe5b0 2024-02-15T23:03:51.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.833+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c8199510 con 0x7f44c80fe5b0 2024-02-15T23:03:51.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.834+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c804e000 con 0x7f44c80fe5b0 2024-02-15T23:03:51.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.834+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f44c4010380 con 0x7f44c80fe5b0 2024-02-15T23:03:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.835+0000 7f44beffd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 0x7f44b406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.835+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f44c408cec0 con 0x7f44c80fe5b0 2024-02-15T23:03:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.835+0000 7f44cd458640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 0x7f44b406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.835+0000 7f44cd458640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 0x7f44b406fcc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44c8195940 tx=0x7f44b8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:51.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:51.839+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f44c4056670 con 0x7f44c80fe5b0 2024-02-15T23:03:52.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.048+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f44c81069a0 con 0x7f44c80fe5b0 2024-02-15T23:03:52.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.048+0000 7f44beffd640 1 -- 172.21.15.138:0/3387330627 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+3290 (secure 0 0 0) 0x7f44c4059d30 con 0x7f44c80fe5b0 2024-02-15T23:03:52.051 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:52.051 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:28.126030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14476,"mds_1":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14476":{"gid":14476,"name":"cephfs.smithi138.fzypgq","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.138:6829/1693530689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1693530689},{"type":"v1","addr":"172.21.15.138:6829","nonce":1693530689}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24273":{"gid":24273,"name":"cephfs.smithi170.banvev","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.170:6825/4027411393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":4027411393},{"type":"v1","addr":"172.21.15.170:6825","nonce":4027411393}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:52.052 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 24 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 msgr2=0x7f44b406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 0x7f44b406fcc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44c8195940 tx=0x7f44b8000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 msgr2=0x7f44c8194330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44c400b420 tx=0x7f44c400b8e0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 shutdown_connections 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f44b406d810 0x7f44b406fcc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44c8104590 0x7f44c8194870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 --2- 172.21.15.138:0/3387330627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44c80fe5b0 0x7f44c8194330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 >> 172.21.15.138:0/3387330627 conn(0x7f44c80743d0 msgr2=0x7f44c80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 shutdown_connections 2024-02-15T23:03:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.051+0000 7f44cfebd640 1 -- 172.21.15.138:0/3387330627 wait complete. 2024-02-15T23:03:52.064 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-02-15T23:03:52.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 -- 172.21.15.138:0/1202569070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8067350 msgr2=0x7efea80677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 --2- 172.21.15.138:0/1202569070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8067350 0x7efea80677c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009880 tx=0x7efe9c02bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 -- 172.21.15.138:0/1202569070 shutdown_connections 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 --2- 172.21.15.138:0/1202569070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8067350 0x7efea80677c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 --2- 172.21.15.138:0/1202569070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8105690 0x7efea8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 -- 172.21.15.138:0/1202569070 >> 172.21.15.138:0/1202569070 conn(0x7efea80743d0 msgr2=0x7efea80747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 -- 172.21.15.138:0/1202569070 shutdown_connections 2024-02-15T23:03:52.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.163+0000 7efead04b640 1 -- 172.21.15.138:0/1202569070 wait complete. 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 Processor -- start 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 -- start start 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8067350 0x7efea81952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8195e80 con 0x7efea8105690 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efead04b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8199c50 con 0x7efea8067350 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efea659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efea659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40052/0 (socket says 172.21.15.138:40052) 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.164+0000 7efea659c640 1 -- 172.21.15.138:0/2716677711 learned_addr learned my addr 172.21.15.138:0/2716677711 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efea6d9d640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8067350 0x7efea81952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efea659c640 1 -- 172.21.15.138:0/2716677711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8067350 msgr2=0x7efea81952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efea659c640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8067350 0x7efea81952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efea659c640 1 -- 172.21.15.138:0/2716677711 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009560 con 0x7efea8105690 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efea659c640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009230 tx=0x7efe9c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe9c0035f0 con 0x7efea8105690 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8199ed0 con 0x7efea8105690 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe9c003c10 con 0x7efea8105690 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe9c005670 con 0x7efea8105690 2024-02-15T23:03:52.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.165+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea819a450 con 0x7efea8105690 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.166+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea804e000 con 0x7efea8105690 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.166+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7efe9c004dd0 con 0x7efea8105690 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.167+0000 7efe8ffff640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 0x7efe9006fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.167+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe9c0af910 con 0x7efea8105690 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.167+0000 7efea6d9d640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 0x7efe9006fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.167+0000 7efea6d9d640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 0x7efe9006fc70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efea0005fd0 tx=0x7efea0009870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.172+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe9c0790c0 con 0x7efea8105690 2024-02-15T23:03:52.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.379+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7efea8196600 con 0x7efea8105690 2024-02-15T23:03:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.380+0000 7efe8ffff640 1 -- 172.21.15.138:0/2716677711 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+3269 (secure 0 0 0) 0x7efe9c041ce0 con 0x7efea8105690 2024-02-15T23:03:52.382 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:52.382 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2375700998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2375700998},{"type":"v1","addr":"172.21.15.138:6827","nonce":2375700998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:52.382 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 25 2024-02-15T23:03:52.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 msgr2=0x7efe9006fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 0x7efe9006fc70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efea0005fd0 tx=0x7efea0009870 comp rx=0 tx=0).stop 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 msgr2=0x7efea81957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009230 tx=0x7efe9c004040 comp rx=0 tx=0).stop 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 shutdown_connections 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7efe9006d7c0 0x7efe9006fc70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea8105690 0x7efea81957f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 --2- 172.21.15.138:0/2716677711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efea8067350 0x7efea81952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 >> 172.21.15.138:0/2716677711 conn(0x7efea80743d0 msgr2=0x7efea80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 shutdown_connections 2024-02-15T23:03:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.382+0000 7efead04b640 1 -- 172.21.15.138:0/2716677711 wait complete. 2024-02-15T23:03:52.395 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:52.395 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-02-15T23:03:52.396 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-15T23:03:52.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/2901196618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00ff040 msgr2=0x7fcfb0109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/2901196618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00ff040 0x7fcfb0109ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009880 tx=0x7fcfa402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/2901196618 shutdown_connections 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/2901196618 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00ff040 0x7fcfb0109ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/2901196618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb00fe730 0x7fcfb00feb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/2901196618 >> 172.21.15.138:0/2901196618 conn(0x7fcfb0073d20 msgr2=0x7fcfb0074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/2901196618 shutdown_connections 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.495+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/2901196618 wait complete. 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 Processor -- start 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 -- start start 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb00ff040 0x7fcfb0195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0195dd0 con 0x7fcfb00fe730 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfb5fe4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0199ba0 con 0x7fcfb00ff040 2024-02-15T23:03:52.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40074/0 (socket says 172.21.15.138:40074) 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfaf7fe640 1 -- 172.21.15.138:0/1538792789 learned_addr learned my addr 172.21.15.138:0/1538792789 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfaf7fe640 1 -- 172.21.15.138:0/1538792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb00ff040 msgr2=0x7fcfb0195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.496+0000 7fcfaf7fe640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb00ff040 0x7fcfb0195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfaf7fe640 1 -- 172.21.15.138:0/1538792789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4009560 con 0x7fcfb00fe730 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfaf7fe640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c810 tx=0x7fcfa000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa00041f0 con 0x7fcfb00fe730 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb0199e80 con 0x7fcfb00fe730 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfa0007e70 con 0x7fcfb00fe730 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfa00049d0 con 0x7fcfb00fe730 2024-02-15T23:03:52.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.497+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb019a460 con 0x7fcfb00fe730 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.498+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb004e000 con 0x7fcfb00fe730 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.498+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fcfa00079b0 con 0x7fcfb00fe730 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.499+0000 7fcfacff9640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 0x7fcf9806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.499+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcfa008d3b0 con 0x7fcfb00fe730 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.499+0000 7fcfaeffd640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 0x7fcf9806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.499+0000 7fcfaeffd640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 0x7fcf9806fcc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4036040 tx=0x7fcfa4000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.503+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfa0056b60 con 0x7fcfb00fe730 2024-02-15T23:03:52.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.712+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fcfb0107120 con 0x7fcfb00fe730 2024-02-15T23:03:52.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.713+0000 7fcfacff9640 1 -- 172.21.15.138:0/1538792789 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4833 (secure 0 0 0) 0x7fcfa005a220 con 0x7fcfb00fe730 2024-02-15T23:03:52.716 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:52.716 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2375700998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2375700998},{"type":"v1","addr":"172.21.15.138:6827","nonce":2375700998}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":34388,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/4266863139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4266863139},{"type":"v1","addr":"172.21.15.138:6829","nonce":4266863139}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44259,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/3599825155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3599825155},{"type":"v1","addr":"172.21.15.170:6825","nonce":3599825155}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:52.716 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 26 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 msgr2=0x7fcf9806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 0x7fcf9806fcc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4036040 tx=0x7fcfa4000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 msgr2=0x7fcfb0195200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c810 tx=0x7fcfa000ccd0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 shutdown_connections 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fcf9806d810 0x7fcf9806fcc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb00ff040 0x7fcfb0195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 --2- 172.21.15.138:0/1538792789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00fe730 0x7fcfb0195200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 >> 172.21.15.138:0/1538792789 conn(0x7fcfb0073d20 msgr2=0x7fcfb01042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 shutdown_connections 2024-02-15T23:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.715+0000 7fcfb5fe4640 1 -- 172.21.15.138:0/1538792789 wait complete. 2024-02-15T23:03:52.727 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:52 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1630753662' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T23:03:52.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:52 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3387330627' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T23:03:52.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:52 smithi138 ceph-mon[89527]: pgmap v275: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:52.728 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:52 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2716677711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T23:03:52.729 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:52.729 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-02-15T23:03:52.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-15T23:03:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:52 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1630753662' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T23:03:52.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:52 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3387330627' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T23:03:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:52 smithi170 ceph-mon[67652]: pgmap v275: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:52.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:52 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2716677711' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T23:03:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 -- 172.21.15.138:0/354536250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a40ff840 msgr2=0x7f68a40ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/354536250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a40ff840 0x7f68a40ffcb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6898009880 tx=0x7f689802bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 -- 172.21.15.138:0/354536250 shutdown_connections 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/354536250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a40ff840 0x7f68a40ffcb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/354536250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a4105850 0x7f68a4105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 -- 172.21.15.138:0/354536250 >> 172.21.15.138:0/354536250 conn(0x7f68a40fb320 msgr2=0x7f68a40fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 -- 172.21.15.138:0/354536250 shutdown_connections 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 -- 172.21.15.138:0/354536250 wait complete. 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.828+0000 7f68aa0c4640 1 Processor -- start 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 -- start start 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a40ff840 0x7f68a4195610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a41961e0 con 0x7f68a4105850 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4199fb0 con 0x7f68a40ff840 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40094/0 (socket says 172.21.15.138:40094) 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 -- 172.21.15.138:0/1836132091 learned_addr learned my addr 172.21.15.138:0/1836132091 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:52.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a37fe640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a40ff840 0x7f68a4195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 -- 172.21.15.138:0/1836132091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a40ff840 msgr2=0x7f68a4195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a40ff840 0x7f68a4195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 -- 172.21.15.138:0/1836132091 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898009560 con 0x7f68a4105850 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a2ffd640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6898009230 tx=0x7f6898004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68980035f0 con 0x7f68a4105850 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a419a230 con 0x7f68a4105850 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6898003c10 con 0x7f68a4105850 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.829+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6898034440 con 0x7f68a4105850 2024-02-15T23:03:52.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.830+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a419a7b0 con 0x7f68a4105850 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.831+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a404e000 con 0x7f68a4105850 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.831+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6898004fd0 con 0x7f68a4105850 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.831+0000 7f68a0ff9640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 0x7f688c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.831+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f68980af9b0 con 0x7f68a4105850 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.831+0000 7f68a37fe640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 0x7f688c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:52.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.832+0000 7f68a37fe640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 0x7f688c06fcc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68a4100980 tx=0x7f6894008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:52.836+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6898079160 con 0x7f68a4105850 2024-02-15T23:03:53.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.048+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f68a4066860 con 0x7f68a4105850 2024-02-15T23:03:53.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.049+0000 7f68a0ff9640 1 -- 172.21.15.138:0/1836132091 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f689807c820 con 0x7f68a4105850 2024-02-15T23:03:53.051 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:53.051 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/4266863139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4266863139},{"type":"v1","addr":"172.21.15.138:6829","nonce":4266863139}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44259,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/3599825155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3599825155},{"type":"v1","addr":"172.21.15.170:6825","nonce":3599825155}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:53.052 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 27 2024-02-15T23:03:53.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 msgr2=0x7f688c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 0x7f688c06fcc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68a4100980 tx=0x7f6894008040 comp rx=0 tx=0).stop 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 msgr2=0x7f68a4195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6898009230 tx=0x7f6898004040 comp rx=0 tx=0).stop 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 shutdown_connections 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f688c06d810 0x7f688c06fcc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68a4105850 0x7f68a4195b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 --2- 172.21.15.138:0/1836132091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68a40ff840 0x7f68a4195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 >> 172.21.15.138:0/1836132091 conn(0x7f68a40fb320 msgr2=0x7f68a40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 shutdown_connections 2024-02-15T23:03:53.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.051+0000 7f68aa0c4640 1 -- 172.21.15.138:0/1836132091 wait complete. 2024-02-15T23:03:53.064 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:53.064 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-02-15T23:03:53.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-15T23:03:53.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 -- 172.21.15.138:0/1048984607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 msgr2=0x7f5e500729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/1048984607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e500729d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009880 tx=0x7f5e4c02bd70 comp rx=0 tx=0).stop 2024-02-15T23:03:53.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 -- 172.21.15.138:0/1048984607 shutdown_connections 2024-02-15T23:03:53.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/1048984607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e50110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/1048984607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e500729d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 -- 172.21.15.138:0/1048984607 >> 172.21.15.138:0/1048984607 conn(0x7f5e500fb190 msgr2=0x7f5e500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 -- 172.21.15.138:0/1048984607 shutdown_connections 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.164+0000 7f5e57fe1640 1 -- 172.21.15.138:0/1048984607 wait complete. 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 Processor -- start 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 -- start start 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e501a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5019b6f0 con 0x7f5e50072600 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5019b860 con 0x7f5e50072f10 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40104/0 (socket says 172.21.15.138:40104) 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 -- 172.21.15.138:0/3089487374 learned_addr learned my addr 172.21.15.138:0/3089487374 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e5557c640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e501a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 -- 172.21.15.138:0/3089487374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 msgr2=0x7f5e501a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e501a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 -- 172.21.15.138:0/3089487374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c009560 con 0x7f5e50072600 2024-02-15T23:03:53.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e5557c640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e501a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e55d7d640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0099a0 tx=0x7f5e4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c0035f0 con 0x7f5e50072600 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e4c003c10 con 0x7f5e50072600 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5019bae0 con 0x7f5e50072600 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.165+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c005690 con 0x7f5e50072600 2024-02-15T23:03:53.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.166+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5019c040 con 0x7f5e50072600 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.166+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5004e000 con 0x7f5e50072600 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.167+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f5e4c004ed0 con 0x7f5e50072600 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.167+0000 7f5e46ffd640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 0x7f5e3c06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.167+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5e4c0b0100 con 0x7f5e50072600 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.167+0000 7f5e5557c640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 0x7f5e3c06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.168+0000 7f5e5557c640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 0x7f5e3c06fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e5019cb60 tx=0x7f5e40005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.172+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5e4c0798b0 con 0x7f5e50072600 2024-02-15T23:03:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.393+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f5e5010d830 con 0x7f5e50072600 2024-02-15T23:03:53.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.394+0000 7f5e46ffd640 1 -- 172.21.15.138:0/3089487374 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4867 (secure 0 0 0) 0x7f5e4c07cf70 con 0x7f5e50072600 2024-02-15T23:03:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:53.397 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/4266863139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4266863139},{"type":"v1","addr":"172.21.15.138:6829","nonce":4266863139}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44259,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/3599825155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3599825155},{"type":"v1","addr":"172.21.15.170:6825","nonce":3599825155}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:53.397 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 28 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 msgr2=0x7f5e3c06fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 0x7f5e3c06fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e5019cb60 tx=0x7f5e40005e50 comp rx=0 tx=0).stop 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 msgr2=0x7f5e501a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0099a0 tx=0x7f5e4c004270 comp rx=0 tx=0).stop 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 shutdown_connections 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f5e3c06d7c0 0x7f5e3c06fc70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e50072f10 0x7f5e501a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 --2- 172.21.15.138:0/3089487374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50072600 0x7f5e501a1680 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 >> 172.21.15.138:0/3089487374 conn(0x7f5e500fb190 msgr2=0x7f5e50101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 shutdown_connections 2024-02-15T23:03:53.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.396+0000 7f5e57fe1640 1 -- 172.21.15.138:0/3089487374 wait complete. 2024-02-15T23:03:53.410 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:53.410 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-02-15T23:03:53.410 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- 172.21.15.138:0/1031264693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c0fe5b0 msgr2=0x7fd07c0fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 --2- 172.21.15.138:0/1031264693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c0fea20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009880 tx=0x7fd06c02bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- 172.21.15.138:0/1031264693 shutdown_connections 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 --2- 172.21.15.138:0/1031264693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c0fea20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 --2- 172.21.15.138:0/1031264693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c104590 0x7fd07c104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- 172.21.15.138:0/1031264693 >> 172.21.15.138:0/1031264693 conn(0x7fd07c0743d0 msgr2=0x7fd07c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- 172.21.15.138:0/1031264693 shutdown_connections 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- 172.21.15.138:0/1031264693 wait complete. 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 Processor -- start 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- start start 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c198190 con 0x7fd07c104590 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.511+0000 7fd083f95640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c19bf60 con 0x7fd07c0fe5b0 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40540/0 (socket says 172.21.15.138:40540) 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 -- 172.21.15.138:0/4008240911 learned_addr learned my addr 172.21.15.138:0/4008240911 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081d31640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 -- 172.21.15.138:0/4008240911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 msgr2=0x7fd07c1975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c1975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 -- 172.21.15.138:0/4008240911 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c009560 con 0x7fd07c104590 2024-02-15T23:03:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081d31640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd081530640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009230 tx=0x7fd06c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c0035f0 con 0x7fd07c104590 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd06c003c10 con 0x7fd07c104590 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c19c1e0 con 0x7fd07c104590 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06c034440 con 0x7fd07c104590 2024-02-15T23:03:53.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.512+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c19c760 con 0x7fd07c104590 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.513+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c04e000 con 0x7fd07c104590 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.514+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fd06c004fd0 con 0x7fd07c104590 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.514+0000 7fd072ffd640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 0x7fd06806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.514+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd06c0af9c0 con 0x7fd07c104590 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.514+0000 7fd081d31640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 0x7fd06806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.514+0000 7fd081d31640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 0x7fd06806fcc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd078006fd0 tx=0x7fd078008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.518+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd06c079170 con 0x7fd07c104590 2024-02-15T23:03:53.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:53 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1538792789' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T23:03:53.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:53 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1836132091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T23:03:53.692 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:53 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3089487374' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T23:03:53.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.734+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fd07c198910 con 0x7fd07c104590 2024-02-15T23:03:53.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.735+0000 7fd072ffd640 1 -- 172.21.15.138:0/4008240911 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4085 (secure 0 0 0) 0x7fd06c07c830 con 0x7fd07c104590 2024-02-15T23:03:53.737 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:53.737 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44259,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/3599825155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3599825155},{"type":"v1","addr":"172.21.15.170:6825","nonce":3599825155}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:53.738 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 29 2024-02-15T23:03:53.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 msgr2=0x7fd06806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 0x7fd06806fcc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd078006fd0 tx=0x7fd078008040 comp rx=0 tx=0).stop 2024-02-15T23:03:53.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 msgr2=0x7fd07c197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009230 tx=0x7fd06c004040 comp rx=0 tx=0).stop 2024-02-15T23:03:53.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 shutdown_connections 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fd06806d810 0x7fd06806fcc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07c104590 0x7fd07c197b00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 --2- 172.21.15.138:0/4008240911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd07c0fe5b0 0x7fd07c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 >> 172.21.15.138:0/4008240911 conn(0x7fd07c0743d0 msgr2=0x7fd07c067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 shutdown_connections 2024-02-15T23:03:53.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.737+0000 7fd083f95640 1 -- 172.21.15.138:0/4008240911 wait complete. 2024-02-15T23:03:53.751 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:53.751 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-02-15T23:03:53.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-15T23:03:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:53 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1538792789' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T23:03:53.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:53 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1836132091' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T23:03:53.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:53 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3089487374' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T23:03:53.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 -- 172.21.15.138:0/828852815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0ff000 msgr2=0x7fda1c109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 --2- 172.21.15.138:0/828852815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0ff000 0x7fda1c109a70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fda080098b0 tx=0x7fda0802bcd0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 -- 172.21.15.138:0/828852815 shutdown_connections 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 --2- 172.21.15.138:0/828852815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0ff000 0x7fda1c109a70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 --2- 172.21.15.138:0/828852815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c0feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 -- 172.21.15.138:0/828852815 >> 172.21.15.138:0/828852815 conn(0x7fda1c073d20 msgr2=0x7fda1c074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 -- 172.21.15.138:0/828852815 shutdown_connections 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.851+0000 7fda22f77640 1 -- 172.21.15.138:0/828852815 wait complete. 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 Processor -- start 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 -- start start 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 0x7fda1c1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c195f50 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c199d20 con 0x7fda1c0ff000 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40546/0 (socket says 172.21.15.138:40546) 2024-02-15T23:03:53.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 -- 172.21.15.138:0/3906540391 learned_addr learned my addr 172.21.15.138:0/3906540391 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda1bfff640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 0x7fda1c1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 -- 172.21.15.138:0/3906540391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 msgr2=0x7fda1c1958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 0x7fda1c1958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 -- 172.21.15.138:0/3906540391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08009560 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda1bfff640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 0x7fda1c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda20d13640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fda1000d6f0 tx=0x7fda1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda10009a30 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda100054e0 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c19a000 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.852+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda10010460 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.853+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c19a530 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.854+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c04e000 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.854+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fda10009b90 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.854+0000 7fda19ffb640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 0x7fda0c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.854+0000 7fda1bfff640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 0x7fda0c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.854+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fda1008cfd0 con 0x7fda1c0fe6f0 2024-02-15T23:03:53.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.855+0000 7fda1bfff640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 0x7fda0c06fcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda08005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:53.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:53.859+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda10056800 con 0x7fda1c0fe6f0 2024-02-15T23:03:54.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.068+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fda1c1070e0 con 0x7fda1c0fe6f0 2024-02-15T23:03:54.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.069+0000 7fda19ffb640 1 -- 172.21.15.138:0/3906540391 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4901 (secure 0 0 0) 0x7fda10020090 con 0x7fda1c0fe6f0 2024-02-15T23:03:54.071 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:54.071 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44259,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/3599825155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3599825155},{"type":"v1","addr":"172.21.15.170:6825","nonce":3599825155}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:54.072 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 30 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 msgr2=0x7fda0c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 0x7fda0c06fcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda08005a20 comp rx=0 tx=0).stop 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 msgr2=0x7fda1c195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fda1000d6f0 tx=0x7fda1000dbb0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 shutdown_connections 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fda0c06d810 0x7fda0c06fcc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c0ff000 0x7fda1c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 --2- 172.21.15.138:0/3906540391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda1c0fe6f0 0x7fda1c195380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 >> 172.21.15.138:0/3906540391 conn(0x7fda1c073d20 msgr2=0x7fda1c1042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 shutdown_connections 2024-02-15T23:03:54.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.071+0000 7fda22f77640 1 -- 172.21.15.138:0/3906540391 wait complete. 2024-02-15T23:03:54.085 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:54.085 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-02-15T23:03:54.085 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-15T23:03:54.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/785836163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00ff870 msgr2=0x7fe1f00ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/785836163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00ff870 0x7fe1f00ffce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009880 tx=0x7fe1dc02bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/785836163 shutdown_connections 2024-02-15T23:03:54.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/785836163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f00ff870 0x7fe1f00ffce0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/785836163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f0105880 0x7fe1f0105c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/785836163 >> 172.21.15.138:0/785836163 conn(0x7fe1f00fb370 msgr2=0x7fe1f00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/785836163 shutdown_connections 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.184+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/785836163 wait complete. 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 Processor -- start 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 -- start start 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f00ff870 0x7fe1f0195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0196200 con 0x7fe1f0105880 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0199fd0 con 0x7fe1f00ff870 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40560/0 (socket says 172.21.15.138:40560) 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 -- 172.21.15.138:0/1349866450 learned_addr learned my addr 172.21.15.138:0/1349866450 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 -- 172.21.15.138:0/1349866450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f00ff870 msgr2=0x7fe1f0195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f00ff870 0x7fe1f0195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 -- 172.21.15.138:0/1349866450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009560 con 0x7fe1f0105880 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1effff640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009230 tx=0x7fe1dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1dc0035f0 con 0x7fe1f0105880 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f019a250 con 0x7fe1f0105880 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1dc003c10 con 0x7fe1f0105880 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.185+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1dc034440 con 0x7fe1f0105880 2024-02-15T23:03:54.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.186+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f019a7d0 con 0x7fe1f0105880 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.187+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f004e000 con 0x7fe1f0105880 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.187+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe1dc004fd0 con 0x7fe1f0105880 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.187+0000 7fe1edffb640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 0x7fe1e006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.188+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe1dc0af9c0 con 0x7fe1f0105880 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.188+0000 7fe1f49fb640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 0x7fe1e006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.188+0000 7fe1f49fb640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 0x7fe1e006fcc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1f01009b0 tx=0x7fe1e4006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.192+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe1dc079170 con 0x7fe1f0105880 2024-02-15T23:03:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.402+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fe1f0066860 con 0x7fe1f0105880 2024-02-15T23:03:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.403+0000 7fe1edffb640 1 -- 172.21.15.138:0/1349866450 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4119 (secure 0 0 0) 0x7fe1dc07c830 con 0x7fe1f0105880 2024-02-15T23:03:54.406 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:54.406 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:54.406 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 31 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 msgr2=0x7fe1e006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 0x7fe1e006fcc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe1f01009b0 tx=0x7fe1e4006c90 comp rx=0 tx=0).stop 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 msgr2=0x7fe1f0195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009230 tx=0x7fe1dc004040 comp rx=0 tx=0).stop 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 shutdown_connections 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe1e006d810 0x7fe1e006fcc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe1f0105880 0x7fe1f0195b70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 --2- 172.21.15.138:0/1349866450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1f00ff870 0x7fe1f0195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 >> 172.21.15.138:0/1349866450 conn(0x7fe1f00fb370 msgr2=0x7fe1f00fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 shutdown_connections 2024-02-15T23:03:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.405+0000 7fe1f6c5f640 1 -- 172.21.15.138:0/1349866450 wait complete. 2024-02-15T23:03:54.419 DEBUG:tasks.fs:max_mds not reduced in epoch 31 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:54.419 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-02-15T23:03:54.419 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-15T23:03:54.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- 172.21.15.138:0/2928724808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 msgr2=0x7f3edc1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/2928724808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc1096a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40098b0 tx=0x7f3ec402bcd0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- 172.21.15.138:0/2928724808 shutdown_connections 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/2928724808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc1096a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/2928724808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 0x7f3edc100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- 172.21.15.138:0/2928724808 >> 172.21.15.138:0/2928724808 conn(0x7f3edc0fa0b0 msgr2=0x7f3edc0fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- 172.21.15.138:0/2928724808 shutdown_connections 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- 172.21.15.138:0/2928724808 wait complete. 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 Processor -- start 2024-02-15T23:03:54.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.520+0000 7f3ee14e7640 1 -- start start 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 0x7f3edc197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc198200 con 0x7f3edc1011b0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc19bfd0 con 0x7f3edc1008a0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40568/0 (socket says 172.21.15.138:40568) 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 -- 172.21.15.138:0/1890192714 learned_addr learned my addr 172.21.15.138:0/1890192714 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3edaffd640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 0x7f3edc197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 -- 172.21.15.138:0/1890192714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 msgr2=0x7f3edc197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 0x7f3edc197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 -- 172.21.15.138:0/1890192714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009560 con 0x7f3edc1011b0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3eda7fc640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009880 tx=0x7f3ec4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec40035f0 con 0x7f3edc1011b0 2024-02-15T23:03:54.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ec4003c10 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc19c250 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec4034440 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.521+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc19c750 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.522+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc04e000 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.523+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3ec4004f60 con 0x7f3edc1011b0 2024-02-15T23:03:54.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.523+0000 7f3ed3fff640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 0x7f3ec806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.523+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3ec40afa50 con 0x7f3edc1011b0 2024-02-15T23:03:54.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.523+0000 7f3edaffd640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 0x7f3ec806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.524+0000 7f3edaffd640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 0x7f3ec806fcc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009890 tx=0x7f3ed4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.528+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ec4079200 con 0x7f3edc1011b0 2024-02-15T23:03:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:54 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/4008240911' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T23:03:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:54 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3906540391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T23:03:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:54 smithi138 ceph-mon[89527]: pgmap v276: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:54.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:54 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1349866450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T23:03:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.737+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f3edc109110 con 0x7f3edc1011b0 2024-02-15T23:03:54.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.738+0000 7f3ed3fff640 1 -- 172.21.15.138:0/1890192714 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f3ec407c8c0 con 0x7f3edc1011b0 2024-02-15T23:03:54.740 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:54.740 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44251,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/4288390842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":4288390842},{"type":"v1","addr":"172.21.15.170:6827","nonce":4288390842}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:54.741 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 32 2024-02-15T23:03:54.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 msgr2=0x7f3ec806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 0x7f3ec806fcc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009890 tx=0x7f3ed4008040 comp rx=0 tx=0).stop 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 msgr2=0x7f3edc197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009880 tx=0x7f3ec4004040 comp rx=0 tx=0).stop 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 shutdown_connections 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3ec806d810 0x7f3ec806fcc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3edc1011b0 0x7f3edc197b70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 --2- 172.21.15.138:0/1890192714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3edc1008a0 0x7f3edc197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 >> 172.21.15.138:0/1890192714 conn(0x7f3edc0fa0b0 msgr2=0x7f3edc1062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 shutdown_connections 2024-02-15T23:03:54.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.740+0000 7f3ee14e7640 1 -- 172.21.15.138:0/1890192714 wait complete. 2024-02-15T23:03:54.753 DEBUG:tasks.fs:max_mds not reduced in epoch 32 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:54.754 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-02-15T23:03:54.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-15T23:03:54.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:54 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/4008240911' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T23:03:54.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:54 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3906540391' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T23:03:54.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:54 smithi170 ceph-mon[67652]: pgmap v276: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:54.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:54 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1349866450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 -- 172.21.15.138:0/1685114378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d01045c0 msgr2=0x7f57d0104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 --2- 172.21.15.138:0/1685114378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d01045c0 0x7f57d0104990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009880 tx=0x7f57c402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 -- 172.21.15.138:0/1685114378 shutdown_connections 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 --2- 172.21.15.138:0/1685114378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d00fe590 0x7f57d00fea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 --2- 172.21.15.138:0/1685114378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d01045c0 0x7f57d0104990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 -- 172.21.15.138:0/1685114378 >> 172.21.15.138:0/1685114378 conn(0x7f57d00fa0b0 msgr2=0x7f57d00fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 -- 172.21.15.138:0/1685114378 shutdown_connections 2024-02-15T23:03:54.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.853+0000 7f57d7215640 1 -- 172.21.15.138:0/1685114378 wait complete. 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 Processor -- start 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 -- start start 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d01045c0 0x7f57d0195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0195ec0 con 0x7f57d00fe590 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0199c90 con 0x7f57d01045c0 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40596/0 (socket says 172.21.15.138:40596) 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 -- 172.21.15.138:0/64738593 learned_addr learned my addr 172.21.15.138:0/64738593 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57cffff640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d01045c0 0x7f57d0195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 -- 172.21.15.138:0/64738593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d01045c0 msgr2=0x7f57d0195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d01045c0 0x7f57d0195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 -- 172.21.15.138:0/64738593 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009560 con 0x7f57d00fe590 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d4fb1640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57c4000c00 tx=0x7f57c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57c40037c0 con 0x7f57d00fe590 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57c4003de0 con 0x7f57d00fe590 2024-02-15T23:03:54.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0199f10 con 0x7f57d00fe590 2024-02-15T23:03:54.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.854+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57c4034460 con 0x7f57d00fe590 2024-02-15T23:03:54.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.855+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d019a490 con 0x7f57d00fe590 2024-02-15T23:03:54.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.856+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d004e000 con 0x7f57d00fe590 2024-02-15T23:03:54.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.856+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f57c4003920 con 0x7f57d00fe590 2024-02-15T23:03:54.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.857+0000 7f57cdffb640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 0x7f57c006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:54.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.857+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f57c40af970 con 0x7f57d00fe590 2024-02-15T23:03:54.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.857+0000 7f57cffff640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 0x7f57c006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:54.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.857+0000 7f57cffff640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 0x7f57c006fcc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57d0196900 tx=0x7f57bc00a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:54.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:54.861+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f57c4079260 con 0x7f57d00fe590 2024-02-15T23:03:55.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.071+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f57d0196640 con 0x7f57d00fe590 2024-02-15T23:03:55.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.072+0000 7f57cdffb640 1 -- 172.21.15.138:0/64738593 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4150 (secure 0 0 0) 0x7f57c407c920 con 0x7f57d00fe590 2024-02-15T23:03:55.074 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:55.074 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:55.075 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 33 2024-02-15T23:03:55.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 msgr2=0x7f57c006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 0x7f57c006fcc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57d0196900 tx=0x7f57bc00a4c0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 msgr2=0x7f57d01952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f57c4000c00 tx=0x7f57c4004270 comp rx=0 tx=0).stop 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 shutdown_connections 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f57c006d810 0x7f57c006fcc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57d01045c0 0x7f57d0195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 --2- 172.21.15.138:0/64738593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d00fe590 0x7f57d01952f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 >> 172.21.15.138:0/64738593 conn(0x7f57d00fa0b0 msgr2=0x7f57d00683e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 shutdown_connections 2024-02-15T23:03:55.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.074+0000 7f57d7215640 1 -- 172.21.15.138:0/64738593 wait complete. 2024-02-15T23:03:55.087 DEBUG:tasks.fs:max_mds not reduced in epoch 33 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:55.088 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-02-15T23:03:55.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-15T23:03:55.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 -- 172.21.15.138:0/1072024784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0fe730 msgr2=0x7f047c0feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 --2- 172.21.15.138:0/1072024784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0fe730 0x7f047c0feb00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0474009c20 tx=0x7f047402c1b0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 -- 172.21.15.138:0/1072024784 shutdown_connections 2024-02-15T23:03:55.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 --2- 172.21.15.138:0/1072024784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0ff040 0x7f047c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 --2- 172.21.15.138:0/1072024784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0fe730 0x7f047c0feb00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 -- 172.21.15.138:0/1072024784 >> 172.21.15.138:0/1072024784 conn(0x7f047c073d20 msgr2=0x7f047c074120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 -- 172.21.15.138:0/1072024784 shutdown_connections 2024-02-15T23:03:55.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 -- 172.21.15.138:0/1072024784 wait complete. 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.187+0000 7f04810ae640 1 Processor -- start 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 -- start start 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0fe730 0x7f047c195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c195da0 con 0x7f047c0ff040 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c195f10 con 0x7f047c0fe730 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40606/0 (socket says 172.21.15.138:40606) 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 -- 172.21.15.138:0/1202108912 learned_addr learned my addr 172.21.15.138:0/1202108912 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047ad9d640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0fe730 0x7f047c195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 -- 172.21.15.138:0/1202108912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0fe730 msgr2=0x7f047c195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0fe730 0x7f047c195260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 -- 172.21.15.138:0/1202108912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0474009900 con 0x7f047c0ff040 2024-02-15T23:03:55.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f047a59c640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f046400c8a0 tx=0x7f046400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0464007b80 con 0x7f047c0ff040 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c199da0 con 0x7f047c0ff040 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0464007ce0 con 0x7f047c0ff040 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0464018810 con 0x7f047c0ff040 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.188+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c19a300 con 0x7f047c0ff040 2024-02-15T23:03:55.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.189+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c04e000 con 0x7f047c0ff040 2024-02-15T23:03:55.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.190+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f0464018a80 con 0x7f047c0ff040 2024-02-15T23:03:55.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.190+0000 7f0473fff640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 0x7f046806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.190+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f046408d780 con 0x7f047c0ff040 2024-02-15T23:03:55.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.190+0000 7f047ad9d640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 0x7f046806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.191+0000 7f047ad9d640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 0x7f046806fcc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0474004af0 tx=0x7f0474004a40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.195+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0464056fe0 con 0x7f047c0ff040 2024-02-15T23:03:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.404+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f047c107120 con 0x7f047c0ff040 2024-02-15T23:03:55.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.405+0000 7f0473fff640 1 -- 172.21.15.138:0/1202108912 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+4960 (secure 0 0 0) 0x7f046405a6a0 con 0x7f047c0ff040 2024-02-15T23:03:55.408 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:55.408 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:00:29.288140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:55.408 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 34 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 msgr2=0x7f046806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 0x7f046806fcc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0474004af0 tx=0x7f0474004a40 comp rx=0 tx=0).stop 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 msgr2=0x7f047c1957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f046400c8a0 tx=0x7f046400cd60 comp rx=0 tx=0).stop 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 shutdown_connections 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f046806d810 0x7f046806fcc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f047c0ff040 0x7f047c1957a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 --2- 172.21.15.138:0/1202108912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f047c0fe730 0x7f047c195260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 >> 172.21.15.138:0/1202108912 conn(0x7f047c073d20 msgr2=0x7f047c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 shutdown_connections 2024-02-15T23:03:55.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.407+0000 7f04810ae640 1 -- 172.21.15.138:0/1202108912 wait complete. 2024-02-15T23:03:55.421 DEBUG:tasks.fs:max_mds not reduced in epoch 34 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-15T23:03:55.421 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-02-15T23:03:55.421 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 -- 172.21.15.138:0/2483438539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e40fe7f0 msgr2=0x7ff9e40fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 --2- 172.21.15.138:0/2483438539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e40fec60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009880 tx=0x7ff9d802bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 -- 172.21.15.138:0/2483438539 shutdown_connections 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 --2- 172.21.15.138:0/2483438539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e40fec60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 --2- 172.21.15.138:0/2483438539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e4104800 0x7ff9e4104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 -- 172.21.15.138:0/2483438539 >> 172.21.15.138:0/2483438539 conn(0x7ff9e40fa2f0 msgr2=0x7ff9e40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 -- 172.21.15.138:0/2483438539 shutdown_connections 2024-02-15T23:03:55.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.521+0000 7ff9e925c640 1 -- 172.21.15.138:0/2483438539 wait complete. 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 Processor -- start 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 -- start start 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e4197580 con 0x7ff9e4104800 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e925c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41976c0 con 0x7ff9e40fe7f0 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40624/0 (socket says 172.21.15.138:40624) 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 -- 172.21.15.138:0/3987027536 learned_addr learned my addr 172.21.15.138:0/3987027536 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e2d9d640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 -- 172.21.15.138:0/3987027536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40fe7f0 msgr2=0x7ff9e419d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e419d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 -- 172.21.15.138:0/3987027536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d8009560 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.522+0000 7ff9e259c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009230 tx=0x7ff9d8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.523+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d80035f0 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.523+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e4197940 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.523+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9d8003c10 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.523+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9d8034440 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.523+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e4197ec0 con 0x7ff9e4104800 2024-02-15T23:03:55.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.524+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e404e000 con 0x7ff9e4104800 2024-02-15T23:03:55.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.524+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff9d8004fd0 con 0x7ff9e4104800 2024-02-15T23:03:55.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.524+0000 7ff9cbfff640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 0x7ff9cc06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.525+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff9d80af9b0 con 0x7ff9e4104800 2024-02-15T23:03:55.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.525+0000 7ff9e2d9d640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 0x7ff9cc06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.525+0000 7ff9e2d9d640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 0x7ff9cc06fcc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40058c0 tx=0x7ff9d400a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.529+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff9d8079160 con 0x7ff9e4104800 2024-02-15T23:03:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:55 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1890192714' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T23:03:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:55 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/64738593' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T23:03:55.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:55 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1202108912' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T23:03:55.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.738+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7ff9e410b9e0 con 0x7ff9e4104800 2024-02-15T23:03:55.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.738+0000 7ff9cbfff640 1 -- 172.21.15.138:0/3987027536 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+4959 (secure 0 0 0) 0x7ff9d807c820 con 0x7ff9e4104800 2024-02-15T23:03:55.741 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:55.741 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:38.409355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:55.741 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 35 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 msgr2=0x7ff9cc06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 0x7ff9cc06fcc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40058c0 tx=0x7ff9d400a4c0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 msgr2=0x7ff9e419dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009230 tx=0x7ff9d8004040 comp rx=0 tx=0).stop 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 shutdown_connections 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9cc06d810 0x7ff9cc06fcc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e4104800 0x7ff9e419dae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 --2- 172.21.15.138:0/3987027536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40fe7f0 0x7ff9e419d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 >> 172.21.15.138:0/3987027536 conn(0x7ff9e40fa2f0 msgr2=0x7ff9e40683e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 shutdown_connections 2024-02-15T23:03:55.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.741+0000 7ff9e925c640 1 -- 172.21.15.138:0/3987027536 wait complete. 2024-02-15T23:03:55.754 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-02-15T23:03:55.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-15T23:03:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:55 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1890192714' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T23:03:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:55 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/64738593' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T23:03:55.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:55 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1202108912' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.854+0000 7f8ec305c640 1 -- 172.21.15.138:0/271630890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072600 msgr2=0x7f8ebc0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.854+0000 7f8ec305c640 1 --2- 172.21.15.138:0/271630890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072600 0x7f8ebc0729d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009880 tx=0x7f8eac02bd70 comp rx=0 tx=0).stop 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- 172.21.15.138:0/271630890 shutdown_connections 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 --2- 172.21.15.138:0/271630890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072f10 0x7f8ebc10b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 --2- 172.21.15.138:0/271630890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072600 0x7f8ebc0729d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- 172.21.15.138:0/271630890 >> 172.21.15.138:0/271630890 conn(0x7f8ebc0fb190 msgr2=0x7f8ebc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- 172.21.15.138:0/271630890 shutdown_connections 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- 172.21.15.138:0/271630890 wait complete. 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 Processor -- start 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- start start 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072600 0x7f8ebc197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc198100 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ec305c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc19bed0 con 0x7f8ebc072600 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ebbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40644/0 (socket says 172.21.15.138:40644) 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.855+0000 7f8ebbfff640 1 -- 172.21.15.138:0/1337757118 learned_addr learned my addr 172.21.15.138:0/1337757118 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ec0df8640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072600 0x7f8ebc197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ebbfff640 1 -- 172.21.15.138:0/1337757118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072600 msgr2=0x7f8ebc197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ebbfff640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072600 0x7f8ebc197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ebbfff640 1 -- 172.21.15.138:0/1337757118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009560 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ebbfff640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000d6f0 tx=0x7f8eb000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb0009a30 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8eb00054e0 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ebc19c1b0 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb0010460 con 0x7f8ebc072f10 2024-02-15T23:03:55.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.856+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc19c710 con 0x7f8ebc072f10 2024-02-15T23:03:55.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.857+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ebc04e000 con 0x7f8ebc072f10 2024-02-15T23:03:55.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.857+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8eb0009b90 con 0x7f8ebc072f10 2024-02-15T23:03:55.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.858+0000 7f8eb9ffb640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 0x7f8ea406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:55.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.858+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8eb008cfd0 con 0x7f8ebc072f10 2024-02-15T23:03:55.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.858+0000 7f8ec0df8640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 0x7f8ea406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:55.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.858+0000 7f8ec0df8640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 0x7f8ea406fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006010 tx=0x7f8eac000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:55.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:55.862+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8eb0056800 con 0x7f8ebc072f10 2024-02-15T23:03:56.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.073+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f8ebc10ea70 con 0x7f8ebc072f10 2024-02-15T23:03:56.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.074+0000 7f8eb9ffb640 1 -- 172.21.15.138:0/1337757118 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+5016 (secure 0 0 0) 0x7f8eb0020090 con 0x7f8ebc072f10 2024-02-15T23:03:56.076 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:56.076 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:39.410252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:56.076 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 36 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 msgr2=0x7f8ea406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 0x7f8ea406fcc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006010 tx=0x7f8eac000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 msgr2=0x7f8ebc197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000d6f0 tx=0x7f8eb000dbb0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 shutdown_connections 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f8ea406d810 0x7f8ea406fcc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ebc072f10 0x7f8ebc197a70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 --2- 172.21.15.138:0/1337757118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ebc072600 0x7f8ebc197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 >> 172.21.15.138:0/1337757118 conn(0x7f8ebc0fb190 msgr2=0x7f8ebc1061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 shutdown_connections 2024-02-15T23:03:56.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.076+0000 7f8ec305c640 1 -- 172.21.15.138:0/1337757118 wait complete. 2024-02-15T23:03:56.089 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-02-15T23:03:56.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-15T23:03:56.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 -- 172.21.15.138:0/2423766552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 msgr2=0x7f9430104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2423766552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430104990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9424009880 tx=0x7f942402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 -- 172.21.15.138:0/2423766552 shutdown_connections 2024-02-15T23:03:56.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2423766552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 0x7f94300fea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2423766552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430104990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 -- 172.21.15.138:0/2423766552 >> 172.21.15.138:0/2423766552 conn(0x7f94300fa070 msgr2=0x7f94300fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 -- 172.21.15.138:0/2423766552 shutdown_connections 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.190+0000 7f9436bd2640 1 -- 172.21.15.138:0/2423766552 wait complete. 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 Processor -- start 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 -- start start 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 0x7f9430194220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430194df0 con 0x7f94301045c0 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f9436bd2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430198bc0 con 0x7f94300fe590 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40670/0 (socket says 172.21.15.138:40670) 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 -- 172.21.15.138:0/2094922526 learned_addr learned my addr 172.21.15.138:0/2094922526 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f943496e640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 0x7f9430194220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 -- 172.21.15.138:0/2094922526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 msgr2=0x7f9430194220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 0x7f9430194220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 -- 172.21.15.138:0/2094922526 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424009560 con 0x7f94301045c0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942ffff640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f941c009860 tx=0x7f941c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.191+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c012070 con 0x7f94301045c0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.192+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430198e40 con 0x7f94301045c0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.192+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f941c0047a0 con 0x7f94301045c0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.192+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f941c007b50 con 0x7f94301045c0 2024-02-15T23:03:56.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.192+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94301993a0 con 0x7f94301045c0 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.193+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943004e000 con 0x7f94301045c0 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.193+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f941c016070 con 0x7f94301045c0 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.193+0000 7f942dffb640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 0x7f942006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.194+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f941c08e920 con 0x7f94301045c0 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.194+0000 7f943496e640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 0x7f942006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.194+0000 7f943496e640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 0x7f942006fcc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9424006010 tx=0x7f9424000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.198+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f941c0580d0 con 0x7f94301045c0 2024-02-15T23:03:56.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.405+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f943010b9a0 con 0x7f94301045c0 2024-02-15T23:03:56.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.405+0000 7f942dffb640 1 -- 172.21.15.138:0/2094922526 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+5015 (secure 0 0 0) 0x7f941c05b790 con 0x7f94301045c0 2024-02-15T23:03:56.408 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:56.408 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:39.414828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:56.409 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 37 2024-02-15T23:03:56.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 msgr2=0x7f942006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 0x7f942006fcc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9424006010 tx=0x7f9424000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 msgr2=0x7f9430194760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f941c009860 tx=0x7f941c009d20 comp rx=0 tx=0).stop 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 shutdown_connections 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f942006d810 0x7f942006fcc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94301045c0 0x7f9430194760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 --2- 172.21.15.138:0/2094922526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94300fe590 0x7f9430194220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 >> 172.21.15.138:0/2094922526 conn(0x7f94300fa070 msgr2=0x7f94300fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 shutdown_connections 2024-02-15T23:03:56.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.408+0000 7f9436bd2640 1 -- 172.21.15.138:0/2094922526 wait complete. 2024-02-15T23:03:56.422 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-15T23:03:56.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- 172.21.15.138:0/1653229908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a241047e0 msgr2=0x7f3a24104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1653229908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a241047e0 0x7f3a24104bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009880 tx=0x7f3a1402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- 172.21.15.138:0/1653229908 shutdown_connections 2024-02-15T23:03:56.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1653229908 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a240fe7d0 0x7f3a240fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1653229908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a241047e0 0x7f3a24104bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- 172.21.15.138:0/1653229908 >> 172.21.15.138:0/1653229908 conn(0x7f3a240fa2d0 msgr2=0x7f3a240fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- 172.21.15.138:0/1653229908 shutdown_connections 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- 172.21.15.138:0/1653229908 wait complete. 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 Processor -- start 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.522+0000 7f3a29eca640 1 -- start start 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a241047e0 0x7f3a24195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24196140 con 0x7f3a240fe7d0 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24199f10 con 0x7f3a241047e0 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40684/0 (socket says 172.21.15.138:40684) 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 -- 172.21.15.138:0/1065919071 learned_addr learned my addr 172.21.15.138:0/1065919071 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a1bfff640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a241047e0 0x7f3a24195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 -- 172.21.15.138:0/1065919071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a241047e0 msgr2=0x7f3a24195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a241047e0 0x7f3a24195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 -- 172.21.15.138:0/1065919071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14009560 con 0x7f3a240fe7d0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a237fe640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009230 tx=0x7f3a14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a140037c0 con 0x7f3a240fe7d0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a14003de0 con 0x7f3a240fe7d0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2419a190 con 0x7f3a240fe7d0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a14034440 con 0x7f3a240fe7d0 2024-02-15T23:03:56.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.523+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2419a690 con 0x7f3a240fe7d0 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.524+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2404e000 con 0x7f3a240fe7d0 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.525+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f3a14004fb0 con 0x7f3a240fe7d0 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.525+0000 7f3a217fa640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 0x7f3a1006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.525+0000 7f3a1bfff640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 0x7f3a1006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.526+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3a140afa50 con 0x7f3a240fe7d0 2024-02-15T23:03:56.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.526+0000 7f3a1bfff640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 0x7f3a1006fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005fd0 tx=0x7f3a0c005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.530+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a14079200 con 0x7f3a240fe7d0 2024-02-15T23:03:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:56 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3987027536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T23:03:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:56 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1337757118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T23:03:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:56 smithi138 ceph-mon[89527]: pgmap v277: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:56.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:56 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2094922526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T23:03:56.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.738+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f3a24066860 con 0x7f3a240fe7d0 2024-02-15T23:03:56.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.739+0000 7f3a217fa640 1 -- 172.21.15.138:0/1065919071 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+5017 (secure 0 0 0) 0x7f3a1407c8c0 con 0x7f3a240fe7d0 2024-02-15T23:03:56.742 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:56.742 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:46.771193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:resolve","state_seq":14,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:56.742 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 38 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 msgr2=0x7f3a1006fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 0x7f3a1006fcc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005fd0 tx=0x7f3a0c005e20 comp rx=0 tx=0).stop 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 msgr2=0x7f3a24195570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009230 tx=0x7f3a14004270 comp rx=0 tx=0).stop 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 shutdown_connections 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f3a1006d810 0x7f3a1006fcc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a241047e0 0x7f3a24195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 --2- 172.21.15.138:0/1065919071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a240fe7d0 0x7f3a24195570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 >> 172.21.15.138:0/1065919071 conn(0x7f3a240fa2d0 msgr2=0x7f3a24102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 shutdown_connections 2024-02-15T23:03:56.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.741+0000 7f3a29eca640 1 -- 172.21.15.138:0/1065919071 wait complete. 2024-02-15T23:03:56.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-15T23:03:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:56 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3987027536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T23:03:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:56 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1337757118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T23:03:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:56 smithi170 ceph-mon[67652]: pgmap v277: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-15T23:03:56.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:56 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2094922526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T23:03:56.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.854+0000 7f6732805640 1 -- 172.21.15.138:0/668425636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 msgr2=0x7f672c0fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.854+0000 7f6732805640 1 --2- 172.21.15.138:0/668425636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c0fec60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f671c009880 tx=0x7f671c02bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.854+0000 7f6732805640 1 -- 172.21.15.138:0/668425636 shutdown_connections 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.854+0000 7f6732805640 1 --2- 172.21.15.138:0/668425636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c0fec60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.854+0000 7f6732805640 1 --2- 172.21.15.138:0/668425636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 0x7f672c104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- 172.21.15.138:0/668425636 >> 172.21.15.138:0/668425636 conn(0x7f672c0fa2f0 msgr2=0x7f672c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- 172.21.15.138:0/668425636 shutdown_connections 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- 172.21.15.138:0/668425636 wait complete. 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 Processor -- start 2024-02-15T23:03:56.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- start start 2024-02-15T23:03:56.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 0x7f672c194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c195110 con 0x7f672c0fe7f0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.855+0000 7f6732805640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c198e90 con 0x7f672c104800 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40696/0 (socket says 172.21.15.138:40696) 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 -- 172.21.15.138:0/2786563364 learned_addr learned my addr 172.21.15.138:0/2786563364 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672b7fe640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 0x7f672c194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 -- 172.21.15.138:0/2786563364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 msgr2=0x7f672c194a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 0x7f672c194a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 -- 172.21.15.138:0/2786563364 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009560 con 0x7f672c0fe7f0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f672bfff640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f671400b3d0 tx=0x7f671400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6714011800 con 0x7f672c0fe7f0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6714011e20 con 0x7f672c0fe7f0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c199170 con 0x7f672c0fe7f0 2024-02-15T23:03:56.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f671400f510 con 0x7f672c0fe7f0 2024-02-15T23:03:56.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.856+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c199750 con 0x7f672c0fe7f0 2024-02-15T23:03:56.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.857+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c04e000 con 0x7f672c0fe7f0 2024-02-15T23:03:56.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.858+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6714010380 con 0x7f672c0fe7f0 2024-02-15T23:03:56.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.858+0000 7f67297fa640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 0x7f671806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:56.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.858+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f671408d310 con 0x7f672c0fe7f0 2024-02-15T23:03:56.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.858+0000 7f672b7fe640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 0x7f671806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:56.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.858+0000 7f672b7fe640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 0x7f671806fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f671c036040 tx=0x7f671c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:56.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:56.862+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6714056a20 con 0x7f672c0fe7f0 2024-02-15T23:03:57.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.074+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f672c066860 con 0x7f672c0fe7f0 2024-02-15T23:03:57.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.075+0000 7f67297fa640 1 -- 172.21.15.138:0/2786563364 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+5019 (secure 0 0 0) 0x7f6714078e60 con 0x7f672c0fe7f0 2024-02-15T23:03:57.077 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:57.077 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:48.106255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:resolve","state_seq":19,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:resolve","state_seq":14,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:57.078 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 39 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 msgr2=0x7f671806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 0x7f671806fcc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f671c036040 tx=0x7f671c005fd0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 msgr2=0x7f672c194540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f671400b3d0 tx=0x7f671400b890 comp rx=0 tx=0).stop 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 shutdown_connections 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f671806d810 0x7f671806fcc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f672c104800 0x7f672c194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 --2- 172.21.15.138:0/2786563364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f672c0fe7f0 0x7f672c194540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 >> 172.21.15.138:0/2786563364 conn(0x7f672c0fa2f0 msgr2=0x7f672c0fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 shutdown_connections 2024-02-15T23:03:57.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.077+0000 7f6732805640 1 -- 172.21.15.138:0/2786563364 wait complete. 2024-02-15T23:03:57.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-02-15T23:03:57.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- 172.21.15.138:0/3465783899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a801045b0 msgr2=0x7f6a80104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 --2- 172.21.15.138:0/3465783899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a801045b0 0x7f6a80104980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009880 tx=0x7f6a7002bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- 172.21.15.138:0/3465783899 shutdown_connections 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 --2- 172.21.15.138:0/3465783899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a800fe580 0x7f6a800fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 --2- 172.21.15.138:0/3465783899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a801045b0 0x7f6a80104980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- 172.21.15.138:0/3465783899 >> 172.21.15.138:0/3465783899 conn(0x7f6a800fa040 msgr2=0x7f6a800fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- 172.21.15.138:0/3465783899 shutdown_connections 2024-02-15T23:03:57.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- 172.21.15.138:0/3465783899 wait complete. 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 Processor -- start 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.190+0000 7f6a85b50640 1 -- start start 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 0x7f6a801946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80194d70 con 0x7f6a800fe580 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a80198b40 con 0x7f6a801045b0 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40712/0 (socket says 172.21.15.138:40712) 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 -- 172.21.15.138:0/1374029217 learned_addr learned my addr 172.21.15.138:0/1374029217 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a77fff640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 0x7f6a801946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 -- 172.21.15.138:0/1374029217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 msgr2=0x7f6a801946e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 0x7f6a801946e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 -- 172.21.15.138:0/1374029217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a70009560 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a77fff640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 0x7f6a801946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7f7fe640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009230 tx=0x7f6a70004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a700035f0 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a70003c10 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80198dc0 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a70005670 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.191+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a80199340 con 0x7f6a800fe580 2024-02-15T23:03:57.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.192+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8004e000 con 0x7f6a800fe580 2024-02-15T23:03:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.193+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6a70004dd0 con 0x7f6a800fe580 2024-02-15T23:03:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.193+0000 7f6a7d7fa640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 0x7f6a6c06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.193+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6a700b1720 con 0x7f6a800fe580 2024-02-15T23:03:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.193+0000 7f6a77fff640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 0x7f6a6c06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.194+0000 7f6a77fff640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 0x7f6a6c06fc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a801957b0 tx=0x7f6a68005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.198+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6a7007aed0 con 0x7f6a800fe580 2024-02-15T23:03:57.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.408+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f6a801954f0 con 0x7f6a800fe580 2024-02-15T23:03:57.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.409+0000 7f6a7d7fa640 1 -- 172.21.15.138:0/1374029217 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+5023 (secure 0 0 0) 0x7f6a7007e590 con 0x7f6a800fe580 2024-02-15T23:03:57.411 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:57.412 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:48.442027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:reconnect","state_seq":20,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:57.412 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 40 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 msgr2=0x7f6a6c06fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 0x7f6a6c06fc70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a801957b0 tx=0x7f6a68005e50 comp rx=0 tx=0).stop 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 msgr2=0x7f6a801941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009230 tx=0x7f6a70004040 comp rx=0 tx=0).stop 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 shutdown_connections 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6a6c06d7c0 0x7f6a6c06fc70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a801045b0 0x7f6a801946e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 --2- 172.21.15.138:0/1374029217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a800fe580 0x7f6a801941a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 >> 172.21.15.138:0/1374029217 conn(0x7f6a800fa040 msgr2=0x7f6a800fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 shutdown_connections 2024-02-15T23:03:57.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.411+0000 7f6a85b50640 1 -- 172.21.15.138:0/1374029217 wait complete. 2024-02-15T23:03:57.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-02-15T23:03:57.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 -- 172.21.15.138:0/2342519425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4101150 msgr2=0x7f6ce4109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 --2- 172.21.15.138:0/2342519425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4101150 0x7f6ce4109640 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009880 tx=0x7f6cd002bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 -- 172.21.15.138:0/2342519425 shutdown_connections 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 --2- 172.21.15.138:0/2342519425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4101150 0x7f6ce4109640 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 --2- 172.21.15.138:0/2342519425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4100840 0x7f6ce4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 -- 172.21.15.138:0/2342519425 >> 172.21.15.138:0/2342519425 conn(0x7f6ce40fa0b0 msgr2=0x7f6ce40fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 -- 172.21.15.138:0/2342519425 shutdown_connections 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.524+0000 7f6cead27640 1 -- 172.21.15.138:0/2342519425 wait complete. 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 Processor -- start 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 -- start start 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4101150 0x7f6ce41959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4196060 con 0x7f6ce4100840 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6cead27640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4199e30 con 0x7f6ce4101150 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40720/0 (socket says 172.21.15.138:40720) 2024-02-15T23:03:57.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 -- 172.21.15.138:0/1686985464 learned_addr learned my addr 172.21.15.138:0/1686985464 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce3fff640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4101150 0x7f6ce41959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 -- 172.21.15.138:0/1686985464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4101150 msgr2=0x7f6ce41959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4101150 0x7f6ce41959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 -- 172.21.15.138:0/1686985464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009560 con 0x7f6ce4100840 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.525+0000 7f6ce8ac3640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800b420 tx=0x7f6cd800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.526+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd8011800 con 0x7f6ce4100840 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.526+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cd8011e20 con 0x7f6ce4100840 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.526+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce419a110 con 0x7f6ce4100840 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.526+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd800f2e0 con 0x7f6ce4100840 2024-02-15T23:03:57.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.526+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce419a640 con 0x7f6ce4100840 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.527+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce404e000 con 0x7f6ce4100840 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.527+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f6cd8010380 con 0x7f6ce4100840 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.527+0000 7f6ce1ffb640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 0x7f6cd406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.528+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6cd808ce10 con 0x7f6ce4100840 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.528+0000 7f6ce3fff640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 0x7f6cd406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.528+0000 7f6ce3fff640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 0x7f6cd406fcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0000c00 tx=0x7f6cd0005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.533+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6cd80565c0 con 0x7f6ce4100840 2024-02-15T23:03:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:57 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1065919071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T23:03:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:57 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2786563364' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T23:03:57.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:57 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1374029217' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T23:03:57.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.748+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f6ce4106c30 con 0x7f6ce4100840 2024-02-15T23:03:57.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.749+0000 7f6ce1ffb640 1 -- 172.21.15.138:0/1686985464 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5017 (secure 0 0 0) 0x7f6cd8059c80 con 0x7f6ce4100840 2024-02-15T23:03:57.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:57.751 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:49.424215+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:57.752 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 41 2024-02-15T23:03:57.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 msgr2=0x7f6cd406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 0x7f6cd406fcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0000c00 tx=0x7f6cd0005fd0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 msgr2=0x7f6ce4195490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800b420 tx=0x7f6cd800b8e0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 shutdown_connections 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f6cd406d810 0x7f6cd406fcc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ce4101150 0x7f6ce41959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 --2- 172.21.15.138:0/1686985464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6ce4100840 0x7f6ce4195490 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 >> 172.21.15.138:0/1686985464 conn(0x7f6ce40fa0b0 msgr2=0x7f6ce4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 shutdown_connections 2024-02-15T23:03:57.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.751+0000 7f6cead27640 1 -- 172.21.15.138:0/1686985464 wait complete. 2024-02-15T23:03:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:57 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1065919071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T23:03:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:57 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2786563364' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T23:03:57.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:57 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1374029217' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T23:03:57.764 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 -- 172.21.15.138:0/3683406970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c40fe750 msgr2=0x7f78c40febc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/3683406970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c40fe750 0x7f78c40febc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009880 tx=0x7f78b402bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 -- 172.21.15.138:0/3683406970 shutdown_connections 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/3683406970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c40fe750 0x7f78c40febc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/3683406970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c4104760 0x7f78c4104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 -- 172.21.15.138:0/3683406970 >> 172.21.15.138:0/3683406970 conn(0x7f78c40fa270 msgr2=0x7f78c40fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 -- 172.21.15.138:0/3683406970 shutdown_connections 2024-02-15T23:03:57.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.864+0000 7f78c8c8b640 1 -- 172.21.15.138:0/3683406970 wait complete. 2024-02-15T23:03:57.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 Processor -- start 2024-02-15T23:03:57.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 -- start start 2024-02-15T23:03:57.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 0x7f78c4194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4195010 con 0x7f78c4104760 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c8c8b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4198de0 con 0x7f78c40fe750 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40736/0 (socket says 172.21.15.138:40736) 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 -- 172.21.15.138:0/2304952525 learned_addr learned my addr 172.21.15.138:0/2304952525 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c259c640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 0x7f78c4194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 -- 172.21.15.138:0/2304952525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 msgr2=0x7f78c4194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 0x7f78c4194440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c1d9b640 1 -- 172.21.15.138:0/2304952525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009560 con 0x7f78c4104760 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.865+0000 7f78c259c640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 0x7f78c4194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78c1d9b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009230 tx=0x7f78b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b40035f0 con 0x7f78c4104760 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78b4003c10 con 0x7f78c4104760 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c4199060 con 0x7f78c4104760 2024-02-15T23:03:57.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b4005670 con 0x7f78c4104760 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.866+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c4199560 con 0x7f78c4104760 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.867+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c404e000 con 0x7f78c4104760 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.867+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f78b4004dd0 con 0x7f78c4104760 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.868+0000 7f78bb7fe640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 0x7f78b006fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.868+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f78b40af910 con 0x7f78c4104760 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.868+0000 7f78c259c640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 0x7f78b006fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:57.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.868+0000 7f78c259c640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 0x7f78b006fc70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0058c0 tx=0x7f78ac005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:57.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:57.872+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f78b40790c0 con 0x7f78c4104760 2024-02-15T23:03:58.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.080+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f78c4066860 con 0x7f78c4104760 2024-02-15T23:03:58.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.081+0000 7f78bb7fe640 1 -- 172.21.15.138:0/2304952525 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5017 (secure 0 0 0) 0x7f78b407c780 con 0x7f78c4104760 2024-02-15T23:03:58.084 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:58.084 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi170.banvev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:50.469001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:58.084 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 42 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 msgr2=0x7f78b006fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 0x7f78b006fc70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0058c0 tx=0x7f78ac005850 comp rx=0 tx=0).stop 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 msgr2=0x7f78c4194980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009230 tx=0x7f78b4004040 comp rx=0 tx=0).stop 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 shutdown_connections 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f78b006d7c0 0x7f78b006fc70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78c4104760 0x7f78c4194980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 --2- 172.21.15.138:0/2304952525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78c40fe750 0x7f78c4194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 >> 172.21.15.138:0/2304952525 conn(0x7f78c40fa270 msgr2=0x7f78c40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 shutdown_connections 2024-02-15T23:03:58.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.083+0000 7f78c8c8b640 1 -- 172.21.15.138:0/2304952525 wait complete. 2024-02-15T23:03:58.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 43 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 -- 172.21.15.138:0/778998582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 msgr2=0x7f816410b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 --2- 172.21.15.138:0/778998582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f816410b9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8158009880 tx=0x7f815802bd70 comp rx=0 tx=0).stop 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 -- 172.21.15.138:0/778998582 shutdown_connections 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 --2- 172.21.15.138:0/778998582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f816410b9f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 --2- 172.21.15.138:0/778998582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 0x7f8164072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 -- 172.21.15.138:0/778998582 >> 172.21.15.138:0/778998582 conn(0x7f81640fb190 msgr2=0x7f81640fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 -- 172.21.15.138:0/778998582 shutdown_connections 2024-02-15T23:03:58.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.197+0000 7f81693eb640 1 -- 172.21.15.138:0/778998582 wait complete. 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 Processor -- start 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 -- start start 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 0x7f8164197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8164198100 con 0x7f8164072e90 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81693eb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419bed0 con 0x7f8164072580 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81627fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81627fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40754/0 (socket says 172.21.15.138:40754) 2024-02-15T23:03:58.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f81627fc640 1 -- 172.21.15.138:0/3835360045 learned_addr learned my addr 172.21.15.138:0/3835360045 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.198+0000 7f8162ffd640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 0x7f8164197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81627fc640 1 -- 172.21.15.138:0/3835360045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 msgr2=0x7f8164197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81627fc640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 0x7f8164197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81627fc640 1 -- 172.21.15.138:0/3835360045 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158009560 con 0x7f8164072e90 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81627fc640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8158009230 tx=0x7f8158004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81580035f0 con 0x7f8164072e90 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8158003c10 con 0x7f8164072e90 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816419c150 con 0x7f8164072e90 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f815803e450 con 0x7f8164072e90 2024-02-15T23:03:58.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.199+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816419c6b0 con 0x7f8164072e90 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.200+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816404e000 con 0x7f8164072e90 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.200+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f8158004f60 con 0x7f8164072e90 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.201+0000 7f814bfff640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 0x7f814c06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.201+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f81580b0050 con 0x7f8164072e90 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.201+0000 7f8162ffd640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 0x7f814c06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.201+0000 7f8162ffd640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 0x7f814c06fcc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8154005fd0 tx=0x7f8154009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.205+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8158079920 con 0x7f8164072e90 2024-02-15T23:03:58.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.413+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7f8164109060 con 0x7f8164072e90 2024-02-15T23:03:58.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.414+0000 7f814bfff640 1 -- 172.21.15.138:0/3835360045 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5032 (secure 0 0 0) 0x7f815807cfe0 con 0x7f8164072e90 2024-02-15T23:03:58.417 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:58.417 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-15T22:48:24.115503+0000","modified":"2024-02-15T23:01:51.435427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34404,"mds_1":34424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34404":{"gid":34404,"name":"cephfs.smithi138.bnqzne","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.138:6827/2312501492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2312501492},{"type":"v1","addr":"172.21.15.138:6827","nonce":2312501492}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34424":{"gid":34424,"name":"cephfs.smithi138.fzypgq","rank":1,"incarnation":36,"state":"up:active","state_seq":17,"addr":"172.21.15.138:6829/3874505948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":3874505948},{"type":"v1","addr":"172.21.15.138:6829","nonce":3874505948}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44317":{"gid":44317,"name":"cephfs.smithi170.banvev","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6825/411044474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":411044474},{"type":"v1","addr":"172.21.15.170:6825","nonce":411044474}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_44321":{"gid":44321,"name":"cephfs.smithi170.cbefkf","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6827/85754605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":85754605},{"type":"v1","addr":"172.21.15.170:6827","nonce":85754605}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-15T23:03:58.417 INFO:teuthology.orchestra.run.smithi138.stderr:dumped fsmap epoch 43 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 msgr2=0x7f814c06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 0x7f814c06fcc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8154005fd0 tx=0x7f8154009680 comp rx=0 tx=0).stop 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 msgr2=0x7f8164197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8158009230 tx=0x7f8158004040 comp rx=0 tx=0).stop 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 shutdown_connections 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f814c06d810 0x7f814c06fcc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8164072e90 0x7f8164197a70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 --2- 172.21.15.138:0/3835360045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8164072580 0x7f8164197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 >> 172.21.15.138:0/3835360045 conn(0x7f81640fb190 msgr2=0x7f8164106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 shutdown_connections 2024-02-15T23:03:58.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.416+0000 7f81693eb640 1 -- 172.21.15.138:0/3835360045 wait complete. 2024-02-15T23:03:58.430 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-15T23:03:58.441 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-15T23:03:58.441 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T23:03:58.441 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T23:03:58.458 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-02-15T23:03:58.458 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T23:03:58.515 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.653+0000 7fc271377640 1 -- 172.21.15.138:0/409038436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fef80 msgr2=0x7fc26c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.653+0000 7fc271377640 1 --2- 172.21.15.138:0/409038436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fef80 0x7fc26c1099f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0098b0 tx=0x7fc25c02bcd0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 -- 172.21.15.138:0/409038436 shutdown_connections 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 --2- 172.21.15.138:0/409038436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fef80 0x7fc26c1099f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 --2- 172.21.15.138:0/409038436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc26c0fe670 0x7fc26c0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 -- 172.21.15.138:0/409038436 >> 172.21.15.138:0/409038436 conn(0x7fc26c074cf0 msgr2=0x7fc26c0750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 -- 172.21.15.138:0/409038436 shutdown_connections 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 -- 172.21.15.138:0/409038436 wait complete. 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 Processor -- start 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 -- start start 2024-02-15T23:03:58.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.654+0000 7fc271377640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc26c0fef80 0x7fc26c1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc271377640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c195e70 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc271377640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c199c40 con 0x7fc26c0fef80 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40772/0 (socket says 172.21.15.138:40772) 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 -- 172.21.15.138:0/3533594080 learned_addr learned my addr 172.21.15.138:0/3533594080 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 -- 172.21.15.138:0/3533594080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc26c0fef80 msgr2=0x7fc26c1957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc26c0fef80 0x7fc26c1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 -- 172.21.15.138:0/3533594080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009560 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc26affd640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b420 tx=0x7fc26000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc260011800 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc260011e20 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c199f20 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26000f2e0 con 0x7fc26c0fe670 2024-02-15T23:03:58.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.655+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c19a500 con 0x7fc26c0fe670 2024-02-15T23:03:58.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.656+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c04e000 con 0x7fc26c0fe670 2024-02-15T23:03:58.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.657+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fc260010380 con 0x7fc26c0fe670 2024-02-15T23:03:58.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.657+0000 7fc253fff640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 0x7fc25406fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.657+0000 7fc26a7fc640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 0x7fc25406fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.657+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc26008cdd0 con 0x7fc26c0fe670 2024-02-15T23:03:58.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.658+0000 7fc26a7fc640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 0x7fc25406fd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc25c036040 tx=0x7fc25c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.662+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc260056600 con 0x7fc26c0fe670 2024-02-15T23:03:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:58 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/1686985464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-15T23:03:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:58 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2304952525' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-02-15T23:03:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:58 smithi138 ceph-mon[89527]: pgmap v278: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:58.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:58 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3835360045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-02-15T23:03:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:58 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/1686985464' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-02-15T23:03:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:58 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2304952525' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-02-15T23:03:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:58 smithi170 ceph-mon[67652]: pgmap v278: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:03:58.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:58 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3835360045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-02-15T23:03:58.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.842+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc26c10c8e0 con 0x7fc26c0fe670 2024-02-15T23:03:58.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.844+0000 7fc253fff640 1 -- 172.21.15.138:0/3533594080 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16828 (secure 0 0 0) 0x7fc260059cc0 con 0x7fc26c0fe670 2024-02-15T23:03:58.846 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:03:58.847 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":85,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T23:01:26.420558+0000","last_up_change":"2024-02-15T23:00:27.103248+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:48:22.710517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:48:23.345890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6803","nonce":3741024094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6805","nonce":3741024094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6809","nonce":3741024094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6807","nonce":3741024094}]},"public_addr":"172.21.15.138:6803/3741024094","cluster_addr":"172.21.15.138:6805/3741024094","heartbeat_back_addr":"172.21.15.138:6809/3741024094","heartbeat_front_addr":"172.21.15.138:6807/3741024094","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6811","nonce":320789010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6813","nonce":320789010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6817","nonce":320789010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6815","nonce":320789010}]},"public_addr":"172.21.15.138:6811/320789010","cluster_addr":"172.21.15.138:6813/320789010","heartbeat_back_addr":"172.21.15.138:6817/320789010","heartbeat_front_addr":"172.21.15.138:6815/320789010","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6819","nonce":3347258839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6821","nonce":3347258839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6825","nonce":3347258839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6823","nonce":3347258839}]},"public_addr":"172.21.15.138:6819/3347258839","cluster_addr":"172.21.15.138:6821/3347258839","heartbeat_back_addr":"172.21.15.138:6825/3347258839","heartbeat_front_addr":"172.21.15.138:6823/3347258839","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6801","nonce":246812523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6803","nonce":246812523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6807","nonce":246812523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6805","nonce":246812523}]},"public_addr":"172.21.15.170:6801/246812523","cluster_addr":"172.21.15.170:6803/246812523","heartbeat_back_addr":"172.21.15.170:6807/246812523","heartbeat_front_addr":"172.21.15.170:6805/246812523","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6809","nonce":1376172342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6811","nonce":1376172342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6815","nonce":1376172342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6813","nonce":1376172342}]},"public_addr":"172.21.15.170:6809/1376172342","cluster_addr":"172.21.15.170:6811/1376172342","heartbeat_back_addr":"172.21.15.170:6815/1376172342","heartbeat_front_addr":"172.21.15.170:6813/1376172342","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6817","nonce":3484244899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6819","nonce":3484244899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6823","nonce":3484244899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6821","nonce":3484244899}]},"public_addr":"172.21.15.170:6817/3484244899","cluster_addr":"172.21.15.170:6819/3484244899","heartbeat_back_addr":"172.21.15.170:6823/3484244899","heartbeat_front_addr":"172.21.15.170:6821/3484244899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6824/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:6829/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6828/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6801/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/4125885020":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/1857695595":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1233270825":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2933677068":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6829/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/3892577367":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/3094578310":"2024-02-16T22:51:35.224167+0000","172.21.15.170:6825/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2366055009":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6826/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:6827/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/464877437":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/990488714":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/4266627949":"2024-02-16T22:56:00.176825+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/4136599694":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.170:0/2930297512":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6828/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/698053139":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/998034485":"2024-02-16T22:56:00.176825+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:03:58.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 msgr2=0x7fc25406fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 0x7fc25406fd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc25c036040 tx=0x7fc25c000bc0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 msgr2=0x7fc26c1952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b420 tx=0x7fc26000b8e0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 shutdown_connections 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fc25406d8d0 0x7fc25406fd80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc26c0fef80 0x7fc26c1957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 --2- 172.21.15.138:0/3533594080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc26c0fe670 0x7fc26c1952a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 >> 172.21.15.138:0/3533594080 conn(0x7fc26c074cf0 msgr2=0x7fc26c104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 shutdown_connections 2024-02-15T23:03:58.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.846+0000 7fc271377640 1 -- 172.21.15.138:0/3533594080 wait complete. 2024-02-15T23:03:58.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:45:52.286926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:48:22.710517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:48:23.345890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T23:03:58.860 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 -- 172.21.15.138:0/1565971890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 msgr2=0x7ff10c104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 --2- 172.21.15.138:0/1565971890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c104960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009c20 tx=0x7ff0fc02c1b0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 -- 172.21.15.138:0/1565971890 shutdown_connections 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 --2- 172.21.15.138:0/1565971890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 0x7ff10c0fea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 --2- 172.21.15.138:0/1565971890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c104960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 -- 172.21.15.138:0/1565971890 >> 172.21.15.138:0/1565971890 conn(0x7ff10c0743d0 msgr2=0x7ff10c0747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 -- 172.21.15.138:0/1565971890 shutdown_connections 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.962+0000 7ff110947640 1 -- 172.21.15.138:0/1565971890 wait complete. 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 Processor -- start 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 -- start start 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 0x7ff10c1942d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c194ea0 con 0x7ff10c104590 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff110947640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c198c70 con 0x7ff10c0fe5b0 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff109d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff109d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40792/0 (socket says 172.21.15.138:40792) 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.963+0000 7ff109d9b640 1 -- 172.21.15.138:0/2630665680 learned_addr learned my addr 172.21.15.138:0/2630665680 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff109d9b640 1 -- 172.21.15.138:0/2630665680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 msgr2=0x7ff10c1942d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff10a59c640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 0x7ff10c1942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff109d9b640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 0x7ff10c1942d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff109d9b640 1 -- 172.21.15.138:0/2630665680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc009900 con 0x7ff10c104590 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff109d9b640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff10000d910 tx=0x7ff10000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10000ed40 con 0x7ff10c104590 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c198ef0 con 0x7ff10c104590 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff100016900 con 0x7ff10c104590 2024-02-15T23:03:58.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff100014990 con 0x7ff10c104590 2024-02-15T23:03:58.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.964+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c1994d0 con 0x7ff10c104590 2024-02-15T23:03:58.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.965+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c04e000 con 0x7ff10c104590 2024-02-15T23:03:58.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.965+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff100016440 con 0x7ff10c104590 2024-02-15T23:03:58.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.966+0000 7ff0fb7fe640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 0x7ff0f406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:58.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.966+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff10008efc0 con 0x7ff10c104590 2024-02-15T23:03:58.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.966+0000 7ff10a59c640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 0x7ff0f406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:58.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.966+0000 7ff10a59c640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 0x7ff0f406fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc004af0 tx=0x7ff0fc004a40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:58.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:58.970+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff100058820 con 0x7ff10c104590 2024-02-15T23:03:59.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.141+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff10c10b9d0 con 0x7ff10c104590 2024-02-15T23:03:59.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.141+0000 7ff0fb7fe640 1 -- 172.21.15.138:0/2630665680 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff10005bee0 con 0x7ff10c104590 2024-02-15T23:03:59.144 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 msgr2=0x7ff0f406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 0x7ff0f406fcc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc004af0 tx=0x7ff0fc004a40 comp rx=0 tx=0).stop 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 msgr2=0x7ff10c194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff10000d910 tx=0x7ff10000ddd0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 shutdown_connections 2024-02-15T23:03:59.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0f406d810 0x7ff0f406fcc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff10c104590 0x7ff10c194810 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 --2- 172.21.15.138:0/2630665680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff10c0fe5b0 0x7ff10c1942d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 >> 172.21.15.138:0/2630665680 conn(0x7ff10c0743d0 msgr2=0x7ff10c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 shutdown_connections 2024-02-15T23:03:59.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.143+0000 7ff110947640 1 -- 172.21.15.138:0/2630665680 wait complete. 2024-02-15T23:03:59.157 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T23:03:59.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.258+0000 7fe4c180b640 1 -- 172.21.15.138:0/2078931170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc0fe7f0 msgr2=0x7fe4bc0fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.258+0000 7fe4c180b640 1 --2- 172.21.15.138:0/2078931170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc0fec60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009880 tx=0x7fe4b002bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- 172.21.15.138:0/2078931170 shutdown_connections 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 --2- 172.21.15.138:0/2078931170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc0fec60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 --2- 172.21.15.138:0/2078931170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc104800 0x7fe4bc104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- 172.21.15.138:0/2078931170 >> 172.21.15.138:0/2078931170 conn(0x7fe4bc0fa2f0 msgr2=0x7fe4bc0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- 172.21.15.138:0/2078931170 shutdown_connections 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- 172.21.15.138:0/2078931170 wait complete. 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 Processor -- start 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- start start 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc196eb0 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.259+0000 7fe4c180b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc197020 con 0x7fe4bc0fe7f0 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40798/0 (socket says 172.21.15.138:40798) 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 -- 172.21.15.138:0/418904405 learned_addr learned my addr 172.21.15.138:0/418904405 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4baffd640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 -- 172.21.15.138:0/418904405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc0fe7f0 msgr2=0x7fe4bc1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 -- 172.21.15.138:0/418904405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0009560 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4ba7fc640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009230 tx=0x7fe4b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4b00035f0 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4b0003c10 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc19f410 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4b0005670 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.260+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc19f8b0 con 0x7fe4bc104800 2024-02-15T23:03:59.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.261+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc04e000 con 0x7fe4bc104800 2024-02-15T23:03:59.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.262+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7fe4b0004dd0 con 0x7fe4bc104800 2024-02-15T23:03:59.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.262+0000 7fe4c0809640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 0x7fe4a406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.262+0000 7fe4baffd640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 0x7fe4a406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.262+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe4b00af910 con 0x7fe4bc104800 2024-02-15T23:03:59.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.262+0000 7fe4baffd640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 0x7fe4a406fc70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005fd0 tx=0x7fe4ac005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.267+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe4b00790c0 con 0x7fe4bc104800 2024-02-15T23:03:59.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.445+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe4bc10b9e0 con 0x7fe4bc104800 2024-02-15T23:03:59.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.445+0000 7fe4c0809640 1 -- 172.21.15.138:0/418904405 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe4b007c780 con 0x7fe4bc104800 2024-02-15T23:03:59.448 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 msgr2=0x7fe4a406fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 0x7fe4a406fc70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005fd0 tx=0x7fe4ac005850 comp rx=0 tx=0).stop 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 msgr2=0x7fe4bc1968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009230 tx=0x7fe4b0004040 comp rx=0 tx=0).stop 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 shutdown_connections 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fe4a406d7c0 0x7fe4a406fc70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4bc104800 0x7fe4bc1968e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 --2- 172.21.15.138:0/418904405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4bc0fe7f0 0x7fe4bc1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 >> 172.21.15.138:0/418904405 conn(0x7fe4bc0fa2f0 msgr2=0x7fe4bc0fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 shutdown_connections 2024-02-15T23:03:59.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.447+0000 7fe4c180b640 1 -- 172.21.15.138:0/418904405 wait complete. 2024-02-15T23:03:59.461 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T23:03:59.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/35682654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 msgr2=0x7ff9c40fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/35682654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c40fec60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009880 tx=0x7ff9b802bce0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/35682654 shutdown_connections 2024-02-15T23:03:59.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/35682654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c40fec60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/35682654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/35682654 >> 172.21.15.138:0/35682654 conn(0x7ff9c40fa2f0 msgr2=0x7ff9c40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/35682654 shutdown_connections 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/35682654 wait complete. 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.563+0000 7ff9c9f5c640 1 Processor -- start 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c9f5c640 1 -- start start 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c9f5c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c9f5c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c9f5c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4194f60 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c9f5c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41950d0 con 0x7ff9c4104800 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40812/0 (socket says 172.21.15.138:40812) 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 -- 172.21.15.138:0/3209236673 learned_addr learned my addr 172.21.15.138:0/3209236673 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c2ffd640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 -- 172.21.15.138:0/3209236673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 msgr2=0x7ff9c4194960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4194960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 -- 172.21.15.138:0/3209236673 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8009560 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c2ffd640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.564+0000 7ff9c37fe640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c8f0 tx=0x7ff9b400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.565+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b40041f0 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.565+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9b4007e10 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.565+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c4198f60 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.565+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b400f450 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.565+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c4199540 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.566+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c404e000 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.566+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff9b4007950 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.566+0000 7ff9c0ff9640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 0x7ff9ac06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.567+0000 7ff9c2ffd640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 0x7ff9ac06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.567+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff9b4013070 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.567+0000 7ff9c2ffd640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 0x7ff9ac06fcc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4195a30 tx=0x7ff9b802cc00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.571+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff9b4056e30 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:59 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3533594080' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:03:59.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:03:59 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2630665680' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:03:59.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.744+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff9c4066860 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.744+0000 7ff9c0ff9640 1 -- 172.21.15.138:0/3209236673 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff9b405a4f0 con 0x7ff9c40fe7f0 2024-02-15T23:03:59.747 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 msgr2=0x7ff9ac06fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 0x7ff9ac06fcc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4195a30 tx=0x7ff9b802cc00 comp rx=0 tx=0).stop 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 msgr2=0x7ff9c4194420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c8f0 tx=0x7ff9b400cdb0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 shutdown_connections 2024-02-15T23:03:59.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff9ac06d810 0x7ff9ac06fcc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9c4104800 0x7ff9c4194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 --2- 172.21.15.138:0/3209236673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9c40fe7f0 0x7ff9c4194420 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 >> 172.21.15.138:0/3209236673 conn(0x7ff9c40fa2f0 msgr2=0x7ff9c40fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 shutdown_connections 2024-02-15T23:03:59.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.746+0000 7ff9c9f5c640 1 -- 172.21.15.138:0/3209236673 wait complete. 2024-02-15T23:03:59.760 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-15T23:03:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:59 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3533594080' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:03:59.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:03:59 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2630665680' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:03:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- 172.21.15.138:0/3920689289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4101020 msgr2=0x7ff0c41096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 --2- 172.21.15.138:0/3920689289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4101020 0x7ff0c41096f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009880 tx=0x7ff0b802bd70 comp rx=0 tx=0).stop 2024-02-15T23:03:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- 172.21.15.138:0/3920689289 shutdown_connections 2024-02-15T23:03:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 --2- 172.21.15.138:0/3920689289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4101020 0x7ff0c41096f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 --2- 172.21.15.138:0/3920689289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4100710 0x7ff0c4100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- 172.21.15.138:0/3920689289 >> 172.21.15.138:0/3920689289 conn(0x7ff0c4075270 msgr2=0x7ff0c4075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- 172.21.15.138:0/3920689289 shutdown_connections 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- 172.21.15.138:0/3920689289 wait complete. 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 Processor -- start 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.859+0000 7ff0ca015640 1 -- start start 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 0x7ff0c4195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4195e10 con 0x7ff0c4100710 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4199be0 con 0x7ff0c4101020 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40830/0 (socket says 172.21.15.138:40830) 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 -- 172.21.15.138:0/2902915971 learned_addr learned my addr 172.21.15.138:0/2902915971 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:03:59.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c2ffd640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 0x7ff0c4195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 -- 172.21.15.138:0/2902915971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 msgr2=0x7ff0c4195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 0x7ff0c4195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 -- 172.21.15.138:0/2902915971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8009560 con 0x7ff0c4100710 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c2ffd640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 0x7ff0c4195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c37fe640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d6f0 tx=0x7ff0b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b4009a30 con 0x7ff0c4100710 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0b40054e0 con 0x7ff0c4100710 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0b4010460 con 0x7ff0c4100710 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c4199ec0 con 0x7ff0c4100710 2024-02-15T23:03:59.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.860+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c419a420 con 0x7ff0c4100710 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.861+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c404e000 con 0x7ff0c4100710 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.862+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7ff0b4009b90 con 0x7ff0c4100710 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.862+0000 7ff0c0ff9640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 0x7ff0ac06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.862+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff0b408d0c0 con 0x7ff0c4100710 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.862+0000 7ff0c2ffd640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 0x7ff0ac06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:03:59.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.863+0000 7ff0c2ffd640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 0x7ff0ac06fd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005ec0 tx=0x7ff0b8000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:03:59.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:03:59.867+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff0b4056870 con 0x7ff0c4100710 2024-02-15T23:04:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.051+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0c4106d30 con 0x7ff0c4100710 2024-02-15T23:04:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.052+0000 7ff0c0ff9640 1 -- 172.21.15.138:0/2902915971 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2462 (secure 0 0 0) 0x7ff0c4106d30 con 0x7ff0c4100710 2024-02-15T23:04:00.054 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6824/4027411393 2024-02-16T23:00:29.288136+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6829/1693530689 2024-02-16T23:00:29.288122+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6828/1693530689 2024-02-16T23:00:29.288122+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/299484414 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/4125885020 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1857695595 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1233270825 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2933677068 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/488430197 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1651462660 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/2928099655 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6829/2668591850 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.055 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/299484414 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/3892577367 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/3094578310 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6825/4027411393 2024-02-16T23:00:29.288136+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/164905863 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1814961516 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/2746308389 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/499746587 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2366055009 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6826/2782905632 2024-02-16T22:48:40.730490+0000 2024-02-15T23:04:00.056 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6827/2782905632 2024-02-16T22:48:40.730490+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4049377511 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/464877437 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/990488714 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4266627949 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/2998046640 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4136599694 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/3349313431 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2930297512 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/2998046640 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/3454666203 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/3454666203 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/711267160 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/499746587 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1457010425 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/2928099655 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:00.057 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6828/2668591850 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:00.058 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/698053139 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.058 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/998034485 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:listed 41 entries 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 msgr2=0x7ff0ac06fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 0x7ff0ac06fd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8005ec0 tx=0x7ff0b8000bc0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 msgr2=0x7ff0c4195240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d6f0 tx=0x7ff0b400dbb0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 shutdown_connections 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7ff0ac06d8d0 0x7ff0ac06fd80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0c4101020 0x7ff0c4195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 --2- 172.21.15.138:0/2902915971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0c4100710 0x7ff0c4195240 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 >> 172.21.15.138:0/2902915971 conn(0x7ff0c4075270 msgr2=0x7ff0c4103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 shutdown_connections 2024-02-15T23:04:00.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.054+0000 7ff0ca015640 1 -- 172.21.15.138:0/2902915971 wait complete. 2024-02-15T23:04:00.068 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-15T23:04:00.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:00.068 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-15T23:04:00.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T23:04:00.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:00.096 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-15T23:04:00.160 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T23:04:00.160 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T23:04:00.180 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-15T23:04:00.180 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-15T23:04:00.239 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T23:04:00.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 -- 172.21.15.138:0/4053448927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 msgr2=0x7f90500fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 --2- 172.21.15.138:0/4053448927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90500fea10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9044009c20 tx=0x7f904402c1b0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 -- 172.21.15.138:0/4053448927 shutdown_connections 2024-02-15T23:04:00.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 --2- 172.21.15.138:0/4053448927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90500fea10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 --2- 172.21.15.138:0/4053448927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f90501049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 -- 172.21.15.138:0/4053448927 >> 172.21.15.138:0/4053448927 conn(0x7f9050075270 msgr2=0x7f9050075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 -- 172.21.15.138:0/4053448927 shutdown_connections 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.339+0000 7f90557ab640 1 -- 172.21.15.138:0/4053448927 wait complete. 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 Processor -- start 2024-02-15T23:04:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 -- start start 2024-02-15T23:04:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f9050194610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050194ca0 con 0x7f90500fe5a0 2024-02-15T23:04:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f90557ab640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050198a70 con 0x7f90501045d0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40838/0 (socket says 172.21.15.138:40838) 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 -- 172.21.15.138:0/2572061491 learned_addr learned my addr 172.21.15.138:0/2572061491 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904e7fc640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f9050194610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 -- 172.21.15.138:0/2572061491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 msgr2=0x7f9050194610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f9050194610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904effd640 1 -- 172.21.15.138:0/2572061491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009900 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.340+0000 7f904e7fc640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f9050194610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f904effd640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f904800c810 tx=0x7f904800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90480041f0 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050198d50 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9048007e70 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90480049d0 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.341+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9050199330 con 0x7f90500fe5a0 2024-02-15T23:04:00.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.342+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905004e000 con 0x7f90500fe5a0 2024-02-15T23:04:00.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.342+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f90480079b0 con 0x7f90500fe5a0 2024-02-15T23:04:00.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.343+0000 7f9037fff640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 0x7f903806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.343+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f904808d3b0 con 0x7f90500fe5a0 2024-02-15T23:04:00.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.343+0000 7f904e7fc640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 0x7f903806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.343+0000 7f904e7fc640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 0x7f903806fd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f90501956e0 tx=0x7f9044005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.347+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9048056b60 con 0x7f90500fe5a0 2024-02-15T23:04:00.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.524+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9050195420 con 0x7f90500fe5a0 2024-02-15T23:04:00.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.525+0000 7f9037fff640 1 -- 172.21.15.138:0/2572061491 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16828 (secure 0 0 0) 0x7f904805a220 con 0x7f90500fe5a0 2024-02-15T23:04:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-02-15T23:04:00.528 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":85,"fsid":"3fa87466-cc53-11ee-95ba-87774f69a715","created":"2024-02-15T22:41:17.864007+0000","modified":"2024-02-15T23:01:26.420558+0000","last_up_change":"2024-02-15T23:00:27.103248+0000","last_in_change":"2024-02-15T22:46:46.954789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-15T22:45:52.286926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T22:48:22.710517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T22:48:23.345890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b48c426e-a38f-47a7-9e05-ad8da75e241a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6803","nonce":3741024094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6805","nonce":3741024094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6809","nonce":3741024094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3741024094},{"type":"v1","addr":"172.21.15.138:6807","nonce":3741024094}]},"public_addr":"172.21.15.138:6803/3741024094","cluster_addr":"172.21.15.138:6805/3741024094","heartbeat_back_addr":"172.21.15.138:6809/3741024094","heartbeat_front_addr":"172.21.15.138:6807/3741024094","state":["exists","up"]},{"osd":1,"uuid":"2ade298e-e38b-40c0-b0bf-943e3979d389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6811","nonce":320789010}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6813","nonce":320789010}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6817","nonce":320789010}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":320789010},{"type":"v1","addr":"172.21.15.138:6815","nonce":320789010}]},"public_addr":"172.21.15.138:6811/320789010","cluster_addr":"172.21.15.138:6813/320789010","heartbeat_back_addr":"172.21.15.138:6817/320789010","heartbeat_front_addr":"172.21.15.138:6815/320789010","state":["exists","up"]},{"osd":2,"uuid":"7d5defd8-a53d-4fd3-a6b4-d26923472061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6819","nonce":3347258839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6821","nonce":3347258839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6825","nonce":3347258839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3347258839},{"type":"v1","addr":"172.21.15.138:6823","nonce":3347258839}]},"public_addr":"172.21.15.138:6819/3347258839","cluster_addr":"172.21.15.138:6821/3347258839","heartbeat_back_addr":"172.21.15.138:6825/3347258839","heartbeat_front_addr":"172.21.15.138:6823/3347258839","state":["exists","up"]},{"osd":3,"uuid":"52212675-7520-48c1-8880-e94ecffaa51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6801","nonce":246812523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6803","nonce":246812523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6807","nonce":246812523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":246812523},{"type":"v1","addr":"172.21.15.170:6805","nonce":246812523}]},"public_addr":"172.21.15.170:6801/246812523","cluster_addr":"172.21.15.170:6803/246812523","heartbeat_back_addr":"172.21.15.170:6807/246812523","heartbeat_front_addr":"172.21.15.170:6805/246812523","state":["exists","up"]},{"osd":4,"uuid":"71361c8d-cc5d-40e9-87f7-b560e9450531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6809","nonce":1376172342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6811","nonce":1376172342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6815","nonce":1376172342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1376172342},{"type":"v1","addr":"172.21.15.170:6813","nonce":1376172342}]},"public_addr":"172.21.15.170:6809/1376172342","cluster_addr":"172.21.15.170:6811/1376172342","heartbeat_back_addr":"172.21.15.170:6815/1376172342","heartbeat_front_addr":"172.21.15.170:6813/1376172342","state":["exists","up"]},{"osd":5,"uuid":"0dbbf950-cfa0-4389-a9d7-3ea3d2a5dcca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6817","nonce":3484244899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6819","nonce":3484244899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6823","nonce":3484244899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3484244899},{"type":"v1","addr":"172.21.15.170:6821","nonce":3484244899}]},"public_addr":"172.21.15.170:6817/3484244899","cluster_addr":"172.21.15.170:6819/3484244899","heartbeat_back_addr":"172.21.15.170:6823/3484244899","heartbeat_front_addr":"172.21.15.170:6821/3484244899","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:44:52.340261+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:21.822159+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:45:50.167374+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:14.609336+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:46:38.914291+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T22:47:03.865410+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6824/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:6829/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6828/1693530689":"2024-02-16T23:00:29.288122+0000","172.21.15.138:6801/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/4125885020":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/1857695595":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1233270825":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2933677068":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/488430197":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/1651462660":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6829/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/299484414":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/3892577367":"2024-02-16T22:56:00.176825+0000","172.21.15.170:0/3094578310":"2024-02-16T22:51:35.224167+0000","172.21.15.170:6825/4027411393":"2024-02-16T23:00:29.288136+0000","172.21.15.138:0/164905863":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/1814961516":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/2746308389":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6801/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/2366055009":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6826/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:6827/2782905632":"2024-02-16T22:48:40.730490+0000","172.21.15.138:0/4049377511":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/464877437":"2024-02-16T22:50:39.150712+0000","172.21.15.170:0/990488714":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/4266627949":"2024-02-16T22:56:00.176825+0000","172.21.15.138:6801/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:0/4136599694":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/3349313431":"2024-02-16T22:43:33.959120+0000","172.21.15.170:0/2930297512":"2024-02-16T22:51:35.224167+0000","172.21.15.138:6800/2998046640":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:6801/3454666203":"2024-02-16T22:43:33.959120+0000","172.21.15.138:0/711267160":"2024-02-16T22:42:22.744776+0000","172.21.15.138:6800/499746587":"2024-02-16T22:50:39.150712+0000","172.21.15.138:0/1457010425":"2024-02-16T22:41:50.174847+0000","172.21.15.138:6800/2928099655":"2024-02-16T22:42:22.744776+0000","172.21.15.170:6828/2668591850":"2024-02-16T22:51:35.224167+0000","172.21.15.138:0/698053139":"2024-02-16T22:56:00.176825+0000","172.21.15.138:0/998034485":"2024-02-16T22:56:00.176825+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 msgr2=0x7f903806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 0x7f903806fd80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f90501956e0 tx=0x7f9044005da0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 msgr2=0x7f90501940d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f904800c810 tx=0x7f904800ccd0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 shutdown_connections 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f903806d8d0 0x7f903806fd80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90501045d0 0x7f9050194610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 --2- 172.21.15.138:0/2572061491 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90500fe5a0 0x7f90501940d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 >> 172.21.15.138:0/2572061491 conn(0x7f9050075270 msgr2=0x7f90500fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 shutdown_connections 2024-02-15T23:04:00.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.527+0000 7f90557ab640 1 -- 172.21.15.138:0/2572061491 wait complete. 2024-02-15T23:04:00.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-15T22:45:52.286926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T22:48:22.710517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T22:48:23.345890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-15T23:04:00.542 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- 172.21.15.138:0/1821291291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc105680 msgr2=0x7f97fc105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 --2- 172.21.15.138:0/1821291291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc105680 0x7f97fc105a50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009880 tx=0x7f97f802bce0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- 172.21.15.138:0/1821291291 shutdown_connections 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 --2- 172.21.15.138:0/1821291291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc0ff670 0x7f97fc0ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 --2- 172.21.15.138:0/1821291291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc105680 0x7f97fc105a50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- 172.21.15.138:0/1821291291 >> 172.21.15.138:0/1821291291 conn(0x7f97fc0fb190 msgr2=0x7f97fc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- 172.21.15.138:0/1821291291 shutdown_connections 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- 172.21.15.138:0/1821291291 wait complete. 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 Processor -- start 2024-02-15T23:04:00.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 -- start start 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.643+0000 7f9803367640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9803367640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc105680 0x7f97fc195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9803367640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc195eb0 con 0x7f97fc0ff670 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9803367640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc199c80 con 0x7f97fc105680 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40860/0 (socket says 172.21.15.138:40860) 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 -- 172.21.15.138:0/2605823431 learned_addr learned my addr 172.21.15.138:0/2605823431 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9800902640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc105680 0x7f97fc195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 -- 172.21.15.138:0/2605823431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc105680 msgr2=0x7f97fc195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc105680 0x7f97fc195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 -- 172.21.15.138:0/2605823431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009560 con 0x7f97fc0ff670 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9801103640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009230 tx=0x7f97f802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f80035f0 con 0x7f97fc0ff670 2024-02-15T23:04:00.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97fc199f00 con 0x7f97fc0ff670 2024-02-15T23:04:00.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97f8003c10 con 0x7f97fc0ff670 2024-02-15T23:04:00.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f8005690 con 0x7f97fc0ff670 2024-02-15T23:04:00.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.644+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc19a480 con 0x7f97fc0ff670 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.645+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc04e000 con 0x7f97fc0ff670 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.646+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f97f8004ed0 con 0x7f97fc0ff670 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.646+0000 7f97ee7fc640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 0x7f97e806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.646+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f97f80af960 con 0x7f97fc0ff670 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.646+0000 7f9800902640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 0x7f97e806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.646+0000 7f9800902640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 0x7f97e806fcc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.651+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f97f8079110 con 0x7f97fc0ff670 2024-02-15T23:04:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:00 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/418904405' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:04:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:00 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/3209236673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:04:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:00 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2902915971' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T23:04:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:00 smithi138 ceph-mon[89527]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:04:00.734 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:00 smithi138 ceph-mon[89527]: pgmap v279: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:04:00.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:00 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/418904405' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:04:00.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:00 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/3209236673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:04:00.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:00 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2902915971' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T23:04:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:00 smithi170 ceph-mon[67652]: from='mgr.34104 172.21.15.138:0/882569254' entity='mgr.smithi138.jqscxs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-15T23:04:00.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:00 smithi170 ceph-mon[67652]: pgmap v279: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-15T23:04:00.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.824+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97fc10c9a0 con 0x7f97fc0ff670 2024-02-15T23:04:00.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.824+0000 7f97ee7fc640 1 -- 172.21.15.138:0/2605823431 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97f807c7d0 con 0x7f97fc0ff670 2024-02-15T23:04:00.827 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 1 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 msgr2=0x7f97e806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 0x7f97e806fcc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97f0005fd0 tx=0x7f97f0005850 comp rx=0 tx=0).stop 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 msgr2=0x7f97fc1952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009230 tx=0x7f97f802c850 comp rx=0 tx=0).stop 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 shutdown_connections 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f97e806d810 0x7f97e806fcc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97fc105680 0x7f97fc195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 --2- 172.21.15.138:0/2605823431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97fc0ff670 0x7f97fc1952e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 >> 172.21.15.138:0/2605823431 conn(0x7f97fc0fb190 msgr2=0x7f97fc0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 shutdown_connections 2024-02-15T23:04:00.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.826+0000 7f9803367640 1 -- 172.21.15.138:0/2605823431 wait complete. 2024-02-15T23:04:00.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 -- 172.21.15.138:0/3656325717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1538105880 msgr2=0x7f1538105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 --2- 172.21.15.138:0/3656325717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1538105880 0x7f1538105c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1530009c20 tx=0x7f153002c1b0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 -- 172.21.15.138:0/3656325717 shutdown_connections 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 --2- 172.21.15.138:0/3656325717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15380ff870 0x7f15380ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 --2- 172.21.15.138:0/3656325717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1538105880 0x7f1538105c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 -- 172.21.15.138:0/3656325717 >> 172.21.15.138:0/3656325717 conn(0x7f15380fb370 msgr2=0x7f15380fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 -- 172.21.15.138:0/3656325717 shutdown_connections 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.941+0000 7f153c97d640 1 -- 172.21.15.138:0/3656325717 wait complete. 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 Processor -- start 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 -- start start 2024-02-15T23:04:00.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 0x7f1538195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1538196110 con 0x7f15380ff870 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153c97d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1538199ee0 con 0x7f1538105880 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40884/0 (socket says 172.21.15.138:40884) 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 -- 172.21.15.138:0/4150141507 learned_addr learned my addr 172.21.15.138:0/4150141507 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f1535d9b640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 0x7f1538195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 -- 172.21.15.138:0/4150141507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 msgr2=0x7f1538195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 0x7f1538195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 -- 172.21.15.138:0/4150141507 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530009900 con 0x7f15380ff870 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f1535d9b640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 0x7f1538195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.942+0000 7f153659c640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1530009430 tx=0x7f1530032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.943+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1530032ed0 con 0x7f15380ff870 2024-02-15T23:04:00.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.943+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1530003e30 con 0x7f15380ff870 2024-02-15T23:04:00.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.943+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153819a160 con 0x7f15380ff870 2024-02-15T23:04:00.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.943+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f153003f440 con 0x7f15380ff870 2024-02-15T23:04:00.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.943+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153819a6e0 con 0x7f15380ff870 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.944+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153804e000 con 0x7f15380ff870 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.944+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f153003b040 con 0x7f15380ff870 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.944+0000 7f152f7fe640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 0x7f152406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.945+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f15300b0230 con 0x7f15380ff870 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.945+0000 7f1535d9b640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 0x7f152406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:00.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.945+0000 7f1535d9b640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 0x7f152406fcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15200058c0 tx=0x7f1520005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:00.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:00.949+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1530079aa0 con 0x7f15380ff870 2024-02-15T23:04:01.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.120+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1538066860 con 0x7f15380ff870 2024-02-15T23:04:01.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.121+0000 7f152f7fe640 1 -- 172.21.15.138:0/4150141507 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f153007d160 con 0x7f15380ff870 2024-02-15T23:04:01.124 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 msgr2=0x7f152406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 0x7f152406fcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15200058c0 tx=0x7f1520005850 comp rx=0 tx=0).stop 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 msgr2=0x7f1538195540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1530009430 tx=0x7f1530032b60 comp rx=0 tx=0).stop 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 shutdown_connections 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f152406d810 0x7f152406fcc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1538105880 0x7f1538195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 --2- 172.21.15.138:0/4150141507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15380ff870 0x7f1538195540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 >> 172.21.15.138:0/4150141507 conn(0x7f15380fb370 msgr2=0x7f15380fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:01.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 shutdown_connections 2024-02-15T23:04:01.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.123+0000 7f153c97d640 1 -- 172.21.15.138:0/4150141507 wait complete. 2024-02-15T23:04:01.137 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.238+0000 7f9f6ff92640 1 -- 172.21.15.138:0/3479500920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 msgr2=0x7f9f68109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.238+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/3479500920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68109a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009880 tx=0x7f9f5802bce0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.238+0000 7f9f6ff92640 1 -- 172.21.15.138:0/3479500920 shutdown_connections 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.238+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/3479500920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68109a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.238+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/3479500920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f680feab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- 172.21.15.138:0/3479500920 >> 172.21.15.138:0/3479500920 conn(0x7f9f68074cf0 msgr2=0x7f9f680750f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- 172.21.15.138:0/3479500920 shutdown_connections 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- 172.21.15.138:0/3479500920 wait complete. 2024-02-15T23:04:01.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 Processor -- start 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- start start 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f681952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68195e90 con 0x7f9f680feff0 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6ff92640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f68199c60 con 0x7f9f680fe6e0 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6d52d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6d52d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40904/0 (socket says 172.21.15.138:40904) 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.239+0000 7f9f6d52d640 1 -- 172.21.15.138:0/423538374 learned_addr learned my addr 172.21.15.138:0/423538374 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6dd2e640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f681952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6d52d640 1 -- 172.21.15.138:0/423538374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 msgr2=0x7f9f681952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6d52d640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f681952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6d52d640 1 -- 172.21.15.138:0/423538374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58009560 con 0x7f9f680feff0 2024-02-15T23:04:01.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6dd2e640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f681952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6d52d640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009230 tx=0x7f9f58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f580037c0 con 0x7f9f680feff0 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f68199ee0 con 0x7f9f680feff0 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f58005d50 con 0x7f9f680feff0 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f58034440 con 0x7f9f680feff0 2024-02-15T23:04:01.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.240+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6819a3e0 con 0x7f9f680feff0 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.241+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6804e000 con 0x7f9f680feff0 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.241+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7f9f58004dd0 con 0x7f9f680feff0 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.242+0000 7f9f5effd640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 0x7f9f5406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.242+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f580af940 con 0x7f9f680feff0 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.242+0000 7f9f6dd2e640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 0x7f9f5406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.242+0000 7f9f6dd2e640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 0x7f9f5406fcc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009b40 tx=0x7f9f64005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:01.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.246+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9f580790f0 con 0x7f9f680feff0 2024-02-15T23:04:01.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.417+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f9f681070d0 con 0x7f9f680feff0 2024-02-15T23:04:01.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.418+0000 7f9f5effd640 1 -- 172.21.15.138:0/423538374 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9f580056b0 con 0x7f9f680feff0 2024-02-15T23:04:01.421 INFO:teuthology.orchestra.run.smithi138.stdout:pg_num: 32 2024-02-15T23:04:01.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 msgr2=0x7f9f5406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 0x7f9f5406fcc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009b40 tx=0x7f9f64005e50 comp rx=0 tx=0).stop 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 msgr2=0x7f9f68195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009230 tx=0x7f9f58004270 comp rx=0 tx=0).stop 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 shutdown_connections 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7f9f5406d810 0x7f9f5406fcc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f680feff0 0x7f9f68195800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 --2- 172.21.15.138:0/423538374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f680fe6e0 0x7f9f681952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 >> 172.21.15.138:0/423538374 conn(0x7f9f68074cf0 msgr2=0x7f9f681042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 shutdown_connections 2024-02-15T23:04:01.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.420+0000 7f9f6ff92640 1 -- 172.21.15.138:0/423538374 wait complete. 2024-02-15T23:04:01.434 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-15T23:04:01.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.532+0000 7feeb826a640 1 -- 172.21.15.138:0/1883226083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0101160 msgr2=0x7feeb0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.532+0000 7feeb826a640 1 --2- 172.21.15.138:0/1883226083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0101160 0x7feeb0109650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feea00098b0 tx=0x7feea002bd60 comp rx=0 tx=0).stop 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- 172.21.15.138:0/1883226083 shutdown_connections 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 --2- 172.21.15.138:0/1883226083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0101160 0x7feeb0109650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 --2- 172.21.15.138:0/1883226083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0100850 0x7feeb0100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- 172.21.15.138:0/1883226083 >> 172.21.15.138:0/1883226083 conn(0x7feeb0075270 msgr2=0x7feeb0075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- 172.21.15.138:0/1883226083 shutdown_connections 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- 172.21.15.138:0/1883226083 wait complete. 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 Processor -- start 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- start start 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0101160 0x7feeb01957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0195e30 con 0x7feeb0100850 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb826a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0199c00 con 0x7feeb0101160 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb6006640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb6006640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:40920/0 (socket says 172.21.15.138:40920) 2024-02-15T23:04:01.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb6006640 1 -- 172.21.15.138:0/2584945777 learned_addr learned my addr 172.21.15.138:0/2584945777 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.533+0000 7feeb5805640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0101160 0x7feeb01957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb6006640 1 -- 172.21.15.138:0/2584945777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0101160 msgr2=0x7feeb01957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb6006640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0101160 0x7feeb01957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb6006640 1 -- 172.21.15.138:0/2584945777 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009560 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb6006640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ea00 tx=0x7feeac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeac00cd50 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feeac005020 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0199ee0 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeac0116a0 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.534+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb019a410 con 0x7feeb0100850 2024-02-15T23:04:01.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.535+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb004e000 con 0x7feeb0100850 2024-02-15T23:04:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.535+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 39) v1 ==== 91495+0+0 (secure 0 0 0) 0x7feeac005190 con 0x7feeb0100850 2024-02-15T23:04:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.536+0000 7feea77fe640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 0x7fee9c06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-15T23:04:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.536+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7feeac08d830 con 0x7feeb0100850 2024-02-15T23:04:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.536+0000 7feeb5805640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 0x7fee9c06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-15T23:04:01.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.536+0000 7feeb5805640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 0x7fee9c06fd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feea0000c00 tx=0x7feea0005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T23:04:01.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.540+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feeac057090 con 0x7feeb0100850 2024-02-15T23:04:01.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.727+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feeb0106cc0 con 0x7feeb0100850 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.727+0000 7feea77fe640 1 -- 172.21.15.138:0/2584945777 <== mon.0 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2462 (secure 0 0 0) 0x7feeac01f9b0 con 0x7feeb0100850 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6824/4027411393 2024-02-16T23:00:29.288136+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6829/1693530689 2024-02-16T23:00:29.288122+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6828/1693530689 2024-02-16T23:00:29.288122+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/299484414 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/4125885020 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1857695595 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1233270825 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.730 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2933677068 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/488430197 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1651462660 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/2928099655 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6829/2668591850 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/299484414 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/3892577367 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/3094578310 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6825/4027411393 2024-02-16T23:00:29.288136+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/164905863 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1814961516 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/2746308389 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/499746587 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2366055009 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.731 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6826/2782905632 2024-02-16T22:48:40.730490+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6827/2782905632 2024-02-16T22:48:40.730490+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4049377511 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/464877437 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/990488714 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4266627949 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/2998046640 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/4136599694 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/3349313431 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:0/2930297512 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/2998046640 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/3454666203 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6801/3454666203 2024-02-16T22:43:33.959120+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/711267160 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:01.732 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/499746587 2024-02-16T22:50:39.150712+0000 2024-02-15T23:04:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/1457010425 2024-02-16T22:41:50.174847+0000 2024-02-15T23:04:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:6800/2928099655 2024-02-16T22:42:22.744776+0000 2024-02-15T23:04:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.170:6828/2668591850 2024-02-16T22:51:35.224167+0000 2024-02-15T23:04:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/698053139 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138:0/998034485 2024-02-16T22:56:00.176825+0000 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:listed 41 entries 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 msgr2=0x7fee9c06fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 0x7fee9c06fd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feea0000c00 tx=0x7feea0005fd0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 msgr2=0x7feeb0195260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ea00 tx=0x7feeac00eec0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 shutdown_connections 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:6800/274765672,v1:172.21.15.138:6801/274765672] conn(0x7fee9c06d8d0 0x7fee9c06fd80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb0101160 0x7feeb01957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 --2- 172.21.15.138:0/2584945777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feeb0100850 0x7feeb0195260 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 >> 172.21.15.138:0/2584945777 conn(0x7feeb0075270 msgr2=0x7feeb0103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 shutdown_connections 2024-02-15T23:04:01.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-02-15T23:04:01.729+0000 7feeb826a640 1 -- 172.21.15.138:0/2584945777 wait complete. 2024-02-15T23:04:01.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:01 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2572061491' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:04:01.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:01 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2605823431' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:01 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/4150141507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.735 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:01 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/423538374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.743 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-15T23:04:01.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:01.743 DEBUG:teuthology.orchestra.run.smithi170:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-15T23:04:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:01 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2572061491' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T23:04:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:01 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2605823431' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:01 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/4150141507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:01 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/423538374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T23:04:01.780 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-02-15T23:04:01.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:01.780 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-15T23:04:01.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:01.852 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2024-02-15T23:04:01.867 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-15T23:04:01.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:01.868 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T23:04:01.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:01.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2024-02-15T23:04:02.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:02.036 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-02-15T23:04:02.055 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-15T23:04:02.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:02.055 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T23:04:02.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T23:04:02.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-02-15T23:04:02.233 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-15T23:04:02.245 INFO:tasks.cephadm:Teardown begin 2024-02-15T23:04:02.245 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T23:04:02.274 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T23:04:02.302 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-15T23:04:02.302 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T23:04:02.332 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T23:04:02.357 INFO:tasks.cephadm:Stopping all daemons... 2024-02-15T23:04:02.357 INFO:tasks.cephadm.mon.smithi138:Stopping mon.smithi138... 2024-02-15T23:04:02.358 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138 2024-02-15T23:04:02.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 systemd[1]: Stopping Ceph mon.smithi138 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:02.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 ceph-mon[89527]: from='client.? 172.21.15.138:0/2584945777' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T23:04:02.658 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 ceph-mon[89527]: pgmap v280: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T23:04:02.761 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:02 smithi170 ceph-mon[67652]: from='client.? 172.21.15.138:0/2584945777' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-15T23:04:02.762 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:02 smithi170 ceph-mon[67652]: pgmap v280: 65 pgs: 65 active+clean; 307 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 5 op/s 2024-02-15T23:04:02.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[89523]: 2024-02-15T23:04:02.655+0000 7fcf6e562700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi138 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:02.984 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138[89523]: 2024-02-15T23:04:02.655+0000 7fcf6e562700 -1 mon.smithi138@0(leader) e3 *** Got Signal Terminated *** 2024-02-15T23:04:02.985 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:02 smithi138 podman[135194]: 2024-02-15 23:04:02.880444027 +0000 UTC m=+0.323465598 container died 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-15T23:04:03.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:03 smithi138 podman[135194]: 2024-02-15 23:04:03.255826808 +0000 UTC m=+0.698848375 container cleanup 2e5a452862d0062fb5eb6b5251a64a8e4650b8eefb1dcad6aef471b1d317d1e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-15T23:04:03.459 INFO:journalctl@ceph.mon.smithi138.smithi138.stdout:Feb 15 23:04:03 smithi138 bash[135194]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi138 2024-02-15T23:04:03.680 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi138.service' 2024-02-15T23:04:03.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:03.733 INFO:tasks.cephadm.mon.smithi138:Stopped mon.smithi138 2024-02-15T23:04:03.733 INFO:tasks.cephadm.mon.smithi170:Stopping mon.smithi170... 2024-02-15T23:04:03.733 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi170 2024-02-15T23:04:04.134 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:03 smithi170 systemd[1]: Stopping Ceph mon.smithi170 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:04.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:04 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170[67648]: 2024-02-15T23:04:04.131+0000 7f77db618700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi170 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:04.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:04 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170[67648]: 2024-02-15T23:04:04.131+0000 7f77db618700 -1 mon.smithi170@1(peon) e3 *** Got Signal Terminated *** 2024-02-15T23:04:04.512 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:04 smithi170 podman[103551]: 2024-02-15 23:04:04.243991243 +0000 UTC m=+0.319665974 container died c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-15T23:04:04.960 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:04 smithi170 podman[103551]: 2024-02-15 23:04:04.740683142 +0000 UTC m=+0.816357881 container cleanup c35b7acf0352eadc105b862a35a1ddd33efc6d72f1c88c4934880c1f2e78ffe0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:04.961 INFO:journalctl@ceph.mon.smithi170.smithi170.stdout:Feb 15 23:04:04 smithi170 bash[103551]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-mon-smithi170 2024-02-15T23:04:05.060 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@mon.smithi170.service' 2024-02-15T23:04:05.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:05.110 INFO:tasks.cephadm.mon.smithi170:Stopped mon.smithi170 2024-02-15T23:04:05.110 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-15T23:04:05.110 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.0 2024-02-15T23:04:05.437 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:05 smithi138 systemd[1]: Stopping Ceph osd.0 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:05.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:05 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T23:04:05.434+0000 7f466f757700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:05.735 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:05 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T23:04:05.434+0000 7f466f757700 -1 osd.0 85 *** Got signal Terminated *** 2024-02-15T23:04:05.735 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:05 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0[101544]: 2024-02-15T23:04:05.434+0000 7f466f757700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:11.234 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:10 smithi138 podman[135325]: 2024-02-15 23:04:10.954971692 +0000 UTC m=+5.648548605 container died a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-02-15T23:04:11.614 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:11 smithi138 podman[135325]: 2024-02-15 23:04:11.34433267 +0000 UTC m=+6.037909582 container cleanup a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-15T23:04:11.614 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:11 smithi138 bash[135325]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0 2024-02-15T23:04:11.963 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:11 smithi138 podman[135344]: 2024-02-15 23:04:11.612859809 +0000 UTC m=+0.660396785 container remove a4d4d7764e90169df7b74ed70dfe0e2d836c260fb82891afa8f86cda299687c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-15T23:04:12.234 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:11 smithi138 podman[135437]: 2024-02-15 23:04:11.864948375 +0000 UTC m=+0.019214942 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:12.235 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:11 smithi138 podman[135437]: 2024-02-15 23:04:11.972140121 +0000 UTC m=+0.126406681 container create 868ea6de16cd9b2ecb1a5b40f2123eaae087279beb69c72ae9f2f132373ef520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-02-15T23:04:12.235 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:12 smithi138 podman[135437]: 2024-02-15 23:04:12.158273977 +0000 UTC m=+0.312540538 container init 868ea6de16cd9b2ecb1a5b40f2123eaae087279beb69c72ae9f2f132373ef520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:04:12.235 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:12 smithi138 podman[135437]: 2024-02-15 23:04:12.161393912 +0000 UTC m=+0.315660478 container start 868ea6de16cd9b2ecb1a5b40f2123eaae087279beb69c72ae9f2f132373ef520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:04:12.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:12 smithi138 podman[135437]: 2024-02-15 23:04:12.267131043 +0000 UTC m=+0.421397613 container attach 868ea6de16cd9b2ecb1a5b40f2123eaae087279beb69c72ae9f2f132373ef520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True) 2024-02-15T23:04:12.734 INFO:journalctl@ceph.osd.0.smithi138.stdout:Feb 15 23:04:12 smithi138 podman[135437]: 2024-02-15 23:04:12.448273789 +0000 UTC m=+0.602540341 container died 868ea6de16cd9b2ecb1a5b40f2123eaae087279beb69c72ae9f2f132373ef520 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:13.151 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.0.service' 2024-02-15T23:04:13.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:13.197 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-15T23:04:13.197 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-15T23:04:13.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.1 2024-02-15T23:04:13.440 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:13 smithi138 systemd[1]: Stopping Ceph osd.1 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:13.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:13 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T23:04:13.532+0000 7f2050329700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:13.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:13 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T23:04:13.532+0000 7f2050329700 -1 osd.1 85 *** Got signal Terminated *** 2024-02-15T23:04:13.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:13 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1[107253]: 2024-02-15T23:04:13.532+0000 7f2050329700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:19.153 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:18 smithi138 podman[135542]: 2024-02-15 23:04:18.894243131 +0000 UTC m=+5.492355404 container died 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, ceph=True) 2024-02-15T23:04:19.478 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:19 smithi138 podman[135542]: 2024-02-15 23:04:19.241328866 +0000 UTC m=+5.839441148 container cleanup 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-15T23:04:19.478 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:19 smithi138 bash[135542]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1 2024-02-15T23:04:19.734 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:19 smithi138 podman[135572]: 2024-02-15 23:04:19.476350077 +0000 UTC m=+0.575648535 container remove 5a736bd344dd5eb5a602c0a7e988e40596d2d2d1533fa532026563cf0dd4af14 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:04:20.165 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:19 smithi138 podman[135662]: 2024-02-15 23:04:19.809488325 +0000 UTC m=+0.017810522 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:20.165 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:19 smithi138 podman[135662]: 2024-02-15 23:04:19.919341313 +0000 UTC m=+0.127663547 container create ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-15T23:04:20.166 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:20 smithi138 podman[135662]: 2024-02-15 23:04:20.105578167 +0000 UTC m=+0.313900361 container init ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214) 2024-02-15T23:04:20.166 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:20 smithi138 podman[135662]: 2024-02-15 23:04:20.109002628 +0000 UTC m=+0.317324826 container start ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-15T23:04:20.166 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:20 smithi138 podman[135662]: 2024-02-15 23:04:20.163450228 +0000 UTC m=+0.371772425 container attach ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:20.485 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:20 smithi138 podman[135662]: 2024-02-15 23:04:20.408474696 +0000 UTC m=+0.616796887 container died ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:04:20.965 INFO:journalctl@ceph.osd.1.smithi138.stdout:Feb 15 23:04:20 smithi138 podman[135688]: 2024-02-15 23:04:20.950534826 +0000 UTC m=+0.536917815 container remove ca6eb53d5f26449d1ae08eab2cedd4c4ec5b0ed4d3a231f68eeecf798a2f0845 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-15T23:04:20.970 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.1.service' 2024-02-15T23:04:21.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:21.013 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-15T23:04:21.013 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-15T23:04:21.014 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.2 2024-02-15T23:04:21.234 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:21 smithi138 systemd[1]: Stopping Ceph osd.2 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:21.734 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T23:04:21.336+0000 7f74cc9e7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:21.734 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T23:04:21.336+0000 7f74cc9e7700 -1 osd.2 85 *** Got signal Terminated *** 2024-02-15T23:04:21.734 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:21 smithi138 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2[112856]: 2024-02-15T23:04:21.336+0000 7f74cc9e7700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:26.965 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:26 smithi138 podman[135766]: 2024-02-15 23:04:26.696032324 +0000 UTC m=+5.466486053 container died 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-15T23:04:27.234 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135766]: 2024-02-15 23:04:27.062420137 +0000 UTC m=+5.832873872 container cleanup 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:27.235 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 bash[135766]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2 2024-02-15T23:04:27.689 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135784]: 2024-02-15 23:04:27.338536957 +0000 UTC m=+0.641879232 container remove 492877c7029ce88ee13ec9b89474c27e8b94ea1fba1039127582810cadffc124 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True) 2024-02-15T23:04:27.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135881]: 2024-02-15 23:04:27.590280584 +0000 UTC m=+0.018633296 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:27.984 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135881]: 2024-02-15 23:04:27.697765307 +0000 UTC m=+0.126118059 container create b647c734fd87e11a3a167ccaff44d62dbd73d67e0bc7e5a1a17527996cea68eb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:27.985 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135881]: 2024-02-15 23:04:27.900571151 +0000 UTC m=+0.328923871 container init b647c734fd87e11a3a167ccaff44d62dbd73d67e0bc7e5a1a17527996cea68eb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:04:27.985 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:27 smithi138 podman[135881]: 2024-02-15 23:04:27.904155193 +0000 UTC m=+0.332507901 container start b647c734fd87e11a3a167ccaff44d62dbd73d67e0bc7e5a1a17527996cea68eb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-15T23:04:28.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:28 smithi138 podman[135881]: 2024-02-15 23:04:28.000225712 +0000 UTC m=+0.428578433 container attach b647c734fd87e11a3a167ccaff44d62dbd73d67e0bc7e5a1a17527996cea68eb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:28.484 INFO:journalctl@ceph.osd.2.smithi138.stdout:Feb 15 23:04:28 smithi138 podman[135881]: 2024-02-15 23:04:28.196375638 +0000 UTC m=+0.624728348 container died b647c734fd87e11a3a167ccaff44d62dbd73d67e0bc7e5a1a17527996cea68eb (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240214, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-15T23:04:28.845 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.2.service' 2024-02-15T23:04:28.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:28.889 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-15T23:04:28.889 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-15T23:04:28.889 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.3 2024-02-15T23:04:29.196 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:28 smithi170 systemd[1]: Stopping Ceph osd.3 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:29.512 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:29 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T23:04:29.193+0000 7f3584a90700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:29.512 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:29 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T23:04:29.193+0000 7f3584a90700 -1 osd.3 85 *** Got signal Terminated *** 2024-02-15T23:04:29.512 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:29 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3[77121]: 2024-02-15T23:04:29.193+0000 7f3584a90700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:34.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:33 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:33.904+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:34.940 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:34 smithi170 podman[103672]: 2024-02-15 23:04:34.660465578 +0000 UTC m=+5.582945514 container died ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-15T23:04:34.940 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:34 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:34.865+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:35.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:34 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:34.937+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:35.262 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103672]: 2024-02-15 23:04:35.110673184 +0000 UTC m=+6.033153162 container cleanup ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:35.262 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 bash[103672]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3 2024-02-15T23:04:35.723 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103690]: 2024-02-15 23:04:35.395526554 +0000 UTC m=+0.735776392 container remove ac1f4577ac73310616951367bc2a51b4c5ac7c042af92eedd83124ac9e1e8b05 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-15T23:04:36.011 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:35 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:35.902+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:36.012 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:35 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:35.944+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:36.012 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103777]: 2024-02-15 23:04:35.721393628 +0000 UTC m=+0.107765551 container create a96e1a52dd2eeb0a5dbd659e90f2603cd5d4c1012263fbcc2aab622942f025e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:04:36.012 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103777]: 2024-02-15 23:04:35.632341292 +0000 UTC m=+0.018713215 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:36.012 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103777]: 2024-02-15 23:04:35.932551843 +0000 UTC m=+0.318923768 container init a96e1a52dd2eeb0a5dbd659e90f2603cd5d4c1012263fbcc2aab622942f025e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-15T23:04:36.012 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:35 smithi170 podman[103777]: 2024-02-15 23:04:35.935577903 +0000 UTC m=+0.321949835 container start a96e1a52dd2eeb0a5dbd659e90f2603cd5d4c1012263fbcc2aab622942f025e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-15T23:04:36.289 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:36 smithi170 podman[103777]: 2024-02-15 23:04:36.032666536 +0000 UTC m=+0.419038461 container attach a96e1a52dd2eeb0a5dbd659e90f2603cd5d4c1012263fbcc2aab622942f025e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS) 2024-02-15T23:04:36.289 INFO:journalctl@ceph.osd.3.smithi170.stdout:Feb 15 23:04:36 smithi170 podman[103777]: 2024-02-15 23:04:36.246717493 +0000 UTC m=+0.633089419 container died a96e1a52dd2eeb0a5dbd659e90f2603cd5d4c1012263fbcc2aab622942f025e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-02-15T23:04:36.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.3.service' 2024-02-15T23:04:36.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:36.891 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-15T23:04:36.892 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-15T23:04:36.892 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.4 2024-02-15T23:04:37.226 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:36 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:36.899+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:37.226 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:36 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:36.902+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:37.226 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:36 smithi170 systemd[1]: Stopping Ceph osd.4 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:37.511 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:37 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:37.222+0000 7fb618b2d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:37.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:37 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:37.222+0000 7fb618b2d700 -1 osd.4 85 *** Got signal Terminated *** 2024-02-15T23:04:37.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:37 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:37.222+0000 7fb618b2d700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:38.261 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:37 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:37.936+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:38.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:37 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:37.927+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:39.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:38 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:38.983+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:39.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:38 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:38.882+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:40.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:39 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:39.966+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:40.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:39 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:39.897+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:41.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:40 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:40.882+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:41.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:40 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:40.998+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:41.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:40 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:40.998+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:18.074502+0000 front 2024-02-15T23:04:18.074488+0000 (oldest deadline 2024-02-15T23:04:40.374369+0000) 2024-02-15T23:04:42.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:42 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:42.008+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:09.973214+0000 front 2024-02-15T23:04:09.973259+0000 (oldest deadline 2024-02-15T23:04:32.873321+0000) 2024-02-15T23:04:42.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:42 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4[82037]: 2024-02-15T23:04:42.008+0000 7fb61191a700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:18.074502+0000 front 2024-02-15T23:04:18.074488+0000 (oldest deadline 2024-02-15T23:04:40.374369+0000) 2024-02-15T23:04:42.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:41 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:41.835+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:42.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:41 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:41.835+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:42.993 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:42 smithi170 podman[103895]: 2024-02-15 23:04:42.726580207 +0000 UTC m=+5.606373092 container died 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5) 2024-02-15T23:04:42.993 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:42 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:42.827+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:42.994 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:42 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:42.827+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:43.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[103895]: 2024-02-15 23:04:43.157370055 +0000 UTC m=+6.037162922 container cleanup 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-15T23:04:43.262 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 bash[103895]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4 2024-02-15T23:04:43.762 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[103913]: 2024-02-15 23:04:43.375595836 +0000 UTC m=+0.642537219 container remove 71df0ff22ac81fc5d64a67b4fd76cc1718e9fcb0cb4eb3538a94066d5c38cf67 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-15T23:04:44.056 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[104005]: 2024-02-15 23:04:43.768012397 +0000 UTC m=+0.108473687 container create 505883f09712d4adc5c74dae9145b33e8c34c3e8390ca138ba5264aef767047e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:44.056 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[104005]: 2024-02-15 23:04:43.678208124 +0000 UTC m=+0.018669414 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:44.056 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[104005]: 2024-02-15 23:04:43.97963514 +0000 UTC m=+0.320096437 container init 505883f09712d4adc5c74dae9145b33e8c34c3e8390ca138ba5264aef767047e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:44.056 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:43 smithi170 podman[104005]: 2024-02-15 23:04:43.983151577 +0000 UTC m=+0.323612875 container start 505883f09712d4adc5c74dae9145b33e8c34c3e8390ca138ba5264aef767047e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:04:44.056 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:44 smithi170 podman[104005]: 2024-02-15 23:04:44.053990967 +0000 UTC m=+0.394452264 container attach 505883f09712d4adc5c74dae9145b33e8c34c3e8390ca138ba5264aef767047e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:44.057 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:43 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:43.794+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:44.057 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:43 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:43.794+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:44.512 INFO:journalctl@ceph.osd.4.smithi170.stdout:Feb 15 23:04:44 smithi170 podman[104005]: 2024-02-15 23:04:44.268641866 +0000 UTC m=+0.609103155 container died 505883f09712d4adc5c74dae9145b33e8c34c3e8390ca138ba5264aef767047e (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:44.885 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:44 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:44.751+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:44.885 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:44 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:44.751+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:44.915 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.4.service' 2024-02-15T23:04:44.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:44.958 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-15T23:04:44.959 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-15T23:04:44.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.5 2024-02-15T23:04:45.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 systemd[1]: Stopping Ceph osd.5 for 3fa87466-cc53-11ee-95ba-87774f69a715... 2024-02-15T23:04:45.762 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:45.286+0000 7f3fcac21700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-15T23:04:45.762 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:45.286+0000 7f3fcac21700 -1 osd.5 85 *** Got signal Terminated *** 2024-02-15T23:04:45.762 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:45.286+0000 7f3fcac21700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T23:04:46.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:45.766+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:46.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:45 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:45.766+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:47.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:46.788+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:47.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:46 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:46.788+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:48.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:47 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:47.832+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:48.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:47 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:47.832+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:49.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:48 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:48.824+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:49.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:48 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:48.824+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:49.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:48 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:48.824+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6822 osd.2 since back 2024-02-15T23:04:23.206178+0000 front 2024-02-15T23:04:23.206138+0000 (oldest deadline 2024-02-15T23:04:47.906153+0000) 2024-02-15T23:04:50.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:49 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:49.819+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6806 osd.0 since back 2024-02-15T23:04:08.703974+0000 front 2024-02-15T23:04:08.703927+0000 (oldest deadline 2024-02-15T23:04:34.003914+0000) 2024-02-15T23:04:50.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:49 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:49.819+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6814 osd.1 since back 2024-02-15T23:04:17.405229+0000 front 2024-02-15T23:04:17.405249+0000 (oldest deadline 2024-02-15T23:04:41.505271+0000) 2024-02-15T23:04:50.262 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:49 smithi170 ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5[86962]: 2024-02-15T23:04:49.819+0000 7f3fc3a0e700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.138:6822 osd.2 since back 2024-02-15T23:04:23.206178+0000 front 2024-02-15T23:04:23.206138+0000 (oldest deadline 2024-02-15T23:04:47.906153+0000) 2024-02-15T23:04:51.053 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:50 smithi170 podman[104111]: 2024-02-15 23:04:50.76765988 +0000 UTC m=+5.591523936 container died 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-15T23:04:51.490 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:51 smithi170 podman[104111]: 2024-02-15 23:04:51.219924772 +0000 UTC m=+6.043788836 container cleanup 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:04:51.490 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:51 smithi170 bash[104111]: ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5 2024-02-15T23:04:51.762 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:51 smithi170 podman[104131]: 2024-02-15 23:04:51.488277495 +0000 UTC m=+0.719970637 container remove 142b7035a2a93e6616ce84d0b6cd8f8e1b59bb79e71f920d82b49f46ca6db8db (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-15T23:04:52.127 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:51 smithi170 podman[104222]: 2024-02-15 23:04:51.738203177 +0000 UTC m=+0.017486562 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-15T23:04:52.127 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:51 smithi170 podman[104222]: 2024-02-15 23:04:51.855924432 +0000 UTC m=+0.135207808 container create 2232eac96ad24de35308c77af20d46b00f036bca5a05f803a356b17f591a31f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-15T23:04:52.127 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:52 smithi170 podman[104222]: 2024-02-15 23:04:52.050114629 +0000 UTC m=+0.329398005 container init 2232eac96ad24de35308c77af20d46b00f036bca5a05f803a356b17f591a31f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-15T23:04:52.127 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:52 smithi170 podman[104222]: 2024-02-15 23:04:52.053205327 +0000 UTC m=+0.332488706 container start 2232eac96ad24de35308c77af20d46b00f036bca5a05f803a356b17f591a31f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True) 2024-02-15T23:04:52.127 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:52 smithi170 podman[104222]: 2024-02-15 23:04:52.125050411 +0000 UTC m=+0.404333804 container attach 2232eac96ad24de35308c77af20d46b00f036bca5a05f803a356b17f591a31f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-15T23:04:52.512 INFO:journalctl@ceph.osd.5.smithi170.stdout:Feb 15 23:04:52 smithi170 podman[104222]: 2024-02-15 23:04:52.34436044 +0000 UTC m=+0.623643809 container died 2232eac96ad24de35308c77af20d46b00f036bca5a05f803a356b17f591a31f8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-3fa87466-cc53-11ee-95ba-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5) 2024-02-15T23:04:53.010 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3fa87466-cc53-11ee-95ba-87774f69a715@osd.5.service' 2024-02-15T23:04:53.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T23:04:53.051 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-15T23:04:53.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T23:04:53.211 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T23:05:17.009 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T23:05:17.157 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T23:05:32.113 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T23:05:32.148 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T23:05:32.177 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-15T23:05:32.179 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi138/crash 2024-02-15T23:05:32.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash -- . 2024-02-15T23:05:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T23:05:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now 2024-02-15T23:05:32.224 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi170/crash 2024-02-15T23:05:32.225 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash -- . 2024-02-15T23:05:32.250 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T23:05:32.250 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2024-02-15T23:05:32.251 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-15T23:05:32.252 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T23:05:32.294 INFO:teuthology.orchestra.run.smithi138.stdout:2024-02-15T23:00:00.000167+0000 mon.smithi138 (mon.0) 472 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:05:32.294 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-15T23:05:32.294 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[SEC\]' /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T23:05:32.367 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]' /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T23:05:32.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[WRN\]' /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T23:05:32.511 INFO:teuthology.orchestra.run.smithi138.stdout:2024-02-15T23:00:00.000167+0000 mon.smithi138 (mon.0) 472 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded 2024-02-15T23:05:32.512 INFO:tasks.cephadm:Compressing logs... 2024-02-15T23:05:32.512 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T23:05:32.554 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/cephadm.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.fzypgq.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.fzypgq.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi138.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi138.jqscxs.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi138.log: /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi138.log 2024-02-15T23:05:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi138.jqscxs.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-15T23:05:32.582 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T23:05:32.582 INFO:teuthology.orchestra.run.smithi170.stderr:: No such file or directory 2024-02-15T23:05:32.582 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi170.gczrzt.log 2024-02-15T23:05:32.582 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.banvev.log 2024-02-15T23:05:32.582 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi170.gczrzt.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.banvev.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log: /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.cbefkf.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.cbefkf.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi170.log 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T23:05:32.585 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.3.log: 91.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi138.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.0.log: 94.1% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi138.log.gz 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log: 85.8% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log: 91.4% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T23:05:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T23:05:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.bnqzne.log 2024-02-15T23:05:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T23:05:32.601 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T23:05:32.601 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi170.log: gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log 2024-02-15T23:05:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log: 85.8% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T23:05:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T23:05:32.603 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.bnqzne.log: 91.7% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T23:05:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log: 94.0% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-client.ceph-exporter.smithi170.log.gz 2024-02-15T23:05:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi170.log 2024-02-15T23:05:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log: 88.3% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T23:05:32.619 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi170.log: 91.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T23:05:32.628 INFO:teuthology.orchestra.run.smithi170.stderr: 88.9% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi170.gczrzt.log.gz 2024-02-15T23:05:32.889 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi170.log.gz 2024-02-15T23:05:32.959 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mgr.smithi138.jqscxs.log.gz 2024-02-15T23:05:33.659 INFO:teuthology.orchestra.run.smithi138.stderr: 90.7% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mon.smithi138.log.gz 2024-02-15T23:05:36.435 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-15T23:05:38.417 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-15T23:05:38.538 INFO:teuthology.orchestra.run.smithi170.stderr: 93.4% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-15T23:05:38.607 INFO:teuthology.orchestra.run.smithi170.stderr: 93.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-15T23:05:39.046 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-15T23:05:39.920 INFO:teuthology.orchestra.run.smithi170.stderr: 95.1% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.cbefkf.log.gz 2024-02-15T23:05:40.050 INFO:teuthology.orchestra.run.smithi170.stderr: 93.5% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-15T23:05:41.785 INFO:teuthology.orchestra.run.smithi138.stderr: 95.1% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.bnqzne.log.gz 2024-02-15T23:06:15.666 INFO:teuthology.orchestra.run.smithi170.stderr: 93.4% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi170.banvev.log.gz 2024-02-15T23:06:15.668 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-02-15T23:06:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m43.100s 2024-02-15T23:06:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:user 1m7.872s 2024-02-15T23:06:15.668 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m2.260s 2024-02-15T23:06:26.519 INFO:teuthology.orchestra.run.smithi138.stderr: 93.1% -- replaced with /var/log/ceph/3fa87466-cc53-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi138.fzypgq.log.gz 2024-02-15T23:06:26.520 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-02-15T23:06:26.520 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m53.955s 2024-02-15T23:06:26.520 INFO:teuthology.orchestra.run.smithi138.stderr:user 1m18.258s 2024-02-15T23:06:26.521 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m2.411s 2024-02-15T23:06:26.521 INFO:tasks.cephadm:Archiving logs... 2024-02-15T23:06:26.522 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi138/log 2024-02-15T23:06:26.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T23:06:38.405 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi170/log 2024-02-15T23:06:38.407 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T23:06:48.326 INFO:tasks.cephadm:Removing cluster... 2024-02-15T23:06:48.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 --force 2024-02-15T23:06:48.483 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T23:06:48.850 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3fa87466-cc53-11ee-95ba-87774f69a715 --force 2024-02-15T23:06:48.998 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 3fa87466-cc53-11ee-95ba-87774f69a715 2024-02-15T23:06:49.360 INFO:tasks.cephadm:Removing cephadm ... 2024-02-15T23:06:49.361 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T23:06:49.377 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T23:06:49.392 INFO:tasks.cephadm:Teardown complete 2024-02-15T23:06:49.392 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T23:06:49.404 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T23:06:49.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T23:06:49.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T23:06:49.509 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T23:06:49.520 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T23:06:49.520 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:06:49.523 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T23:06:49.534 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-02-15T23:06:49.538 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-02-15T23:06:49.538 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T23:06:49.538 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-02-15T23:06:49.538 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +664us[ +621us] +/- 89ms 2024-02-15T23:06:49.539 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -1562us[-1606us] +/- 63ms 2024-02-15T23:06:49.539 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +1913us[+1869us] +/- 110ms 2024-02-15T23:06:49.539 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +654us[ +668us] +/- 89ms 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -1559us[-1544us] +/- 63ms 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +1911us[+1926us] +/- 110ms 2024-02-15T23:06:49.541 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T23:06:49.542 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T23:06:49.554 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T23:06:49.555 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T23:06:49.569 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T23:06:49.666 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T23:06:49.744 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T23:06:49.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:06:49.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T23:06:49.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:06:49.806 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T23:06:49.826 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T23:06:49.842 INFO:teuthology.task.internal:Duration was 2032.293494 seconds 2024-02-15T23:06:49.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T23:06:49.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T23:06:49.855 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T23:06:49.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T23:06:49.898 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T23:06:49.900 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T23:06:50.270 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T23:06:50.271 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-02-15T23:06:50.271 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T23:06:50.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-02-15T23:06:50.331 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T23:06:50.353 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T23:06:50.353 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T23:06:50.373 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T23:06:50.423 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T23:06:50.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T23:06:50.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T23:06:51.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T23:06:51.093 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T23:06:51.093 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T23:06:51.120 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T23:06:51.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T23:06:51.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:06:51.173 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:06:51.196 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-02-15T23:06:51.215 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-02-15T23:06:51.231 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:06:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:06:51.266 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T23:06:51.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T23:06:51.284 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T23:06:51.297 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T23:06:51.298 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi138 2024-02-15T23:06:51.298 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T23:06:51.373 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777/remote/smithi170 2024-02-15T23:06:51.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T23:06:51.416 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T23:06:51.416 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T23:06:51.419 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T23:06:51.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T23:06:51.477 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T23:06:51.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T23:06:51.489 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T23:06:51.489 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T23:06:51.491 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T23:06:51.503 INFO:teuthology.orchestra.run.smithi138.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 23:06 /home/ubuntu/cephtest 2024-02-15T23:06:51.518 INFO:teuthology.orchestra.run.smithi170.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 23:06 /home/ubuntu/cephtest 2024-02-15T23:06:51.519 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T23:06:51.531 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T23:06:51.558 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T23:06:51.584 DEBUG:teuthology.nuke:shortname: smithi138 2024-02-15T23:06:51.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:06:51.609 DEBUG:teuthology.nuke:shortname: smithi170 2024-02-15T23:06:51.610 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T23:06:51.615 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:24:39.661599', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxxDCi4HZrYb15GRe3e63dDZ4to8z+UGJnZJy3byZXrzflI2i2rL8mYvgqZrl3sDK2a3uxya1kuszD2zcyaotU='} 2024-02-15T23:06:51.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-15_21:23:20-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7561777', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 22:24:39.660504', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRh5/JwRbNo6zz1Cdo3ZkAWDgvFlhPlRzs7qwWhkwxtrh4A9dmdVdtIoyTODS0w2YZ+SHoakFgbYXdXwG2Nca4='} 2024-02-15T23:06:51.666 INFO:teuthology.orchestra.console.smithi138:Power off 2024-02-15T23:06:51.667 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T23:06:51.692 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-02-15T23:06:51.692 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:51.707 INFO:teuthology.orchestra.console.smithi170:Power off 2024-02-15T23:06:51.707 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T23:06:51.718 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-15T23:06:51.730 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-02-15T23:06:51.730 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:51.752 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-02-15T23:06:55.719 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:55.753 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:55.828 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-02-15T23:06:55.861 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-02-15T23:06:59.834 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:59.863 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T23:06:59.944 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-02-15T23:06:59.972 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-02-15T23:07:00.046 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-02-15T23:07:00.073 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-02-15T23:07:00.178 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2032.2934942245483 failure_reason: '"2024-02-15T23:00:00.000167+0000 mon.smithi138 (mon.0) 472 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-02-15T23:07:00.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T23:07:00.258 INFO:teuthology.run:FAIL